Research & Development World

  • R&D World Home
  • Topics
    • Aerospace
    • Automotive
    • Biotech
    • Careers
    • Chemistry
    • Environment
    • Energy
    • Life Science
    • Material Science
    • R&D Management
    • Physics
  • Technology
    • 3D Printing
    • A.I./Robotics
    • Software
    • Battery Technology
    • Controlled Environments
      • Cleanrooms
      • Graphene
      • Lasers
      • Regulations/Standards
      • Sensors
    • Imaging
    • Nanotechnology
    • Scientific Computing
      • Big Data
      • HPC/Supercomputing
      • Informatics
      • Security
    • Semiconductors
  • R&D Market Pulse
  • R&D 100
    • Call for Nominations: The 2025 R&D 100 Awards
    • R&D 100 Awards Event
    • R&D 100 Submissions
    • Winner Archive
    • Explore the 2024 R&D 100 award winners and finalists
  • Resources
    • Research Reports
    • Digital Issues
    • R&D Index
    • Subscribe
    • Video
    • Webinars
  • Global Funding Forecast
  • Top Labs
  • Advertise
  • SUBSCRIBE

Crowdsourcing: Game Apps Bring Big Data to Psychological Research

By R&D Editors | December 22, 2014

Sample images from Airport Scanner: the left image contains one target (hand grenade), the middle contains two identical targets (two exemplars of the dynamite stick target type), and the right image contains two different target types (derringer, gasoline can). Airport Scanner images appear with permission from Kedlin. Copyright 2014 by the Kedlin Company.WASHINGTON — A fast-paced game app where players pretend they are baggage screening officers operating airport x-ray scanners has provided researchers with billions of pieces of data in record time, according to an article published by the American Psychological Association (APA).

“Mobile devices offer researchers an exciting new means to crowdsource an experiment using games that are actually tests of cognition or other brain functions,” said Stephen R. Mitroff, PhD, of Duke University, lead author of the report, published in APA’s Journal of Experimental Psychology: Human Perception and Performance. “Questions that could have taken decades to answer in a laboratory setting, or that could not be realistically answered in a lab, can be examined using big data gathered in a relatively short time.”

To demonstrate the potential of mobile technology to gather data, the researchers partnered with Kedlin, the developer of the popular mobile app game Airport Scanner, which challenges players to identify illegal items in luggage passing through an airport x-ray scanner. Players view one bag at a time and tap their touchscreen to identify banned items. The game includes a logbook of illegal items (e.g., guns, hand grenades, switchblades) and legal items (e.g., ear phones, clothing), and the list expands from a handful of possible target items to hundreds as players progress through the game.

Between January 2013 and November 2014, the game provided anonymous data from more than 2 billion trials from over 7 million mobile devices that Mitroff and his research team at the Duke Center for Cognitive Neuroscience have been analyzing, the report said. Players consent to the data collection when installing the game on their smartphone or other hand-held device.

One research question explored through the Airport Scanner game was examining players’ ability to spot items that occurred on screen very rarely, or in less than 0.1 percent of all bags.

“When a target appears only 0.1 percent of the time, you need 1,000 trials to get just a single case of that target. Too many trials would be needed to realistically assess detection of that particular target in a laboratory setting,” Mitroff said. “With the large dataset, we were able to look at hundreds of cases for each of the nearly 30 rarest targets.”

Another experiment found that when two banned items both appeared in a bag, players were more likely to miss the second to-be-found item when the two were different than if they were identical. For example, players were more likely to miss a dynamite stick after finding a gasoline can than they were to miss a dynamite stick after first finding a dynamite stick.

 “While using a game interface to assess cognitive abilities is not new to psychological research, mobile technology offers a phenomenal opportunity to examine cognitive processes on a large scale,” Mitroff said. “In 1998, 1 million trials were analyzed by Jeremy M. Wolfe, PhD, of Harvard Medical School, to understand visual search. This was a mind-blowing amount of data that took 10 years to collect. Today, we can collect over a million trials a day through Airport Scanner.” 

Other advantages of crowdsourcing include that it can be a less-expensive means of collecting data automatically and continuously and that it has the ability to mimic real-world situations that are difficult to address in a laboratory, according to the report.

Crowdsourcing research data does have disadvantages, the authors noted. Researchers must have the skills to create a fun game app or they need to partner with a developer. Collecting large amounts of data may not necessarily result in high-quality data, which requires carefully developing research questions to be addressed through the game. And collecting data through crowdsourcing means researchers have no control over who is playing, they said.

Citation: “What Can 1 Billion Trials Tell Us About Visual Search?” Stephen R. Mitroff, PhD, Adam T. Biggs, PhD, Stephen H. Adamo, BS, Emma Wu Dowd, MSc, Jonathan Winkle, BS, and Kait Clark, PhD, Duke University, Journal of Experimental Psychology: Human Perception and Performance, online December 8, 2014.  

Related Articles Read More >

QED-C outlines road map for merging quantum and AI
Quantum computing hardware advance slashes superinductor capacitance >60%, cutting substrate loss
Hold your exaflops! Why comparing AI clusters to supercomputers is bananas
Why IBM predicts quantum advantage within two years
rd newsletter
EXPAND YOUR KNOWLEDGE AND STAY CONNECTED
Get the latest info on technologies, trends, and strategies in Research & Development.
RD 25 Power Index

R&D World Digital Issues

Fall 2024 issue

Browse the most current issue of R&D World and back issues in an easy to use high quality format. Clip, share and download with the leading R&D magazine today.

Research & Development World
  • Subscribe to R&D World Magazine
  • Enews Sign Up
  • Contact Us
  • About Us
  • Drug Discovery & Development
  • Pharmaceutical Processing
  • Global Funding Forecast

Copyright © 2025 WTWH Media LLC. All Rights Reserved. The material on this site may not be reproduced, distributed, transmitted, cached or otherwise used, except with the prior written permission of WTWH Media
Privacy Policy | Advertising | About Us

Search R&D World

  • R&D World Home
  • Topics
    • Aerospace
    • Automotive
    • Biotech
    • Careers
    • Chemistry
    • Environment
    • Energy
    • Life Science
    • Material Science
    • R&D Management
    • Physics
  • Technology
    • 3D Printing
    • A.I./Robotics
    • Software
    • Battery Technology
    • Controlled Environments
      • Cleanrooms
      • Graphene
      • Lasers
      • Regulations/Standards
      • Sensors
    • Imaging
    • Nanotechnology
    • Scientific Computing
      • Big Data
      • HPC/Supercomputing
      • Informatics
      • Security
    • Semiconductors
  • R&D Market Pulse
  • R&D 100
    • Call for Nominations: The 2025 R&D 100 Awards
    • R&D 100 Awards Event
    • R&D 100 Submissions
    • Winner Archive
    • Explore the 2024 R&D 100 award winners and finalists
  • Resources
    • Research Reports
    • Digital Issues
    • R&D Index
    • Subscribe
    • Video
    • Webinars
  • Global Funding Forecast
  • Top Labs
  • Advertise
  • SUBSCRIBE