4.5 Article

Creating web applications for online psychological experiments: A hands-on technical guide including a template

相关参考文献

注意:仅列出部分参考文献,下载原文获取全部文献信息。
Article Political Science

Detecting and Deterring Information Search in Online Surveys

Matthew H. Graham

Summary: This article presents a framework to evaluate methods of combating information search in online surveys. Three empirical studies show that search is a significant but manageable problem. Search frequency varies depending on question content, ranging from 2% to 30%. Deterrence and detection methods are effective in reducing search, with a combined success rate of over 90%.

AMERICAN JOURNAL OF POLITICAL SCIENCE (2023)

Article Psychology, Mathematical

Simulating behavior to help researchers build experiments

Joshua R. de Leeuw et al.

Summary: In this paper, an approach to reduce the time required for testing behavioral experiments is described. The approach involves automated simulation of participant behavior using software that can generate plausible participant behavior based on the experiment's code. This approach improves the way researchers build experiments and is demonstrated using jsPsych.

BEHAVIOR RESEARCH METHODS (2023)

Article Education & Educational Research

Conducting Linguistic Experiments Online With OpenSesame and OSWeb

Sebastiaan Mathot et al.

Summary: This article presents a workflow for running behavioral experiments online, focusing on experiments that require presenting complex stimuli and measuring reaction times, such as psycholinguistic experiments. The workflow relies on three integrated tools: OpenSesame/OSWeb for experiment development, JATOS for experiment hosting, and Prolific for participant recruitment. The article discusses various challenges associated with online experiments, including temporal precision, counterbalancing, data quality, and privacy and ethics concerns. Overall, the article concludes that online experiments can be a viable alternative to laboratory-based experiments, despite the challenges.

LANGUAGE LEARNING (2022)

Article Psychology, Mathematical

Data quality of platforms and panels for online behavioral research

Peer Eyal et al.

Summary: The study found significant differences in data quality aspects among different platforms and panels in online behavioral research, especially in comprehension, attention, and honesty. Reputation could not predict data quality, but frequency and purpose of usage did, especially on MTurk.

BEHAVIOR RESEARCH METHODS (2022)

Article Psychology, Mathematical

lab.js: A free, open, online study builder

Felix Henninger et al.

Summary: lab.js is a free, open-source experiment builder that allows researchers to easily build studies for both online and laboratory data collection through a visual interface without programming. It provides high accuracy and precision in measuring presentation and response times, while also allowing customization of study appearance and behavior using html, css, and JavaScript code if needed. Experiments constructed with lab.js can be run locally or published online with ease, integrating with popular data collection platforms for transparent replications and facilitating open, cumulative science.

BEHAVIOR RESEARCH METHODS (2022)

Article Psychology, Experimental

Addressing selective attrition in the enhanced response time-based concealed information test: A within-subject replication

Gaspar Lukacs

Summary: The response time-based concealed information test can reveal slower responses when a person recognizes a relevant item among irrelevant items, exposing potential deception. A study introduced an enhanced version with additional items, which outperformed the original but led to higher dropout rates. However, even when selective attrition was prevented, a significant enhancement was still observed in the experiment replicating the original test.

APPLIED COGNITIVE PSYCHOLOGY (2021)

Article Psychology, Mathematical

Realistic precision and accuracy of online experiment platforms, web browsers, and devices

Alexander Anwyl-Irvine et al.

Summary: Online behavioral research is booming due to its increasing ease of use and ability to quickly collect large samples. Researchers have conducted automated tests to understand how different web-building platforms, browsers, and operating systems impact experiment presentation and data quality. Findings show that modern web platforms provide reasonable accuracy and precision for display duration and manual response time, with no single platform standing out as the best in all features and conditions. Participants' demographics, technology, and software usage were also analyzed to provide context to the research findings.

BEHAVIOR RESEARCH METHODS (2021)

Article Psychology, Mathematical

A primer on running human behavioural experiments online

Tijl Grootswagers

BEHAVIOR RESEARCH METHODS (2020)

Article Psychology, Mathematical

Gorilla in our midst: An online behavioral experiment builder

Alexander L. Anwyl-Irvine et al.

BEHAVIOR RESEARCH METHODS (2020)

Article Computer Science, Interdisciplinary Applications

Adjusting to the GDPR: The Impact on Data Scientists and Behavioral Researchers

Travis Greene et al.

BIG DATA (2019)

Article Psychology, Experimental

Color and emotion: effects of hue, saturation, and brightness

Lisa Wilms et al.

PSYCHOLOGICAL RESEARCH-PSYCHOLOGISCHE FORSCHUNG (2018)

Article Psychology, Mathematical

PageFocus: Using paradata to detect and prevent cheating on online achievement tests

Birk Diedenhofen et al.

BEHAVIOR RESEARCH METHODS (2017)

Article Psychology, Social

The Pitfall of Experimenting on the Web: How Unattended Selective Attrition Leads to Surprising (Yet False) Research Conclusions

Haotian Zhou et al.

JOURNAL OF PERSONALITY AND SOCIAL PSYCHOLOGY (2016)

Article Psychology, Social

Methods for the detection of carelessly invalid responses in survey data

Paul G. Curran

JOURNAL OF EXPERIMENTAL SOCIAL PSYCHOLOGY (2016)

Article Health Care Sciences & Services

Uncontrolled Web-Based Administration of Surveys on Factual Health-Related Knowledge: A Randomized Study of Untimed Versus Timed Quizzing

Alexander Domnich et al.

JOURNAL OF MEDICAL INTERNET RESEARCH (2015)

Article Multidisciplinary Sciences

Conducting perception research over the internet: a tutorial review

Andy T. Woods et al.

Article Psychology, Mathematical

QRTEngine: An easy solution for running online reaction time experiments using Qualtrics

Jonathan S. Barnhoorn et al.

BEHAVIOR RESEARCH METHODS (2015)

Article Psychology, Mathematical

jsPsych: A JavaScript library for creating behavioral experiments in a Web browser

Joshua R. de Leeuw

BEHAVIOR RESEARCH METHODS (2015)