4.5 Article

Never miss a beep: Using mobile sensing to investigate (non-)compliance in experience sampling studies

Related references

Note: Only part of the references are listed.
Article Psychology, Clinical

Ecological Momentary Assessment: A Meta-Analysis on Designs, Samples, and Compliance Across Research Fields

Cornelia Wrzus et al.

Summary: Ecological Momentary Assessments (EMA) are widely used in psychology and related fields. This meta-analysis examines how study designs and sample characteristics affect compliance and dropout rates. Results show that compliance is higher when financial incentives are provided, and the number of assessments per day does not predict compliance or dropout rates.

ASSESSMENT (2023)

Article Clinical Neurology

Prompt-level predictors of compliance in an ecological momentary assessment study of young adults' mental health

Aja Louise Murray et al.

Summary: This study used data from a general population young adult EMA study and fitted dynamic structural equation models to explore potential predictors of missing the next prompt. The results suggest that higher levels of stress, overall negative affect, and the specific negative affective state of 'upset' at a given prompt predict a greater likelihood of missing the next prompt.

JOURNAL OF AFFECTIVE DISORDERS (2023)

Article Psychiatry

Respondent characteristics associated with adherence in a general population ecological momentary assessment study

Aja Murray et al.

Summary: This study investigated the predictors of adherence to ecological momentary assessment (EMA) surveys. The results showed that moral shame, self-control, self-injury, aggression, tobacco use, psychopathy, and delinquency were associated with lower adherence. Only alcohol use was related to adherence, with beer and alcopops associated with higher adherence and spirits associated with lower adherence.

INTERNATIONAL JOURNAL OF METHODS IN PSYCHIATRIC RESEARCH (2023)

Article Communication

Modeling social interaction dynamics measured with smartphone sensors: An ambulatory assessment study on social interactions and loneliness

Timon Elmer et al.

Summary: This article demonstrates how time-stamped sensor data of social interactions can be modeled with multistate survival models. It examines the association between loneliness and the time and duration of social interactions, finding that only relational loneliness predicts shorter social interaction encounters.

JOURNAL OF SOCIAL AND PERSONAL RELATIONSHIPS (2023)

Article Psychology, Clinical

Evaluation of Pressing Issues in Ecological Momentary Assessment

Arthur A. Stone et al.

Summary: The Experience Sampling Method and Ecological Momentary Assessment (EMA) have been widely adopted in recent decades. These methods go beyond retrospective self-reports by capturing everyday experiences in their immediate context. This review identifies and evaluates nine conceptual, methodological, and psychometric issues of EMA, aiming to stimulate discussion and guide future research. Resolving these issues will significantly advance the field.

ANNUAL REVIEW OF CLINICAL PSYCHOLOGY (2023)

Article Psychology, Clinical

Compliance Trends in a 14-Week Ecological Momentary Assessment Study of Undergraduate Alcohol Drinkers

Andrea L. Howard et al.

Summary: This study analyzed compliance data from 182 surveys of EMA research and found that high compliance is crucial for successful ecological momentary assessment. However, the reasons for missed prompts remain unclear. Compliance gradually declined from 88.9% to 70% over 14 weeks, and the decline was faster in participants with lower overall compliance rates. No significant differences were found in demographics, personality, mental health, or substance use between participants with better versus worse compliance rates. Compliance varied by survey type, and unannounced bonus incentives did not affect compliance rates. Participants completed fewer surveys in the week after winning a gift card. Recommendations for future EMA studies are provided.

ASSESSMENT (2023)

Article Psychology, Multidisciplinary

A population-based investigation of participation rate and self-selection bias in momentary data capture and survey studies

Arthur A. A. Stone et al.

Summary: Participant selection bias is a concern for all types of surveys, especially for momentary data capture studies. This study invited 3,000 individuals to participate and recorded the uptake rates. Overall, 85.9% did not respond, 6.9% expressed interest, and 2.1% agreed to participate. Individuals with higher income, open personality, better skills, interest in the research topic, and previous survey experience were more likely to consent. The one-time survey had higher participation compared to momentary studies.

CURRENT PSYCHOLOGY (2023)

Article Psychology

Best Practices in Supervised Machine Learning: A Tutorial for Psychologists

Florian Pargent et al.

Summary: Supervised machine learning is gaining popularity in psychology and other social sciences, but it is not widely taught in psychology programs. This tutorial provides an intuitive but comprehensive introduction to supervised machine learning for psychologists in four modules, covering topics such as resampling methods for evaluating model performance, introducing the random forest model, performing benchmark experiments, and interpreting machine learning models. The tutorial uses R programming language and the mlr3 package, with demonstrations using the PhoneStudy dataset.

ADVANCES IN METHODS AND PRACTICES IN PSYCHOLOGICAL SCIENCE (2023)

Article Psychology, Social

Snapshots of Daily Life: Situations Investigated Through the Lens of Smartphone Sensing

Ramona Schoedel et al.

Summary: This study demonstrates how smartphones can establish associations between psychological perception and physical reality of situations. By analyzing 9,790 situational snapshots from 455 participants over 14 days, the study found significant predictions of the Situational Eight Duty, Intellect, Adversity, Mating, pOsitivity, Negativity, Deception, Sociality (DIAMONDS) dimensions using smartphone sensing.

JOURNAL OF PERSONALITY AND SOCIAL PSYCHOLOGY (2023)

Article Psychology, Multidisciplinary

Everything has its price: Foundations of cost-sensitive machine learning and its application in psychology.

Philipp Sterner et al.

PSYCHOLOGICAL METHODS (2023)

Article Social Sciences, Mathematical Methods

Coverage Error in Data Collection Combining Mobile Surveys With Passive Measurement Using Apps: Data From a German National Survey

Florian Keusch et al.

Summary: Researchers are increasingly combining self-reports from mobile surveys with passive data collection using sensors and apps on smartphones. However, the penetration of smartphones varies across different groups, and the limitations of different operating systems affect passive mobile data collection. Based on data from the PASS survey in Germany, smartphone ownership and specific operating systems are correlated with sociodemographic and substantive variables.

SOCIOLOGICAL METHODS & RESEARCH (2023)

Article Psychology, Multidisciplinary

Small Effects: The Indispensable Foundation for a Cumulative Psychological Science

Friedrich M. Goetz et al.

Summary: Research indicates that complex psychological phenomena are influenced by multiple causes, each having a small effect. However, the current publication culture values large effects while overlooking small yet real effects. These small effects can have significant consequences when considered at scale and over time. Utilizing big data, machine learning, and changing cultural norms can help advance psychology research and practices.

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE (2022)

Article Psychology, Clinical

Compliance in Ambulatory Assessment Studies: Investigating Study and Sample Characteristics as Predictors

Charlotte Ottenstein et al.

Summary: The compliance in ambulatory assessment studies may be influenced by the total number of measurement occasions and study days, with a higher percentage of healthy controls in clinical studies associated with a higher compliance rate. Other study characteristics and sample characteristics were not related to compliance.

ASSESSMENT (2022)

Review Psychology, Clinical

Global prevalence of depression and elevated depressive symptoms among adolescents: A systematic review and meta-analysis

Shefaly Shorey et al.

Summary: This review examined the global prevalence of depression among adolescents, revealing an increasing trend in elevated depressive symptoms with the highest prevalence in female adolescents and those from the Middle East, Africa, and Asia. Future research and policies should prioritize preventive and intervention efforts targeting adolescent depression, with a focus on developing gender-specific and culturally relevant programs.

BRITISH JOURNAL OF CLINICAL PSYCHOLOGY (2022)

Article Social Sciences, Mathematical Methods

A Crash Course in Good and Bad Controls

Carlos Cinelli et al.

Summary: This paper introduces graphical tools for addressing the problem of bad control and aims to make these tools accessible to a broader community of scientists concerned with the causal interpretation of regression models.

SOCIOLOGICAL METHODS & RESEARCH (2022)

Article Psychology, Mathematical

The effects of assessment intensity on participant burden, compliance, within-person variance, and within-person relationships in ambulatory assessment

Kilian Hasselhorn et al.

Summary: The study found that higher sampling frequency in ambulatory assessment studies can increase participants' perceived burden, while longer questionnaire lengths do not affect perceived burden or compliance. Additionally, changes in sampling frequency and questionnaire length have an impact on within-person variability and relationships between time-varying variables.

BEHAVIOR RESEARCH METHODS (2022)

Article Psychology, Clinical

The Effects of Sampling Frequency and Questionnaire Length on Perceived Burden, Compliance, and Careless Responding in Experience Sampling Data in a Student Population

Gudrun Eisele et al.

Summary: Little is known about the association between assessment intensity, burden, data quantity, and data quality in experience sampling method (ESM) studies. This study found that longer questionnaires increased burden and compromised data quantity and quality, while increased sampling frequency did not have negative consequences.

ASSESSMENT (2022)

Review Statistics & Probability

Graphical Models for Processing Missing Data

Karthika Mohan et al.

Summary: This article reviews recent advances in missing data research using graphical models, addressing the limitations of traditional frameworks and providing meaningful performance guarantees, even in cases of missing data not at random. The study identifies conditions for consistent estimation and procedures for implementation, as well as deriving testable implications for missing data models.

JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION (2021)

Article Mathematical & Computational Biology

The Matthews correlation coefficient (MCC) is more reliable than balanced accuracy, bookmaker informedness, and markedness in two-class confusion matrix evaluation

Davide Chicco et al.

Summary: In this manuscript, the authors reaffirm the robustness of the Matthews correlation coefficient (MCC) as a metric for summarizing classifier performance. They compare MCC to other metrics such as balanced accuracy, bookmaker informedness, and markedness, and demonstrate situations where MCC provides a more informative response. The authors also identify three exceptions where bookmaker informedness may be more appropriate, but overall suggest MCC as a standard measure for evaluating binary classifications in various fields.

BIODATA MINING (2021)

Article Multidisciplinary Sciences

Integrating explanation and prediction in computational social science

Jake M. Hofman et al.

Summary: Computational social science involves the convergence of different fields with different ways of thinking and doing science. It emphasizes combining explanatory and predictive approaches, advocating for integrative modeling to further research goals.

NATURE (2021)

Article Psychology

Putting Psychology to the Test: Rethinking Model Evaluation Through Benchmarking and Prediction

Roberta Rocca et al.

Summary: Consensus on common evaluation benchmarks is lacking in the field of psychology, leading to idiosyncratic evaluation practices and difficulty in discerning between good and bad models. Introducing common benchmarks is advocated as a means to drive cumulative progress in psychology, emphasizing the practical utility of scientific models.

ADVANCES IN METHODS AND PRACTICES IN PSYCHOLOGICAL SCIENCE (2021)

Article Psychology, Social

Eavesdropping on Missing Data: What Are University Students Doing When They Miss Experience Sampling Reports?

Jessie Sun et al.

Summary: The study analyzed 3,678 observations using an Electronically Activated Recorder and found little evidence to suggest that missing ESM reports were correlated with constructs of interest to ESM researchers. This provides reassuring evidence for the validity of ESM research among relatively healthy university student samples.

PERSONALITY AND SOCIAL PSYCHOLOGY BULLETIN (2021)

Article Psychology, Social

Supervised machine learning methods in psychology: A practical introduction with annotated R code

Hannes Rosenbusch et al.

Summary: This article provides an overview of machine learning methods in psychological research, including basic concepts, prediction algorithms, examples, and best practices for implementation. It emphasizes the importance of machine learning methods in maintaining psychology as a predictive science.

SOCIAL AND PERSONALITY PSYCHOLOGY COMPASS (2021)

Article Management

Workdays are not created equal: Job satisfaction and job stressors across the workweek

Shani Pindek et al.

Summary: This study found that employees are more likely to experience job dissatisfaction and more job stressors at the beginning of the workweek, supporting the "Monday blues" perspective.

HUMAN RELATIONS (2021)

Article Psychology, Clinical

Have you been exercising lately? Testing the role of past behavior on exercise adherence

Filipe Rodrigues et al.

Summary: The study demonstrates that past behavior can offset the direct impact of intention on future behavior and act as a buffer variable for experienced gym members. It also found that past behavior plays a role in moderating the indirect effects of other variables on intention, thus influencing behavior.

JOURNAL OF HEALTH PSYCHOLOGY (2021)

Article Computer Science, Cybernetics

Overcoming compliance bias in self-report studies: A cross-study analysis

Niels van Berkel et al.

INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES (2020)

Article Computer Science, Interdisciplinary Applications

Collecting Survey and Smartphone Sensor Data With an App: Opportunities and Challenges Around Privacy and Informed Consent

Frauke Kreuter et al.

SOCIAL SCIENCE COMPUTER REVIEW (2020)

Article Public, Environmental & Occupational Health

Selection Mechanisms and Their Consequences: Understanding and Addressing Selection Bias

Louisa H. Smith

CURRENT EPIDEMIOLOGY REPORTS (2020)

Article Psychology, Multidisciplinary

Machine Learning and Psychological Research: The Unexplored Effect of Measurement

Ross Jacobucci et al.

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE (2020)

Review Health Care Sciences & Services

A systematic review shows no performance benefit of machine learning over logistic regression for clinical prediction models

Evangelia Christodoulou et al.

JOURNAL OF CLINICAL EPIDEMIOLOGY (2019)

Article Computer Science, Cybernetics

Effect of experience sampling schedules on response rate and recall accuracy of objective self-reports

Niels van Berkel et al.

INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES (2019)

Article Psychology, Clinical

Response Compliance and Predictors Thereof in Studies Using the Experience Sampling Method

Aki Rintala et al.

PSYCHOLOGICAL ASSESSMENT (2019)

Article Psychology, Multidisciplinary

Predictive Modeling With Psychological Panel Data

Florian Pargent et al.

ZEITSCHRIFT FUR PSYCHOLOGIE-JOURNAL OF PSYCHOLOGY (2018)

Article Psychology

Thinking Clearly About Correlations and Causation: Graphical Causal Models for Observational Data

Julia M. Rohrer

ADVANCES IN METHODS AND PRACTICES IN PSYCHOLOGICAL SCIENCE (2018)

Article Computer Science, Interdisciplinary Applications

ranger: A Fast Implementation of Random Forests for High Dimensional Data in C plus plus and R

Marvin N. Wright et al.

JOURNAL OF STATISTICAL SOFTWARE (2017)

Article Multidisciplinary Sciences

Users of the main smartphone operating systems (iOS, Android) differ only little in personality

Friedrich M. Goetz et al.

PLOS ONE (2017)

Article Multidisciplinary Sciences

Optimal classifier for imbalanced data using Matthews Correlation Coefficient metric

Sabri Boughorbel et al.

PLOS ONE (2017)

Article Psychology, Multidisciplinary

Choosing Prediction Over Explanation in Psychology: Lessons From Machine Learning

Tal Yarkoni et al.

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE (2017)

Article Psychology, Social

Explaining System Missing: Missing Data and Experience Sampling Method

Derrick C. McLean et al.

SOCIAL PSYCHOLOGICAL AND PERSONALITY SCIENCE (2017)

Article Psychology, Multidisciplinary

Using Smartphones to Collect Behavioral Data in Psychological Science: Opportunities, Practical Considerations, and Challenges

Gabriella M. Harari et al.

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE (2016)

Article Psychiatry

Use of the experience sampling method in the context of clinical trials

Simone J. W. Verhagen et al.

EVIDENCE-BASED MENTAL HEALTH (2016)

Review Psychology, Multidisciplinary

Degrees of Freedom in Planning, Running, Analyzing, and Reporting Psychological Studies: A Checklist to Avoid p-Hacking

Jelte M. Wicherts et al.

FRONTIERS IN PSYCHOLOGY (2016)

Article Mathematics, Interdisciplinary Applications

Graphical Representation of Missing Data Problems

Felix Thoemmes et al.

STRUCTURAL EQUATION MODELING-A MULTIDISCIPLINARY JOURNAL (2015)

Article Psychology, Social

Lab and/or Field? Measuring Personality Processes and Their Social Consequences

Cornelia Wrzus et al.

EUROPEAN JOURNAL OF PERSONALITY (2015)

Article Substance Abuse

Factors Predicting Compliance to Ecological Momentary Assessment Among Adolescent Smokers

Alexander W. Sokolovsky et al.

NICOTINE & TOBACCO RESEARCH (2014)

Article Psychology, Applied

Missing Data: Five Practical Guidelines

Daniel A. Newman

ORGANIZATIONAL RESEARCH METHODS (2014)

Article Psychology, Multidisciplinary

The dark side of smartphone usage: Psychological traits, compulsive behavior and technostress

Yu-Kang Lee et al.

COMPUTERS IN HUMAN BEHAVIOR (2014)

Article Psychology, Social

The Situational Eight DIAMONDS: A Taxonomy of Major Dimensions of Situation Characteristics

John F. Rauthmann et al.

JOURNAL OF PERSONALITY AND SOCIAL PSYCHOLOGY (2014)

Article Computer Science, Interdisciplinary Applications

Missed Beeps and Missing Data: Dispositional and Situational Predictors of Nonresponse in Experience Sampling Research

Paul J. Silvia et al.

SOCIAL SCIENCE COMPUTER REVIEW (2013)

Article Psychology, Multidisciplinary

The Smartphone Psychology Manifesto

Geoffrey Miller

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE (2012)

Article Statistics & Probability

Selection Bias in Web Surveys

Jelke Bethlehem

INTERNATIONAL STATISTICAL REVIEW (2010)

Article Computer Science, Interdisciplinary Applications

Regularization Paths for Generalized Linear Models via Coordinate Descent

Jerome Friedman et al.

JOURNAL OF STATISTICAL SOFTWARE (2010)

Article Statistics & Probability

To Explain or to Predict?

Galit Shmueli

STATISTICAL SCIENCE (2010)

Review Psychology

Missing Data Analysis: Making It Work in the Real World

John W. Graham

ANNUAL REVIEW OF PSYCHOLOGY (2009)

Article Computer Science, Interdisciplinary Applications

Building Predictive Models in R Using the caret Package

Max Kuhn

JOURNAL OF STATISTICAL SOFTWARE (2008)

Article Psychology, Social

The dynamics of personality states, goals, and well-being

Daniel Heller et al.

PERSONALITY AND SOCIAL PSYCHOLOGY BULLETIN (2007)

Article Mathematics, Interdisciplinary Applications

Multiple imputation of item scores in test and questionnaire data, and influence on psychometric results

Joost R. van Ginkel et al.

MULTIVARIATE BEHAVIORAL RESEARCH (2007)

Article Computer Science, Artificial Intelligence

An introduction to ROC analysis

Tom Fawcett

PATTERN RECOGNITION LETTERS (2006)

Article Management

Cost-sensitive learning and decision making revisited

S Viaene et al.

EUROPEAN JOURNAL OF OPERATIONAL RESEARCH (2005)

Article Statistics & Probability

Regularization and variable selection via the elastic net

H Zou et al.

JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY (2005)

Article Psychology, Applied

Profiling active and passive nonrespondents to an organizational survey.

SG Rogelberg et al.

JOURNAL OF APPLIED PSYCHOLOGY (2003)

Article Psychology, Multidisciplinary

Capturing momentary, self-report data: A proposal for reporting guidelines

AA Stone et al.

ANNALS OF BEHAVIORAL MEDICINE (2002)

Article Computer Science, Artificial Intelligence

Random forests

L Breiman

MACHINE LEARNING (2001)

Article Psychology, Social

Toward a structure- and process-integrated view of personality: Traits as density distributions of states

W Fleeson

JOURNAL OF PERSONALITY AND SOCIAL PSYCHOLOGY (2001)