4.5 Article

Type I error rates and power of two randomization test procedures for the changing criterion design

Related references

Note: Only part of the references are listed.
Article Neurosciences

A practitioner's guide to conducting and analysing embedded randomized single-case experimental designs

Rene Tanious et al.

Summary: Single-case experimental designs (SCEDs) are used for individual-level research questions. Embedded designs, which are frequently used, lack specific recommendations. This article provides guidance on embedded SCED designs, including design options, requirements, randomization, and data analysis.

NEUROPSYCHOLOGICAL REHABILITATION (2023)

Review Clinical Neurology

Single-case experimental designs for child neurological rehabilitation and developmental disability research

Agata Krasny-Pacini

Summary: Single-case experimental designs (SCEDs) are a set of methodologies used to test the effectiveness of interventions at the individual level using rigorous and prospective methods. SCEDs offer flexibility in research design and can inform clinical decision-making, particularly for personalized outcomes, families with complex needs, and measuring progress based on parental intervention implementation and personal goals.

DEVELOPMENTAL MEDICINE AND CHILD NEUROLOGY (2023)

Article Psychology, Educational

Single-case intervention research design standards: Additional proposed upgrades and future directions

Thomas R. Kratochwill et al.

Summary: Standards for single-case intervention research design have undergone significant changes in the past decade. These standards serve the purpose of assisting in research methodology and guiding literature syntheses within a specific research domain. In this article, the authors provide additional recommendations to clarify key features of these standards and address underdeveloped or missing aspects in research and literature syntheses. The recommendations are organized into three categories and are crucial for future standards, research design training, and reporting of single-case intervention investigations during evidence-based practice initiatives.

JOURNAL OF SCHOOL PSYCHOLOGY (2023)

Article Psychology, Clinical

Randomization Procedures for Changing Criterion Designs

John Ferron et al.

Summary: To strengthen the scientific credibility arguments for single-case intervention studies, randomization design-and-analysis methods have been developed for various single-case designs, such as multiple-baseline, ABAB, and alternating treatment designs. This paper focuses on developing randomization methods for changing criterion designs. The authors illustrate the methods for both preplanned and response-guided changing criterion designs and discuss the limitations and validity of the intervention-effect inferences.

BEHAVIOR MODIFICATION (2023)

Article Psychology, Mathematical

Power analysis for single-case designs: Computations for (AB)k designs

Larry Hedges et al.

Summary: This study focuses on the power analysis of single-case experimental designs (SCEDs) using statistical computations. The results show that effect size has the greatest impact on power, followed by the number of subjects and phase reversals. The conditions to meet power requirements are reasonable in SCEDs.

BEHAVIOR RESEARCH METHODS (2023)

Article Psychology, Clinical

Additional randomization test procedures for the changing criterion design

Rene Tanious

Summary: This article introduces two novel randomization procedures for single-point and range-bound changing criterion designs, and explains how to use them. It also discusses the applicability of each randomization procedure in different contexts, and explains how these procedures maintain the researcher's flexibility.

BEHAVIORAL INTERVENTIONS (2022)

Article Psychology, Mathematical

The randomized marker method for single-case randomization tests: Handling data missing at random and data missing not at random

Tamal Kumar De et al.

Summary: Single-case experiments often face missing data problems. The randomized marker method has been found to be valid and powerful for single-case randomization tests with missing data missing completely at random. However, it is difficult to ascertain the missing data mechanism in real-life experiments. This study examined the performance of the randomized marker method for data missing at random and missing not at random, and compared it with multiple imputation.

BEHAVIOR RESEARCH METHODS (2022)

Article Psychology, Educational

Single-case design standards: An update and proposed upgrades

Thomas R. Kratochwill et al.

Summary: This paper critiques the WWC Standards for Single-Case Research Design (Standards 4.1) and recommends the use of visual analysis to verify design standards, as well as addressing limitations and statistical issues. The authors suggest that Standards 4.1 may be best suited for meta-analyses of single-case designs, emphasizing the need for transparency in distinguishing different types of SCD studies in research synthesis.

JOURNAL OF SCHOOL PSYCHOLOGY (2021)

Article Psychology, Clinical

Autocorrelation and estimates of treatment effect size for single-case experimental design data

Lucy Barnard-Brak et al.

Summary: The study found that non-parametric effect size measures are more significantly influenced by the degree of autocorrelation compared to parametric measures. It is recommended to avoid using NAP, IRD, and PND values as the autocorrelation between data points increases in single-case design data analysis.

BEHAVIORAL INTERVENTIONS (2021)

Review Psychology, Mathematical

A systematic review of applied single-case research published between 2016 and 2018: Study designs, randomization, data aspects, and data analysis

Rene Tanious et al.

Summary: Single-case experimental designs (SCEDs) have become popular in various research fields, with specific guidelines developed for their conduct and analysis. A systematic review of SCEDs published from 2016 to 2018 found that the multiple baseline design remains the most commonly used, and visual analysis paired with descriptive statistics is the most frequently used data analysis method. Inferential statistical methods and randomization in study designs are also utilized.

BEHAVIOR RESEARCH METHODS (2021)

Article Psychology, Educational

Investigation of Single-Case Multiple-Baseline Randomization Tests of Trend and Variability

Joel R. Levin et al.

Summary: This study compared various randomization test procedures in assessing different types of intervention-based effects in single-case educational intervention research, and proposed an alternative measure of variability that is more sensitive to detecting changes.

EDUCATIONAL PSYCHOLOGY REVIEW (2021)

Article Education & Educational Research

Bias Adjustment in Multilevel Meta-Analysis of Standardized Single-Case Experimental Data

Laleh Jamshidi et al.

Summary: Prior research identified bias in estimating overall fixed effects and variance components using multilevel meta-analyses of standardized single-case data. However, the relative bias decreases as the number of measurement occasions increases. Hedges's bias correction procedure improved the accuracy of estimations for both fixed effects and variance components.

JOURNAL OF EXPERIMENTAL EDUCATION (2021)

Article Multidisciplinary Sciences

Power of a randomization test in a single case multiple baseline AB design

Samantha Bouwmeester et al.

PLOS ONE (2020)

Article Social Sciences, Mathematical Methods

Modeling Heterogeneity of the Level-1 Error Covariance Matrix in Multilevel Models for Single-Case Data

Eunkyeng Baek et al.

METHODOLOGY-EUROPEAN JOURNAL OF RESEARCH METHODS FOR THE BEHAVIORAL AND SOCIAL SCIENCES (2020)

Article Education & Educational Research

Changing Criterion Designs: Integrating Methodological and Data Analysis Recommendations

Rumen Manolov et al.

JOURNAL OF EXPERIMENTAL EDUCATION (2020)

Article Psychology, Clinical

Randomization tests for changing criterion designs

Patrick Onghena et al.

BEHAVIOUR RESEARCH AND THERAPY (2019)

Article Psychology, Clinical

Single-case experimental designs. Evaluating interventions in research and clinical practice

Alan E. Kazdin

BEHAVIOUR RESEARCH AND THERAPY (2019)

Article Psychology, Clinical

A Simulation Study on Two Analytical Techniques for Alternating Treatments Designs

Rumen Manolov

BEHAVIOR MODIFICATION (2019)

Article Education, Special

A Primer on Single-Case Research Designs: Contemporary Use and Analysis

Jennifer R. Ledford et al.

AJIDD-AMERICAN JOURNAL ON INTELLECTUAL AND DEVELOPMENTAL DISABILITIES (2019)

Article Psychology, Mathematical

Analysis of single-case experimental count data using the linear mixed effects model: A simulation study

Lies Declercq et al.

BEHAVIOR RESEARCH METHODS (2019)

Article Psychology, Mathematical

Randomized single-case AB phase designs: Prospects and pitfalls

Bart Michiels et al.

BEHAVIOR RESEARCH METHODS (2019)

Article Education & Educational Research

Approaches for Specifying the Level-1 Error Structure When Synthesizing Single-Case Data

Seang-Hwane Joo et al.

JOURNAL OF EXPERIMENTAL EDUCATION (2019)

Article Health Care Sciences & Services

Randomized Single-Case Experimental Designs in Healthcare Research: What, Why, and How?

Rene Tanious et al.

HEALTHCARE (2019)

Article Clinical Neurology

Comparison of randomization-test procedures for single-case multiple-baseline designs

Joel R. Levin et al.

DEVELOPMENTAL NEUROREHABILITATION (2018)

Article Psychology, Clinical

A MONTE CARLO EVALUATION OF MASKED VISUAL ANALYSIS IN RESPONSE-GUIDED VERSUS FIXED-CRITERIA MULTIPLE-BASELINE DESIGNS

John M. Ferron et al.

JOURNAL OF APPLIED BEHAVIOR ANALYSIS (2017)

Review Psychology, Clinical

Best Practices in Utilizing the Changing Criterion Design

Liesa A. Klein et al.

BEHAVIOR ANALYSIS IN PRACTICE (2017)

Article Psychology, Clinical

Using a Changing-Criterion Design to Evaluate the Effects of Check-In/Check-Out With Goal Modification

Sara C. McDaniel et al.

JOURNAL OF POSITIVE BEHAVIOR INTERVENTIONS (2016)

Article Psychology, Mathematical

The consequences of modeling autocorrelation when synthesizing single-case studies using a three-level model

Merlande Petit-Bois et al.

BEHAVIOR RESEARCH METHODS (2016)

Article Psychology, Educational

Mystery Motivator: A Tier 1 Classroom Behavioral Intervention

Eva A. Kowalewicz et al.

SCHOOL PSYCHOLOGY QUARTERLY (2014)

Article Psychology, Mathematical

Bayesian estimates of autocorrelations in single-case designs

William R. Shadish et al.

BEHAVIOR RESEARCH METHODS (2013)

Article Psychology, Educational

Single-Case Experimental Designs in Educational Research: A Methodology for Causal Analyses in Teaching and Learning

Joshua B. Plavnick et al.

EDUCATIONAL PSYCHOLOGY REVIEW (2013)

Article Education, Special

Using Point-Of-View Video Modeling and Forward Chaining to Teach a Functional Self-Help Skill to a Child with Autism

Akriti Shrestha et al.

JOURNAL OF BEHAVIORAL EDUCATION (2013)

Review Psychology, Multidisciplinary

Single-Case Experimental Designs: A Systematic Review of Published Research and Current Standards

Justin D. Smith

PSYCHOLOGICAL METHODS (2012)

Article Psychology, Experimental

Effect Size Estimates: Current Use, Calculations, and Interpretation

Catherine O. Fritz et al.

JOURNAL OF EXPERIMENTAL PSYCHOLOGY-GENERAL (2012)

Article Psychology, Mathematical

Characteristics of single-case designs used to assess intervention effects in 2008

William R. Shadish et al.

BEHAVIOR RESEARCH METHODS (2011)

Article Psychology, Multidisciplinary

Enhancing the Scientific Credibility of Single-Case Intervention Research: Randomization to the Rescue

Thomas R. Kratochwill et al.

PSYCHOLOGICAL METHODS (2010)

Article Education & Educational Research

Data-Division-Specific Robustness and Power of Randomization Tests for ABAB Designs

Rumen Manolov et al.

JOURNAL OF EXPERIMENTAL EDUCATION (2010)

Article Psychology, Mathematical

An R package for single-case randomization tests

Isis Bulte et al.

BEHAVIOR RESEARCH METHODS (2008)

Article Psychology, Multidisciplinary

RANDOM ASSIGNMENT OF INTERVENTION POINTS IN TWO-PHASE SINGLE-CASE DESIGNS: DATA-DIVISION-SPECIFIC DISTRIBUTIONS

Antonio Solanas et al.

PSYCHOLOGICAL REPORTS (2008)

Article Education, Special

The Distributed Criterion Design

Dennis McDougall

JOURNAL OF BEHAVIORAL EDUCATION (2006)

Review Anesthesiology

Customization of pain treatments - Single-case design and analysis

P Onghena et al.

CLINICAL JOURNAL OF PAIN (2005)

Article Education & Educational Research

Statistical power of randomization tests used with multiple-baseline designs

J Ferron et al.

JOURNAL OF EXPERIMENTAL EDUCATION (2002)