Why do Experiments Fail? Six Practical Suggestions for Successful Online Experiments

Experiments are frequently used in the travel and hospitality literature to provide stronger evidence of causal relationships between various constructs. Recently, despite the use of online platforms for experimental studies, such studies have often failed to find significant results, as expected. To increase the probability of obtaining significant results for experiments using online panels, this paper suggests six practical recommendations across three categories: (i) handling less homogenous online participants; (ii) understanding and managing different motivations and abilities in online participants; and (iii) using effective and transparent experimental designs and procedures. This paper provides the results of three empirical investigations to support these recommendations.

Automated summary

This paper proposes six practical recommendations for obtaining significant results in experiments conducted on online panels, and provides evidence from three empirical investigations to support these recommendations.