Validating an innovative real-time Delphi approach - A methodological comparison between real-time and conventional Delphi studies

A novel and innovative real-time Delphi technique is introduced in order to address previously identified weaknesses of the conventional Delphi method, such as complicated facilitator tasks, lack of real-time presentation of results, and difficulties in tracking progress over time. We demonstrate how the real-time (computer-based) method increases the efficiency of the process, accommodates expert availability, and reduces drop-out-rates. Modifications in the Delphi procedure (e.g. change of iteration principle) not only increase efficiency but also change the nature and process of the survey technique itself. By identifying and analysing three individual effects (initial condition effect, feedback effect, and iteration effect) we examine whether the modifications in the survey process cause deviations to the survey results. Empirical data obtained from both conventional as well as real-time Delphi studies is analysed based on multiple statistical analyses. The research findings indicate that significant differences between the two Delphi survey formats do not exist and final survey results are not affected by changes in the survey procedure. (C) 2011 Elsevier Inc. All rights reserved.