Delphi questionnaires versus individual and group interviews: A comparison case

doi:10.1016/0040-1625(90)90029-U

Technological Forecasting and Social Change

Volume 37, Issue 3, May 1990, Pages 293-304

https://doi.org/10.1016/0040-1625(90)90029-U Get rights and content

Abstract

The article reports on a methodological investigation for different types of the communication device represented by the Delphi method. Traditionally mailed or computer-mediated questionnaires are used. The Delphi method was invented to overcome undesirable effects of group interaction while retaining the positive effects of interactive group judgments. This article supplies evidence for the opposite: the superiority of face- to-face techniques (individual and group interviews) as compared to mailed questionnaires in a three-round Policy Delphi using half-structured questionnaires. Moreover, the case study proves that they might produce different results. In a field- or quasi-experimental design the three techniques were compared for their effects. The performance of 100 panel members on a large number of quality standards in the Delphi method is described. A list of pros and cons of the three techniques in a (Policy) Delphi serves as a summary.

References (16)

J.A.G.M. Dijk van
Popularising Delphi Method, Developing an Instrument to Control Technological Change for Employees
Quality and Quantity
(1989)
J.A.G.M. Dijk van
Delphi Method as a Learning Instrument: Bank Employees Discussing an Automation Project
Technological Forecasting and Social Change
(1990)
A.L. Delbecq et al.
Group Techniques for Program Planning: A Guide to Nominal Group and Delphi Processes
(1975)
D.H. Gustafson et al.
A Comparative Study of Differences in Subjective Likehood Estimates Made byIndividuals, Interacting Groups, Delphi Groups, and Nominal Groups
Organisational Behavior and Human Performance
(1973)
C.M. Moore
Group Techniques for Idea Building
(1987)
W.E. Riggs
The Delphi Technique, an Experimental Evaluation
Technological Forecasting and Social Change
(1983)
A. Van de Ven
Group Decision Making and Effectiveness
(1974)
M. Turoff
The Policy Delphi

There are more references available in the full text version of this article.

Cited by (59)

A model for assisting software project managers to treat project teams as key stakeholders: What do experts say?
2021, Procedia Computer Science
Project teams (PTs) are critical resources in the success of projects in the Information and Communication Technology (ICT) sector, as projects in this sector are highly dependent on human resources. Numerous researchers have written about the key role played by the PTs. However, PTs have not received commensurate recognition from their project managers (PMs) when it comes to the addressing of their needs and interests. ICT PTs have become forgotten stakeholders. In an effort to address the neglect of project teams by PMs, a model was developed by the authors of this paper to assist ICT PMs in treating PTs as key stakeholders. The purpose of this paper is to present the results of the refinement and evaluation process to which this model was subjected, using a two-phase Delphi methodology, using experienced experts comprising five PMs, twenty PT members as well as five academics. The data collected from the experts using interviews was analysed by means of statistical and qualitative methods. The results show that the experts have welcomed the use of the model in the ICT sector, acknowledging its suitability for a real-life project environment. Future studies should include the validation of the model in a real-life project environment.
Business models for sustainable consumption in the circular economy: An expert study
2019, Journal of Cleaner Production
Citation Excerpt :
A Delphi-inspired approach was selected as it supports the exploratory nature of this study (Skulmoski et al., 2007). Van Dijk (1990) compared the application of questionnaires, group interviews and individual interviews in Delphi studies and concluded that individual interviews have lower drop-out rates, increased involvement and improved quality of answers compared to the other data collection methods. Already in the early days of the Delphi method, the RAND cooperation used interviews alongside questionnaires to clarify aspects and to enrich the data (Dalkey and Helmer, 1963).
Combining sustainable consumption with the circular economy concept could help tackle challenges, such as resource scarcity and climate change by reducing resource throughput and increasing cycling of products and materials within the economic system, thereby reducing emissions and virgin material use. To achieve sustainable consumption in a circular economy production and consumption practices need to change. Business models can potentially influence both practices as it defines how a company conducts business and shapes the company-consumer relationship. This paper developed future business models for sustainable consumption through two rounds of semi-structured interviews with experts from academia, industry, and policy. During the first interview round, four business model elements that are important for sustainable consumption were identified: Resource strategy, Revenue model, Consumer effort, and Objective to (decrease/increase) consumption level. Based on these elements, we developed a comprehensive business model framework. Using this framework, experts envisioned future business models for sustainable consumption of clothing during the second interview round. The findings of this study suggest that the most promising business models for sustainable consumption are those that reduce overall consumption levels and consumer effort. Further, we found that a diverse range of business models in the market can potentially enable different customer segments to consume sustainably.
Inventory and rating of performance indicators and organisational features in metropolitan public transport: A worldwide Delphi survey
2018, Research in Transportation Economics
Citation Excerpt :
Finally, whilst the Delphi promotes breadth, results may lack in depth. The limited time availability of experts, the need to maintain questionnaires concise, and the lack of direct interaction lead to less detailed accounts than what can be achieved with personal interviews for instance (Van Dijk, 1990). It is interesting to further develop the findings of a Delphi with additional methods that can complement the survey – workshops or case studies for instance (de Loë, 1995).
This paper contributes to the discussion on the ways organisational form of public transport systems may influence its performance. A worldwide Delphi survey with experts in the field is presented. After a three-stage iterative process interspersing questionnaires and controlled feedback the survey produces authoritative inventories and ratings of performance indicators and organisational features in public transport. In relation to performance indicators, system-wide metrics such as user satisfaction, cost-recovery, and modal split are selected as preferred measures for a strategic assessment of public transport. Concerning features of organisational form driving performance outcomes, integration emerged as the central dimension: policy integration between public transport and other sectors, single integrated planning authority, as well as ticket and fare integration were highly rated by Delphi experts.
The future of CSR - Selected findings from a Europe-wide Delphi study
2018, Journal of Cleaner Production
Citation Excerpt :
The results of previous rounds serve as input for subsequent rounds, and experts are asked either to re-assess their judgements, or to interpret the results. In doing so, the merging of qualitative approaches (e.g., open interviews) and quantitative approaches (e.g., structured surveys) is more likely to produce solid results (Van Dlijk, 1990). Therefore, it is often applied to complex and under-explored phenomena in science and technology forecasting, business forecasting, and participative policy-making.
The literature on Corporate Social Responsibility (CSR) is rich in historical evidence explaining its rise, development, and global diffusion. Very few studies, however, have tried to forecast its future. Hence, the aim of this study is to explore the expected future role of CSR in Europe. To achieve this objective, we apply the Delphi method, an interactive forecasting technique based on the opinions of experts. Drawing upon the opinions of more than 500 experts representing 32 European countries and five economic sectors, the study concludes that the role of CSR will increase in the near future years, although the importance of this projection might differ among European macro-regions and sectors. We also examine the role of public CSR policies as well as different stakeholder groups in stimulating greater CSR involvement among companies. We show that among public CSR policies, the most important will be public procurement, subsidies and tax incentives, and CSR reporting standards. As for groups, the most prominent role in mobilising the socially responsible corporate behaviour will be played by business stakeholders, public authorities, and non-governmental organisations (NGOs).
Ecosilient Index to assess the greenness and resilience of the upstream automotive supply chain
2013, Journal of Cleaner Production
Citation Excerpt :
It was considered that it would give more value to this research phase to incorporate the point of view of a representative of the AFIA (Portuguese Association of Automotive Suppliers) which is the association that links and represents the automotive suppliers, both at the national and international level. This contributes to guarantee the validity of the results obtained from the Delphi technique application since according to Van Dijk (1990) the information collected by the Delphi study is only as good as the experts who participate on the panel. So, only persons with a considerable knowledge on the research topics and automotive industry were included in the panel members.
This paper suggests an Ecosilient Index to assess the greenness and resilience of automotive companies and the corresponding supply chain. An integrated assessment model is proposed based on green and resilient practices. The Delphi technique is used to obtain the weights of the supply chain paradigms that are the focus of the study and the corresponding practices. The application of the proposed index is then illustrated using a case study approach in the automotive supply chain; in particular the case study is focused in the link supplier/manufacturer. The case study findings confirm the applicability of this index in a real-world supply chain and highlight its managerial implications. The results show that the resilient paradigm is considered to be the one that contributes more to the competitiveness of the automotive supply chain. The green practice identified as the most important to the greenness of this industry is to reduce energy consumption. The significant contributions to resilience are sourcing strategies that allow switching of suppliers, flexible supply base/flexible sourcing and creating total supply chain visibility. The proposed index was developed in the context of automotive sector; this constitutes an initial effort to close the gap between theory and practice. Future research is needed to investigate the index applicability in different industry contexts.
Integrating Delphi and participatory backcasting in pursuit of trustworthiness - The case of electric mobility in Germany
2012, Technological Forecasting and Social Change
Citation Excerpt :
Furthermore, the comments that were entered into the system were updated on a continuous basis. During a comparison of several other participative methods to validate the Delphi findings, such as individual interviews, group interviews (e.g. focus groups) and nominal group techniques, Van Dijk [101] found out that the panel members provided most answers and arguments in the individual interviews. According to Van Dijk, this might enhance the credibility of the research particularly in Delphi studies, since more perspectives are brought into the research.
Backcasting is an established approach to assess the creation and realisation of desirable futures, being especially suitable for complex issues where a radical change is required. A variety of methods is used to execute backcasting exercises with broad stakeholder participation. However, due to certain group inefficiencies it is a challenge to execute backcasting exercises in a participatory and yet rigorous and trustworthy way. We present an innovative participatory backcasting approach, integrating a Delphi survey and semi-structured interviews for electric mobility in Germany. As a major contribution, we demonstrate how to increase trustworthiness in participatory backcasting, by allowing for continuous stakeholder participation in a structured and transparent manner: from the creation of a preferable future to the assessment of the major factors leading to this future. The results illustrate a future vision of electric mobility in Germany in the year 2030 and present a discussion of the major factors leading to this desirable future. In addition to presenting the major benefits of our approach by integrating Delphi and participatory backcasting, we also outline the challenges related to this approach, such as difficulties in developing detailed roadmaps or the limited inclusion of end-users as major stakeholders.

View all citing articles on Scopus

^∗: JAN A. G. M. VAN DIJK is at the Faculty of Social Sciences, State University, Utrecht, The Netherlands

View full text

Delphi questionnaires versus individual and group interviews: A comparison case

Abstract

Popularising Delphi Method, Developing an Instrument to Control Technological Change for Employees

Quality and Quantity

Delphi Method as a Learning Instrument: Bank Employees Discussing an Automation Project

Technological Forecasting and Social Change

Group Techniques for Program Planning: A Guide to Nominal Group and Delphi Processes

A Comparative Study of Differences in Subjective Likehood Estimates Made byIndividuals, Interacting Groups, Delphi Groups, and Nominal Groups

Organisational Behavior and Human Performance

Group Techniques for Idea Building

The Delphi Technique, an Experimental Evaluation

Technological Forecasting and Social Change

Group Decision Making and Effectiveness

The Policy Delphi