Abstract
The Delphi method has developed from a “classic” to a variety of Delphi methods or “types”, which can have very different functions and are used in different subject areas. Online variants, especially the Real-time Delphi with instant feedback are becoming more and more popular. This introduction explains the different definitions, types and fields of application and shows the most important points to consider when using one of the Delphi methods. Special attention should be paid to the participants and their different backgrounds and expertise as well as to the design of the “questionnaire”. For example, typical questions in a Delphi are about the importance or time horizon of realizing a statement about a future issue, e.g. a problem solution in the health care system, a technology, or an educational measure. The Delphi method will continue to have a place in the canon of methods used in Foresight and Futures Research as well as in general empirical research in various disciplines where uncertainty is an issue (e.g. business administration). The method will be integrated more and more into overall processes and is a building block in the method mix of futures sciences, e.g. coupled with scenarios.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
- 2.
This phenomenon is also found in the very simple horoscopes (e.g. in magazines): The person who believes in the horoscope behaves accordingly and thus makes the event possible in the first place. The other possibility is that the horoscope is formulated so broadly that subjectively one of the individual events is true in any case.
- 3.
- 4.
Dalkey and Campbell have demonstrated that without the preservation of anonymity after the discussion, the result is not as accurate as the average opinion of the participants in the discussion before the discussion, Dalkey (1968).
- 5.
- 6.
The Japanese national Delphi of the NISTEP, for example, was for the first time conducted online in the tenth edition (published in 2015). 5 years earlier, the paper questionnaire had still been used.
- 7.
On the function of the brain, e.g. Burnett (2016).
- 8.
For examples from the BOHEMIA project, see Andreescu et al. (2017).
Literature
Aengenheyster, S., Cuhls, K., Gerhold, L., Heiskanen-Schüttler, M., Huck, J., & Muszynskae, M. (2017). Real-time Delphi in practice – A comparative analysis of existing software-based tools. Technological Forecasting and Social Change https://doi.org/10.1016/j.techfore.2017.01.023.
Aichholzer, G. (2002). Das ExpertInnen-Delphi: Methodische Grundlagen und Anwendungsfeld Technology Foresight. In A. Bogner, B. Littig, & W. Menz (Hrsg.), Das Experteninterview (p. 133–153). VS Verlag. https://doi.org/10.1007/978-3-322-93270-9_6.
Andreescu, L., et al. or European Commission (2017). New horizons: Data from a Delphi survey in support of European Union future policies in research and innovation (Report KI-06-17-345-EN-N). 10.2777/654172 or https://ec.europa.eu/research/foresight/index.cfm. Accessed 28 April 2018.
Andronicos, M. (1983). Delphi.
Aschemann-Witzel, J., Perez-Cueto, F. J. A., Niedzwiedzka, B., Verbeke, W., & Bech-Larsen, T. (2012). Transferability of private food marketing success factors to public food and health policy: An expert Delphi survey. Food Policy, 37(2012), 650–660.
Bardecki, M. J. (1984). Participant’s response to the Delphi method: An attitudinal perspective. Technological Forecasting and Social Change, 25, 281–292.
Becker, D. (1974). Analyse der Delphi-Methode und Ansätze zu ihrer optimalen Gestaltung. Dissertation, Mannheim.
Berg, J., Forsythe, E. R., Nelson, F., & Rietz, T. A. (2000). Results from a dozen years of election futures markets research. College of Business Administration, University of Iowa. http://www.biz.uiowa.edu/iem/archive/BFNR_2000.pdf. Accessed 6 Sept 2011.
Bioeconomy Council. (2015). Global visions for the bioeconomy – An international Delphi-study, durchgeführt von K. Cuhls, V. Kayser, & S. Grandt. Fraunhofer ISI. http://gbs2015.com/fileadmin/gbs2015/Downloads/GBS2015_02_Delphi-Study.pdf. Accessed 29 Sept 2018.
Blind, K., & Cuhls, K. (2001). Der Einfluss der Expertise auf das Antwortverhalten in Delphi-Studien: Ein Hypothesentest. ZUMA-Nachrichten, 49, 57–80.
Blind, K., Cuhls, K., & Grupp, H. (2001). Personal attitudes in the assessment of the future of science and technology: A factor analysis approach. Technological Forecasting and Social Change, 68, 131–149.
Brockhoff, K. (1979). Delphi-Prognosen im Computer-Dialog. Experimentelle Erprobung und Auswertung kurzfristiger Prognosen. Mohr.
Bundesministerium für Forschung und Technologie (BMFT) (Ed.). (1993). Deutscher Delphi-Bericht zur Entwicklung von Wissenschaft und Technik. BMFT.
Burnett, D. (2016). Unser verrücktes Gehirn. C. Bertelsmann.
Cuhls, K. (1998). Technikvorausschau in Japan. Ein Rückblick auf 30 Jahre Delphi-Expertenbefragungen. Physica.
Cuhls, K. (2000). Opening up foresight processes. Économies et Sociétés, Série Dynamique technologique et Organisation, 5, 21–40.
Cuhls, K. (2003). From Forecasting to Foresight processes – New participative Foresight Activities in Germany. Cuhls, K. & Salo, Ahti (Hrsg.), Journal of Forecasting, Wiley Interscience, Special Issue, 22, 93–111.
Cuhls, K. (2009). Delphi-Befragungen in der Zukunftsforschung. In R. Popp & E. Schüll (Eds.), Zukunft und Forschung (Wissenschaftliche Schriftenreihe des Zentrums für Zukunftsstudien Salzburg): Bd.1. Zukunftsforschung und Zukunftsgestaltung. Beiträge aus Wissenschaft und Praxis. Springer.
Cuhls, K. (2012). Zu den Unterschieden zwischen Delphi-Befragungen und “einfachen” Zukunftsbefragungen. In R. Popp (Ed.), Wissenschaftliche Schriftenreihe Zukunft und Forschung des Zentrums für Zukunftsstudien Salzburg: Bd. 2. Zukunft und Wissenschaft: Wege und Irrwege der Zukunftsforschung (S. 139–159). Springer.
Cuhls, K. (2017). Unternehmensstrategische Auswertung von Foresight-Ergebnissen. In M. Möhrle & R. Isenmann (Eds.), Technologie-Roadmapping, VDI (pp. 47–62). Springer. https://doi.org/10.1007/978-3-662-52709-2_4.
Cuhls, K., & Möhrle, M. G. (2008). Unternehmensstrategische Auswertung der Delphi-Berichte. In M. G. Möhrle & R. Isenmann (Hrsg.), Technologie-Roadmapping, Zukunftsstrategien für Technologieunternehmen (3. Revised and extended edition. pp. 107–135). Springer.
Cuhls, K., Breiner, S., & Grupp, H. (1995). Delphi-Bericht 1995 zur Entwicklung von Wissenschaft und Technik – Mini-Delphi. Karlsruhe (Druck als Broschüre des BMBF, Bonn 1996).
Cuhls, K., Blind, K. & Grupp, H. (Hrsg.). (1998). Delphi ‘98 Umfrage. Zukunft nachgefragt. Studie zur globalen Entwicklung von Wissenschaft und Technik. Methoden- und Datenband, Karlsruhe. https://doi.org/10.13140/2.1.2412.8965.
Cuhls, K., Blind, K., & Grupp, H. (2002). Innovations for our future. Delphi ‘98: New foresight on science and technology. Technology, innovation and policy (Series of the Fraunhofer Institute for systems and innovation research ISI no. 13). Physica.
Cuhls, K., von Oertzen, J., & Kimpeler, S. (2007). Zukünftige Informationstechnologie für den Gesundheitsbereich. Ergebnisse einer Delphi-Befragung, FAZIT-Schriftenreihe. Stuttgart. https://www.fazit-forschung.de
Cuhls, K., van der Giessen, A., & Toivanen, H. (2015). Models of horizon scanning. How to integrate horizon scanning into European research and innovation policies. Report to the European Commission, Brussels, also: Cuhls, K. (2019). Horizon scanning in foresight – Why Horizon Scanning is only a part of the game. Futures and Foresight Science. https://doi.org/10.1002/ffo2.23.
Dalkey, N. C. (1967). Delphi. RAND Corporation. https://www.rand.org/content/dam/rand/pubs/papers/2006/P3704.pdf. Accessed 7 April 2019.
Dalkey, N. C. (1968). Predicting the future. Rand Corporation.
Dalkey, N. C. (1969a). Analyses from a group opinion study. Futures, 2(12), 541–551.
Dalkey, N. C. (1969b). The Delphi method: An experimental study of group opinion, prepared for United States Air Force Project Rand. Rand Corporation.
Dalkey, N. C., & Helmer, O. (1963). An experimental application of the Delphi-method to the use of experts. Management Science, 9, 458–467.
Dalkey, N. C., Brown, B., & Cochran, S. (1969). The Delphi method, III: Use of self ratings to improve group estimates. Rand Corporation.
de Loe, R. C., Melnychuk, N., Murray, D., & Plummer, R. (2016). Advancing the state of policy Delphi practice: A systematic review evaluating methodological evolution, innovation, and opportunities. Technological Forecasting and Social Change, 104, 78–88.
El-Chichakli, B., Braun, J., Barben, D., Lang, C., & Philip, J. (2016). Five cornerstones of a global bioeconomy. Nature, 535, 221–223.
European Commission/European Union. (2018). Transitions at the horizon: Perspectives for the European Union’s future research- and innovation-related policies. https://ec.europa.eu/info/research-and-innovation/strategy/support-policy-making/support-eu-research-and-innovation-policy-making/foresight/activities/current/bohemia_en
Festinger, L. (1978). Theorie der kognitiven Dissonanz. In M. Irle & V. Möntmann (Hrsg.), Verlag Hans Huber.
Friedewald, M., von Oertzen, J., & Cuhls, K. (2007). European perspectives on the information society: Delphi report. EPIS Deliverable 2.3.1. Fraunhofer ISI, Brussels: European Techno-Economic Policy Support Network (ETEPS). http://epis.jrc.es/documents/Deliverables/EPIS%202-3-1%20Delphi%20Report.pdf. Accessed 6 Sept 2011.
Gerhold, L., et al. (Eds.). (2015). Zukunft und Forschung: Bd. 4. Standards und Gütekriterien der Zukunftsforschung. Ein Handbuch der Wissenschaft und Praxis (S. 86–93). Springer.
Gheorghiu, R., Andreescu, L., & Curaj, A. (2014). Dynamic argumentative Delphi: Lessons learned from two large-scale foresight exercises. In Contribution to the 5th International Conference on Future-Oriented Technology Analysis (FTA) – Engage today to shape tomorrow, Brüssel (S. 27–28).
Gordon, T., & Pease, A. (2006). An efficient, RT Delphi: “Round-less” almost real time Delphi method. Technological Forecasting and Social Change, 73, 321–333.
Gordon, T. J., & Helmer, O. (1964). Report on a long-range forecasting study. Rand Corporation.
Grupp, H. (Ed.). (1995). Der Delphi-report (collaboration with S. Breiner & K. Cuhls). dva.
Häder, M. (2002). Delphi-Befragungen – Ein Arbeitsbuch. Springer.
Häder, M. (2009). Delphi-Befragungen – Ein Arbeitsbuch (Zweite Aufl.). Springer.
Häder, M. (2014). Delphi-Befragungen: Ein Arbeitsbuch (2. Aufl.). Springer.
Häder, M., & Häder, S. (1995). Delphi und Kognitionspsychologie: Ein Zugang zur theoretischen Fundierung der Delphi-Methode. ZUMA-Nachrichten, 37.
Hämäläinen, R. P. (2003). Decisionarium – Aiding decisions, negotiating and collecting. Journal of Multi-Criteria Decision Analysis, 12, 101–110. https://doi.org/10.1002/mcda.350
Helmer, O. (1966). Social technology. Rand Corporation.
Helmer, O. (1983). Looking forward. A guide to futures research. Sage.
Helmer, O., & Rescher, N. (1959). On the epistemology of the inexact sciences. Management Science, 6, 47–52.
Humphrey-Murto, S., Varpio, L., Wood, T. J., Gonsalves, C., Ufholz, L., Mascioli, K., Wang, C., & Foth, T. (2017). The use of the Delphi and other consensus group methods in medical education research: A review. Academic Medicine https://doi.org/10.1097/ACM.0000000000001812. Accessed 18 Jan 2018.
Kagaku Gijutsuchô Keikakukyoku (Hrsg.). (1971). Gijutsu Yosoku Hôkokusho (Bericht zur Technikvorausschau). Tôkyô.
Kanama, D., Kondo, A., & Yokoo, Y. (2008). Development of technology foresight: Integration of technology roadmapping and the Delphi method. International Journal of Technology Intelligence and Planning, 4(2), 184–200.
Keeney, S., Hasson, F., & McKenna, H. (2011). The Delphi technique in nursing and health research. Wiley-Blackwell.
Krüger, U. M. (1975). Die Antizipation und Verbreitung von Innovationen. Entwicklung und Anwendung eines kommunikations-strategischen Konzeptes unter besonderer Berücksichtigung der Delphi-Technik. Dissertation, Köln.
Kuwahara, T. (2001). Technology foresight in Japan: The potential and implications of DELPHI approach (NISTEP research material no. 77), S. 119–135.
Kuwan, H, Ulrich, J. G., & Westkamp, H. (1998). Die Entwicklung des Berufsbildungssystems bis zum Jahr 2020: Ergebnisse des Bildungs-Delphi 1997/98. BWP, 6, 3–8. http://www.forschungsnetzwerk.at/downloadpub/kuwan1998_bwp_06_1998.pdf. Accessed 29 Sept 2018.
Landeta, J. (2006). Current validity of the Delphi method in social sciences. Technological Forecasting and Social Change, 73, 467–482.
Linstone, H. A. (1998). Multiple perspectives revisited. In IAMOT conference, Orlando.
Linstone, H. A., & Mitroff, I. I. (1994). The challenge of the 21st century: Managing technology and ourselves in a shrinking world. State University of New York Press.
Linstone, H. A., & Turoff, M. (Eds.). (1975). The Delphi method: Techniques and applications. Addison Wesley/Advanced Book Program.
Luckner, S., Kratzer, F., & Weinhardt, C. (2005). Stoccer – A forecasting market for the FIFA World Cup 2006. In Proceedings of the 4th Workshop on e-Business (WeB 2005).
Maass, M. (1993). Das antike Delphi. Orakel, Schätze und Monumente. Wissenschaftliche Buchgesellschaft.
Miles, I., Green, L., & Popper, R. (Hrsg.). (2004). WP 4 futures forum, D4.2 Scenario methodology for foresight in the European research area, Fistera – Thematic network on foresight on information society technologies in the European research area. Manchester. http://fistera.jrc.ec.europa.eu/pages/latest.htm. Accessed 3 Dec 2010.
National Institute of Science and Technology Policy (NISTEP) (Hrsg.). (1997). The sixth technology forecast survey – Future technology in Japan toward the year 2025 (NISTEP report no. 52). Tokyo.
National Institute of Science and Technology Policy (NISTEP) (Hrsg.). (2005). Comprehensive analysis of science and technology benchmarking and foresight (NISTEP report no. 99). Tokyo.
National Institute of Science and Technology Policy (NISTEP) (Hrsg.). (2015). The 10th science and technology foresight (Report no. 164). Tokyo. http://data.nistep.go.jp/dspace/bitstream/11035/3079/2537/NISTEP-NR164-SummaryE.pdf
Nedeva, M., Georghiou, L., Loveridge, D., & Cameron, H. (1996). The use of co-nomination to identify expert participants for technology foresight. R&D Management, 26(2), 155–168.
Niederberger, M., & Renn, O. (2018). Das Gruppendelphi-Verfahren. Vom Konzept bis zur Anwendung. Springer.
Parke, H. W. (1956). The Delphic oracle. Blackwell.
Pill, J. (1971). The Delphi method: Substance, context, a critique and an annotated bibliography. Socio-Economic Planning Science, 5, 57–71.
Prognos, A. G., & Infratest Burke Sozialforschung. (1998). Delphi-Befragung 1996/1998 Potentiale und Dimensionen der Wissensgesellschaft – Auswirkungen auf Bildungsprozesse und Bildungsstrukturen. Integrierter Abschlussbericht. Selbstverlag.
Rowe, G., & Wright, G. (2011). The Delphi technique: Past, present, and future prospects – Introduction to the special issue. Technological Forecasting and Social Change, 78, 1487–1490.
Rowe, G., Wright, G., & McColl, A. (2005). Judgment change during Delphi-like procedures: The role of majority influence, expertise, and confidence. Technological Forecasting and Social Change, 72, 377–399.
Sackman, H. (1975). Delphi critique. Expert opinion, forecasting, and group process. Rand Corporation.
Salo, A., & Gustafsson, T. (2004). Group support system for foresight processes. International Journal of Foresight and Innovation Policy, 1(3–4), 249–269.
Schulz, M., & Renn, O. (Eds.). (2009). Das Gruppendelphi. Konzept und Fragebogenkonstruktion. VS Verlag.
Seeger, T. (1979). Die Delphi-Methode: Expertenbefragung zwischen Prognose und Gruppenmeinungsbildungsprozessen. Hochschul.
Seker, S. E. (2015). Computerized argument Delphi technique. IEEE Access. https://doi.org/10.1109/access.2015.2424703
Spann, M., & Skiera, B. (2004). Einsatzmöglichkeiten Virtueller Börsen in der Marktforschung. Zeitschrift für Betriebswirtschaft (ZfB), 74, 25–48.
Steinert, M. (2009). A dissensus based online Delphi approach: An explorative research tool. Technological Forecasting and Social Change, 76, 291–300.
Sternberg, E., Critchley, S., Gallagher, S., & Raman, V. V. (2011). A self-fulfilling prophecy: Linking belief to behavior. Annals of the New York Academy of Sciences, 1234(1), 83–97. https://doi.org/10.1111/j.1749-6632.2011.06184.x
Surowiecki, J. (2004). The wisdom of crowds. Anchor: Doubleday.
Trevelyan, E. G., & Robinson, N. (2015). Delphi methodology in health research: How to do it? European Journal of Integrative Medicine, 7, 423–428.
Turoff, M. (1970). The design of a policy Delphi. Technological Forecasting and Social Change, 2(2), 149–171.
Unauthored. (2017). Delphi. Whitepaper Delphi Markets. https://delphi.markets/whitepaper.pdf. Accessed 15 Feb 2018.
Weaver, J., Filson Moses, J., & Snyder, M. (2015). Self-fulfilling prophecies in ability settings. The Journal of Social Psychology. https://doi.org/10.1080/00224545.2015.1076761
Webler, T., Levine, D., Rakel, H., & Renn, O. (1991). The group Delphi: A novel attempt at reducing uncertainty. Technological Forecasting and Social Change, 39(3), 253–263.
Wechsler, W. (1978). Delphi-Methode, Gestaltung und Potential für betriebliche Prognoseprozesse (Schriftenreihe Wirtschaftswissenschaftliche Forschung und Entwicklung). Florentz.
Woudenberg, F. (1991). An evaluation of Delphi. Technological Forecasting and Social Change, 40(2), 131–150.
Zipfinger, S. (2007). Computer-aided Delphi – An experimental study of comparing round-based with real-time implementation of the method. Trauner.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Fachmedien Wiesbaden GmbH, part of Springer Nature
About this chapter
Cite this chapter
Cuhls, K. (2023). The Delphi Method: An Introduction. In: Niederberger, M., Renn, O. (eds) Delphi Methods In The Social And Health Sciences. Springer, Wiesbaden. https://doi.org/10.1007/978-3-658-38862-1_1
Download citation
DOI: https://doi.org/10.1007/978-3-658-38862-1_1
Published:
Publisher Name: Springer, Wiesbaden
Print ISBN: 978-3-658-38861-4
Online ISBN: 978-3-658-38862-1
eBook Packages: Social SciencesSocial Sciences (R0)