Abstract
After showing how Deborah Mayo’s error-statistical philosophy of science might be applied to address important questions about the evidential status of computer simulation results, I argue that an error-statistical perspective offers an interesting new way of thinking about computer simulation models and has the potential to significantly improve the practice of simulation model evaluation. Though intended primarily as a contribution to the epistemology of simulation, the analysis also serves to fill in details of Mayo’s epistemology of experiment.
Article PDF
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
References
Beck B. (2002). Model evaluation and performance. In: El-Shaarawi, A.H. and Piegorsch, W.W. (eds) Encyclopedia of environmetrics, pp 1275–1279. Wiley, Chichester
Berk R.A., Bickel P., Campbell K., Fovell R., Keller-McNulty S., Kelly E., Linn R., Park B., Perelson A., Rouphail N., Sacks J. and Schoenberg F. (2002). Workshop on statistical approaches for the evaluation of complex computer models. Statistical Science, 17: 173–192
IPCC (2007). In S. Solomon, D. Qin, M. Manning, Z. Chen, M. Marquis, K. B. Averyt, M. Tignor, & H. L. Miller (Eds.), Climate change 2007: The physical science basis. Contribution of working group I to the fourth assessment report of the intergovernmental panel on climate change. Cambridge: Cambridge University Press.
Mayo D. (1996). Error and the growth of experimental knowledge. University of Chicago Press, Chicago
Mayo, D. (2000). Experimental practice and an error statistical account of evidence. Philosophy of Science, 67(Supp), S193–S207.
Mayo D. (2005). Evidence as passing severe tests: Highly probable vs highly probed hypotheses. In: Achinstein, P. (eds) Scientific evidence: Philosophical theories and applications, pp 95–128. Johns Hopkins, Baltimore
Mayo D. and Spanos A. (2004). Methodology in practice: Statistical misspecification testing. Philosophy of Science, 71: 1007–1025
Nachamkin J.E. (2004). Mesoscale verification using meteorological composites. Monthly Weather Review, 132: 941–955
Oberkampf, W. L., Blottner, F. G., & Aeschliman, D. P. (1995). Methodology for computational fluid dynamics code verification/validation. AIAA Paper 1995–2226.
Oreskes N., Shrader-Frechette K. and Belitz K. (1994). Verification, validation, and confirmation of numerical models in the earth sciences. Science, 263: 641–646
Roache P.J. (1994). Perspective: A method for uniform reporting of grid refinement studies. Journal of Fluids Engineering, 116: 405–413
Roache P.J. (1997). Quantification of uncertainty in computational fluid dynamics. Annual Review of Fluid Mechanics, 29: 123–160
Roache P.J. (1998). Verification and validation in computational science and engineering. Albuquerque, Hermosa
Roache P.J. (2002). Code verification by the method of manufactured solutions. Journal of Fluids Engineering, 124(1): 4–10
Roache P.J. (2003). Conservatism of the grid convergence index in finite volume computations on steady-state fluid flow and heat transfer. Journal of Fluids Engineering, 125: 731–732
Roy C.J. (2005). Review of code and solution verification procedures for computational simulation. Journal of Computational Physics, 205: 131–156
Rykiel E.J. (1996). Testing ecological models: The meaning of validation. Ecological Modelling, 90: 229–244
Salari, K., & Knupp, P. (2000). Code verification by the method of manufactured solutions. Sandia Report SAND2000-1444.
Taylor A.A. and Leslie L.M. (2005). A single-station approach to model output statistics temperature forecast error assessment. Weather and Forecasting, 20(6): 1006–1020
Wilson R., Shao J. and Stern F. (2004). Discussion: Criticisms of the “Correction Factor” verification method. Journal of Fluids Engineering, 126: 704–706
Winsberg E. (1999a). Sanctioning models: The epistemology of simulation. Science in Context, 12: 275–292
Winsberg, E. (1999b). Simulation and the philosophy of science: Computationally intensive studies of complex physical systems. Dissertation, Indiana University.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Parker, W.S. Computer simulation through an error-statistical lens. Synthese 163, 371–384 (2008). https://doi.org/10.1007/s11229-007-9296-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11229-007-9296-0