Abstract
Several well-known statisticians regard significance testing as a deeply problematic procedure in statistical inference. Yet, in-depth discussion of null hypothesis significance testing (NHST) has largely been absent from the literature on organizations or, more specifically, management control systems. This article attempts to redress this oversight by drawing on neoinstitutional theory to frame, analyze, and explore the NHST problem. Regulative, normative, and cultural-cognitive forces partly explain the longevity of NHST in organization studies. The unintended negative consequences of NHST include a reinforcement of the academic-practitioner divide, an obstacle to the growth of knowledge, discouragement of study replications, and mechanization of researcher decision making. An appreciation of these institutional explanations for NHST as well as the harm caused by NHST may ultimately help researchers develop superior methodological alternatives to a controversial statistical technique.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Abelson, R. P. (1997). A retrospective on the significance test ban of 1999 (If there were no significance tests, they would be invented). In L. L. Harlow, S. A. Mulaik, & J. H. Steiger (Eds.), What if there were no significance tests? Mahwah: Erlbaum.
Abrahamson, E. (1996). Management fashion. The Academy of Management Review, 21(1), 254–285.
Adair, R. K. (1982). A physics editor comments on Peters and Ceci’s peer-review study. Behavioral and Brain Sciences, 5(2), 196.
Ahrens, T., & Chapman, C. S. (2007). Doing qualitative field research in management accounting: Positioning data to contribute to theory. In C. S. Chapman, A. G. Hopwood, & M. D. Shields (Eds.), Handbook of management accounting research (Vol. 1, pp. 299–318). Amsterdam: Elsevier.
Alkaraan, F., & Northcott, D. (2007). Strategic investment decision making: The influence of pre-decision control mechanisms. Qualitative Research in Accounting & Management, 4(2), 133–150.
Alvesson, M., & Deetz, S. (1996). Critical theory and postmodernism approaches to organization studies. In S. R. Clegg, C. Hardy, & W. R. Nord (Eds.), Handbook of organization studies (pp. 191–217). Thousand Oaks: Sage.
Anderson, D. R., Burnham, K. P., & Thompson, W. L. (2000). Null hypothesis testing: Problems, prevalence, and an alternative. The Journal of Wildlife Management, 64, 912–923.
Bakan, D. (1966). The test of significance in psychological research. Psychological Bulletin, 66, 423–437.
Barber, B. (1971). Resistance by scientists to scientific discovery. Science, 134(3479), 596–602.
Barnes, B., Bloor, D., & Henry, J. (1996). Scientific knowledge: A sociological analysis. Chicago: University of Chicago Press.
Baum, J. A. C. (1996). Organizational ecology. In S. R. Clegg, In C. Hardy, & W. R. Nord (Eds.), Handbook of organization studies (pp. 77–114). London: Sage.
Begg, C. B. (1994). Publication bias. In H. M. Cooper & L. V. Hedges (Eds.), The handbook of research synthesis (pp. 399–409). New York: Sage.
Berman, M. (1981). The reenchantment of the world. London: Cornell University Press.
Beyer, J. M., Chanove, R. G., & Fox, W. B. (1995). The review process and the fates of manuscripts submitted to AMJ. Academy of Management Journal, 38(5), 1219–1260.
Birnberg, J. G., Luft, J., & Shields, M. D. (2007). Psychology theory in management accounting research. In C. S. Chapman, A. G. Hopwood, & M. D. Shields (Eds.), Handbook of management accounting research (Vol. 1, pp. 113–136). Amsterdam: Elsevier
Bloor, D. (1991). Knowledge and social imagery (2nd edn.). Chicago: University of Chicago Press.
Boje, D. M., Gephart, R. P. Jr., & Thatchenkery, T. J. (1996). Postmodern management and organization theory. Thousand Oaks: Sage.
Boxall, P., & Purcell, J. (2003). Strategy and human resource management. New York: Palgrave Macmillan.
Bromwich, M. (2007). Economics in management accounting. In C. S. Chapman, A. G. Hopwood, & M. D. Shields (Eds.), Handbook of management accounting research (Vol. 1, pp. 137–162). Amsterdam: Elsevier.
Brooks, D. (2004). The CIA: Method and madness. New York Times online, February 2.
Brown, J. R. (2001). Who rules in science? An opinionated guide to the wars. Cambridge: Harvard University Press.
Brown, R. H., & Malone, E. L. (2004). Reason, politics, and the politics of truth: How science is both autonomous and dependent. Sociological Theory, 22(1), 106–122.
Burawoy, M. (1990). Marxism as science. American Sociological Review, 55, 775–793.
Burrell, G. (1996). Normal science, paradigms, metaphors, discourses and genealogies of analysis. In S. R. Clegg, C. Hardy & W. R. Nord (Eds.), Handbook of organization studies (pp. 642–658). London: Sage.
Burrell, G., & Morgan, G. (1979). Sociological paradigms and organisational analysis. London: Heinemann.
Calas, M. B., & Smircich, L. (1999). Past postmodernism? Reflections and tentative directions. The Academy of Management Review, 24(4), 649–671.
Camic, C., & Wilson, F. D. (2003). Authors and reviewers: In appreciation. American Sociological Review, 68(6), iii–v.
Campbell, J. P. (1982). Editorial: Some remarks from the outgoing editor. Journal of Applied Psychology, 67, 691–700.
Carroll, G. R., & Hannan, M. T. (2000). The demography of corporations and industries. Princeton: Princeton University Press.
Carver, R. P. (1978). The case against statistical significance testing. Harvard Educational Review, 48, 378–399.
Chalmers, A. F. (1999). What is this thing called science? (3rd edn.). Indianapolis: Hackett.
Chenhall, R. H. (2003). Management control systems design within its organizational context: Findings from contingency-based research and directions for the future. Accounting, Organizations and Society, 28, 127–168.
Chenhall, R. H. (2007). Theorising contingencies in management control systems research. In C. S. Chapman, A. G. Hopwood, & M. D. Shields (Eds.), Handbook of management accounting research (Vol. 1, pp. 163–206). Amsterdam: Elsevier.
Chow, S. L. (1998). Précis of statistical significance: rationale, validity, and utility. Behavioral and Brain Sciences, 21(2), 169–239.
Chow, S. L. (2000). The Popperian framework, statistical significance, and rejection of chance. Behavioral and Brain Sciences, 23(2), 294–298.
Cohen, J. (1962). The statistical power of abnormal-social psychological research: A review. Journal of Abnormal and Social Psychology, 65, 145–153.
Cohen, J. (1965). Some statistical issues in psychological research. In D. D. Wolman (Ed.), Handbook of clinical psychology. New York: McGraw-Hill.
Cohen, J. (1988). Statistical power for the behavioral sciences (2nd edn.). Hillsdale: Erlbaum.
Cohen, B. P. (1989). Developing sociological knowledge: Theory and method (2nd edn.). Chicago: Nelson-Hall.
Cohen, J. (1990). Things I have learned (so far). The American Psychologist, 45, 1304–1312.
Cohen, J. (1992). A power primer. Psychological Bulletin, 112(1), 155–159.
Cohen, J. (1994). The Earth is round (p<0.05). The American Psychologist, 49, 997–1003.
Collins, H. M., & Pinch, T. J. (1982). Frames of meaning: The social construction of extraordinary science. London: Routledge & Kegan Paul.
Cortina, J. M., & Folger, R. G. (1998). When is it acceptable to accept a null hypothesis: No way, Jose? Organizational Research Methods, 1(3), 334–350.
Coursol, A., & Wagner, E. E. (1986). Effect of positive findings on submission and acceptance rates: A note on meta-analysis bias. Professional Psychology, 17, 136–137.
Creswell, J. W. (1998). Qualitative inquiry and research design: Choosing among five traditions. Thousand Oaks: Sage.
Creswell, J. W. (2003). Research design: Qualitative, quantitative, and mixed methods approaches. Thousand Oaks: Sage.
Crofts, K., & Bisman, J. (2010). Interrogating accountability: An illustration of the use of Leximancer software for qualitative data analysis. Qualitative Research in Accounting & Management, 7(2), 180–207.
Daston, L. (1992). Objectivity and the escape from perspective. Social Studies of Science, 22, 597–618.
Davila, T. (2000). An empirical study on the drivers of management control shystems’ design in new product development. Accounting, Organizations and Society, 25(4/5), 383–409.
Dawes, R. M. (1988). Rational choice in an uncertain world. Fort Worth: Harcourt Brace.
DiMaggio, P. J. (1995). Comments on “What theory is not”. Administrative Science Quarterly, 40(3), 391–397.
Donaldson, L. (1985). In defence of organization theory. Cambridge: Cambridge University Press.
Donaldson, L. (1995). American anti-management theories of organization: A critique of paradigm proliferation. Cambridge: Cambridge University Press.
Donaldson, L. (1996). For positivist organization theory: Proving the hard core. Thousand Oaks: Sage.
Donaldson, L. (2003). Organization theory as a positive science. In H. Tsoukas & C. Knudsen (Eds.), The Oxford handbook of organization theory: meta-theoretical perspectives (pp. 39–62). New York: Oxford University Press.
Dunnette, M. D. (1966). Fads, fashions, and folderol in psychology. The American Psychologist, 21, 343–352.
Farewell, V. T., Tom, B. D. M., & Royston, P. (2004). The impact of dichotomization on the efficiency of testing for an interaction effect in exponential family models. Journal of the American Statistical Association, 99(467), 822–831.
Feldman, S. P. (2004). The culture of objectivity: Quantification, uncertainty, and the evaluation of risk at NASA. Human Relations, 57(6), 691–718.
Ferraro, F., Pfeffer, J., & Sutton, R. I. (2005). Economics language and assumptions: How theories can become self-fulfilling. The Academy of Management Review, 30(1), 8–24.
Feyerabend, P. K. (1975). Against method: Outline of an anarchistic theory of knowledge. London: New Left Books.
Fidler, F., Cumming, G., Burgman, M., & Thomason, N. (2004). Statistical reform in medicine, psychology and ecology. The Journal of Socio-Economics, 33, 615–630.
Finch, S., Cumming, G., & Thomason, N. (2001). Reporting of statistical significance in the Journal of Applied Psychology: Little evidence of reform. Educational and Psychological Measurement, 61(2), 181–210.
Fisher, R. A. (1935). The design of experiments. Edinburgh: Oliver & Boyd.
Fuchs, S. (2001). What makes “sciences” scientific. In J. H. Turner (Ed.), Handbook of sociological theory (pp. 21–35). New York: Kluwer Academic/Plenum.
Gans, J. S., & Shepherd, G. B. (1994). How are the mighty fallen: Rejected classic articles by leading economists. Journal of Economic Perspectives, 8, 165–179.
Gephart, R. P. Jr. (1986). Deconstructing the defense for quantification in social science: A content analysis of journal articles on the parametric strategy. Qualitative Sociology, 9, 126–144.
Gephart, R. P., Jr. (1988). Ethnostatistics: Qualitative foundations for quantitative research. Newbury Park: Sage.
Gephart, R. P., Boje, D. M., & Thatchenkery, T. J. (1996). Postmodern management and the coming crises of organizational analysis. In D. M. Boje, R. P. Gephart Jr., & T. J. Thatchenkery (Eds.), Postmodern management and organization theory (pp. 1–18). Thousand Oaks: Sage.
Gergen, K. J. (2001). Psychological science in a postmodern context. The American Psychologist, 56(10), 803–813.
Ghoshal, S. (2005). Bad management theories are destroying good management practices. Academy of Management Learning & Education, 4(1), 75–91.
Gigerenzer, G. (1993). The superego, the ego, and the id in statistical reasoning. In G. Keren & C. Lewis (Eds.), A handbook for data analysis in the behavioral sciences, Vol 1: Methodological issues (pp. 311–339). Hillsdale: Erlbaum.
Gigerenzer, G. (1998). We need statistical thinking, not statistical rituals. Behavioral and Brain Sciences, 21, 199–200.
Gigerenzer, G. (2004). Mindless statistics. The Journal of Socio-Economics, 33, 587–606.
Gliner, J. A., Leech, N. L., & Morgan, G. A. (2002). Problems with null hypothesis significance testing (NHST): What do the textbooks say? The Journal of Experimental Education, 71(1), 83–92.
Goldstone, J. A. (2004). Response: Reasoning about history, sociologically. Sociological Methodology, 34, 35–61.
Gorski, P. S. (2004). The poverty of deductivism: A constructive realist model of sociological explanation. Sociological Methodology, 34, 1–33.
Gujarati, D. N. (1988). Basic econometrics (2nd edn.). New York: McGraw-Hill.
Guttman, L. (1985). The illogic of statistical inference for cumulative science. Applied Stochastic Models and Data Analysis, 1, 3–10.
Hacking, I. (1965). The logic of statistical inference. Cambridge: Cambridge University Press.
Hagen, R. L. (1997). In praise of the null hypothesis statistical test. The American Psychologist, 52, 15–24.
Harlow, L. L., Mulaik, S. A., & Steiger, J. H. (1997). What if there were no significance tests? Mahwah: Erlbaum.
Hedges, L. V. (1987). How hard is hard science, how soft is soft science? The empirical cumulativeness of research. The American Psychologist, 42(2), 443–455.
Hedges, L. V., & Olkin, I. (1980). Vote-counting methods in research synthesis. Psychological Bulletin, 88, 359–369.
Hempel, C. G. (1965). Aspects of scientific explanation and other essays in the philosophy of science. New York: Free Press.
Hesford, J. W., Lee, S.-H., Van der Stede, W. A., & Young, S. M. (2007). Management accounting: a bibliographic study. In C. S. Chapman, A. G. Hopwood, & M. D. Shields (Eds.), Handbook of management accounting research (Vol. 1, pp. 3–26). Amsterdam: Elsevier.
Hill, T. L. (2003). Null hypothesis significance testing, the file drawer problem, and intercessory prayer: a Bayesian analysis of the effect (or effectiveness) of each. Dissertation Abstracts International B, 63(7-B). Accessed April 19.
Hilmer, F. G., & Donaldson, L. (1996). Management redeemed: Debunking the fads that undermine corporate performance. East Roseville: Free Press Australia.
Hoffman, A. J. (1997). From heresy to dogma: An institutional history of corporate environmentalism. San Francisco: Lexington.
Hofmann, S. G. (2002). Fisher’s fallacy and NHST’s flawed logic. The American Psychologist, 57(1), 69–70.
Hogben, L. F. R. S. (1968). Statistical methods. New York: Norton.
Hubbard, R., Parsa, A. R., & Luthy, M. R. (1997). The spread of statistical significance testing: The case of the Journal of Applied Psychology. Theory & Psychology, 7, 545–554.
Hunter, J. E. (1997). Needed: A ban on the significance test. Psychological Science, 8(1), 3–7.
Hunter, J. E., & Schmidt, F. L. (2004). Methods of meta-analysis: Correcting error and bias in research findings (2nd edn.). Thousand Oaks: Sage.
Jackson, N., & Carter, P. (1993). ‘Paradigm wars’: A response to Hugh Willmott. Organization Studies, 14(5), 727–730.
Jepperson, R. L. (1991). Institutions, institutional effects, and institutionalism. In W. W. Powell & P. J. DiMaggio (Eds.), The new institutionalism in organizational analysis (pp. 143–163). Chicago: University of Chicago Press.
Kabanoff, B. (1996). Computers can read as well as count: How computer-aided text analysis can benefit organisational research. In Journal of Organizational Behavior (1986–1998) (pp. 1–20). London: Chichester.
Kaplan, A. (1964). The conduct of inquiry. San Francisco: Chandler.
Kaufman, A. S. (1998). Introduction to the special issue on statistical significance testing. Research in the Schools, 5, 1.
Kilduff, M., & Mehra, A. (1997). Postmodernism and organizational research. The Academy of Management Review, 22(2), 453–481.
Kincaid, H. (1996). Philosophical foundations of the social sciences. New York: Cambridge University Press.
Kirk, R. E. (1996). Practical significance: A concept whose time has come. Educational and Psychological Measurement, 56, 746–759.
Kline, R. B. (2004). Beyond significance testing: Reforming data analysis methods in behavioral research. Washington: APA.
Kmetz, J. L. (1998). The information processing theory of organization. Aldershot: Ashgate.
Knorr-Cetina, K. D. (1999). Epistemic cultures: How the sciences make knowledge. Cambridge: Harvard University Press.
Krueger, J. (2001). Null hypothesis significance testing: On the survival of a flawed method. The American Psychologist, 56(1), 16–26.
Kuhn, T. S. (1970). The structure of scientific revolutions (2nd edn.). Chicago: University of Chicago Press.
Labovitz, S. (1972). Statistical usage in sociology: Sacred cows and rituals. Sociological Methods & Research, 1(1), 13–37.
Laing, R. D. (1959). The divided self. London: Tavistock.
Lakatos, I. (1970). Falsification and the methodology of scientific research programmes. In I. Lakatos, & A. Musgrave (Eds.), Criticism and the growth of knowledge. Cambridge: Cambridge University Press.
Lambert, R. A. (2007). Agency theory and management accounting. In C. S. Chapman, A. G. Hopwood, & M. D. Shields (Eds.), Handbook of management accounting research (Vol. 1, pp. 247–268). Amsterdam: Elsevier.
Larsen, K. R., & Monarchi, D. E. (2004). A mathematical approach to categorization and labeling of qualitative data: The latent categorization method. Sociological Methodology, 34, 349–392.
Latour, B., & Woolgar, S. (1986). Laboratory life: The construction of scientific facts (2nd edn.). Princeton: Princeton University Press.
Lazarus, D. (1982). Interrater agreement and acceptance rates in physics. Behavioral and Brain Sciences, 5(2), 219.
Leamer, E. (1983). Let’s take the con out of econometrics. American Economic Review, 73, 31–43.
Lecoutre, M.-P., Poitevineau, J., & Lecoutre, B. (2003). Even statisticians are not immune to misinterpretations of Null Hypothesis Tests. International Journal of Psychology, 38(1), 37–45.
Lewis, M. C., & Grimes, A. J. (1999). Metatriangulation: Building theory from multiple paradigms. The Academy of Management Review, 24(4), 672–690.
Light, R. J., & Smith, P. V. (1971). Accumulating evidence: Procedures for resolving contradictions among different research studies. Harvard Educational Review, 41, 429–471.
Lindblom, C. E. (1987). Alternatives to validity: Some thoughts suggested by Campbell’s guidelines. Knowledge: Creation, Diffusion, Utilization, 8, 509–520.
Locke, E. A., & Becker, T. E. (1998a). Objectivism’s answer to the sad, old world of subjectivism. The Academy of Management Review, 23(4), 658–659.
Locke, E. A., & Becker, T. E. (1998b). Rebuttal to a subjectivist critique of an objectivist approach to integrity in organizations. The Academy of Management Review, 23, 170–175.
Luhmann, N. (1990). Die Wissenschaft der Gesellschaft. Frankfurt am Main: Suhrkamp.
Lynch, M. (1993). Scientific practice and ordinary action: Ethnomethodology and social studies of science. Cambridge: Cambridge University Press.
Lynne, G. D. (1999). Divided self models of the socioeconomic person: The metaeconomics approach. The Journal of Socio-Economics, 28(3), 267–288.
MacKenzie, D. A. (1981). Statistics in Britain, 1865–1930: The social construction of scientific knowledge. Edinburgh: Edinburgh University Press.
Mahoney, M. J. (1976). Scientist as subject: The psychological imperative. Cambridge: Ballinger.
Malgady, R. G. (2000). Myths about the null hypothesis and paths to reform. In R. H. Dana (Ed.), Handbook of cross-cultural and multicultural personality assessment (pp. 49–62). Mahwah: Lawrence Erlbaum.
McCloskey, D. N. (1998). The rhetoric of economics (2nd edn.). Madison: University of Wisconsin Press.
McGuire, W. J. (1983). A contextualist theory of knowledge: Its implications for innovation and reform in psychological research. In L. Berkowitz (Ed.), Advances in experimental social psychology (pp. 1–47). Orlando: Academic Press.
McNemar, Q. (1960). At random: Sense and nonsense. The American Psychologist, 15, 295–300.
McSwite, O. C. (1997). Legitimacy in public administration: A discourse analysis. Advances in public administration. Thousand Oaks: Sage.
Meehl, P. E. (1990). Why summaries of research on psychological theories are often uninterpretable. Psychological Reports, 66, 195–244. Monograph Suppl. 1-V66.
Meehl, P. E. (1997). The problem is epistemology, not statistics: Replace significance tests by confidence intervals and quantify accuracy of risky numerical predictors. In L. L. Harlow, S. A. Mulaik, & J. H. Steiger (Eds.), What if there were no significance tests? Mahwah: Erlbaum.
Meyer, J. W., & Rowan, B. (1977). Institutionalized organizations: Formal structure as myth and ceremony. American Journal of Sociology, 83, 340–363.
Meyer, J. W., & Scott, W. R. (1983). Organizational environments: Ritual and rationality. Beverly Hills: Sage.
Miller, P. (2007). Management accounting and sociology. In C. S. Chapman, A. G. Hopwood, & M. D. Shields (Eds.), Handbook of management accounting research (pp. 285–295). Amsterdam: Elsevier.
Miner, J. B. (2003). The rated importance scientific validity, and practical usefulness of organizational behavior theories: A quantitative review. Academy of Management Learning & Education, 2(3), 250–268.
Mirchandani, R. (2005). Postmodernism and sociology: From the epistemological to the empirical. Sociological Theory, 23(1), 86–115.
Morris, M. W., Leung, K., Ames, D., & Lickel, B. (1999). Views from inside and outside: Integrating emic and etic insights about culture and justice judgment. The Academy of Management Review, 24(4), 781–796.
Morrison, D. E., & Henkel, R. E. (1970). The significance test controversy: A reader. Chicago: Aldine.
Nagel, T. (1986). The view from nowhere. Oxford: Oxford University Press.
Nelson, N., Rosenthal, R., & Rosnow, R. L. (1986). Interpretation of significance levels and effect sizes by psychological researchers. The American Psychologist, 41, 1299–1301.
Nelson, J. S., Megill, A., & McCloskey, D. N. (1987). Rhetoric of inquiry. In J. S. Nelson, A. Megill, & D. N. McCloskey (Eds.), The rhetoric of the human sciences: Language and argument in scholarship and public affairs (pp. 3–18). Madison: University of Wisconsin Press.
Nicholson, N. (1997). Evolutionary psychology: Toward a new view of human nature and organizational society. Human Relations, 50(9), 1053–1078.
Nickerson, R. S. (2000). Null hypothesis significance testing: A review of an old and continuing controversy. Psychological Methods, 5(2), 241–301.
Nola, R. (2003). Rescuing reason: A critique of anti-rationalist views of science and knowledge. Boston: Kluwer Academic.
Nunnally, J. C. Jr. (1960). The place of statistics in psychology. Educational and Psychological Measurement, 20, 641–650.
Nunnally, J. C. Jr. (1975). Introduction to statistics for psychology and education. New York: McGraw-Hill.
Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3rd edn.). New York: McGraw-Hill.
Oakes, M. L. (1986). Statistical inference: A commentary for the social and behavioral sciences. New York: Wiley.
Oliver, C. (1991). Strategic responses to institutional processes. The Academy of Management Review, 16, 145–179.
Orlitzky, M. (2011). Institutional logics in the study of organizations: The social construction of the relationship between corporate social and financial performance. Business Ethics Quarterly, 21(3), 409–444.
Orlitzky, M., & Benjamin, J. D. (2001). Corporate social performance and firm risk: A meta-analytic review. Business & Society, 40(4), 369–396.
Orlitzky, M., & Benjamin, J. D. (2003). The effects of sex composition on small-group performance in a business school case competition. Academy of Management Learning & Education, 2(2), 128–138.
Orlitzky, M., Schmidt, F. L., & Rynes, S. L. (2003). Corporate social and financial performance: A meta-analysis. Organization Studies, 24(3), 403–441.
Park, S. H., & Gordon, M. E. (1996). Publication records and tenure decisions in the field of Strategic Management. Strategic Management Journal, 17, 109–128.
Pearce, J. L. (2004). Presidential address: What do we know and how do we really know it? The Academy of Management Review, 29(2), 175–179.
Pedhazur, E. J., & Schmelkin, L. P. (1991). Measurement, design, and analysis: An integrated approach. Hillsdale: Erlbaum.
Peters, D. P., & Ceci, S. (1982). Peer-review practices of psychological journals: The fate of published articles, submitted again. Behavioral and Brain Sciences, 5, 187–195.
Pfeffer, J. (1993). Barriers to the advance of organizational science: Paradigm development as a dependent variable. The Academy of Management Review, 18(4), 599–620.
Pfeffer, J., & Sutton, R. I. (2006). Hard facts, dangerous half-truths, and total nonsense: Profiting from evidence-based management. Boston: Harvard Business School Press.
Platt, J. R. (1964). Strong inference. Science, 146, 347–353.
Popper, K. R. (1962). The open society and its enemies: Volume II: The high tide of prophesy: Hegel, Marx, and the aftermath. London: Routledge & Kegan Paul.
Popper, K. R. (1969). Conjectures and refutations. London: Routledge.
Popper, K. R. (1972). The logic of scientific discovery. London: Hutchinson.
Popper, K. R. (1983). Realism and the aim of science. London: Hutchinson.
Porter, T. M. (1992). Quantification and the accounting ideal in science. Social Studies of Science, 22, 633–652.
Powell, T. C. (2001). Competitive advantage: Logical and philosophical considerations. Strategic Management Journal, 22, 875–888.
Priem, R. L., & Butler, J. E. (2001). Is the resource-based “view” a useful perspective for strategic management research? The Academy of Management Review, 26, 22–40.
Reed, M. (1990). From paradigms to images: The paradigm warrior turns post-modernist guru. Personnel Review, 19(3), 35–40.
Rindskopf, D. M. (1997). Testing “small,” not null, hypotheses: Classical and Bayesian approaches. In L. L. Harlow, S. A. Mulaik, & J. H. Steiger (Eds.), What if there were no significance tests? (pp. 319–332). Hillsdale: Erlbaum.
Rodgers, J. L. (2010). The epistemology of mathematical and statistical modeling: A quiet methodological revolution. The American Psychologist, 65(1), 1–12.
Rorty, R. (1989). Contingency, irony, and solidarity. New York: Cambridge University Press.
Rorty, R. (1991). Objectivity, relativism, and truth: Philosophical papers, Vol. I. Cambridge: Cambridge University Press.
Rorty, R. (1997). Truth, politics, and post-modernism. Assen: Van Gorcum.
Rosenau, P. M. (1992). Post-modernism and the social sciences: Insights, inroads, and intrusions. Princeton: Princeton University Press.
Rosnow, R. L., & Rosenthal, R. (1989). Statistical procedures and the justification of knowledge in psychological science. The American Psychologist, 44, 1276–1284.
Royall, R. (1997). Statistical evidence—a likelihood paradigm. London: Chapman & Hall.
Rozeboom, W. W. (1997). Good science is abductive, not hypothetico-deductive. In L. L. Harlow, S. A. Mulaik, & J. H. Steiger (Eds.), What if there were no significance tests? (pp. 335–391). Hillsdale: Erlbaum.
Rynes, S. L., Bartunek, J. M., & Daft, R. L. (2001). Across the great divide: Knowledge creation and transfer between practitioners and academics. Academy of Management Journal, 44(2), 340–355.
Sastry, M. A. (1997). Problems and paradoxes in a model of punctuated organizational change. Administrative Science Quarterly, 42, 237–275.
Scandura, T. A., & Williams, E. A. (2000). Research methodology in management: Current practices, trends, and implications for future research. Academy of Management Journal, 43, 1248–1264.
Schmidt, F. L. (1992). What do data really mean? Research findings, meta-analysis, and cumulative knowledge in psychology. The American Psychologist, 47, 1173–1181.
Schmidt, F. L. (1996). Statistical significance testing and cumulative knowledge in psychology: Implications for training and researchers. Psychological Methods, 1, 115–129.
Schmidt, F. L., & Hunter, J. E. (1997). Eight common but false objections to the discontinuation of significance testing in the analysis of research data. In L. L. Harlow, S. A. Mulaik, & J. H. Steiger (Eds.), What if there were no significance tests? (pp. 37–64). Hillsdale: Erlbaum.
Schmidt, F. L., & Hunter, J. E. (2002). Are there benefits from NHST? The American Psychologist, 57(1), 65–66.
Schmidt, F. L., Hunter, J. E., & Urry, V. E. (1976). Statistical power in criterion-related validity studies. Journal of Applied Psychology, 61, 473–485.
Schofer, E. (2004). Cross-national differences in the expansion of science, 1970–1990. Social Forces, 83(1), 215–248.
Schwab, D. P. (1999). Research methods for organizational studies. Mahwah: Erlbaum.
Schwab, A., & Starbuck, W. H. (2009). Null-hypothesis significance tests in behavioral and management research: We can do better. Research Methodology in Strategy and Management, 5, 29–54.
Scott, W. R. (1994). Institutions and organizations: Toward a theoretical synthesis. In W. R. Scott & J. W. Meyer (Eds.), Institutional environments and organizations: Structural complexity and individualism (pp. 55–80). Thousand Oaks: Sage.
Scott, W. R. (1995). Institutions and organizations. Thousand Oaks: Sage.
Scott, W. R. (2001). Institutions and organizations (2nd edn.). Thousand Oaks: Sage.
Sedlmeier, P., & Gigerenzer, G. (1989). Do studies of statistical power have an effect on the power of studies? Psychological Bulletin, 105, 309–316.
Seth, A., Carlson, K. D., Hatfield, D. E., & Lan, H.-W. (2009). So what? Beyond statistical significance to substantive significance in strategy research. Research Methodology in Strategy and Management, 5, 3–28.
Shapin, S. (1994). A social history of truth: Civility and science in seventeenth-century England. Chicago: University of Chicago Press.
Shapin, S., & Schaffer, S. (1985). Leviathan and the air-pump: Hobbes, Boyle and the experimental life. Princeton: Princeton University Press.
Shaver, J. P., & Norton, R. S. (1980). Randomness and replication in ten years of the American Educational Research Journal. Educational Researcher, 9, 9–15.
Sober, E. (2005). Is drift a serious alternative to natural selection as an explanation of complex adaptive traits? Royal Institute of Philosophy Supplement, 56, 125–154.
Steiger, J. H. (1990). Structural model evaluation and modification: An interval estimation approach. Multivariate Behavioral Research, 25, 173–180.
Stinchcombe, A. L. (1965). Social structure and organizations. In J. G. March (Ed.), Handbook of organizations (pp. 142–193). Chicago: Rand McNally.
Stinchcombe, A. L. (1968). Constructing social theories. Chicago: University of Chicago Press.
Suchman, M. C. (1995). Managing legitimacy: Strategic and institutional approaches. The Academy of Management Review, 20, 571–610.
Sutton, R. I., & Staw, B. M. (1995). What theory is not. Administrative Science Quarterly, 40, 371–384.
Tashakkori, A., & Teddlie, C. (1998). Mixed methodology: Combining qualitative and quantitative approaches. Thousand Oaks: Sage.
Tashakkori, A., & Teddlie, C. (2002). Handbook of mixed methods in the social and behavioral sciences. Thousand Oaks: Sage.
Thompson, P. (1993). Postmodernism: Fatal distraction. In J. Hassard & M. Parker (Eds.), Postmodernism and organizations (pp. 183–203). Thousand Oaks: Sage.
Tracey, T. J. G. (2000). Issues in the analysis and interpretation of quantitative data: Deinstitutionalization of the null hypothesis test. In S. D. Brown & R. W. Lent (Eds.) Handbook of counseling psychology (3nd edn.) (pp. 177–198). New York: Wiley.
Tsang, E. W. K., & Kwan, K.-M. (1999). Replication and theory development in organizational science: A critical realist perspective. The Academy of Management Review, 24(4), 759–780.
Tsoukas, H., & Knudsen, C. (2003). Introduction: The need for meta-theoretical reflection in organization theory. In H. Tsoukas & C. Knudsen (Eds.), The Oxford handbook of organization theory: Meta-theoretical perspectives (pp. 1–36). Oxford: Oxford University Press.
Turner, J. H. (2002). Face-to-face: Towards a sociological theory of interpersonal behavior. Stanford: Stanford University Press.
Tversky, A., & Kahneman, D. (1974). Judgment under uncertainty: Heuristics and biases. Science, 185, 1124–1131.
Van Maanen, J. (1988). Tales of the field: On writing ethnography. Chicago: University of Chicago Press.
Van Maanen, J. (1995a). Fear and loathing in organization studies. Organization Science, 6(6), 687–692.
Van Maanen, J. (1995b). Style as theory. Organization Science, 6(1), 133–143.
Van Maanen, J. (1998a). Different strokes: Qualitative research in the Administrative Science Quarterly from 1956–1996. In J. E. Van Maanen (Ed.), Qualitative studies of organizations (pp. ix–xxxii). Thousand Oaks: Sage.
Van Maanen, J. E. (1998b). Qualitative studies of organizations. Thousand Oaks: Sage.
Wainer, H. (1999). One cheer for null hypothesis significance testing. Psychological Methods, 4(2), 212–213.
Weick, K. E. (1977). Editorial note. Administrative Science Quarterly, 22, 138–139.
Weick, K. E. (1989). Theory construction as disciplined imagination. The Academy of Management Review, 14, 516–531.
Weick, K. E. (1995). What theory is not, theorizing is. Administrative Science Quarterly, 40(3), 385–390.
Weick, K. E. (1996). Drop your tools: An allegory for organizational studies. Administrative Science Quarterly, 41, 301–313.
Weick, K. E. (2001). Making sense of the organization. Malden: Blackwell.
Ziliak, S. T., & McCloskey, D. N. (2008). The cult of statistical significance: How the standard error costs us jobs, justice, and lives. Ann Arbor: University of Michigan Press.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Orlitzky, M. Institutionalized dualism: statistical significance testing as myth and ceremony. J Manag Control 22, 47–77 (2011). https://doi.org/10.1007/s00187-011-0126-7
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00187-011-0126-7