The Presence of Something or the Absence of Nothing: Increasing Theoretical Precision in Management Research

Organizational Research Methods - Tập 13 Số 4 - Trang 668-689 - 2010
Jeffrey R. Edwards1, James Berry1
1The Kenan-Flagler Business School, University of North Carolina at Chapel Hill, USA,

Tóm tắt

In management research, theory testing confronts a paradox described by Meehl in which designing studies with greater methodological rigor puts theories at less risk of falsification. This paradox exists because most management theories make predictions that are merely directional, such as stating that two variables will be positively or negatively related. As methodological rigor increases, the probability that an estimated effect will differ from zero likewise increases, and the likelihood of finding support for a directional prediction boils down to a coin toss. This paradox can be resolved by developing theories with greater precision, such that their propositions predict something more meaningful than deviations from zero. This article evaluates the precision of theories in management research, offers guidelines for making theories more precise, and discusses ways to overcome barriers to the pursuit of theoretical precision.

Từ khóa


Tài liệu tham khảo

10.1111/j.1467-9280.1997.tb00536.x

10.5465/AMR.2009.36982613

Aguinis, H., 2003, Regression analysis for categorical moderators

Aiken, L.A., 1991, Multiple regression: Testing and interpreting interactions

10.5465/amr.2007.26586822

10.2307/2094445

10.1037/0033-2909.103.3.411

10.5465/amr.1989.4308374

10.2307/2393203

10.1037/h0020412

10.1037/h0036653

10.1037/h0039657

10.1037/0003-066X.61.1.27

10.1002/9781118619179

10.1002/9780470743386

Carlson, K.D., Paper presented at the meeting of the Society for Industrial and Organizational Psychology

10.17763/haer.48.3.t490261645281841

10.1080/00220973.1993.10806591

10.1177/001872679204500105

Cohen, J., 1988, Statistical power analysis for the behavioral sciences, 2

10.1037/0003-066X.49.12.997

10.1037/1082-989X.2.2.161

10.1207/s15327906mbr1802_2

10.1037/0003-066X.42.2.145

10.5465/AMR.2007.24351453

10.1007/s11482-009-9062-1

Dubin, R., 1978, Theory building

10.5465/AMJ.2004.13405593

10.1002/job.529

Edwards, J.R. & Shipp, A.J. ( 2007). The relationship between person-environment fit and outcomes: An integrative theoretical framework. In C. Ostroff & T. A. Judge (Eds.), Perspectives on organizational fit (pp. 209-258). San Francisco, CA: Jossey-Bass.

10.2307/258557

10.1177/0959354395051004

Ferris, G.R., Bowen, M.G., Treadway, D.C., Hochwarter, W.A., Hall, A.T. & & Perrewé, P.L. (2006). The assumed linearity of organizational phenomena: Implications for occupational stress and well-being . In P. L. Perrewé & D. C. Ganster (Eds.), Research in occupational stress and well-being (Vol. 5, pp. 205-232). Oxford, UK: Elsevier Science Ltd.

10.1037/0021-9010.70.1.215

10.1146/annurev.so.06.080180.001155

10.1037/1082-989X.1.4.379

10.1177/0959354398082006

10.1016/j.socec.2004.09.033

10.1037/0021-9010.79.5.783

10.1016/S1053-4822(99)00004-2

10.1080/03637759109376240

10.5465/AMJ.2007.28166119

10.5465/AMR.2007.26586485

10.1177/1476127007077559

Hodges, J., 1954, Journal of the Royal Statistical Society, 16, 261, 10.1111/j.2517-6161.1954.tb00169.x

10.2466/pr0.1997.80.1.337

10.1002/(SICI)1097-0266(199803)19:3<243::AID-SMJ951>3.0.CO;2-0

Hulin, C. L., 2000, Computational modeling of behavior in organizations

10.4135/9781412985031

Jaccard, J., 1990, Interaction effects in multiple regression

10.1016/0749-5978(91)90043-S

10.1177/109442810034005

10.1037/0003-066X.61.1.42

10.1111/j.1744-6570.1981.tb00942.x

10.1177/0013164496056005002

10.1037/0003-066X.56.1.16

10.1017/CBO9780511621123.003

10.2307/270822

10.1023/A:1010080228107

10.5465/amr.1999.2553247

Lipsey, M.W., 1990, Design sensitivity: Statistical power for experimental research

Lipsey, M.W., 2000, Practical meta-analysis

10.1037/h0026141

10.1207/s15327906mbr2901_1

10.1037/0003-066X.40.1.29

10.1177/0170840609347055

McNemar, Q., 1962, Psychological statistics, 3

10.1086/288135

10.1037/0022-006X.46.4.806

10.1207/s15327965pli0102_1

10.2466/pr0.1990.66.1.195

Meehl, P.E. ( 1997). The problem is epistemology, not statistics: Replace significance tests by confidence intervals and quantify accuracy of risky numerical predictions. In L. L. Harlow , S. A. Mulaik & J. H. Steiger (Eds.), What if there were no significance tests? (pp. 391-423). Hillsdale, NJ: Lawrence Erlbaum.

10.1177/001316445101100101

Mulaik, S.A., Raju, N.S. & Harshman, R.A. (1997). There is a time and place for significance testing. In L. L. Harlow , S. A. Mulaik, & J. H. Steiger (Eds.), What if there were no significance tests? (pp. 65-116). Hillsdale, NJ: Erlbaum.

10.1037/0003-066X.45.3.403

Murphy, K.R., 2009, Statistical power analysis: A simple and general model for traditional and modern hypothesis tests, 3

10.1207/S15327043HUP1604_2

Neuliep, J.W. & Crandall, R. ( 1991). Editorial bias against replication research. In J. W. Neuliep (Ed.), Replication research in the social sciences (pp. 85-90). Newbury Park, CA : Sage.

10.1037/1082-989X.5.2.241

10.1006/obhd.1998.2750

Pedhazur, E.J., 1997, Multiple regression in behavioral research, 3

10.5465/amr.1999.2553249

Pfeffer, I., 1982, Organizations and organization theory

10.5465/amr.1993.9402210152

10.5465/AMJ.2007.28166117

10.1126/science.146.3642.347

10.5465/amr.1989.4308389

Popper, K.R., 1959, The logic of scientific discovery

10.5465/amr.1985.4278215

10.1037/a0018326

10.1037/0033-2909.86.3.638

Rotton, J., 1995, Journal of Social Behavior and Personality, 10, 1

10.1037/h0042040

Runkel, P.J., 1972, Research on human behavior: A systematic guide to method

10.1037/0003-066X.47.10.1173

10.1177/014662168601000101

10.1177/0013164496056004001

10.1037/0003-066X.51.10.1065

10.1080/00220973.1993.10806595

10.1037/0003-066X.40.1.73

10.1037/h0047060

10.1080/00401706.1977.10489581

10.1080/00223980.1995.9914982

Sterling, T.D., 1995, The American Statistician, 49, 108, 10.1080/00031305.1995.10476125

10.1177/004912417800600405

Sudman, S., 1996, Thinking about answers: The application of cognitive processes to survey methodology

10.2307/2393788

10.1037/1082-989X.6.4.371

10.1037/h0027108

10.1214/ss/1177011945

10.1007/BF00122574

Vandenberg, R.J. & Grelle, D.M. ( 2009). Alternative model specifications in structural equation modeling: Facts, fictions, and truth. In C. E. Lance & R. J. Vandenberg (Eds.), Statistical and methodological myths and urban legends: Received doctrine, verity, and fable in the organizational and social sciences (pp. 165-191). New York, NY: Routledge.

10.1037/1082-989X.4.2.212

10.5465/amr.1989.4308376

10.2307/258554

10.2307/256858