The Illusion of Statistical Control

Organizational Research Methods - Tập 15 Số 3 - Trang 413-435 - 2012
Kevin D. Carlson1, Jinpei Wu2
1Department of Management, Pamplin College of Business, Virginia Tech, Blacksburg, VA, USA
2School of Business, Minnesota State University Moorhead, Moorhead, MN, USA

Tóm tắt

The authors extend previous recommendations for improved control variable (CV) practice in management research by mapping the objectives for using statistical control to recommendations for research practice. Including CVs in research designs to permit statistical control of “nuisance” variance is a common research practice that is subject to well-documented and potentially serious problems. Yet because CVs are frequently weakly related to focal variables, they rarely influence the interpretation of results. As a result, current practice offers an illusion of statistical control when in fact little control actually occurs. The authors extend the growing literature on CV practice by examining the ambiguity of researchers' stated purposes for using statistical control that makes it difficult to determine whether common CV practice accomplishes any of these intents effectively. Guidelines for improving research practice are offered, including adopting a conservative stance toward the inclusion of CVs in the analysis of quasiexperimental and correlational designs guided by the principle “When in doubt, leave them out.”

Từ khóa


Tài liệu tham khảo

A list of the studies included the analysis is available from the first author

10.1177/1094428110397773

10.1037/0022-3514.51.6.1173

10.1111/j.1468-2958.2002.tb00827.x

10.1177/1094428105278021

10.1177/1094428108321153

10.1002/smj.568

10.1007/s10869-005-9009-y

10.1016/j.hrmr.2008.03.001

10.1177/1094428106292895

10.1037/h0075654

10.5465/amj.2007.24162082

10.5465/amj.2007.24162081

Cohen J., 2003, Applied multiple regression/correlation analysis for the behavior sciences

10.1177/001316447203200303

10.1097/01.psy.0000140008.70959.41

D’Andrade R., 1990, Journal of Quantitative Anthropology, 2, 47

10.1037/0021-9010.92.5.1228

10.1037/0021-843X.93.2.222

10.1177/109442819814002

Hays W. L., 1988, Statistics, 4

10.1177/0146167292182001

10.1002/smj.589

Kerlinger F. N., 1973, Multiple regression in behavioral research

10.5465/amj.2007.25525906

10.1002/smj.587

10.5465/amj.2007.26279172

Meehl P. E., 1970, Analyses of theories and methods of physics and psychology, 373

10.1037/h0030750

10.1002/smj.643

10.1111/1467-8624.00588

10.1037/0021-9010.92.6.1584

10.1037/0021-9010.88.5.879

Rosenberg M., 2008, War as they knew it

10.1177/1094428105284955

Spector P. E., 1995, International review of industrial and organizational psychology, 10, 249

10.1177/1094428110369842

10.1002/(SICI)1099-1379(200002)21:1<79::AID-JOB964>3.0.CO;2-G

Stone-Romero E. F., 2007, The encyclopedia of industrial and organizational psychology, 519

10.1002/smj.623

10.1037/0021-9010.79.3.323