Context may be King, but generalizability is the Emperor!

Journal of Information Technology - Tập 31 Số 3 - Trang 257-264 - 2016
Cheng, Zhi (Aaron)1, Dimoka, Angelika1, Pavlou, Paul A.1
1Fox School of Business, Temple University, Philadelphia, USA

Tóm tắt

The relative importance of context and generalizability (or particularism and universalism) has long been debated in scientific research. Recently, Davison and Martinsons raised valid concerns about the possibility of false universalism in IS research, discussed its negative consequences, and made a call for explicitly including particularism in research design and reporting. In this commentary, we generally agree with the notion that context should matter more in IS research; yet, the importance of generalizability in research should not be downplayed. Specifically, we posit that generalizability should be given higher position in the scientific process and be the ultimate goal for researchers. Still, researchers need to fully understand the research context, which, in combination and replication, can help to cautiously make generalizable knowledge claims. Therefore, we characterize the relationship between context and generalizability as that of a “King” (as an analogy of the local role of context) versus the “Emperor” (as an analogy of the global role of generalizability).

Tài liệu tham khảo

citation_journal_title=ACM Transactions on Information Systems (TOIS); citation_title=Incorporating Contextual Information in Recommender Systems Using a Multidimensional Approach; citation_author=G Adomavicius, R Sankaranarayanan, S Sen, A Tuzhilin; citation_volume=23; citation_issue=1; citation_publication_date=2005; citation_pages=103-145; citation_doi=10.1145/1055709.1055714; citation_id=CR1

citation_title=Social Psychology; citation_publication_date=2013; citation_id=CR2; citation_author=E Aronson; citation_author=TD Wilson; citation_author=SR Sommers; citation_publisher=Pearson

citation_journal_title=Information Systems Research; citation_title=Firm-Level Evidence of the Longitudinal Effects of IT Use on Employment; citation_author=H Atasoy, R Banker, PA Pavlou; citation_volume=27; citation_issue=1; citation_publication_date=2016; citation_pages=6-26; citation_doi=10.1287/isre.2015.0618; citation_id=CR3

citation_journal_title=Information Systems Journal; citation_title=The Significance of Context in Information Systems and Organizational Change; citation_author=C Avgerou; citation_volume=11; citation_issue=1; citation_publication_date=2001; citation_pages=43-63; citation_doi=10.1046/j.1365-2575.2001.00095.x; citation_id=CR4

citation_journal_title=MIS Quarterly; citation_title=Evidence of the Effect of Trust Building Technology in Electronic Markets: Price Premiums and Buyer Behavior; citation_author=S Ba, PA Pavlou; citation_volume=26; citation_issue=3; citation_publication_date=2002; citation_pages=243-268; citation_doi=10.2307/4132332; citation_id=CR5

citation_journal_title=Management and Organization Review; citation_title=The Future of Chinese Management Research: A Theory of Chinese Management Versus a Chinese Theory of Management; citation_author=JB Barney, S Zhang; citation_volume=5; citation_issue=1; citation_publication_date=2009; citation_pages=15-28; citation_id=CR6

citation_journal_title=American Sociological Review; citation_title=Religion and Economic Growth Across Countries; citation_author=RJ Barro, RM McCleary; citation_volume=68; citation_issue=5; citation_publication_date=2003; citation_pages=760-781; citation_doi=10.2307/1519761; citation_id=CR7

citation_journal_title=MIS Quarterly; citation_title=Validation in Information Systems Research: A State-of-the-art Assessment; citation_author=M-C Boudreau, D Gefen, DW Straub; citation_volume=25; citation_issue=1; citation_publication_date=2001; citation_pages=1-16; citation_doi=10.2307/3250956; citation_id=CR8

citation_journal_title=Strategic Management Journal; citation_title=Construct Measurement in Strategic Management Research: Illusion or Reality?; citation_author=BK Boyd, S Gove, MA Hitt; citation_volume=26; citation_issue=3; citation_publication_date=2005; citation_pages=239-257; citation_doi=10.1002/smj.444; citation_id=CR9

citation_journal_title=Journal of Consumer Research; citation_title=The Concept of External Validity; citation_author=BJ Calder, LW Phillips, AM Tybout; citation_volume=9; citation_publication_date=1982; citation_pages=240-244; citation_doi=10.1086/208920; citation_id=CR10

citation_journal_title=New Directions for Program Evaluation; citation_title=Relabeling Internal and External Validity for Applied Social Scientists; citation_author=DT Campbell; citation_volume=31; citation_publication_date=1986; citation_pages=67-77; citation_doi=10.1002/ev.1434; citation_id=CR11

citation_title=Experimental and Quasi Experimental Designs for Research; citation_publication_date=1967; citation_id=CR12; citation_author=DT Campbell; citation_author=JC Stanley; citation_publisher=Rand Mc Nally and Co Inc

Chang, A.C. and Li, P. (2015). Is Economics Research Replicable? Sixty Published Papers from Thirteen Journals Say ‘Usually Not’, SSRN. Retrieved from

http://www.federalreserve.gov/econresdata/feds/2015/files/2015083pap.pdf

.

citation_title=The Innovator’s Dilemma; citation_publication_date=1997; citation_id=CR14; citation_author=C Christenson; citation_publisher=Harvard Business School Press

citation_journal_title=Journal of Economic Literature; citation_title=Instruments, Randomization, and Learning About Development; citation_author=A Deaton; citation_volume=48; citation_publication_date=2010; citation_pages=424-455; citation_doi=10.1257/jel.48.2.424; citation_id=CR15

citation_journal_title=MIS Quarterly; citation_title=What Does the Brain Tell Us About Trust and Distrust? Evidence from a Functional Neuroimaging Study; citation_author=A Dimoka; citation_volume=34; citation_issue=2; citation_publication_date=2010; citation_pages=373-396; citation_id=CR16

Dimoka, A., Banker, R.D., Benbasat, I., Davis, F.D., Dennis, A.R., Gefen, D., Gupta, A., Ischebeck, A., Kenning, P.H., Pavlou, P.A., Müller-Putz, G., Riedl, R., vom Brocke, J. and Weber, B. (2012). On the Use of Neurophysiological Tools in is Research: Developing a Research Agenda for NeuroIS, MIS Quarterly

36(3): 679–719.

citation_journal_title=MIS Quarterly; citation_title=On Product Uncertainty in Online Markets: Theory and Evidence; citation_author=Angelika Dimoka, Yili Hong, Paul A Pavlou; citation_volume=36; citation_issue=2; citation_publication_date=2012; citation_pages=395-426; citation_id=CR18

citation_journal_title=Information Systems Research; citation_title=Research Commentary – NeuroIS: The Potential of Cognitive Neuroscience for Information Systems Research; citation_author=A Dimoka, PA Pavlou, FD Davis; citation_volume=22; citation_issue=4; citation_publication_date=2010; citation_pages=687-702; citation_doi=10.1287/isre.1100.0284; citation_id=CR19

citation_journal_title=American Psychologist; citation_title=Research Settings in Industrial and Organizational Psychology: Are Findings in the Field More Generalizable than in the Laboratory?; citation_author=RL Dipboye, MF Flanagan; citation_volume=34; citation_issue=2; citation_publication_date=1979; citation_pages=141; citation_doi=10.1037/0003-066X.34.2.141; citation_id=CR20

citation_journal_title=Decision Sciences; citation_title=Technology-Based New Product Development Partnerships; citation_author=John Ettlie, Paul A Pavlou; citation_volume=37; citation_issue=2; citation_publication_date=2006; citation_pages=117-148; citation_doi=10.1111/j.1540-5915.2006.00119.x; citation_id=CR21

citation_journal_title=Information Systems Research; citation_title=The Boundaries of Trust and Risk: The Quadratic Moderating Role of Institutional Structures; citation_author=David Gefen, Paul A Pavlou; citation_volume=23; citation_issue=3; citation_publication_date=2012; citation_pages=940-959; citation_doi=10.1287/isre.1110.0395; citation_id=CR22

citation_journal_title=MIS Quarterly; citation_title=The Nature of Theory in Information Systems; citation_author=S Gregor; citation_volume=30; citation_publication_date=2006; citation_pages=611-642; citation_id=CR23

citation_journal_title=Journal of Econometrics; citation_title=Comparing IV with Structural Models: What Simple IV Can and Cannot Identify; citation_author=JJ Heckman, S Urzua; citation_volume=156; citation_issue=1; citation_publication_date=2010; citation_pages=27-37; citation_doi=10.1016/j.jeconom.2009.09.006; citation_id=CR25

citation_journal_title=Information Systems Research; citation_title=A Framework and Guidelines for Context-Specific Theorizing in Information Systems Research; citation_author=W Hong, FK Chan, JY Thong, LC Chasalow, G Dhillon; citation_volume=25; citation_issue=1; citation_publication_date=2013; citation_pages=111-136; citation_doi=10.1287/isre.2013.0501; citation_id=CR26

citation_journal_title=Information Systems Research; citation_title=Product Fit Uncertainty: Nature, Effects, and Antecedents; citation_author=Yili Hong, Paul A Pavlou; citation_volume=25; citation_issue=2; citation_publication_date=2014; citation_pages=328-344; citation_doi=10.1287/isre.2014.0520; citation_id=CR27

Hong, Y., Wang, A. and Pavlou, P.A. (2015). Comparing Open and Sealed Bid Auctions: Evidence from Online Labor Markets, Information Systems Research (forthcoming).

citation_journal_title=Strategic Management Journal; citation_title=Replication in Strategic Management: Scientific Testing for Validity, Generalizability, and Usefulness; citation_author=R Hubbard, DE Vetter, EL Little; citation_volume=19; citation_issue=3; citation_publication_date=1998; citation_pages=243-254; citation_doi=10.1002/(SICI)1097-0266(199803)19:3<243::AID-SMJ951>3.0.CO;2-0; citation_id=CR29

citation_journal_title=Journal of the Economic Literature; citation_title=Better LATE Than Nothing: Some Comments on Deaton (2009) and Heckman and Urzua (2009); citation_author=GW Imbens; citation_volume=48; citation_issue=2; citation_publication_date=2010; citation_pages=399-423; citation_doi=10.1257/jel.48.2.399; citation_id=CR30

citation_journal_title=Chance; citation_title=Why Most Published Research Findings are False; citation_author=JP Ioannidis; citation_volume=18; citation_issue=4; citation_publication_date=2005; citation_pages=40-47; citation_doi=10.1080/09332480.2005.10722754; citation_id=CR31

citation_journal_title=Academy of Management Journal; citation_title=The Role of Context in Work Team Diversity Research: A Meta-Analytic Review; citation_author=A Joshi, H Roh; citation_volume=52; citation_issue=3; citation_publication_date=2009; citation_pages=599-627; citation_doi=10.5465/AMJ.2009.41331491; citation_id=CR32

citation_journal_title=MIT Sloan Management Review; citation_title=How Useful is the Theory of Disruptive Innovation?; citation_author=AA King, B Baatartogtokh; citation_volume=57; citation_issue=1; citation_publication_date=2015; citation_pages=77; citation_id=CR33

citation_journal_title=Information Systems Research; citation_title=Generalizing Generalizability in Information Systems Research; citation_author=AS Lee, RL Baskerville; citation_volume=14; citation_issue=3; citation_publication_date=2003; citation_pages=221-243; citation_doi=10.1287/isre.14.3.221.16560; citation_id=CR34

citation_journal_title=MIS Quarterly; citation_title=Conceptualizing Generalizability: New Contributions and a Reply; citation_author=AS Lee, RL Baskerville; citation_volume=36; citation_issue=3; citation_publication_date=2012; citation_pages=749-761; citation_id=CR35

citation_journal_title=The New Yorker; citation_title=The Truth Wears Off; citation_author=J Lehrer; citation_volume=13; citation_publication_date=2010; citation_pages=52; citation_id=CR36

citation_journal_title=MIS Quarterly; citation_title=Review: A Review of Culture in Information Systems Research: Toward a Theory of Information Technology Culture Conflict; citation_author=DE Leidner, T Kayworth; citation_volume=30; citation_issue=2; citation_publication_date=2006; citation_pages=357-399; citation_id=CR37

citation_journal_title=Journal of Information Technology; citation_title=Research on IT in China: A Call for Greater Contextualization; citation_author=L Li, P Gao, J Mao; citation_volume=29; citation_issue=3; citation_publication_date=2014; citation_pages=208-222; citation_doi=10.1057/jit.2014.15; citation_id=CR38

citation_journal_title=Accounting, Auditing & Accountability Journal; citation_title=The Problem of Generalizability: Anecdotes and Evidence in Accounting Research; citation_author=K Lukka, E Kasanen; citation_volume=8; citation_issue=5; citation_publication_date=1995; citation_pages=71-90; citation_doi=10.1108/09513579510147733; citation_id=CR39

citation_journal_title=Journal of Consumer Research; citation_title=On the External Validity of Experiments in Consumer Research; citation_author=JG Lynch; citation_volume=9; citation_publication_date=1982; citation_pages=225-239; citation_doi=10.1086/208919; citation_id=CR40

citation_journal_title=Journal of Consumer Research; citation_title=The Role of External Validity in Theoretical Research; citation_author=JG Lynch; citation_volume=10; citation_publication_date=1983; citation_pages=109-111; citation_doi=10.1086/208949; citation_id=CR41

citation_journal_title=Journal of the Academy of Marketing Science; citation_title=Theory and external validity; citation_author=JG Lynch; citation_volume=27; citation_issue=3; citation_publication_date=1999; citation_pages=367-376; citation_doi=10.1177/0092070399273007; citation_id=CR42

citation_journal_title=Journal of Consumer Research; citation_title=External Validity and the Research Process: A Comment on the Calder/Lynch Dialogue; citation_author=JE McGrath, D Brinberg; citation_volume=10; citation_issue=1; citation_publication_date=1983; citation_pages=115-124; citation_doi=10.1086/208951; citation_id=CR43

citation_journal_title=Journal of Management Studies; citation_title=Assessing Porter’s (1980) Model in Terms of Its Generalizability, Accuracy and Simplicity; citation_author=A Miller, GG Dess; citation_volume=30; citation_issue=4; citation_publication_date=1993; citation_pages=553-585; citation_doi=10.1111/j.1467-6486.1993.tb00316.x; citation_id=CR44

citation_journal_title=Information Systems Research; citation_title=Combining IS Research Methods: Towards a Pluralist Methodology; citation_author=J Mingers; citation_volume=12; citation_issue=3; citation_publication_date=2001; citation_pages=240-259; citation_doi=10.1287/isre.12.3.240.9709; citation_id=CR45

citation_journal_title=American Psychologist; citation_title=In Defense of External Invalidity; citation_author=DG Mook; citation_volume=38; citation_issue=4; citation_publication_date=1983; citation_pages=379; citation_doi=10.1037/0003-066X.38.4.379; citation_id=CR46

Open Science Collaboration. (2015). Estimating the Reproducibility of Psychological Science, Science

349(6251): aac4716.

citation_journal_title=Management Information Systems Quarterly; citation_title=Information Technology and Administrative Efficiency in US State Governments: A Stochastic Frontier Approach; citation_author=M-S Pang, A Tafti, MS Krishnan; citation_volume=38; citation_issue=4; citation_publication_date=2014; citation_pages=1079-1101; citation_id=CR48

citation_journal_title=MIS Quarterly; citation_title=State of the Information Privacy Literature: Where are We Now and Where Should We Go?; citation_author=PA Pavlou; citation_volume=35; citation_issue=4; citation_publication_date=2011; citation_pages=977-988; citation_id=CR49

citation_journal_title=Information Systems Research; citation_title=The Nature and Role of Feedback Text Comments in Online Marketplaces: Implications for Trust Building, Price Premiums, and Seller Differentiation; citation_author=PA Pavlou, A Dimoka; citation_volume=17; citation_issue=4; citation_publication_date=2006; citation_pages=391-412; citation_doi=10.1287/isre.1060.0106; citation_id=CR50

citation_journal_title=Information Systems Research; citation_title=From IT Leveraging Competence to Competitive Advantage in Turbulent Environments: The Case of New Product Development; citation_author=PA Pavlou, OA Sawy; citation_volume=17; citation_issue=3; citation_publication_date=2006; citation_pages=198-227; citation_doi=10.1287/isre.1060.0094; citation_id=CR51

citation_journal_title=MIS Quarterly; citation_title=Understanding and Predicting Electronic Commerce Adoption: An Extension of the Theory of Planned Behavior; citation_author=PA Pavlou, M Fygenson; citation_volume=30; citation_issue=1; citation_publication_date=2006; citation_pages=115-143; citation_id=CR52

citation_journal_title=International Journal of Nursing Studies; citation_title=Generalization in Quantitative and Qualitative Research: Myths and Strategies; citation_author=DF Polit, CT Beck; citation_volume=47; citation_issue=11; citation_publication_date=2010; citation_pages=1451-1458; citation_doi=10.1016/j.ijnurstu.2010.06.004; citation_id=CR53

citation_journal_title=MIS Quarterly; citation_title=Inter-firm IT Capability Profiles and Communications for Co-Creating Relational Value: Evidence from the Logistics Industry; citation_author=Arun Rai, Paul A Pavlou, Ghiyoung Im, Du Steve; citation_volume=36; citation_issue=1; citation_publication_date=2012; citation_pages=233-262; citation_id=CR54

citation_journal_title=Management Science; citation_title=When can Management Science Research be Generalized Internationally?; citation_author=PM Rosenzweig; citation_volume=40; citation_issue=1; citation_publication_date=1994; citation_pages=28-39; citation_doi=10.1287/mnsc.40.1.28; citation_id=CR55

citation_journal_title=Journal of organizational behavior; citation_title=Location, Location, Location: Contextualizing Organizational Research; citation_author=DM Rousseau, Y Fried; citation_volume=22; citation_issue=1; citation_publication_date=2001; citation_pages=1-13; citation_doi=10.1002/job.78; citation_id=CR56

citation_journal_title=Academy of Management Journal; citation_title=Research Methodology in Management: Current Practices, Trends, and Implications for Future Research; citation_author=TA Scandura, EA Williams; citation_volume=43; citation_issue=6; citation_publication_date=2000; citation_pages=1248-1264; citation_doi=10.2307/1556348; citation_id=CR57

citation_journal_title=European Journal of Information Systems; citation_title=Towards the Improved Treatment of Generalization of Knowledge Claims in IS Research: Drawing general Conclusions from Samples; citation_author=PB Seddon, R Scheepers; citation_volume=21; citation_issue=1; citation_publication_date=2012; citation_pages=6-21; citation_doi=10.1057/ejis.2011.9; citation_id=CR58

citation_journal_title=Journal of Information Technology; citation_title=Generalization in IS Research: A Critique of the Conflicting Positions of Lee & Baskerville and Tsang & Williams; citation_author=PB Seddon, R Scheepers; citation_volume=30; citation_issue=1; citation_publication_date=2015; citation_pages=30-43; citation_doi=10.1057/jit.2014.33; citation_id=CR59

citation_title=Experimental and Quasi-Experimental Designs for Generalized Causal Inference; citation_publication_date=2002; citation_id=CR60; citation_author=WR Shadish; citation_author=TD Cook; citation_author=DT Campbell; citation_publisher=Wadsworth Cengage Learning

citation_journal_title=Journal of Management; citation_title=The Role of Sampling in Strategic Management Research on Performance: A Two-Study Analysis; citation_author=JC Short, DJ Ketchen, TB Palmer; citation_volume=28; citation_issue=3; citation_publication_date=2002; citation_pages=363-385; citation_doi=10.1177/014920630202800306; citation_id=CR61

citation_journal_title=MIS Quarterly; citation_title=Information Privacy Research: An Interdisciplinary Review; citation_author=HJ Smith, T Dinev, H Xu; citation_volume=35; citation_issue=4; citation_publication_date=2011; citation_pages=989-1016; citation_id=CR62

citation_journal_title=Management and Organization Review; citation_title=Contextualization in Chinese Management Research; citation_author=AS Tsui; citation_volume=2; citation_issue=1; citation_publication_date=2006; citation_pages=1-13; citation_doi=10.1111/j.1740-8784.2006.00033.x; citation_id=CR63

citation_journal_title=Journal of Marketing Research; citation_title=Predicting Advertising Success Beyond Traditional Measures: New Insights from Neurophysiological Methods and Market Response Modeling; citation_author=V Venkatraman, A Dimoka, PA Pavlou, K Vo, W Hampton, B Bollinger, HE Hershfield, M Ishihara, RS Winer; citation_volume=52; citation_issue=4; citation_publication_date=2014; citation_pages=436-452; citation_doi=10.1509/jmr.13.0593; citation_id=CR64

citation_journal_title=Management Information Systems Quarterly; citation_title=Generalization and Hume’s Problem of Induction: Misconceptions and Clarifications; citation_author=J Williams, E Tsang; citation_volume=36; citation_issue=3; citation_publication_date=2012; citation_pages=729-748; citation_id=CR65

citation_title=Case Study Research: Design and Methods; citation_publication_date=1994; citation_id=CR66; citation_author=R Yin; citation_publisher=Sage

citation_journal_title=American Sociological Review; citation_title=Model Uncertainty in Sociological Research: An Application to Religion and Economic Growth; citation_author=C Young; citation_volume=74; citation_issue=3; citation_publication_date=2009; citation_pages=380-397; citation_doi=10.1177/000312240907400303; citation_id=CR67