Assessing User Competence: Conceptualization and Measurement

Information Systems Research - Tập 11 Số 1 - Trang 37-60 - 2000
Barbara L. Marcolin1, Deborah Compeau1, Malcolm C. Munro1, Sid L. Huff2
1Faculty of Management, The University of Calgary, 2500 University Drive NW, Calgary, Alberta, Canada T2N 1N4
2Faculty of Commerce and Administration, Victoria University of Wellington, Wellington, New Zealand

Tóm tắt

Organizations today face great pressure to maximize the bene its from their investments in information technology (IT). They are challenged not just to use IT, but to use it as effectively as possible. Understanding how to assess the competence of users is critical in maximizing the effectiveness of IT use. Yet the user competence construct is largely absent from prominent technology acceptance and it models, poorly conceptualized, and inconsistently measured. We begin by presenting a conceptual model of the assessment of user competence to organize and clarify the diverse literature regarding what user competence means and the problems of assessment. As an illustrative study, we then report the findings from an experiment involving 66 participants. The experiment was conducted to compare empirically two methods (paper and pencil tests versus self-report questionnaire), across two different types of software, or domains of knowledge (word processing versus spreadsheet packages), and two different conceptualizations of competence (software knowledge versus self-efficacy). The analysis shows statistical significance in all three main effects. How user competence is measured, what is measured, what measurement context is employed:all influence the measurement outcome. Furthermore, significant interaction effects indicate that different combinations of measurement methods, conceptualization, and knowledge domains produce different results. The concept of frame of reference, and its anchoring effect on subjects' responses, explains a number of these findings. The study demonstrates the need for clarity in both defining what type of competence is being assessed and in drawing conclusions regarding competence, based upon the types of measures used. Since the results suggest that definition and measurement of the user competence construct can change the ability score being captured, the existing information system (IS) models of usage must contain the concept of an ability rating. We conclude by discussing how user competence can be incorporated into the Task-Technology Fit model, as well as additional theoretical and practical implications of our research.

Từ khóa


Tài liệu tham khảo

Anderson J. R., 1980, Cognitive Psychology and Its Implications

Ballantine J., 1998, Information Systems Success Measurement, 46

Bandura A., 1986, Social Foundations of Thought and Action

10.1016/S0378-7206(97)00043-8

Bowen W., 1986, Fortune, 121, 20

10.1287/isre.7.3.281

Bushnell D. S., 1990, Training Development J, 44, 41

Buszowski F., 1989, Comput. Canada, 16, 22

10.1006/obhd.1994.1019

Carr M., 1990, Comput. Canada, 16, 41

10.1016/0306-4573(88)90111-2

10.2307/249688

10.1287/isre.6.2.118

10.1145/68814.68816

10.2307/249008

10.1287/mnsc.35.8.982

10.1037/0021-9010.80.1.158

10.1287/isre.3.1.60

10.2307/3380007

10.1145/68814.68817

Fishbein M., 1975, Belief, Attitude, Intention and Behaviour: An Introduction to Theory and Research

10.4018/978-1-878289-03-2

10.2307/249689

10.1080/07421222.1992.11517949

Hayen R. L., 1990, J. Systems Management, 7

Higginbotham J. S., 1997, Res. Development, 39, R

Hopper M. D., 1990, Harvard Bus. Rev., 68, 118

Hurt M.IS-user relationships: Factors which impact their perceived effectiveness and differences between is and users (1990) (University of Texas at Austin). Unpublished Ph.D. dissertation

Industrial Management, 1986, Computer literacy is not enough, 10, 40

Kanter R. M., 1997, The Frontiers of Management

Karten N., 1987, Inform. Strategy: The Executive's J., 36

10.1080/07399018808962901

10.1080/07399019108964974

Kirk R. E., 1982, Experimental Design: Procedures for the Behavioural Sciences, 2

Klauk D. R., 1988, B & E Rev., 34, 30

10.2307/976389

10.1037/0021-9010.78.2.311

10.2307/248891

Little B., 1997, The Globe and Mail

10.1287/isre.3.2.150

Magnet M., 1994, Fortune, 129, 79

10.1287/isre.2.3.173

Marcolin B. L., 1992, Proc. of ASAC 1992 Conference, 108

10.1037/0021-9010.69.1.147

10.1080/07421222.1994.11518034

10.1287/isre.2.3.192

10.1016/S0378-7206(97)00035-9

10.2307/249454

10.2307/248985

Nunnally J. C., 1978, Psychometric Theory, 2

Panko R., 1988, End User Computing: Management, Applications and Technology

10.2307/3150868

10.1111/j.1540-5915.1993.tb00510.x

10.1145/42411.42418

10.1145/358413.358429

Rosenthal B. E., 1990, Banking Software Rev., 15, 28

Schroeder D. L., 1990, Proc. 1990 Ann. Meeting Decision Sci. Institute., 1096

10.1037/0022-0663.73.1.93

10.1287/isre.8.3.240

Skills Evaluation System (SES), 1990, User's Guide, Version 3.0

10.1037/0021-9010.78.6.994

Stewart Tom, 1997, Intellectual Capital

10.1287/isre.3.3.252

Swope C., 1987, J. Compensation Benefits, 3, 100

Symons V., 1987, Training, 24, 49

10.1287/isre.6.2.144

10.2307/249443

10.1080/07421222.1994.11518035

Tsay J., 1988, Interface, 8, 10

Venkatesh V., 1996, Proc. Internat. Conf. Inform. Systems, 213

Webster J., 1989, Conf. Desktop Inform. Tech.

10.1177/014920639301900109

Winter S. J., 1992, Proc. ICIS 1992 Conf., 149

10.1037/0021-9010.79.4.525

Zmud R. W., 1983, Information Systems in Organizations

Thông tin
Thông tin xuất bản

Information Systems Research

Tập 11 Số 1

37-60

Thông tin tác giả