A META‐ANALYTIC EXAMINATION OF THE INSTRUCTIONAL EFFECTIVENESS OF COMPUTER‐BASED SIMULATION GAMES

Personnel Psychology - Tập 64 Số 2 - Trang 489-528 - 2011
Traci Sitzmann1
1University of Colorado, Denver

Tóm tắt

Interactive cognitive complexity theory suggests that simulation games are more effective than other instructional methods because they simultaneously engage trainees’ affective and cognitive processes (Tennyson & Jorczak, 2008). Meta‐analytic techniques were used to examine the instructional effectiveness of computer‐based simulation games relative to a comparison group (k= 65,N= 6,476). Consistent with theory, posttraining self‐efficacy was 20% higher, declarative knowledge was 11% higher, procedural knowledge was 14% higher, and retention was 9% higher for trainees taught with simulation games, relative to a comparison group. However, the results provide strong evidence of publication bias in simulation games research. Characteristics of simulation games and the instructional context also moderated the effectiveness of simulation games. Trainees learned more, relative to a comparison group, when simulation games conveyed course material actively rather than passively, trainees could access the simulation game as many times as desired, and the simulation game was a supplement to other instructional methods rather than stand‐alone instruction. However, trainees learned less from simulation games than comparison instructional methods when the instruction the comparison group received as a substitute for the simulation game actively engaged them in the learning experience.

Từ khóa


Tài liệu tham khảo

References marked with an asterisk indicate studies included in the meta‐analysis.

Aldrich C, 2007, Engaging mini‐games find niche in training, T+D, 22

10.1111/j.1744-6570.1988.tb00632.x

10.1037/0033-295X.84.2.191

10.1016/0749-5978(91)90022-L

10.1207/s15326985ep2802_3

10.4278/0890-1171-12.1.8

Bayrak C, 2008, Effects of computer simulations programs on university students’ achievement in physics, Turkish Online Journal of Distance Education, 9

10.1016/j.urology.2004.04.030

10.1080/09585190802200173

10.1111/j.1744-6570.2002.tb00111.x

10.1037/0021-9010.93.2.296

*Blunt R, 2007, Does game‐based learning work? Results from three recent studies

*Bower RW, 1998, An investigation of a manipulative simulation in the learning of recursive programming

10.5032/jae.2002.01036

10.1207/s15327108ijap1502_4

10.2190/PWDP-45L8-LHL5-2VX7

Brown KG, 2002, Creating, implementing, and maintaining effective training and development: State‐of‐the‐art lessons for practice, 192

10.1037/12170-016

10.1097/00005053-196210000-00014

*Cameron B, 2005, The effect of online gaming, cognition and feedback type in facilitating delayed achievement of different learning objectives, Journal of Interactive Learning Research, 16, 243

Cataloglu E, 2006, Open source software in teaching physics: A case study on vector algebra and visual representations, The Turkish Online Journal of Educational Technology, 5

Chen H‐HC, 2008, Computer games and team and individual learning, 39

*Chou C‐H, 1998, The effectiveness of using multimedia computer simulations coupled with social constructivist pedagogy in a college introductory physics classroom

10.3102/00346543053004445

10.1007/BF02299088

CNET Networks Entertainment. (2004 January 23).The greatest games of all time: The Oregon Trail. Retrieved fromhttp://www.gamespot.com/gamespot/features/all/greatestgames/p‐34.html

Cook TD, 1979, Quasi‐experimentation: Design and analysis for field settings

10.1037/0022-0663.88.4.715

Csikszentmihalyi M, 1990, Flow: The psychology of optimal experience

Deci E, 1985, The support of autonomy and control of behavior, Journal of Personality and Social Psychology, 53, 1024, 10.1037/0022-3514.53.6.1024

*DeRouin‐Jessen R, 2008, Game on: The impact of game features in computer‐based training

10.1300/J017v17n04_02

Dewey J, 1938, Experience and education

Driskell JE, 1984, Microcomputer videogame based training, Educational Technology, 24, 11

10.1016/j.compedu.2005.11.026

10.1080/00221347608980584

10.1037/1076-898X.9.4.219

10.1002/tea.3660290503

Federation of American Scientists, 2006, Summit on educational games: Harnessing the power of video games for learning

10.1111/j.1744-6570.1998.tb00731.x

Fleiss JL, 1981, Statistical methods for rates and proportions

Fletcher JD, 2006, Using computer games and simulations for instruction: A research review

10.1111/1467-8535.00122

10.1207/s15327051hci0601_3

10.1177/1046878102238607

Glass GV, 1981, Meta‐analysis in social research

*Gokhale A, 1991, Effectiveness of computer simulation versus lab and sequencing of instruction in teaching logic circuits, Journal of Industrial Teacher Education, 28, 22

*Gopher D, 1994, Transfer of skill from a computer game trainer to flight, Human Factors, 36, 387, 10.1177/001872089403600301

10.2190/KW8Y-F816-BFVN-LQQB

Gredler ME, 1996, Handbook of research for educational communications and technology, 521

10.21236/ADA441935

Hedges LV, 1985, Statistical methods for meta‐analysis

10.1016/j.compedu.2008.08.008

Hsu Y‐S, 1997, Development and formative evaluation of an instructional simulation of adiabatic processes, 10.31274/rtd-180813-13270

10.1037/0021-9010.80.2.327

10.1080/147032901300002800

Hunter JE, 1990, Methods of meta‐analysis: Correcting error and bias in research findings

Ivers K, 1994, Teaching telecommunications: A comparison between video and computer‐based instruction

Jana R, 2006, On‐the‐job video gaming, Business Week, 3977, 43

10.1080/09523980802283889

Jonassen D, 2002, Trends and issues in instructional design and technology, 107

10.1037/0021-9010.90.4.677

10.1037/0021-9010.93.1.59

10.1016/S0952-8180(02)00384-7

Kinkade RE, 1995, Evaluation of a computer simulation in a therapeutics case discussion, American Journal of Pharmaceutical Education, 59, 147, 10.1016/S0002-9459(24)04398-5

10.1080/095006999290066

Kos I, 1996, Teaching clinically oriented embryology with computer simulations

10.1037/0021-9010.91.4.900

10.1037/0021-9010.78.2.311

10.1037/11582-004

10.1016/0747-5632(91)90030-5

Kulik JA, 1994, Technology assessment in education and training, 9

Lawson KA, 1991, Using a computer‐simulation program and a traditional approach to teach pharmacy financial management, American Journal of Pharmaceutical Education, 55, 226, 10.1016/S0002-9459(24)06506-9

Lee J, 1999, Effectiveness of a computer‐based instructional simulation: A meta‐analysis, International Journal of Instructional Media, 26, 71

Liao Y‐K. C., 1999, Effects of hypermedia on students’ achievement: A meta‐analysis, Journal of Educational Multimedia and Hypermedia, 8, 255

10.1177/0002716202250791

10.1037/0003-066X.48.12.1181

Lipsey MW, 2001, Applied social research methods series: Vol. 49. Practical meta‐analysis

Loar RS, 2007, The impact of a computer simulated case study on nurse practitioner students’ declarative knowledge and clinical performance

10.1207/s15516709cog0504_2

10.1037/0003-066X.59.1.14

10.1016/0094-730X(89)90007-7

10.2307/256447

10.3200/JOEB.79.4.198-204

Moshirnia AV, 2008, The influence of information delivery systems in modified video games on learning

Moslehpour S, 1993, A comparison of achievement resulting from learning electronics concepts by computer simulation versus traditional laboratory instruction, 10.31274/rtd-180813-12779

Munro A, 2008, Computer games and team and individual learning, 39

10.21236/ADA222909

10.2307/258393

North MM, 2003, Immersive visualization tool for pedagogical practices of computer science concepts: A pilot study, JCSC, 19, 207

Northup PT, 2002, Online learners’ preference for interaction, Quarterly Review of Distance Education, 3, 219

10.1080/09585170500384529

10.1207/s15327108ijap0403_5

10.1016/j.chb.2008.02.016

10.1207/S15327876MP1201_4

10.1037/0022-3514.62.4.625

Piaget J, 1951, Psychology of intelligence

Prensky M, 2001, Digital game‐based learning

10.1177/1046878192233001

10.1007/s10803-006-0193-z

10.1177/1046496407300479

10.1207/s15327876mp0804_3

10.3758/BF03203492

10.1177/104687810103200402

Rowland PM, 1988, The effect of two modes of computer‐assisted instruction and individual learning differences on the understanding of science concept relationships

Rowland PM, 1987, Effects of modes of computer‐assisted instruction on conceptual understanding and achievement of college students exhibiting individual differences in learning: A pilot study

10.1207/s15327876mp0702_2

10.1207/s15327108ijap0803_2

10.1037/10260-010

10.1146/annurev.psych.52.1.471

Schenker JD, 2007, The effectiveness of technology use in statistics instruction in higher education: A meta‐analysis using hierarchical linear modeling

10.1177/002246698602000410

10.2968/062004010

10.1097/00003246-199904000-00045

10.1080/1049482900010104

10.1109/WSC.1995.479050

Simons R‐J, 1993, The learner as designer of his own learning environment

10.1037/0021-9010.93.2.280

10.1111/j.1754-9434.2008.00094.x

10.1037/a0018080

10.5465/AMLE.2010.51428542

10.4018/978-1-59904-753-9.ch001

10.1111/j.1744-6570.2006.00049.x

Slagle M, 2006, Poll: 4 in 10 Americans play video games [Electronic Version], Washington Post

10.1037/0021-9010.87.1.96

Sterling J, 1991, The effect of simulation software on students’ attitudes and understanding in introductory statistics, Journal of Computers in Mathematics and Science Teaching, 10, 51

10.1016/0361-476X(82)90021-2

Sukhai DR, 2005, The effects of Web‐based animated demonstration and guided simulation on time and performance in business software applications training

10.1177/1046878104263546

Surface EA, 2009, Relative effectiveness of Tactical Iraqi(tm) training and lecture‐based classroom training

10.1007/978-3-322-99316-8_25

10.1023/B:TRUC.0000021808.72598.4d

T+D, 2007, What do simulations cost?, T+D, 88

10.2190/403P-N4N2-6715-1515

Tennyson RD, 1997, Instructional design, 113

Tennyson RD, 2008, Computer games and team and individual learning, 39

Tobias S, 2007, What research has to say about designing computer games for learning, Educational Technology, 47, 20

10.1177/104687810003100102

10.2190/V5YJ-76DX-ECL6-R851

10.1006/ijhc.1999.0367

10.2190/FLHV-K4WA-WPVQ-H0YM

10.1080/0954730940310405

10.2307/257034

10.1037/0021-9010.75.3.315

Willis DAS, 1989, Development and evaluation of IRIS: A computer simulation to teach preservice teachers to administer a formal reading inventory

10.1177/1046878108321866

10.1089/cpb.2006.9994

Yares A, 2005, The effects of diagnosis training software on the diagnostic fluency and self‐confidence of school psychology graduate trainees

10.1080/09523980600641445

10.1111/j.1365-2729.2006.00215.x

10.1111/j.1467-9620.2005.00544.x