Analyzing learner-hypermedia interaction: An overview of online methods
Tóm tắt
In this paper we examine the potential of online methods for hypermedia research. Online methods allow the recording, analysis and interpretation of learner-hypermedia interaction. Online methods have been extensively used in cognitive research, and especially in the area of discourse processing. In the first part of the paper we examine several online methods used in discourse comprehension research. We discuss the benefits and limits of each method, and its applicability to hypermedia research. In the second part we focus on the analysis of learner-hypermedia interaction protocols. We introduce several possible approaches, as a function of the observation grain, or the precision of the events that the researcher needs to examine. We present qualitative and quantitative examples at the coarse, intermediate and fine grain and we discuss the research context in which each approach seems most appropriate. We conclude that the empirical study of learner-hypermedia interaction should comply with the general standards of empirical research, e.g., explicit hypotheses and controlled study conditions.
Tài liệu tham khảo
Aaronson, D. & Scarborough, H.S. (1976). Performance theories for sentence coding: Some quantitative evidence. Journal of Experimental Psychology: Human Perception and Performance 2: 56–70.
Afflerbach, P. (1989). The influence of prior knowledge on expert readers main idea comprehension. Reading Research Quarterly 25(1): 31–46.
Black, A., Wright, P., Black, D. & Norman, K. (1992). Consulting online dictionary information while reading. Hypermedia 4(3): 145–169.
Britt, M.A., Rouet, J.-F. & Perfetti, C.A. (1996). Using hypertext to study and reason about historical evidence. In J.-F. Rouet, J.J. Levonen, A.P. Dillon & R.J. Spiro, eds, Hypertext and Cognition, pp. 43–72. Hillsdale, NJ: Lawrence Erlbaum Associates.
Britton, B.K., Glynn, S.M. & Smith, J.W. (1985). Cognitive demands of processing expository text: A cognitive workbench model. In B.K. Britton & J.B. Black, eds, Understanding Expository Text, pp. 227–247. Hillsdale, NJ: Lawrence Erlbaum Associates.
Britton, B.K., Muth, K.D. & Glynn, S.M. (1986). Effects of text organization on memory: Test of a cognitive effort hypothesis with limited exposure time. Discourse Processes 9: 475–487.
Burton, J.K., Niles, J.A., Lalik, R.M. & Reed, W.N. (1986). Cognitive capacity engagement during and following interspersed mathemagenic questions. Journal of Educational Psychology 78(2): 147–152.
Carmel, E., Crawford, S. & Chen, H. (1992). Browsing in hypertext: A cognitive study. IEEE Transactions on Systems, Man, and Cybernetics 22(5): 865–884.
Caverni, J.P. (1988). La verbalisation comme source d'observables pour l'´etude du fonctionnement cognitif. In J.P. Caverni, ed., Psychologie cognitive: modèles et mèthodes, pp. 253–274. Grenoble: Presses Universitaires.
Dee-Lucas, D. & Larkin, J.H. (1995). Learning from electronic texts: Effects of interactive overviews for information access. Cognition & Instruction 13(3): 431–468.
Dell, G.S., McKoon, G. & Ratcliff, R. (1983). The activation of antecedent information during the processing of anaphoric reference in reading. Journal of Verbal Learning and Verbal Behavior 22: 121–132.
Ericsson, K.A. & Simon, H.A. (1980). Protocol Analysis: Verbal Reports as Data. Cambridge, MA: MIT Press.
Eysenck, M.W. & Keane, M.T. (1990). Cognitive Psychology: A Student's Handbook. London: Lawrence Erlbaum Associates.
Fletcher, C.R. (1981). Shortterm memory processes in text comprehension. Journal of Verbal Learning and Verbal Behavior 20: 546–574.
Fletcher, C.R. (1986). Strategies for the allocation of short termmemory during comprehension. Journal of Memory and Language 25: 43–58.
Foltz, P.W. (1996). Comprehension, coherence and strategies in hypertext and linear text. In J.-F. Rouet, J.J. Levonen, A.P. Dillon & R.J. Spiro, eds, Hypertext and Cognition, pp. 109–136. Hillsdale, NJ: Lawrence Erlbaum Associates.
Foss, C.L. (1989). Detecting Lost Users: Empirical Studies on Browsing Hypertext. Sophia-Antipolis (France): Institut National de la Recherche en Informatique et Automatique, Technical Report #972.
Frazier, L. (1983). Processing sentence structure. In K. Rayner, ed., EyeMovements in Reading: Perceptual and Language Processes. New York: Academic Press.
Gernsbacher, M.A. (1991). Language Comprehension as Structure Building. Hillsdale, NJ: Lawrence Erlbaum Associates.
Graesser, A.L. (1981). Prose Comprehension Beyond the Word. New York: Springer Verlag.
Gray, S.H. (1990). Using protocol analysis and drawings to study mental model construction during hypertext navigation. International Journal of HumanComputer Interaction 2(4): 359–377.
Instone, K., Teasley, B. & Leventhal, L. (1996). Lessons learned from redesigning hypertext user interfaces. In H. van Oostendorp & S. de Mul, eds, Cognitive Aspects of Electronic Text Processing, pp. 265–286. Norwood, NJ: Ablex.
Juola, J.F. (1988). The use of computer displays to improve reading comprehension. Applied Cognitive Psychology 2: 87–95.
Just, M.A. & Carpenter, P.A. (1980). A theory of reading: From eyes fixation to comprehension. Psychological Review 87: 329–354.
Just, M.A., Carpenter, P.A. & Wooley, J. (1982). Paradigms and processes in reading comprehension. Journal of Experimental Psychology: General 3: 228–238.
Kieras, D.E. & Just, M.A., eds (1984). New Methods in Reading Comprehension Research. Hillsdale, NJ: Lawrence Erlbaum Associates.
Kintsch, W. & van Dijk, T.A. (1978). Toward a model of text comprehension and production. Psychological Review 85: 363–394.
Kutas, M. & Hillyard, S.A. (1983). Eventrelated potentials to grammatical errors and semantic anomalies. Memory and Cognition 11: 539–550.
Lesgold, A.M. & Perfetti, C.A. (1978). Interactive processes in reading comprehension. Discourse Processes 1: 323–336.
Lindsay, P.H. & Norman, D.A. (1977). Human Information Processing: An Introduction to Psychology. New York: Academic Press.
Maguire, M. & Sweeney, M. (1989). System monitoring: Garbage generator or basis for comprehensive evaluation system? In A. Sutcliffe & L. Macaulay, eds, Proceedings of CHI' 89, pp. 375–394. Cambridge, U.K.: Cambridge University Press.
Marchionini, G. (1990). Evaluating hypermediabased learning. In D.H. Jonassen & H. Mandl, eds, Designing Hypermedia for Learning, pp. 355–373. Berlin: SpringerVerlag.
Marchionini, G. & Shneiderman, B. (1988). Finding facts versus browsing knowledge in hypertext systems. IEEE Computer 20: 70–80.
McKnight, C., Dillon, A. & Richardson, J. (1990). A comparison of linear and hypertext formats in information retrieval. In R. McAleese & C. Green, eds, Hypertext: State of the Art, pp. 10–19. Oxford: Intellect.
McLeod, M. (1991). Tools for monitoring and analyzing the use of hypermedia software. In A.J.M. Oliveira, ed., Structures of Communication and Intelligent Helps for Hypermedia Software. New York: Springer Verlag.
Mitchell, D.C. (1984). An evaluation of subjectpaced reading tasks and other methods for investigating immediate processes in reading. In D.E. Kieras & M.A. Just, eds, New Methods in Reading Comprehension Research, pp. 91–118. Hillsdale, NJ: Lawrence Erlbaum Associates.
Nisbett, R.E. & Wilson, T.D. (1977). Telling more than we can know: Verbal reports on mental processes. Psychological Review 84: 231–259.
Passerault, J.M. & Gaonac'h, D. (1991). Delayed process monitoring during reading in slow and fast readers. European Bulletin of Cognitive Psychology 11: 371–383.
Politch, J. & Donchin, E. (1988). P300 and the word frequency effect. Electroencephalography and Clinical Neurophysiology 70(1): 33–45.
Potter, M.C. (1984). Rapid serial visual presentation: A method for studying language processing. In D.E. Kieras & M.A. Just, eds, New Methods in Reading Comprehension Research, pp. 91–118. Hillsdale, NJ: Lawrence Erlbaum Associates.
Pressley, M. & Afflerbach, P. (1995). Verbal Protocols of Reading: TheNature of Constructively Responsive Reading. Hillsdale, NJ: Lawrence Erlbaum Associates.
Pynte, J. (1974). Une expérience automatisée en psycholinguistique. Informatique et Sciences Humaines 23: 45–56.
Rayner, K. & Carroll, P.J. (1984). Eye movements and reading comprehension. In D.E. Kieras & M.A. Just, eds, New Methods in Reading Comprehension Research, pp. 129–150. Hillsdale, N.J.: Erlbaum.
Reynolds, R.E. & Anderson, R.L. (1982). Influence of questions on the allocation of attention during reading. Journal of Educational Psychology 74: 623–632.
Rouet, J.-F. (1990). Interactive text processing by inexperienced (hyper-) readers. In A. Rizk, N. Streitz & J. André, eds, Hypertexts: Concepts, Systems, and Applications, pp. 250–260. Cambridge, U.K.: Cambridge University Press.
Rouet, J.-F. (1992). Cognitive processing of hyperdocuments: When does nonlinearity help? In D. Lucarella, J. Nanard, M. Nanard & P. Paolini, eds, Proceedings of the Fourth ACM Conference on Hypertext, pp. 131–140. New York, NY: ACM Press.
Rouet, J.-F. & Levonen, J.J. (1996). Studying and learning with nonlinear documents: Empirical studies and their implications. In J.-F. Rouet, J.J. Levonen, A.P. Dillon & R.J. Spiro, eds, Hypertext and Cognition, pp. 9–24. Mahwah, NJ: Lawrence Erlbaum Associates.
Stanovitch, K. (1981). Attentional and automatic context effects in reading. In A.M. Lesgold & C.A. Perfetti, eds, Interactive Processes in Reading, pp. 241–262. Hillsdale, NJ: Lawrence Erlbaum Associates.
Till, R.E., Mross, E.F. & Kintsch, W. (1988). Time course of priming for associate and inference words in a discourse context. Memory and Cognition 16: 283–299.
Tricot, A. & Coste, J.P. (1995). Evaluating complex learnerhypermedia interaction: What criteria for what tasks? Paper presented at the Sixth European Conference for Research on Learning and Instruction. Nijmegen, The Netherlands, August 26–31.
Van Dijk, T.A. & Kintsch, W. (1983). Strategies of Discourse Comprehension. Hillsdale, NJ: Lawrence Erlbaum Associates.
White, P. (1980). Limitations on verbal reports of internal events: A refutation of Nisbett and Wilson and of Bem. Psychological Review 87: 105–112.
Wright, P. (1991). Cognitive overheads and prostheses: Some issues in evaluating hypertexts. In R. Furuta & D. Stotts, eds, Proceedings of the Third ACM Conference on Hypertext, pp. 1–12. New York, NY: ACM Press.
Wright, P. & Lickorish, A. (1994) Menus and memory load: Navigation strategies in interactive search tasks. International Journal of HumanComputer Studies 40: 965–1008.
Zagar, D. (1988). L'utilisation du temps d'exposition comme indicateur du temps de traitement pendant la lecture. In J.P. Caverni, ed., Psychologie cognitive: Modèles et méthodes, pp. 293–308. Grenoble: Presses Universitaires.
Zeller, P. (1996). Etude des stratégies d'exploration d'un hyperdocument utilisé pour la formation professionnelle des ambulanciers (study of a hyperdocument used in the professional training of ambulance workers). Université de Genève, Facultée de Psychologie et des Sciences de l'Education, unpublished manuscript.