Diagnostic Models for Procedural Bugs in Basic Mathematical Skills*

Cognitive Science - Tập 2 Số 2 - Trang 155-192 - 1978
John Seely Brown1, Richard R. Burton1
1Bolt, Beranek and Newman

Tóm tắt

A new diagnostic modeling system for automatically synthesizing a deep‐structure model of a student's misconceptions or bugs in his basic mathematical skills provides a mechanism for explaining why a student is making a mistake as opposed to simply identifying the mistake. This report is divided into four sections: The first provides examples of the problems that must be handled by a diagnostic model. It then introduces procedural networks as a general framework for representing the knowledge underlying a skill. The challenge in designing this representation is to find one that facilitates the discovery of misconceptions or bugs existing in a particular student's encoding of this knowledge. The second section discusses some of the pedagogical issues that have emerged from the use of diagnostic models within an instructional system. This discussion is framed in the context of a computer‐based tutoring/gaming system developed to teach students and student teachers how to diagnose bugs strategically as well as how to provide a better understanding of the underlying structure of arithmetic skills. The third section describes our uses of an executable network as a tool for automatically diagnosing student behavior, for automatically generating “diagnostic” tests, and for judging the diagnostic quality of a given exam. Included in this section is a discussion of the success of this system in diagnosing 1300 school students from a data base of 20.000 test items. The last section discusses future research directions.

Từ khóa


Tài liệu tham khảo

Barr A., 1974, A rationale and description of the BASIC instructional program

Brown J. S., 1974, Structural models of a student's knowledge and inferential processes

Brown J. S., 1975, Representation and understanding: Studies in cognitive science

Brown J. S., 1977, Presented at the First International Conference on Applied General Systems Research: Recent Developments and Trends

Brown J. S., 1978, Learning strategies

Brown J. S., 1976, Reactive learning environment for computer assisted electronics instruction, 10.1037/e532082009-001

Brown J. S., 1977, Aspects of a theory for automated student modelling

Burton R. R., 1977, Semantic grammar: A technique for constructing natural language interfaces to instructional systems, 10.1145/1045283.1045290

Burton R. R., 1976, Proceedings of the Symposium on Computer Science and Education

Carbonell J., 1973, Proceedings of the Third International Joint Conference on Artificial Intelligence

Carr B., 1977, Overlays: A theory of modeling for computer aided instruction

Collins A., 1975, The psychology of learning and motivation

10.2307/748696

Dienes Z. P., 1970, Learning logic, logical games

Easley J. A., Jr., 1975, Teaching by listening ‐ toward a new day in math classes, Contemporary Education, 47, 19

Friend J., 1976, Description of items to be used in addition/subtraction tests

Goldstein I.Understanding simple picture programs. Massachusetts Institute of Technology AI Laboratory Technical Report 294 September 1974.

Goldstein I.The computer as coach: An athletic paradigm for intellectual education. Massachusetts Institute of Technology AI Memo 389 February 1977.

Goldstein I. &Grimson E.Annotated production systems. A model for skill acquisition.Proceedings of the Seventh International Joint Conference on Artificial Intelligence August 1977.

10.1038/scientificamerican0277-100

Matz M.Some issues on building an Articulate Expert for high school algebra. BBN Report ICAI 10 (in preparation) 1978.

Miller M. &Goldstein I.Overview of a linguistic theory of design. Massachusetts Institute of Technology AI Memo 383 December 1976.

Rich C. &Schrobe H. E.Initial report on a LISP programmer's apprentice. Massachusetts Institute of Technology Al‐TR‐354 December 1976.

Rubin A.Hypothesis formation and evaluation in medical diagnosis. Massachusetts Institute of Technology Artificial Intelligence Laboratory Al‐TR‐316 January 1975.

Sacerdoti E., 1977, The Artificial Intelligence Series

Searle B. Friend J. &Suppes P.The radio mathematics project: Nicaragua 1974–1975. Institute for Mathematical Studies in the Social Sciences Stanford University 1976.

10.1016/S0020-7373(74)80005-2

Smith M. J. &Sleeman D. H.APRIL: A flexible production rule interpreter. SIGART Newsletter No. 63 June 1977.

West T.Diagnosing pupil errors: looking for patterns.The Arithmetic Teacher 1971 64.

Young R. M.Mixtures of strategies in structurally adaptive production systems: Examples from seriation and subtraction. SIGART Newsletter No. 63 June 1977.