On selecting a measure of retrieval effectiveness

Wiley - Tập 24 Số 2 - Trang 87-100 - 1973
William S. Cooper1
1School of Librarianship University of California Berkeley, California

Tóm tắt

AbstractIt is argued that a user's subjective evaluation of the personal utility of a retrieval system's output to him, if it could be properly quantified, would be a near‐ideal measure of retrieval effectiveness. A hypothetical methodology is presented for measuring this utility by means of an elicitation procedure. Because the hypothetical methodology is impractical, compromise methods are outlined and their underlying simplifying assumptions are discussed. The more plausible the simplifying assumptions on which a performance measure is based, the better the measure. This, along with evidence gleaned from ‘validation experiments’ of a certain kind, is suggsted as a criterion for selecting or deriving the best measure of effectiveness to use under given test conditions.

Từ khóa


Tài liệu tham khảo

Robertson S. E., The Parametric Description of Retrieval Tests, Journal of Documentation, 25, 1, 10.1108/eb026462

10.1108/eb026466

10.1126/science.141.3577.245

Giuliano V., 1966, Study and Test of a Methodology for Laboratory Evaluation of Message Retrieval Systems, Report ESD‐TR‐66‐405

King D. W., 1971, The Evaluation of Information Services and Products

Cooper W. S. On Deriving Design Equations for Information Retrieval Systems Journal of the American Society for Information Science385–395(1970).

10.1016/0020-0271(71)90024-6

Schlaifer R., 1961, Introduction to Statistics for Business Decisions

10.1037/11774-000

10.1126/science.103.2684.677

10.1126/science.161.3844.849

Thông tin
Thông tin xuất bản

Wiley

Tập 24 Số 2

87-100

Thông tin tác giả