The concept of relevance in IR

Wiley - Tập 54 Số 10 - Trang 913-925 - 2003
Pia Borlund1
1Department of Information Studies, Royal School of Library and Information Science, Aalborg branch, Sohngaardsholmsvej 2, DK-9000 Aalborg, Denmark

Tóm tắt

Abstract

This article introduces the concept of relevance as viewed and applied in the context of IR evaluation, by presenting an overview of the multidimensional and dynamic nature of the concept. The literature on relevance reveals how the relevance concept, especially in regard to the multidimensionality of relevance, is many faceted, and does not just refer to the various relevance criteria users may apply in the process of judging relevance of retrieved information objects. From our point of view, the multidimensionality of relevance explains why some will argue that no consensus has been reached on the relevance concept. Thus, the objective of this article is to present an overview of the many different views and ways by which the concept of relevance is used—leading to a consistent and compatible understanding of the concept. In addition, special attention is paid to the type of situational relevance. Many researchers perceive situational relevance as the most realistic type of user relevance, and therefore situational relevance is discussed with reference to its potential dynamic nature, and as a requirement for interactive information retrieval (IIR) evaluation.

Từ khóa


Tài liệu tham khảo

10.1016/S0306-4573(97)00078-2

10.1002/(SICI)1097-4571(199404)45:3<149::AID-ASI5>3.0.CO;2-J

Bateman J.(1998).Changes in relevance criteria: A longitudinal study. In: ASIS Proceedings.1998(pp.23–32).

Belkin N.J., 1977, International workshop on the cognitive viewpoint, 187

10.1108/eb026653

10.1108/EUM0000000007198

Borlund P., 1998, Measures of relative relevance and ranked half‐life: Performance indicators for interactive IR, 324

Borlund P., 2000, Evaluation of interactive information retrieval systems. Doctoral dissertation, Åbo Akademi University

10.1108/EUM0000000007110

Brookes B.C., 1975, 42

Brookes B.C., 1975, Problems of information science, FID 530, 115

Brookes B.C., 1977, International workshop on the cognitive viewpoint, 195

10.1177/016555158000200302

10.1002/(SICI)1097-4571(199404)45:3<142::AID-ASI4>3.0.CO;2-6

Campbell I., 1996, The ostensive model of developing information needs, 251

Cleverdon C.W., 1960, Aslib Cranfield research project: Report on the first stage of an investigation into the comparative efficiency of indexing systems

10.1016/0020-0271(71)90024-6

10.1177/002224378001700401

10.1016/S0306-4573(99)00072-2

Cuadra C.A., 1967, Project summary (TM‐3520/001/00)

10.1108/eb026436

De Mey M., 1980, Theory and application of information research, 49

Doyle L.B.(1963).Is Relevance an adequate criterion in retrieval system evaluation?Proceedings of the American Documentation Institute; 26th annual meeting (pp.199–200). Chicago IL.

10.1002/(SICI)1097-4571(198809)39:5<293::AID-ASI1>3.0.CO;2-I

Eisenberg M. &Hu X.(1987).Dichotomous relevance judgments and the evaluation of information systems. In: ASIS Proceedings (pp.66–69).

Eisenberg M. &Schamber L.(1988).Relevance: The Search for a definition. In ASIS Proceedings (pp.164–168).

10.1016/0306-4573(88)90042-8

10.1002/(SICI)1097-4571(199404)45:3<124::AID-ASI2>3.0.CO;2-8

10.1002/(SICI)1097-4571(199510)46:9<646::AID-ASI2>3.0.CO;2-1

10.1002/asi.5090070408

10.1002/(SICI)1097-4571(199210)43:9<602::AID-ASI3>3.0.CO;2-Q

10.1016/S0953-5438(02)00023-1

Hjørland B., 1997, Information seeking and subject representation: An activity–theoretical approach to information science

10.1108/eb026960

10.2307/3150242

10.1002/(SICI)1097-4571(199404)45:3<160::AID-ASI6>3.0.CO;2-4

Järvelin K., 2000, IR evaluation methods for retrieving highly relevant documents, 41

Kuhlthau C.C., 1993, Seeking meaning: A process approach to library and information science

10.1002/asi.4630200204

Lemon N., 1973, Attitudes and their measurement

10.1016/S0953-5438(98)00012-5

10.1016/0306-4573(93)90026-A

10.1086/602592

10.1002/(SICI)1097-4571(199404)45:3<135::AID-ASI3>3.0.CO;2-1

Rees A.M., 1967

Reid J., 1999, A New, task‐oriented paradigm for information retrieval: Implications for evaluation of information retrieval systems, 97

10.1016/0306-4573(92)90004-J

Robins D.(1997).Shifts of focus in information retrieval interaction. In ASIS Proceedings (pp.123–134).

Saracevic T.(1969).Comparative effects of titles abstracts and full texts on relevance judgments. In ASIS Proceedings (pp.293–299).

10.1002/asi.4630260604

Saracevic T., 1996, Relevance Reconsidered '96, 201

Saracevic T. &Su L.(1989).Modelling and measuring user–intermediary–computer interaction online searching: Design of study. In ASIS Proceedings (pp.75–80).

Schamber L., 1994, Annual review of information science and technology (ARIST), 3

10.1016/0306-4573(90)90050-C

Sperber D., 1986, Relevance: Communication and cognition

10.1016/S0306-4573(98)00025-9

10.1016/0306-4573(92)90007-M

10.1086/620653

10.1086/601800

10.1002/(SICI)1097-4571(1999)50:3<254::AID-ASI8>3.0.CO;2-Y

10.1016/S0306-4573(97)00081-2

10.1108/eb026215

10.1108/EUM0000000007127

van Rijsbergen C.J., 1979, Information retrieval

Voorhees E., 2001, Evaluation by highly relevant documents, 41

Voorhees E.M., 1998, Variations in relevance judgments and the measurement of retrieval effectiveness, 315

10.1016/S0306-4573(00)00010-8

10.1016/0020-0271(73)90096-X

Thông tin
Thông tin xuất bản

Wiley

Tập 54 Số 10

913-925

Thông tin tác giả