Automatic Summarization of Open-Domain Multiparty Dialogues in Diverse Genres

Computational Linguistics - Tập 28 Số 4 - Trang 447-485 - 2002
Klaus Zechner1
1Educational Testing Service, Educational Testing Service, Rosedale Road MS 11-R, Princeton, NJ 08541.

Tóm tắt

Automatic summarization of open-domain spoken dialogues is a relatively new research area. This article introduces the task and the challenges involved and motivates and presents an approach for obtaining automatic-extract summaries for human transcripts of multiparty dialogues of four different genres, without any restriction on domain. We address the following issues, which are intrinsic to spoken-dialogue summarization and typically can be ignored when summarizing written text such as news wire data: (1) detection and removal of speech disfluencies; (2) detection and insertion of sentence boundaries; and (3) detection and linking of cross-speaker information units (question-answer pairs). A system evaluation is performed using a corpus of 23 dialogue excerpts with an average duration of about 10 minutes, comprising 80 topical segments and about 47,000 words total. The corpus was manually annotated for relevant text spans by six human annotators. The global evaluation shows that for the two more informal genres, our summarization system using dialogue-specific components significantly outperforms two baselines: (1) a maximum-marginal-relevance ranking algorithm using TF*IDF term weighting, and (2) a LEAD baseline that extracts the first n words from a text.

Từ khóa


Tài liệu tham khảo

Carletta Jean, 1997, Computational Linguistics, 23, 13

10.1177/001316446002000104

10.2307/2529886

Grosz Barbara J, 1986, Computational Linguistics, 12, 175

Hearst Marti A, 1997, Computational Linguistics, 23, 33

Heeman Peter A, 1999, Computational Linguistics, 25, 527

10.1121/1.408547

Passonneau Rebecca J, 1997, Computational Linguistics, 23, 103

10.1002/asi.5090120210

10.1177/002383099804100410

10.1016/S0167-6393(00)00028-5

10.1162/089120100561737