Unsupervised training of acoustic models for large vocabulary continuous speech recognition

F. Wessel1, H. Ney1
1Lehrstuhl für Informatik VI, Computer Science Department, RWTH Aachen University of Technology, Aachen, Germany

Tóm tắt

For speech recognition systems, the amount of acoustic training data is of crucial importance. In the past, large amounts of speech were recorded and transcribed manually for training. Since untranscribed speech is available in various forms these days, the unsupervised training of a speech recognizer on recognized transcriptions is studied. A low-cost recognizer trained with only one hour of manually transcribed speech is used to recognize 72 hours of untranscribed acoustic data. These transcriptions are then used in combination with confidence measures to train an improved recognizer. The effect of confidence measures which are used to detect possible recognition errors is studied systematically. Finally, the unsupervised training is applied iteratively. Using this method, the recognizer is trained with very little manual effort while losing only 14.3% relative on the Broadcast News '96 and 18.6% relative on the Broadcast News '98 evaluation test sets.

Từ khóa

#Vocabulary #Speech recognition #Broadcasting #Error analysis #Linear discriminant analysis #Training data #Computer science #Acoustic signal detection #Testing #Personnel

Tài liệu tham khảo

10.1109/89.906002 10.1109/ICASSP.1998.674408 10.1006/csla.1996.0022 lamel, 2000, Lightly supervised acoustic model training, Proc Automatic Speech Recognition Workshop, 150 kemp, 1999, Unsupervised training of a speech recognizer: Recent experiments, Proc of European Conference of Speech Communication and Technology, 5, 2725