Using inverted files to compress text

S. Ristov1
1Rudjer Boskovic Institute, Zagreb, Croatia

Tóm tắt

This is the first report on a new approach to text compression. It consists of representing the text file with compressed inverted file index in conjunction with very compact lexicon, where lexicon includes every word in the text. The index is compressed using standard index compression techniques, and lexicon is compressed with original dictionary compression method that gives better compression results than existing procedures. Compression procedure is complex, but decompression time is linear with the file size, although it requires two passes and hence can not be performed online. First experiments show that this method, when refined, can be competitive for larger texts that only need to be decompressed in the real time.

Từ khóa

#Image coding #Data compression #Indexing #Application software #Computer applications #Time measurement #Image reconstruction #Multidimensional systems #Information technology

Tài liệu tham khảo

10.1109/DCC.2002.1000013 ristov, 1999, Ziv lempel compression of huge natural language data tries using suffix arrays, Proceedings of the 10th Annual Symposium Combinatorial Pattern Matching CPM'99, 196, 10.1007/3-540-48452-3_15 bell, 1990, Text Compression witten, 1999, Managing Gigabytes