Using inverted files to compress text
ITI 2002. Proceedings of the 24th International Conference on Information Technology Interfaces (IEEE Cat. No.02EX534) - Trang 443-447 vol.1
Tóm tắt
This is the first report on a new approach to text compression. It consists of representing the text file with compressed inverted file index in conjunction with very compact lexicon, where lexicon includes every word in the text. The index is compressed using standard index compression techniques, and lexicon is compressed with original dictionary compression method that gives better compression results than existing procedures. Compression procedure is complex, but decompression time is linear with the file size, although it requires two passes and hence can not be performed online. First experiments show that this method, when refined, can be competitive for larger texts that only need to be decompressed in the real time.
Từ khóa
#Image coding #Data compression #Indexing #Application software #Computer applications #Time measurement #Image reconstruction #Multidimensional systems #Information technologyTài liệu tham khảo
10.1109/DCC.2002.1000013
ristov, 1999, Ziv lempel compression of huge natural language data tries using suffix arrays, Proceedings of the 10th Annual Symposium Combinatorial Pattern Matching CPM'99, 196, 10.1007/3-540-48452-3_15
bell, 1990, Text Compression
witten, 1999, Managing Gigabytes