Learning similarity measure for natural image retrieval with relevance feedback

IEEE Transactions on Neural Networks - Tập 13 Số 4 - Trang 811-820 - 2002
Guo-Dong Guo1, A.K. Jain2, Wei-Ying Ma3, Hong-Jiang Zhang3
1Computer Sciences Department, University of Wisconsin Madison, WI, USA
2Department of Computer Science and Engineering, Michigan State University, East Lansing, MI, USA
3Microsoft Research China, Beijing, China

Tóm tắt

A new scheme of learning similarity measure is proposed for content-based image retrieval (CBIR). It learns a boundary that separates the images in the database into two clusters. Images inside the boundary are ranked by their Euclidean distances to the query. The scheme is called constrained similarity measure (CSM), which not only takes into consideration the perceptual similarity between images, but also significantly improves the retrieval performance of the Euclidean distance measure. Two techniques, support vector machine (SVM) and AdaBoost from machine learning, are utilized to learn the boundary. They are compared to see their differences in boundary learning. The positive and negative examples used to learn the boundary are provided by the user with relevance feedback. The CSM metric is evaluated in a large database of 10009 natural images with an accurate ground truth. Experimental results demonstrate the usefulness and effectiveness of the proposed similarity measure for image retrieval.

Từ khóa

#Image retrieval #Feedback #Content based retrieval #Support vector machines #Indexing #Image databases #Machine learning #Information retrieval #Humans #Euclidean distance

Tài liệu tham khảo

10.1109/34.192463 minka, 1995, Interactive learning using a society of models niblack, 1993, the qbic project: querying images by content using color, texture, and shape, Proc SPIE, 1908, 173, 10.1117/12.143648 10.1109/ACV.1996.572008 pentland, 1994, photobook: tools for content based manipulation of image databases, Proc SPIE, 2185, 34, 10.1117/12.171786 10.1109/ICCV.1999.790412 rui, 1997, a relevance feedback architecture in content-based multimedia information retrieval systems, Proc IEEE Workshop Content-Based Access of Image and Video Libraries 10.1109/76.718510 10.1109/34.790428 10.1109/34.895972 wyszecki, 1982, Color Science Concepts and Methods Quantitative Data and Formulae 10.1006/jcss.1997.1504 weston, 2000, feature selection for svm's, Advances in neural information processing systems, 13 10.1109/ICPR.2000.906006 10.1145/266180.266383 guo, 2001, Learning Similarity Measure for Natural Image Retrieval With Relevance Feedback, 731 ma, 1998, content-based image indexing and retrieval, Handbook of Multimedia Computing johansson, 2000, A Survey on Contents Based Search in Image Databases 10.1007/BF00994018 10.1109/34.531803 burges, 1996, simplified support vector decision rules, Proc 13th Int Conf Machine Learning, 71 10.1109/72.788641 10.1007/BF00130487 stricker, 1995, similarity of color images, Proc SPIE Conf Storage and Retrieval for Image and Video Databases II, 2185, 381, 10.1117/12.205308 10.1109/CVPR.2000.855824 10.1109/TSMC.1978.4309999 vapnik, 1998, Statistical Learning Theory 10.1109/83.892448