3D object retrieval via range image queries in a bag-of-visual-words context

The Visual Computer - Tập 29 Số 12 - Trang 1351-1361 - 2013
Sfikas, Konstantinos1, Theoharis, Theoharis1,2, Pratikakis, Ioannis3
1Computer Graphics Laboratory, Department of Informatics and Telecommunications, University of Athens, Athens, Greece
2IDI, NTNU, Trondheim, Norway
3Department of Electrical and Computer Engineering, Democritus University of Thrace, Xanthi, Greece

Tóm tắt

3D object retrieval based on range image queries that represent partial views of real 3D objects is presented. The complete 3D models of the database are described by a set of panoramic views, and a Bag-of-Visual-Words model is built using SIFT features extracted from them. To address the problem of partial matching, we suggest a histogram computation scheme, on the panoramic views, that represents local information by taking into account spatial context. Furthermore, a number of optimization techniques are applied throughout the process for enhancing the retrieval performance. Its superior performance is shown by evaluating it against state-of-the-art methods on standard datasets.

Tài liệu tham khảo

citation_journal_title=Pattern Recognit. Lett.; citation_title=3D scene retrieval and recognition with depth gradient images; citation_author=A. Adán, P. Merchán, S. Salamanca; citation_volume=32; citation_issue=9; citation_publication_date=2011; citation_pages=1337-1353; citation_doi=10.1016/j.patrec.2011.03.016; citation_id=CR1 citation_journal_title=Vis. Comput.; citation_title=3D articulated object retrieval using a graph-based representation; citation_author=A. Agathos, I. Pratikakis, P. Papadakis, S. Perantonis, P. Azariadis, N.S. Sapidis; citation_volume=26; citation_issue=10; citation_publication_date=2010; citation_pages=1301-1319; citation_doi=10.1007/s00371-010-0523-1; citation_id=CR2 citation_title=Three things everyone should know to improve object retrieval; citation_inbook_title=CVPR; citation_publication_date=2012; citation_pages=2911-2918; citation_id=CR3; citation_author=R. Arandjelović; citation_author=A. Zisserman; citation_publisher=IEEE Press citation_journal_title=Bull. Calcutta Math. Soc.; citation_title=On a measure of divergence between two statistical populations defined by their probability distributions; citation_author=A. Bhattacharyya; citation_volume=35; citation_publication_date=1943; citation_pages=99-109; citation_id=CR4 citation_title=Scene classification via pLSA; citation_inbook_title=ECCV (4)’06; citation_publication_date=2006; citation_pages=517-530; citation_id=CR5; citation_author=A. Bosch; citation_author=A. Zisserman; citation_author=X. Muñoz; citation_publisher=Springer citation_title=Image classification using random forests and ferns; citation_inbook_title=ICCV’07; citation_publication_date=2007; citation_pages=1-8; citation_id=CR6; citation_author=A. Bosch; citation_author=A. Zisserman; citation_author=X. Muñoz; citation_publisher=IEEE Press citation_title=Enhanced 2D/3D approaches based on relevance index for 3D-shape retrieval; citation_inbook_title=SMI; citation_publication_date=2006; citation_pages=36; citation_id=CR7; citation_author=M. Chaouch; citation_author=A. Verroust-Blondet; citation_publisher=IEEE Comput. Soc. citation_title=A new descriptor for 2D depth image indexing and 3D model retrieval; citation_inbook_title=IEEE International Conference on Image Processing (ICIP 2007); citation_publication_date=2007; citation_pages=373-376; citation_id=CR8; citation_author=M. Chaouch; citation_author=A. Verroust-Blondet citation_journal_title=Comput. Graph. Forum; citation_title=On visual similarity based 3D model retrieval; citation_author=D.Y. Chen, X.P. Tian, Y.T. Shen, M. Ouhyoung; citation_volume=22; citation_publication_date=2003; citation_pages=223-232; citation_doi=10.1111/1467-8659.00669; citation_id=CR9 citation_journal_title=Pattern Recognit. Lett.; citation_title=3D free-form object recognition in range images using local surface patches; citation_author=H. Chen, B. Bhanu; citation_volume=28; citation_issue=10; citation_publication_date=2007; citation_pages=1252-1262; citation_doi=10.1016/j.patrec.2007.02.009; citation_id=CR10 citation_title=Mammographic image classification using histogram intersection; citation_inbook_title=ISBI; citation_publication_date=2010; citation_pages=197-200; citation_id=CR11; citation_author=E. Cheng; citation_author=N. Xie; citation_author=H. Lin; citation_author=P.R. Bakic; citation_author=A.D.A. Maidment; citation_author=V. Megalooikonomou; citation_publisher=IEEE Press citation_title=Visual categorization with bags of keypoints; citation_inbook_title=Workshop on Statistical Learning in Computer Vision (ECCV); citation_publication_date=2004; citation_pages=1-22; citation_id=CR12; citation_author=G. Csurka; citation_author=C.R. Dance; citation_author=L. Fan; citation_author=J. Willamowski; citation_author=C. Bray citation_title=A compact multi-view descriptor for 3D object retrieval; citation_inbook_title=Proceedings of the 2009 Seventh International Workshop on Content-Based Multimedia Indexing (CBMI ’09); citation_publication_date=2009; citation_pages=115-119; citation_id=CR13; citation_author=P. Daras; citation_author=A. Axenopoulos; citation_publisher=IEEE Computer Society citation_title=An introduction to Morphological Image Processing; citation_publication_date=1992; citation_id=CR14; citation_author=E.R. Dougherty; citation_publisher=SPIE Optical Engineering Press citation_title=SHREC’09 track: querying with partial models; citation_inbook_title=Eurographics Workshop on 3D Object Retrieval; citation_publication_date=2009; citation_pages=69-76; citation_id=CR15; citation_author=H. Dutagaci; citation_author=A. Godil; citation_author=A. Axenopoulos; citation_author=P. Daras; citation_author=T. Furuya; citation_author=R. Ohbuchi citation_title=SHREC’10 track: Range scan retrieval; citation_inbook_title=Eurographics Workshop on 3D Object Retrieval; citation_publication_date=2010; citation_pages=109-115; citation_id=CR16; citation_author=H. Dutagaci; citation_author=A. Godil; citation_author=C.P. Cheung; citation_author=T. Furuya; citation_author=U. Hillenbrand; citation_author=R. Ohbuchi citation_title=A new shape benchmark for 3D object retrieval; citation_inbook_title=ISVC (1); citation_publication_date=2008; citation_pages=381-392; citation_id=CR17; citation_author=R. Fang; citation_author=A. Godil; citation_author=X. Li; citation_author=A. Wagan; citation_publisher=Springer citation_title=Recognizing objects in range data using regional point descriptors; citation_inbook_title=Proceedings of the European Conference on Computer Vision (ECCV); citation_publication_date=2004; citation_pages=224-237; citation_id=CR18; citation_author=A. Frome; citation_author=D. Huber; citation_author=R. Kolluri; citation_author=T. Bülow; citation_author=J. Malik; citation_publisher=Springer citation_title=Dense sampling and fast encoding for 3D model retrieval using bag-of-visual features; citation_inbook_title=Proceedings of the ACM International Conference on Image and Video Retrieval (CIVR ’09); citation_publication_date=2009; citation_pages=26:1-26:8; citation_id=CR19; citation_author=T. Furuya; citation_author=R. Ohbuchi; citation_publisher=ACM citation_journal_title=Mach. Learn.; citation_title=Extremely randomized trees; citation_author=P. Geurts, D. Ernst, L. Wehenkel; citation_volume=36; citation_issue=1; citation_publication_date=2006; citation_pages=3-42; citation_doi=10.1007/s10994-006-6226-1; citation_id=CR20 Giorgi, D., Biasotti, S., Paraboschi, L.: SHape REtrieval contest 2007: Watertight models track (2007) citation_title=3D object recognition from range images using local feature histograms; citation_inbook_title=Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2001); citation_publication_date=2001; citation_pages=394-399; citation_id=CR22; citation_author=G. Hetzel; citation_author=B. Leibe; citation_author=P. Levi; citation_author=B. Schiele; citation_publisher=IEEE Comput. Soc. citation_journal_title=ACM Trans. Inf. Syst.; citation_title=Cumulated gain-based evaluation of IR techniques; citation_author=K. Järvelin, J. Kekäläinen; citation_volume=20; citation_issue=4; citation_publication_date=2002; citation_pages=422-446; citation_doi=10.1145/582415.582418; citation_id=CR23 citation_journal_title=IEEE Trans. Pattern Anal. Mach. Intell.; citation_title=Using spin images for efficient object recognition in cluttered 3D scenes; citation_author=A.E. Johnson, M. Hebert; citation_volume=21; citation_issue=5; citation_publication_date=1999; citation_pages=433-449; citation_doi=10.1109/34.765655; citation_id=CR24 citation_title=Rotation invariant spherical harmonic representation of 3D shape descriptors; citation_inbook_title=Proceedings of the 2003 Eurographics/ACM SIGGRAPH symposium on Geometry processing (SGP ’03); citation_publication_date=2003; citation_pages=156-164; citation_id=CR25; citation_author=M. Kazhdan; citation_author=T. Funkhouser; citation_author=S. Rusinkiewicz citation_journal_title=IEEE Trans. Inf. Theory; citation_title=Least squares quantization in PCM; citation_author=S.P. Lloyd; citation_volume=28; citation_issue=2; citation_publication_date=1982; citation_pages=129-137; citation_doi=10.1109/TIT.1982.1056489; citation_id=CR26 citation_title=Object recognition from local scale-invariant features; citation_inbook_title=Proceedings of the International Conference on Computer Vision (ICCV ’99); citation_publication_date=1999; citation_pages=1150-1157; citation_id=CR27; citation_author=D.G. Lowe; citation_publisher=IEEE Comput. Soc. citation_journal_title=Vis. Comput.; citation_title=Reeb graph path dissimilarity for 3D object matching and retrieval; citation_author=W. Mohamed, A. Hamza; citation_volume=28; citation_issue=3; citation_publication_date=2012; citation_pages=305-318; citation_doi=10.1007/s00371-011-0640-5; citation_id=CR28 citation_title=Scale-weighted dense bag of visual features for 3D model retrieval from a partial view 3D model; citation_inbook_title=IEEE 12th International Conference on Computer Vision Workshops (ICCV Workshops); citation_publication_date=2009; citation_pages=63-70; citation_id=CR29; citation_author=R. Ohbuchi; citation_author=T. Furuya citation_title=Retrieving 3D shapes based on their appearance; citation_inbook_title=Proceedings of the 5th ACM SIGMM international workshop on Multimedia information retrieval, MIR ’03; citation_publication_date=2003; citation_pages=39-45; citation_id=CR30; citation_author=R. Ohbuchi; citation_author=M. Nakazawa; citation_author=T. Takei; citation_publisher=ACM citation_title=Salient local visual features for shape-based 3D model retrieval; citation_inbook_title=Shape Modeling International; citation_publication_date=2008; citation_pages=93-102; citation_id=CR31; citation_author=R. Ohbuchi; citation_author=K. Osada; citation_author=T. Furuya; citation_author=T. Banno; citation_publisher=IEEE Press citation_journal_title=Int. J. Comput. Vis.; citation_title=PANORAMA: A 3D shape descriptor based on panoramic views for unsupervised 3D object retrieval; citation_author=P. Papadakis, I. Pratikakis, T. Theoharis, S.J. Perantonis; citation_volume=89; citation_issue=2–3; citation_publication_date=2010; citation_pages=177-192; citation_doi=10.1007/s11263-009-0281-6; citation_id=CR32 citation_title=A new paradigm for recognizing 3-D object shapes from range data; citation_inbook_title=Proceedings of the Ninth IEEE International Conference on Computer Vision (ICCV ’03); citation_publication_date=2003; citation_pages=1126-1133; citation_id=CR33; citation_author=S. Ruiz-Correa; citation_author=L.G. Shapiro; citation_author=M. Meila; citation_publisher=IEEE Comput. Soc. citation_title=3D Object Retrieval via Range Image Queries based on SIFT descriptors on Panoramic Views; citation_inbook_title=Eurographics Workshop on 3D Object Retrieval; citation_publication_date=2012; citation_pages=9-15; citation_id=CR34; citation_author=K. Sfikas; citation_author=I. Pratikakis; citation_author=T. Theoharis citation_journal_title=Vis. Comput.; citation_title=Non-rigid 3D object retrieval using topological information guided by conformal factors; citation_author=K. Sfikas, T. Theoharis, I. Pratikakis; citation_volume=28; citation_publication_date=2012; citation_pages=943-955; citation_doi=10.1007/s00371-012-0714-z; citation_id=CR35 citation_journal_title=Pattern Recognit.; citation_title=A new 3D model retrieval approach based on the elevation descriptor; citation_author=J.L. Shih, C.H. Lee, J.T. Wang; citation_volume=40; citation_issue=1; citation_publication_date=2007; citation_pages=283-295; citation_doi=10.1016/j.patcog.2006.04.034; citation_id=CR36 citation_title=The Princeton shape benchmark; citation_inbook_title=Proceedings of the Shape Modeling International 2004 (SMI ’04); citation_publication_date=2004; citation_pages=167-178; citation_id=CR37; citation_author=P. Shilane; citation_author=P. Min; citation_author=M. Kazhdan; citation_author=T. Funkhouser; citation_publisher=IEEE Comput. Soc. citation_title=Real-time human pose recognition in parts from single depth images; citation_inbook_title=Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR ’11); citation_publication_date=2011; citation_pages=1297-1304; citation_id=CR38; citation_author=J. Shotton; citation_author=A. Fitzgibbon; citation_author=M. Cook; citation_author=T. Sharp; citation_author=M. Finocchio; citation_author=R. Moore; citation_author=A. Kipman; citation_author=A. Blake; citation_publisher=IEEE Comput. Soc. SHREC2011: shape retrieval contest of range scans. http://www.itl.nist.gov/iad/vug/sharp/contest/2011/RangeScans/ . Accessed on 08/2012 citation_journal_title=IEEE Trans. Pattern Anal. Mach. Intell.; citation_title=Efficient visual search of videos cast as text retrieval; citation_author=J. Sivic, A. Zisserman; citation_volume=31; citation_publication_date=2009; citation_pages=591-606; citation_doi=10.1109/TPAMI.2008.111; citation_id=CR40 citation_journal_title=IEEE Trans. Multimed.; citation_title=3D model search and retrieval from range images using salient features; citation_author=T.G. Stavropoulos, P. Moschonas, K. Moustakas, D. Tzovaras, M.G. Strintzis; citation_volume=12; citation_issue=7; citation_publication_date=2010; citation_pages=692-704; citation_doi=10.1109/TMM.2010.2053023; citation_id=CR41 citation_title=Graphics and Visualization: Principles & Algorithms; citation_publication_date=2007; citation_id=CR42; citation_author=T. Theoharis; citation_author=G. Papaioannou; citation_author=N. Platis; citation_author=N.M. Patrikalakis; citation_publisher=A. K. Peters, Ltd. citation_title=DESIRE: a composite 3D-shape descriptor; citation_inbook_title=ICME; citation_publication_date=2005; citation_pages=962-965; citation_id=CR43; citation_author=D.V. Vranic; citation_publisher=IEEE Press citation_title=Surflet-pair-relation histograms: a statistical 3D-shape representation for rapid classification; citation_inbook_title=3DIM; citation_publication_date=2003; citation_pages=474-481; citation_id=CR44; citation_author=E. Wahl; citation_author=U. Hillenbrand; citation_author=G. Hirzinger; citation_publisher=IEEE Comput. Soc.