Content-based 3D mesh model retrieval from hand-written sketch

Springer Science and Business Media LLC - Tập 2 - Trang 87-98 - 2008
Satoshi Kanai1
1Graduate School of Information Science and Technology, Hokkaido University, Sapporo, Japan

Tóm tắt

Recently, huge numbers of 3D models (solid, surface, and mesh models) have been archived in CA-X systems for industrial design, engineering, manufacturing and e-commerce. Efficient searching methods for 3D models become important for system users. For this purpose, a content-based 3D mesh model retrieval system from hand- written sketch is proposed in this paper. In the system, the user puts a query in the form of a 2D hand-written sketch to a 3D mesh model database, and the system automatically returns a set of mesh models whose 2D views are similar to the input sketch. Generic Fourier Descriptor and Local Binary Pattern which are features invariant to rotation, translation and scaling of 2D images are used to measure dissimilarities between a query sketch and images generated from 3D models. The effectiveness of the retrieval system is evaluated through case studies on industrial design process.

Tài liệu tham khảo

Várudy T., Martin R.R. and Cox J. (1997). Special issue: reverse engineering of geometric models. Comput. Aided Des. 29(4): 253–254 Bennis, F., Chedmail, P., Hélary, O.: Representation of design activities using neural networks: application to fuzzy dimensioning. Montréal-Québec, IDMME’2000 (2000) Manjunath B.S., Salembier P. and Sikora T. (2002). Introduction to MPEG-7: Multimedia Content Description Interface. Wiley, Hoboken Smeulders A.W.M., Worring M., Santini S., Gupta A. and Jain R. (2000). Content-based image retrieval at the end of the early years. IEEE Trans. Pattern Anal. Mach. Intell. 22(12): 1349–1380 Hanjalic A., Langelaar G.C., van Roosmalen P.M.B., Biemond J., Lagendijk R.L (2000). Image and video databases: restroration, watermarking and retrieval. Adv. Image Commun. 8: 313–434 Tangelder, J.W.H., Veltkamp, R.C.: A survey of content based 3d shape retrieval methods. In: Shape Modeling International, pp. 145–156 (2004) Corney J., Rea H. and Clark D. (2002). Coarse filters for shape matching. IEEE Comput. Graph. Appl. 22(3): 65–74 Iyer N., Jayanti S., Lou K., Kalyanaraman Y. and Ramani K. (2005). Three dimensional shape searching: state-of-the-art review and future trends. Comput. Aided Des. 37(5): 509–530 Kazhdan M., Chazelle B., Dobkin D., Funkhouser T. and Rusinkiewicz T. (2004). A reflective symmetry descriptor for 3d models. Algorithmica 38(1): 201–225 Zhang, C., Chen, T.: Indexing and retrieval of 3d models aided by active learning. ACM Multimedia, pp. 615–616 (2001) Osada R., Funkhouser T., Chazelle B. and Dobkin D. (2002). Shape distributions. ACM Trans. Graph. 21(4): 807–832 Ip, C.Y., Lapadat, D., Sieger, L., Regli, W.C.: Using shape distributions to compare solid models. In: Proc. ACM Solid Modeling ’02, pp. 273–280 (2002) Ohbuchi, R., Otagiri, T., Ibato, M., Takei, T. (2002) Shape-similarity search of three-dimensional models using parameterized statistics. In: Proc. Pacific Graphics 2002, pp. 265–274 Shum, H.-Y., Hebert, M., Ikeuchi, K.: On 3d shape similarity. In: Proc. IEEE Computer Vision and Pattern Recognition, pp. 526–531 (1996) Johnson A.E. and Hebert M. (1999). Using spin images for efficient object recognition in cluttered 3d scenes. PAMI 21(5): 635–651 Chua S.J. and Jarvis R. (1997). Point signatures: a new representation for 3d object recognition. Int. J. Comput. Vis. 25: 63–5 Cardone, A., Gupta, S.K.: Identifying similar parts for assisting cost estimation of prismatic machined parts. In: Proceedings of 2004 ASME/DETC, number 57761, ASME/DETC (2004) El-Mehalawi M. and Miller R.A. (2003). A database system of mechanical components based on geometric and topological similarity. Part i: representation. J. Comput. Aided Des. 35(1): 83–94 El-Mehalawi M. and Miller R.A. (2003). A database system of mechanical components based on geometric and topological similarity. part ii: indexing, retrieval, matching and similarity assessment. J. Comput. Aided Des. 35(1): 95–105 McWherter, D., Peabody, M., Shokoufandeh, A., Regli, W.C.: Database techniques for archival of solid models. Solid Modeling ’01, pp. 78–87 (2001) Sundar, H., Silver, D., Gagvani, N., Dickenson, S.: Skeleton based shape matching and retrieval. In: Proc. of Shape Modeling International 2003, pp. 130–139 (2003) Iyer N., Lou K., Jayanti S., Kalyanaraman Y. and Ramani K. (2005). Shape based searching for product lifecycle applications. Comput. Aided Des. 37: 1435–1446 Hilaga, M., Shinagawa, Y., Kohmura, T., Kunii, T.L.: Topology matching for fully automatic similarity estimation of 3d shapes. In: ACM SIGGRAPH 2001, pp. 12–17, August 2001 Macrini, D., Shokoufandeh, A., Dickenson, S., Siddiqi, K., Zucker, S.: Viewbased 3-d object recognition using shock graphs. ICPR 2002 (2002) Cyr, C.M., Kimia, B.: 3d object recognition using shape similiarity-based aspect graph. ICCV01, pp. I:254–I:261 (2001) Ohbuchi, R., Nakazawa, M., Takei, T.: Retrieving 3d shapes based on their appearance.In: Proc. 5th ACM SIGMM Workshop on Multimedia Information Retrieval (MIR 003), (MIR 003) (2003) Funkhouser T., Min P., Kazhdan M., Chen J., Halderman A. and Dobkin D. (2003). A search engine for 3D models. ACM Trans. Graph. 22(1): 83–105 Chen, D.-Y., Tian, X.-P., Shen, Y.-T., Ouhyoung, M.: On visual similarity based 3d model retrieval. In: Computer Graphics Forum (EG 2003 Proceedings), number 22(3) (2003) Hou, S., Ramani, K.: Dynamic query interface for 3d shape search. In: Proceedings of 2004 ASME/DETC, number 57687, DETC2004, (2004) Pu J.T., Lou K. and Ramani K. (2005). A 2d sketch-based user interface for 3d cad model retrieval. Comput. Aided Des. Appl. 2(6): 717–725 Raskar, R.: Hardware support for non-photorealistic rendering. In: Proc. of SIGGRAPH/ Eurographics Workshop on Graphics Hardware (HWWS), pp. 41–47, August 2001 Pierre S. (2004). Morphological Image Analysis. Springer, Berlin Zhang D. and Lu G. (2002). Shape-based image retrieval using generic fourier descriptor. Signal Process. Image Commun. 17: 825–848 Ojala T., Pietikainen M. and Harwood D. (1996). A comparative study of texture measures with classification based on feature distributions. Pattern Recognit. 29(1): 51–59 Ohashi G., Nagashima Y., Mochizuki K. and Shimodaira Y. (2002). Edge-based image retrieval using a rough sketch. J. Inst. Image Inf. Telev. Eng. (in Japanese) 56(4): 653–658 De espona 3d enciclopedia. http://www.deespona.com Müller H., Müller W., Squire D.M., Marchand S. and Pun T. (2001). Performance evaluation in content-based image retrieval: overview and proposals. Pattern Recognit. Lett. 22: 593–601 Zhang D. and Lu G. (2003). A comparative study of curvature scale space and fourier descriptors for shape-based image retrieval. J. Vis. Commun. Image Present. 14: 41–60 Glunlund G.H. (1972). Fourier preprocessing for hand paint character recognition. IEEE Trans. Computer C21(2): 195–201