The interpretation of laser radar images by a knowledge-based system

Machine Vision and Applications - Tập 4 Số 3 - Trang 145-163 - 1991
Chu, Chen-Chau1, Aggarwal, J. K.1
1Computer and Vision Research Center, University of Texas at Austin, Austin, USA

Tóm tắt

This paper presents a knowledge-based system to interpret laser radar (ladar) images. The objective of this research is to detect and recognize man-made objects in outdoor scenes. Our system applies themultisensor fusion approach to multiple ladar modalities to improve both segmentation and interpretation. The segmentation modules are written in C. The knowledge-based interpretation system is constructed usingKEE and Lisp. Low-level attributes of image segments (regions) are computed by the segmentation modules and then converted to theKEE format. The interpretation system applies forward chaining in a bottom-up fashion to derive object-level interpretation from input generated by low-level processing and segmentation modules. The interpretation modules detect man-made objects from the background using low-level attributes. Segments are grouped into objects, which are then classified into predefined categories (vehicles, ground, etc.). The efficiency of the interpretation system is enhanced by transferring nonsymbolic processing tasks to a concurrent service manager (program). Experimental results using ladar data are presented.

Tài liệu tham khảo

citation_title=Laser radar systems and techniques; citation_publication_date=1979; citation_id=CR1; citation_author=CG Bachman; citation_publisher=Artech House Belknap R, Riseman EM, Hanson AR (1985) The information fusion problem and rule-based hypotheses applied to complex aggregations of image events. In: The Proceedings of DARPA Image Understanding Workshop. Miami Beach, FL, December 9–10, pp 279–292 Bhanu B, Symosek P (1987) In: Interpretation of terrain using hierarchical symbolic groupings for multi-spectral images. In: The Proceedings of DARPA Image Understanding Workshop. Los Angeles, CA, February, pp 466–474 citation_journal_title=IEEE Transactions on Aerospace and Electronics Systems; citation_title=A prospectus for automatic target recognition; citation_author=WM Brown, CW Swonger; citation_volume=AES-25; citation_issue=3; citation_publication_date=1989; citation_pages=401-410; citation_id=CR4 citation_title=Rule-Based Expert Systems; citation_publication_date=1984; citation_id=CR5; citation_author=BG Buchanan; citation_author=EH Shortliffe; citation_publisher=Addison-Wesley Chu C, Nandhakumar N, Aggarwal JK (1988) Information integration and scene segmentation for laser radar images. In: Proceedings of the Pattern Recognition for Advanced Missile Systems Conference. Huntsville AL, November 14–15, pp 93–105 citation_journal_title=Pattern Recognition; citation_title=Image segmentation using laser radar data; citation_author=C Chu, N Nandhakumar, JK Aggarwal; citation_volume=23; citation_publication_date=1990; citation_pages=569-581; citation_id=CR7 citation_journal_title=Artificial Intelligence; citation_title=Heuristic classification; citation_author=WJ Clancey; citation_volume=27; citation_publication_date=1985; citation_pages=289-350; citation_id=CR8 Daily MJ, Harris JG, Reiser K (1987) Detecting obstacles in range imagery. In: The Proceedings of DARPA Image Understanding Workshop. Los Angeles, CA, February, pp 87–97 Daily MJ, Harris JG, Reiser K (1988) An operational perception system for cross-country navigation. In: The Proceedings of DARPA Image Understanding Workshop. Cambridge, MA, pp 568–575 citation_journal_title=IEEE Transactions on Pattern Analysis and Machine Intelligence; citation_title=A rule-based approach to visual pattern inspection; citation_author=AM Darwish, AK Jain; citation_volume=PAMI-10; citation_issue=1; citation_publication_date=1988; citation_pages=56-68; citation_id=CR11 citation_title=The origin of rule-based systems in AI; citation_inbook_title=Rule-Based Expert Systems; citation_publication_date=1984; citation_pages=20-52; citation_id=CR12; citation_author=R Davis; citation_author=JJ King; citation_publisher=Addison-Wesley Draper BA, Brolio J, Collins RT, Hanson AR, Riseman EM (1988) Image interpretation by distributed cooperative process. In: The Proceedings of Computer Vision and Pattern Recognition. Ann Arbor, MI, June 5–9, pp 129–135 Draper BA, Collins RT, Brolio J, Griffith J, Hanson AR, Riseman EM (1987) Tools and experiments in the knowledge-directed interpretation of road scenes. In: The Proceedings of DARPA Image Understanding Workshop. Los Angeles, CA, February, pp 179–193 citation_journal_title=International Journal of Computer Vision; citation_title=The schema system; citation_author=BA Draper, RT Collins, J Brolio, AR Hanson, EM Riseman; citation_volume=2; citation_publication_date=1989; citation_pages=209-250; citation_id=CR15 Dudgeon DE, Verly JG, Delanoy RL (1988) An experimental system for recognizing targets in laser radar imagery. In: Proceedings of the Pattern Recognition for Advanced Missile Systems Conference. Huntsville, AL, November 14–15, pp 107–116 Dudgeon DE, Verly JG, Delanoy RL (1989) An experimental target recognition system for laser radar imagery. In: The Proceedings of DARPA Image Understanding Workshop. Palo Alto, CA, May, pp 479–506 Fan TJ, Medioni G, Nevatia R (1988) 3D object recognition using surface description. In: Proceedings of DARPA Image Understanding Workshop. April, pp 383–397 Fowler CA (1989) Three R's of radar: Recollections, remonstrances, and ruminations. IEEE Aerospace and Electronics Systems Magazine August, pp 18–25 citation_journal_title=Proceedings of SPIE.; citation_title=Survey of AI approaches to the integration of information; citation_author=TD Garvey; citation_volume=782; citation_publication_date=1987; citation_pages=68-82; citation_id=CR20 Gupta A, Forgy CL, Kalp D, Newell A, Tambe M (1988) Parallel OPS5 on the encore multimax. In: The Proceedings of International Conference of Parallel Processing, pp 271–280 Harwood D, Chang S, Davis LS (1987) Interpreting aerial photographs by segmentation and search. In: The Proceedings of DARPA Image Understanding Workshop. Los Angeles, CA, February, pp 507–520 Herbert M, Kanade T (1988) 3-D vision for outdoor navigation by an autonomous vehicle. In: The Proceedings of DARPA Image Understanding Workshop. Cambridge, MA, pp 593–601 Herbert M, Kanade T (1988) 3-D vision for outdoor navigation by an autonomous vehicle. In: The Proceedings of DARPA Image Understanding Workshop. Cambridge, MA, pp 593–601 citation_journal_title=Computer Vision, Graphics, and Image Processing; citation_title=Hypothesis integration in image understanding systems; citation_author=VS Hwang, LS Davis, T Matsuyama; citation_volume=36; citation_publication_date=1986; citation_pages=321-371; citation_id=CR25 IntelliCorp (1986)KEE Software Development System User's Manual, IntelliCorp citation_journal_title=IEEE Transactions on Pattern Analysis and Machine Intelligence; citation_title=Evidence-based recognition of 3-D objects; citation_author=AK Jain, R Hoffman; citation_volume=PAMI-10; citation_issue=6; citation_publication_date=1988; citation_pages=783-802; citation_id=CR27 Kohler RR (1984) Integrating non-semantic knowledge into image segmentation process. COINS Technical Report 84-04, University of Massachusetts Lawton DT, Levitt TS, Gelband P (1988) Knowledge based visions for terrestrial robots. In: The Proceedings of DARPA Image Understanding Workshop. Cambridge, MA, pp 103–110 citation_journal_title=Applied Optics; citation_title=Noise sources in laser radar systems; citation_author=D Letaick, I Renhorn, O Steinvall, JH Shapiro; citation_volume=28; citation_issue=13; citation_publication_date=1989; citation_pages=2657-2665; citation_id=CR30 citation_journal_title=IEEE Transactions on Pattern Analysis and Machine Intelligence; citation_title=Low level image segmentation: An expert system; citation_author=MD Levine, AM Nazif; citation_volume=PAMI-6; citation_issue=5; citation_publication_date=1985; citation_pages=555-577; citation_id=CR31 McKeown Jr., DM, Denlinger JL (1988) Cooperative methods for road tracking in aerial imagery. In: The Proceedings of DARPA Image Understanding Workshop. Cambridge, MA, pp 327–341 McKeown Jr., DM, Harvey WA (1987) Automating knowledge acquisition for aerial image interpretation. In: The Proceedings of DARPA Image Understanding Workshop, Los Angeles, CA, February, pp 205–226 citation_journal_title=IEEE Transactions on Pattern Analysis and Machine Intelligence; citation_title=Rule-based interpretation of aerial imagery; citation_author=DM McKeown, WA Harvey, J McDermott; citation_volume=PAMI-7; citation_issue=5; citation_publication_date=1985; citation_pages=570-585; citation_id=CR34 citation_journal_title=IEEE Transactions on Pattern Analysis and Machine Intelligence; citation_title=Knowledge structuring and constraint satisfaction: The Mapsee approach; citation_author=JA Mulder, AK Mackworth, WS Havens; citation_volume=PAMI-10; citation_issue=9; citation_publication_date=1988; citation_pages=866-879; citation_id=CR35 citation_title=Knowledge-based interpretation of outdoor natural color scenes; citation_publication_date=1985; citation_id=CR36; citation_author=Y Ohta; citation_publisher=Pitman Publishing Olin KE, Vilnrotter FM, Daily MJ, Reiser K (1987) Developments in knowledge-based vision for obstacle detection and avoidance. In: The Proceedings of DARPA Image Understanding Workshop. Los Angeles, CA, February, pp 78–86 citation_title=Artificial intelligence; citation_publication_date=1983; citation_id=CR38; citation_author=E Rich; citation_publisher=McGraw-Hill citation_title=A mathematical theory of evidence; citation_publication_date=1976; citation_id=CR39; citation_author=G Shafer; citation_publisher=Princeton University Press citation_journal_title=Applied Optics; citation_title=Imaging and target detection with a heterodyne-reception optical radar; citation_author=JH Shapiro, BA Capron, RC Harney; citation_volume=20; citation_issue=19; citation_publication_date=1981; citation_pages=3292-3313; citation_id=CR40 Shapiro LG (1985) The role of AI in computer vision. The Second Conference on Artificial Intelligence Applications. Miami Beach, FL, December 11–13, 76–81 citation_title=Introduction to radar systems; citation_publication_date=1980; citation_id=CR42; citation_author=MI Skolnik; citation_publisher=McGraw-Hill citation_journal_title=Proceedings of SPIE; citation_title=Multisensor data fusion of laser radar and forward looking infrared (FLIR) for target segmentation and enhancement; citation_author=CW Tong, SK Rogers, JP Mills, MK Kabrisky; citation_volume=782; citation_publication_date=1987; citation_pages=10-19; citation_id=CR43 citation_journal_title=Applied Optics; citation_title=Laboratory target reflectance measurements for coherent laser radar applications; citation_author=JY Wang, PA Pruitt; citation_volume=23; citation_issue=15; citation_publication_date=1984; citation_pages=2559-2564; citation_id=CR44