Semantic mapping for mobile robotics tasks: A survey

Robotics and Autonomous Systems - Tập 66 - Trang 86-103 - 2015
Ioannis Kostavelis, Αντώνιος Γαστεράτος

Tóm tắt

Từ khóa


Tài liệu tham khảo

Ryle, 1962, Abstractions, Dialogue, 1, 5, 10.1017/S0012217300040579

Pronobis, 2012, Large-scale semantic mapping and reasoning with heterogeneous modalities, 3515

Kostavelis, 2013, Learning spatially semantic representations for cognitive robot navigation, Robot. Auton. Syst., 61, 1460, 10.1016/j.robot.2013.07.008

Zender, 2008, Conceptual spatial representations for indoor mobile robots, Robot. Auton. Syst., 56, 493, 10.1016/j.robot.2008.03.007

Mozos, 2010

Pronobis, 2011

M.-W. Inc., Merriam-Webster’s collegiate dictionary, Merriam-Webster, 2004.

Pronobis, 2006, A discriminative approach to robust visual place recognition, 3829

A. Ranganathan, F. Dellaert, Semantic modeling of places using objects, in: Proceedings of the 2007 Robotics: Science and Systems Conference, vol. 3, 2007, pp. 27–30.

DeSouza, 2002, Vision for mobile robot navigation: A survey, Trans. Pattern Anal. Mach. Intell., 24, 237, 10.1109/34.982903

Kuipers, 1978, Modeling spatial knowledge, Cogn. Sci., 2, 129, 10.1207/s15516709cog0202_3

Kuipers, 1991, A robot exploration and mapping strategy based on a semantic hierarchy of spatial representations, Robot. Auton. Syst., 8, 47, 10.1016/0921-8890(91)90014-C

Kuipers, 2000, The spatial semantic hierarchy, Artif. Intell., 119, 191, 10.1016/S0004-3702(00)00017-5

Thrun, 2005

Filliat, 2003, Map-based navigation in mobile robots: I. A review of localization strategies, Cogn. Syst. Res., 4, 243, 10.1016/S1389-0417(03)00008-1

Meyer, 2003, Map-based navigation in mobile robots: II. A review of map-learning and path-planning strategies, Cogn. Syst. Res., 4, 283, 10.1016/S1389-0417(03)00007-X

Jian, 2013, Support-theoretic subgraph preconditioners for large-scale slam, 9

Grisetti, 2007, Improved techniques for grid mapping with rao-blackwellized particle filters, IEEE Trans. Robot., 23, 34, 10.1109/TRO.2006.889486

Hahnel, 2003, An efficient fastslam algorithm for generating maps of large-scale cyclic environments from raw laser range measurements, vol.~1, 206

Durrant-Whyte, 2006, Simultaneous localization and mapping: part I, Robot. Autom. Mag., IEEE, 13, 99, 10.1109/MRA.2006.1638022

Bailey, 2006, Simultaneous localization and mapping (slam): Part II, Robot. Autom. Mag., 13, 108, 10.1109/MRA.2006.1678144

Thrun, 1998, Learning metric-topological maps for indoor mobile robot navigation, Artif. Intell., 99, 21, 10.1016/S0004-3702(97)00078-7

Angeli, 2009, Visual topological slam and global localization, 4300

Blanco, 2007, A new approach for large-scale localization and mapping: Hybrid metric-topological slam, 2061

Bazeille, 2011, Incremental topo-metric slam using vision and robot odometry, 4067

Nielsen, 2004, Snapshots for semantic maps, vol.~3, 2853

Kostavelis, 2012, Learning the terrain and planning a collision-free trajectory for indoor post-disaster environments, 1

Kostavelis, 2012, Collision risk assessment for autonomous robots by offline traversability learning, Robot. Auton. Syst., 60, 1367, 10.1016/j.robot.2012.03.004

Rusu, 2008, Robots in the kitchen: Exploiting ubiquitous sensing and actuation, Robot. Auton. Syst., 56, 844, 10.1016/j.robot.2008.06.010

Viswanathan, 2010, Automated place classification using object detection, 324

Viswanathan, 2011, Place classification using visual object categorization and global information, 1

Russell, 2008, Labelme: A database and web-based tool for image annotation, Int. J. Comput. Vis., 77, 157, 10.1007/s11263-007-0090-8

Trevor, 2013, Efficient organized point cloud segmentation with connected components

Swadzba, 2014, A detailed analysis of a new 3d spatial feature vector for indoor scene classification, Robot. Auton. Syst., 62, 646, 10.1016/j.robot.2012.10.006

Mozos, 2012, Categorization of indoor places using the kinect sensor, Sensors, 12, 6695, 10.3390/s120506695

Espinace, 2013, Indoor scene recognition by a mobile robot through adaptive object detection, Robot. Auton. Syst., 61, 932, 10.1016/j.robot.2013.05.002

Nüchter, 2006, 3d mapping with semantic knowledge, 335

Blodow, 2011, Autonomous semantic mapping for robots performing everyday manipulation tasks in kitchen environments, 4263

Rusu, 2009, Model-based and learned semantic object labeling in 3d point cloud maps of kitchen environments, 3601

Trevor, 2010, Tables, counters, and shelves: Semantic mapping of surfaces in 3d

Rusu, 2008, Towards 3d point cloud based object maps for household environments, Robot. Auton. Syst., 56, 927, 10.1016/j.robot.2008.08.005

A.J. Trevor, J.G. Rogers, C. Nieto-Granda, H.I. Christensen, Feature-based mapping with grounded landmark and place labels, in: Workshop on Grounding Human–Robot Dialog for Spatial Tasks, 2011.

Cowley, 2011, Rapid multi-robot exploration with topometric maps, 1044

Günther, 2013, Building semantic object maps from sparse and noisy 3d data, 2228

Civera, 2011, Towards semantic slam using a monocular camera, 1277

Martinez~Mozos, 2007, Supervised semantic labeling of places using information extracted from sensor data, Robot. Auton. Syst., 55, 391, 10.1016/j.robot.2006.12.003

M. Michael, N. Roy, S. Thrun, D. Haehnel, C.S., et al. Carmen robot navigation toolkit, 2000. URL http://carmen.sourceforge.net/.

Pronobis, 2010, Multi-modal semantic place classification, Int. J. Robot. Res., 29, 298, 10.1177/0278364909356483

Ekvall, 2006, Integrating active mobile robot object recognition and slam in natural environments, 5792

Liu, 2014, Extracting semantic indoor maps from occupancy grids, Robot. Auton. Syst., 62, 663, 10.1016/j.robot.2012.10.004

Krishnan, 2010, A visual exploration algorithm using semantic cues that constructs image based hybrid maps, 1316

M. Luperto, A.Q. Li, F. Amigoni, A system for building semantic maps of indoor environments exploiting the concept of building typology, in: RoboCup 2013: Robot World Cup XVII, 2013, pp. 504–515.

A. Pronobis, P. Jensfelt, Understanding the real world: Combining objects, appearance, geometry and topology for semantic mapping.

Vasudevan, 2007, Cognitive maps for mobile robotsan object based approach, Robot. Auton. Syst., 55, 359, 10.1016/j.robot.2006.12.008

Case, 2011, Autonomous sign reading for semantic mapping, 3297

Nieto-Granda, 2010, Semantic map partitioning in indoor environments using regional analysis, 1451

M. Quigley, K. Conley, B. Gerkey, J. Faust, T. Foote, J. Leibs, R. Wheeler, A.Y. Ng, Ros: an open-source robot operating system, in: International Conference on Robotics and Automation, Workshop on Open Source Software, vol. 3, 2009.

Feng, 2012, Effective venue image retrieval using robust feature extraction and model constrained matching for mobile robot localization, Mach. Vis. Appl., 23, 1011, 10.1007/s00138-011-0350-z

Ranganathan, 2011, Visual place categorization in maps, 3982

Liu, 2013, Applying rule-based context knowledge to build abstract semantic maps of indoor environments, 5141

Galindo, 2005, Multi-hierarchical semantic maps for mobile robotics, 2278

Rituerto, 2014, Semantic labeling for indoor topological mapping using a wearable catadioptric system, Robot. Auton. Syst., 62, 685, 10.1016/j.robot.2012.10.002

J. Fasola, M.J. Matarić, Using semantic fields to model dynamic spatial relations in a robot architecture for natural language instruction of service robots, in: International Conference on Intelligent Robots and Systems, 2013.

Wang, 2011, An extended-hct semantic description for visual place recognition, Int. J. Robot. Res., 30, 1403, 10.1177/0278364911406760

Bordes, 2013, Information fusion and evidential grammars for object class segmentation

Sengupta, 2013, Urban 3d semantic modelling using stereo vision, 580

Paul, 2012, Semantic categorization of outdoor scenes with uncertainty estimates using multi-class gaussian process classification, 2404

Steder, 2011, Place recognition in 3d scans using a combination of bag of words and point feature based relative pose estimation, 1249

Sengupta, 2012, Automatic dense visual semantic mapping from street-level imagery, 857

Singh, 2012, Acquiring semantics induced topology in urban environments, 3509

Saux, 2013, Rapid semantic mapping: Learn environment classifiers on the fly, 3725

Katsura, 2003, A view-based outdoor navigation using object recognition robust to changes of weather and seasons, vol.~3, 2974

Viswanathan, 2009, Automated spatial-semantic modeling with applications to place labeling and informed search, 284

Vasudevan, 2008, Bayesian space conceptualization and place classification for semantic maps in mobile robotics, Robot. Auton. Syst., 56, 522, 10.1016/j.robot.2008.03.005

A. Pronobis, K. Sjöö, A. Aydemir, A.N. Bishop, P. Jensfelt, Representing spatial knowledge in mobile cognitive systems, in: 11th International Conference on Intelligent Autonomous Systems, 2010.

A. Aydemir, M. Göbelbecker, A. Pronobis, K. Sjöö, P. Jensfelt, Plan-based object search and exploration using semantic spatial knowledge in the real world, in: European Conference on Mobile Robotics, 2011.

Ko, 2013, Semantic mapping and navigation: A Bayesian approach, 2630

Mozos, 2006, Supervised learning of topological maps using semantic information extracted from range data, 2772

A. Pronobis, P. Jensfelt, Hierarchical multi-modal place categorization, in: 5th European Conference on Mobile Robots, 2011.

Kostavelis, 2013, Online spatiotemporal-coherent semantic maps for advanced robot navigation

Ranganathan, 2012, Pliss: labeling places using online changepoint detection, Auton. Robots, 32, 351, 10.1007/s10514-012-9273-4

H. Guillaume, M. Dubois, F. Emmanuelle, P. Tarroux, et al. Temporal bag-of-words—a generative model for visual place recognition using temporal integration, in: VISAPP-International Conference on Computer Vision Theory and Applications, 2011.

Cadena, 2012, Robust place recognition with stereo sequences, IEEE Trans. Robot., 28, 871, 10.1109/TRO.2012.2189497

Kostavelis, 2013, How do you help a robot to find a place? a supervised learning paradigm to semantically infer about places, 324

Linde, 2004, Object recognition using composed receptive field histograms of higher dimensionality, vol.~2, 1

Ullah, 2008, Towards robust place recognition for robot localization, 530

Pronobis, 2010, The more you learn, the less you store: Memory-controlled incremental svm for visual place recognition, Image Vis. Comput., 28, 1080, 10.1016/j.imavis.2010.01.015

Fazl-Ersi, 2012, Histogram of oriented uniform patterns for robust place recognition and categorization, Int. J. Robot. Res., 31, 468, 10.1177/0278364911434936

U. Weiss, P. Biber, Semantic place classification and mapping for autonomous agricultural robots, in: International Conference on Robotics and Automation, Workshop on Semantic Mapping and Autonomous Knowledge Acquisition, 2010.

Stachniss, 2006, Speeding-up multi-robot exploration by considering semantic place information, 1692

Meger, 2008, Curious George: An attentive semantic robot, Robot. Auton. Syst., 56, 503, 10.1016/j.robot.2008.03.008

Jebari, 2011, Multi-sensor semantic mapping and exploration of indoor environments, 151

Cadena, 2013, Semantic parsing for priming object detection in RGBD scenes

Wolf, 2008, Semantic mapping using mobile robots, Trans. Robot., 24, 245, 10.1109/TRO.2008.917001

He, 2013, Nonparametric semantic segmentation for 3d street scenes, 3697

Costante, 2013, A transfer learning approach for multi-cue semantic place recognition, 2122

Anand, 2013, Contextually guided semantic labeling and search for three-dimensional point clouds, Int. J. Robot. Res., 32, 19, 10.1177/0278364912461538

Topp, 2010, Detecting region transitions for human-augmented mapping, Trans. Robot., 26, 715, 10.1109/TRO.2010.2049178

Kruijff, 2007, Situated dialogue and spatial organization: What, where... and why, Int. J. Adv. Robot. Syst., 4, 125

Bonanni, 2013, Human–robot collaboration for semantic labeling of the environment

Trevor, 2012, Interactive map labeling for service robots

F. Dayoub, T. Duckett, G.E.A. Cielniak, Towards an object-based semantic memory for long-term operation of mobile service robots, in: IEEE International Conference on Robotics and Automation, 3rd Workshop on Semantic Perception, Mapping, and Exploration, Georgia Institute of Technology, 2010.

K. Klasing, G. Lidoris, A. Bauer, F. Rohrmüller, D. Wollherr, M. Buss, The autonomous city explorer: Towards semantic navigation in urban environments, in: 1st International Workshop on Cognition for Technical Systems, CoTeSys, 2008.

J. Penders, Viewfinder:final activity report.

Baudoin, 2009, View-finder: robotics assistance to fire-fighting services and crisis management, 1

Prestes, 2013, Towards a core ontology for robotics and automation, Robot. Auton. Syst., 61, 1193, 10.1016/j.robot.2013.04.005

Wyatt, 2010, Self-understanding and self-extension: A systems and representational approach, Trans. Auton. Mental Dev., 2, 282, 10.1109/TAMD.2010.2090149

Lim, 2011, Ontology-based unified robot knowledge for service robots in indoor environments, IEEE Trans. Syst. Man Cybern. A, 41, 492, 10.1109/TSMCA.2010.2076404

Bouguerra, 2007, Semantic knowledge-based execution monitoring for mobile robots, 3693

Tenorth, 2010, Knowrob-map-knowledge-linked semantic object maps, 430

Finucane, 2010, Ltlmop: Experimenting with language, temporal logic and robot control, 1988

C. Matuszek, E. Herbst, L. Zettlemoyer, D. Fox, Learning to parse natural language commands to a robot control system, in: Proc. of the 13th Int’l Symposium on Experimental Robotics, ISER, 2012.

Heintz, 2013, Semantically grounded stream reasoning integrated with ROS, 5935

Borkowski, 2010, Towards semantic navigation in mobile robotics, 719

Galindo, 2008, Robot task planning using semantic maps, Robot. Auton. Syst., 56, 955, 10.1016/j.robot.2008.08.007

Kollar, 2013, Learning environmental knowledge from task-based human–robot dialog, 4304

Liu, 2011, Ubiquitous and cooperative network robot system within a service framework, Int. J. Humanoid Robot., 8, 147, 10.1142/S021984361100237X

C. Galindo, J. González, J.-A. Fernández-Madrigal, A. Saffiotti, Robots that change their world: Inferring goals from semantic knowledge, in: 5th European Conference on Mobile Robots, 2011, pp. 1–6.

Wu, 2009, Visual place categorization: Problem, dataset, and algorithm, 4763

I. Kostavelis, A. Gasteratos, Cognitive Navigation Dataset, Group of Robotics and Cgnitive Systems, 2012, Available at URL http://robotics.pme.duth.gr/kostavelis/Dataset.html.

Pronobis, 2010, A realistic benchmark for visual indoor place recognition, Robot. Auton. Syst., 58, 81, 10.1016/j.robot.2009.07.025

Pronobis, 2009, COLD: COsy Localization Database, Int. J. Robot. Res. (IJRR), 28, 588, 10.1177/0278364909103912

Geiger, 2012, Are we ready for autonomous driving? the kitti vision benchmark suite, 3354

J. Fritsch, T. Kuehnl, A. Geiger, A new performance measure and evaluation benchmark for road detection algorithms, in: International Conference on Intelligent Transportation Systems, 2013.

Geiger, 2013, Vision meets robotics: The kitti dataset, Int. J. Robot. Res., 10.1177/0278364913491297

Mèuller, 2010

J. Martínez-Gómez, I. García-Varea, B. Caputo, Overview of the imageclef 2012 robot vision task, in: CLEF (Online Working Notes/Labs/Workshop), 2012.

Fong, 2003, A survey of socially interactive robots, Robot. Auton. Syst., 42, 143, 10.1016/S0921-8890(02)00372-X

Kostavelis, 2013, Visual odometry for autonomous robot navigation through efficient outlier rejection, 45