HoloSLAM: a novel approach to virtual landmark-based SLAM for indoor environments

Jiang G, Yin L, Jin S, Tian C, Ma X, Ou Y (2019) A simultaneous localization and mapping (SLAM) framework for 2.5D map building based on low-cost LiDAR and vision fusion. Appl Sci. https://doi.org/10.3390/app9102105 Aulinas J, Petillot Y, Salvi J, Lladó X (2008) The SLAM problem: a survey. Front Artif Intell Appl. https://doi.org/10.3233/978-1-58603-925-7-363 Ding H, Zhang B, Zhou J, Yan Y, Tian G, Gu B (2022) Recent developments and applications of simultaneous localization and mapping in agriculture. J F Robot. https://doi.org/10.1002/rob.22077 Chen Y et al (2018) The accuracy comparison of three simultaneous localization and mapping (SLAM)-based indoor mapping technologies. Sensors (Switzerland). https://doi.org/10.3390/s18103228 Willners JS et al (2021) Robust underwater SLAM using autonomous relocalisation. IFAC-PapersOnLine. https://doi.org/10.1016/j.ifacol.2021.10.104 Kalita H, Gholap AS, Thangavelautham J (2020) Dynamics and control of a hopping robot for extreme environment exploration on the Moon and Mars. IEEE Aerosp Conf Proc. https://doi.org/10.1109/AERO47225.2020.9172617 Taheri H, Xia ZC (2021) SLAM; definition and evolution. Eng Appl Artif Intell 97:104032. https://doi.org/10.1016/j.engappai.2020.104032 Zhong X, Zhou Y, Liu H (2017) Design and recognition of artificial landmarks for reliable indoor self-localization of mobile robots. Int J Adv Robot Syst. https://doi.org/10.1177/1729881417693489 Nguyen X-H, Nguyen V-H, Ngo T-T (2020) A new landmark detection approach for slam algorithm applied in mobile robot. J Sci Technol - Tech Univ. https://doi.org/10.51316/30.7.6 Kumar Aggarwal A (2015) Machine vision based self-position estimation of mobile robots. Int J Electron Commun Eng Technol 6(10):20–29 Domain F, Jouffre D, Caverivière A (2000) SLAM for dummies: a tutorial approach to simultaneous localization and mapping. https://doi.org/10.1017/S0025315400002526 Básaca-Preciado LC et al (2020) Autonomous mobile vehicle system overview for wheeled ground applications. Machine vision and navigation. Springer, Cham. https://doi.org/10.1007/978-3-030-22587-2_15 Fazli S, Kleeman L (2007) Simultaneous landmark classification, localization and map building for an advanced sonar ring. Robotica. https://doi.org/10.1017/S0263574706003079 Souto LAV, Castro A, Gonçalves LMG, Nascimento TP (2017) Stairs and doors recognition as natural landmarks based on clouds of 3D edge-points from RGB-D sensors for mobile robot localization. Sensors (Switzerland). https://doi.org/10.3390/s17081824 Rosa S (2014) Localization and mapping for service robotics applications. p 113. https://doi.org/10.6092/polito/porto/2542488 Bahraini MS, Rad AB, Bozorg M (2019) SLAM in dynamic environments: a deep learning approach for moving object tracking using ML-RANSAC algorithm. Sensors (Switzerland). https://doi.org/10.3390/s19173699 Ryu H (2019) A revisiting method using a covariance traveling salesman problem algorithm for landmark-based simultaneous localization and mapping. Sensors (Switzerland) 19(22):4910. https://doi.org/10.3390/s19224910 Núñez P, Vázquez-Martín R, del Toro JC, Bandera A, Sandoval F (2008) Natural landmark extraction for mobile robot navigation based on an adaptive curvature estimation. Rob Auton Syst. https://doi.org/10.1016/j.robot.2007.07.005 Arican Z (2004) Vision-based robot localization using artificial and natural landmarks, August, 2004 Franco Jr JC (2019) Modelagem BIM de infraestrutura urbana a partir de levantamentos aéreos com drone Holmes C, Barfoot TD (2023) An efficient global optimality certificate for landmark-based SLAM. IEEE Robot Autom Lett. https://doi.org/10.1109/LRA.2023.3238173 Gonzalez JP, Stentz A (2007) Planning with uncertainty in position using high-resolution maps. In: Proc. - IEEE Int. Conf. Robot. Autom. pp 1015–1022. https://doi.org/10.1109/ROBOT.2007.363118 Du ZJ, Huang SS, Mu TJ, Zhao Q, Martin RR, Xu K (2022) Accurate dynamic SLAM using CRF-based long-term consistency. IEEE Trans Vis Comput Graph. https://doi.org/10.1109/TVCG.2020.3028218 Dong X, Cheng L, Peng H, Li T (2022) FSD-SLAM: a fast semi-direct SLAM algorithm. Complex Intell Syst. https://doi.org/10.1007/s40747-021-00323-y Atanasov N, Bowman SL, Daniilidis K, Pappas GJ (2018) A unifying view of geometry, semantics, and data association in SLAM. IJCAI Int Jt Conf Artif Intell. https://doi.org/10.24963/ijcai.2018/722 Lahemer ES, Rad A (2019) An adaptive augmented vision-based ellipsoidal slam for indoor environments. Sensors (Switzerland). https://doi.org/10.3390/s19122795 Aycock T (2010) A simultaneous localization and mapping implementation using inexpensive hardware. Update Pedrycz W (1997) Bounding approaches to system identification. Control Eng Pract. https://doi.org/10.1016/S0967-0661(97)87398-4 Arena F, Collotta M, Pau G, Termine F (2022) An overview of augmented reality. Computers. https://doi.org/10.3390/computers11020028 Bray B, Zeller M, Schonning N (2018) What is mixed reality? Microsoft [Online]. Available: https://docs.microsoft.com/en-us/windows/mixed-reality/mixed-reality Microsoft, “Microsoft, Microsoft HoloLens, Available https://www.microsoft.com/en-us/hololens”, [Online]. Available: www.microsoft.com/en-us/hololens C. Republic, A. Technologies and I. Studies (2019) Hybrid slam modelling of autonomous vehicle with, no. September Fankhauser P, Bloesch M, Hutter M (2018) Probabilistic terrain mapping for mobile robots with uncertain localization. IEEE Robot Autom Lett. https://doi.org/10.1109/LRA.2018.2849506 Durrant-Whyte H, Rye D, Nebot E (1996) Localization of autonomous guided vehicles. Robot Res. https://doi.org/10.1007/978-1-4471-1021-7_69 Kalman RE (1960) A new approach to linear filtering and prediction problems. J Basic Eng. https://doi.org/10.1115/1.3662552 Samsuri SB, Zamzuri H, Abdul Rahman MA, Mazlan SA, Abd Rahman AH (2015) Computational cost analysis of extended Kalman filter in simultaneous localization and mapping (EKF-SLAM) problem for autonomous vehicle. ARPN J Eng Appl Sci 10(17):7764–7768 Sola J (2013) Simulataneous localization and mapping with the extended Kalman filter, Unpubl. Available http://www.joansola.eu/JoanSola/eng/JoanSola.html Thrun S, Wolfram B, Dieter F (2005) Probabilistic robotics Placed JA et al (2023) A survey on active simultaneous localization and mapping: state of the art and new frontiers. IEEE Trans Robot. https://doi.org/10.1109/tro.2023.3248510 Taheri H, Xia ZC (2021) SLAM; definition and evolution. Eng Appl Artif Intell. https://doi.org/10.1016/j.engappai.2020.104032 Cadena C, Carlone L, Carrillo H, Latif Y, Scaramuzza D, Neira J, Reid I, Leonard JJ (2016) Past, present, and future of simultaneous localization and mapping: towards the robust-perception age. IEEE Trans Robot. https://doi.org/10.1109/TRO.2016.2624754 Scholte E, Campbell ME (2003) A nonlinear set-membership filter for on-line applications. Int J Robust Nonlinear Control. https://doi.org/10.1002/rnc.856 Eliazar A, Parr R (2003) DP-SLAM: Fast, robust simultaneous localization and mapping without predetermined landmarks. In: IJCAI International Joint Conference on Artificial Intelligence Werede Gunaza Teame, Yu Y, Zhongmin W (2020) Optimization of SLAM Gmapping based on Simulation. Int J Eng Res. https://doi.org/10.17577/ijertv9is040107 Abbeel P (2006) gMapping. Trans Robot Haykin S (2001) Kalman filtering and neural networks. Wiley. https://doi.org/10.1002/0471221546 Sim R, Little JJ (2006) Autonomous vision-based exploration and mapping using hybrid maps and Rao-Blackwellised particle filters. IEEE Int Conf Intell Robot Syst. https://doi.org/10.1109/IROS.2006.282485 Wen S et al (2018) Camera recognition and laser detection based on EKF-SLAM in the autonomous navigation of humanoid robot. J Intell Robot Syst Theory Appl. https://doi.org/10.1007/s10846-017-0712-5 Smith R, Self M, Cheeseman P (1988) Estimating uncertain spatial relationships in robotics. Mach Intell Pattern Recognit. https://doi.org/10.1016/B978-0-444-70396-5.50042-X Neira J, Tardós JD (2001) Data association in stochastic mapping using the joint compatibility test. IEEE Trans Robot Autom. https://doi.org/10.1109/70.976019 Kato H (2012) Introduction to augmented reality. J Inst Image Inf Telev Eng. https://doi.org/10.3169/itej.66.53 Aliyu F, Talib CA (2019) Virtual reality technology. Asia Proc Soc Sci. https://doi.org/10.31580/apss.v4i3.856 Milgram P, Kishino F (1994) Taxonomy of mixed reality visual displays. IEICE Trans Inf Syst 77(12):1321–1329 Milgram P, Fumio K (2003) A taxonomy of mixed reality visual displays. IEICE Trans Inf Syst 2003 Flavián C, Ibáñez-Sánchez S, Orús C (2019) The impact of virtual, augmented and mixed reality technologies on the customer experience. J Bus Res. https://doi.org/10.1016/j.jbusres.2018.10.050 Pan Z, Cheok AD, Yang H, Zhu J, Shi J (2006) Virtual reality and mixed reality for virtual learning environments. Comput Graph 30(1):20–28. https://doi.org/10.1016/j.cag.2005.10.004 Rokhsaritalemi S, Sadeghi-Niaraki A, Choi SM (2020) A review on mixed reality: current trends, challenges and prospects. Appl Sci (Switzerland). https://doi.org/10.3390/app10020636 Mallikarjuna Rao AJ, Sharma M (2017) HoloLens blueprints : experience the virtual and real worlds coming together with HoloLens, 6th ed. Birmingham, England ; Mumbai, India : Packt Publishing. [Online]. Available: https://learning.oreilly.com/library/view/hololens-blueprints/9781787281943/ Meulstee JW et al (2019) Toward holographic-guided surgery. Surg Innov. https://doi.org/10.1177/1553350618799552 Rubino D, Rubino D (2016) Microsoft HoloLens – Here are the full processor, storage and RAM specs, 2.5.2016. https://docs.microsoft.com/en-us/windows/mixed-reality/hololens-hardware-details. Accessed 04 Apr 2019 Vroegop D (2017) Microsoft HoloLens developer’s guide. Packt Publishing. [Online]. Available: https://learning.oreilly.com/library/view/microsoft-hololens-developers/9781786460851/ Microsoft, MR Basics 100: Getting started with Unity. https://docs.microsoft.com/en-us/windows/mixed-reality/holograms-100 Microsoft (2018) HoloLens research mode. https://docs.microsoft.com/en-us/windows/mixed-reality/research-mode Microsoft Hololens Hardware, [Online]. Available: https://docs.microsoft.com/en-us/windows/mixed-reality/hololens-hardware-details Microsoft (2016) Using the HoloLens emulator. https://docs.microsoft.com/en-us/windows/mixed-reality/using-the-hololens-emulator. Accessed 01 Jan 2020 Liu Y, Dong H, Zhang L, El Saddik A (2018) Technical evaluation of HoloLens for multimedia: a first look. IEEE Multimed. https://doi.org/10.1109/MMUL.2018.2873473 Soares I, Sousa RB, Petry M, Moreira AP (2021) Accuracy and repeatability tests on HoloLens 2 and htc vive. Multimodal Technol Interact. https://doi.org/10.3390/mti5080047 Aldebaran Robotics Website (2019) https://www.aldebaranrobotics.com/en/Home/welcome.html?language=en-GB. Accessed 25 Apr 2019 Hugel V et al (2009) Mechatronic design of NAO humanoid. pp 769–774. https://doi.org/10.1109/robot.2009.5152516. Aldabarn Robotics (2019) NAO software documentaion Bergmann F (2015) Acoustic communication between two robots based on the NAO robot system, Bachelor Thesis López-Caudana EO, González Gutiérrez CD (2016) Fuzzy PD controller in NAO system’s platform. Automation and control trends. InTech. https://doi.org/10.5772/63979 Hartley R, Zisserman A, Hartley R, Zisserman A (2011) Camera models. Multiple view geometry in computer vision. Cambridge University Press, Cambridge. https://doi.org/10.1017/cbo9780511811685.010 Hartley R, Zisserman A (2004) Multiple view geometry in computer vision. Cambridge University Press, Cambridge. https://doi.org/10.1017/cbo9780511811685 Andrew AM (2001) Multiple view geometry in computer vision. Kybernetes. https://doi.org/10.1016/S0143-8166(01)00145-2 Zhang H, Zhang C, Yang W, Chen CY (2015) Localization and navigation using QR code for mobile robot in indoor environment. In: 2015 IEEE Int. Conf. Robot. Biomimetics, IEEE-ROBIO 2015, no. March, pp 2501–2506. https://doi.org/10.1109/ROBIO.2015.7419715 Girisha H, Dheerendra Kumar A, Singh A, Bharath KP, Deepak (2022) QR code detection. Int J Adv Res Sci Commun Technol. https://doi.org/10.48175/ijarsct-5353 Huo L, Zhu J, Singh PK, Pavlovich PA (2021) Research on QR image code recognition system based on artificial intelligence algorithm. J Intell Syst. https://doi.org/10.1515/jisys-2020-0143 Alexandrea P (2019) Top 12 Best 3D software for beginners. https://www.3dnatives.com/en/3d-software-beginners100420174/. Accessed 01 Apr 2019