Approach for improved development of advanced driver assistance systems for future smart mobility concepts
Tóm tắt
To use the benefits of Advanced Driver Assistance Systems (ADAS)-Tests in simulation and reality a new approach for using Augmented Reality (AR) in an automotive vehicle for testing ADAS is presented in this paper. Our procedure provides a link between simulation and reality and should enable a faster development process for future increasingly complex ADAS tests and future mobility solutions. Test fields for ADAS offer a small number of orientation points. Furthermore, these must be detected and processed at high vehicle speeds. That requires high computational power both for developing our method and its subsequent use in testing. Using image segmentation (IS), artificial intelligence (AI) for object recognition, and visual simultaneous localization and mapping (vSLAM), we aim to create a three-dimensional model with accurate information about the test site. It is expected that using AI and IS will significantly improve performance as computational speed and accuracy for AR applications in automobiles.
Tài liệu tham khảo
K. Bengler, K. Dietmayer, B. Farbe et al., Three decades of driver assistance systems: review and future perspectives. IEEE Intell. Transp. Syst. Mag. 6, 6–22 (2014)
R.R. Brooks, S.S. Iyengar, Multi-Sensor Fusion: Fundamentals and Applications with Software (Prentice Hall, Hoboken, 1998). https://search.library.wisc.edu/catalog/999904353602121. ISBN 978-0-13-901653-0
C. Campos, R. Elvira, J.J.G. Rodríguez et al., ORB-SLAM3: an accurate open-source library for visual, visual-inertial, and multimap SLAM. IEEE Trans. Robot. 37, 1–17 (2021). https://doi.org/10.1109/TRO.2021.3075644
R. Chatila, J. Laumond, Position referencing and consistent world modeling for mobile robots, in Proceedings. 1985 IEEE International Conference on Robotics and Automation, vol. 2 (1985), pp. 138–145. https://doi.org/10.1109/ROBOT.1985.1087373
R. Chatila, J.-P. Laumond, Position referencing and consistent world modeling for mobile robots, in 1985 IEEE International Conference on Proceedings Robotics and Automation, vol. 2 (1985), pp. 138–145. https://doi.org/10.1109/ROBOT.1985.1087373
M. Darms, Eine Basis-Systemarchitektur zur Sensordatenfusion von Umfeldsensoren fur Fahreras-sistenzsysteme (TU Darmstadt, Dusseldorf, 2007). de. Zugl.: Darmstadt, Techn. Univ., Diss., 2007. PhD thesis. http://tubiblio.ulb.tu-darmstadt.de/35385/. ISBN 978-3-18-365312-6
M. Darms, Eine basis-systemarchitektur zur sensordatenfusion von umfeldsensoren fuer fahrerassistenzsysteme. PhD thesis, Technische Universitat (2007)
M. Darms, Fusion umfelderfassender Sensoren, in Handbuch Fahrerassistenzsysteme: Grundlagen, Komponenten und Systeme für aktive Sicherheit und Komfort, ed. by H. Winner, S. Hakuli, G.W. Wiesbaden (Vieweg+Teubner, Wiesbaden, 2012), pp. 237–248. https://doi.org/10.1007/978-3-8348-8619-4_18. ISBN 978-3-8348-8619-4
J.J. Engel, J. Sturm, D. Cremers, Camera-based navigation of a low-cost quadrocopter, in 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems (2012), pp. 2815–2821
R. Fredriksson, M.G. Lenné, S. van Montfort et al., European NCAP program developments to address driver distraction, drowsiness and sudden sickness. Front. Neuroergon. 2, 786674 (2021). https://doi.org/10.3389/fnrgo.2021.786674. https://www.frontiersin.org/article/10.3389/fnrgo.2021.786674
T.M. Gasser, A. Seeck, B. Walker Smith, Rahmenbedingungen fur die Fahrerassistenzentwicklung, in Handbuch Fahrerassistenzsysteme: Grundlagen, Komponenten und Systeme für aktive Sicherheit und Komfort, ed. by H. Winner et al. (Springer, Wiesbaden, 2015), pp. 27–54. https://doi.org/10.1007/978-3-658-05734-3_3. ISBN 978-3-658-05734-3
S. Hakuli, M. Krug, Virtuelle integration, in Handbuch Fahrerassistenzsysteme, Grundlagen, Komponenten und Systeme fur aktive Sicherheit und Komfort, ed. by H. Winner et al. (Springer, Wiesbaden, 2015), pp. 125–138. https://doi.org/10.1007/978-3-658-05734-3_8
B.-J. Kim, S.-B. Lee, A study on the evaluation method of autonomous emergency vehicle braking for pedestrians test using monocular cameras. Appl. Sci. 10, 4683 (2020). https://doi.org/10.3390/app10134683. https://www.mdpi.com/2076-3417/10/13/4683
C. Miquet, New test method for reproducible real-time tests of ADAS ECUs: “vehicle-in-the-loop” connects real-world vehicle with the virtual world, in 5th International Munich Chassis Symposium 2014 (Springer, Wiesbaden, 2014), pp. 575–589. https://doi.org/10.1007/978-3-658-05978-1_40
R. Mur-Artal, J. Montiel, J. Tardos, ORB-SLAM: a versatile and accurate monocular SLAM system. IEEE Trans. Robot. 31, 1147–1163 (2015). https://doi.org/10.1109/TRO.2015.2463671
M. Nagai, Research into ADAS with autonomous driving intelligence for future innovation, in 5th International Munich Chassis Symposium 2014, ed. by P.E. Pfeffer (Springer, Wiesbaden, 2014), pp. 779–793. ISBN 978-3-658-05978-1
M. Noll, P. Rapps, Ultraschallsensorik, in Handbuch Fahrerassistenzsysteme: Grundlagen, Komponenten und Systeme für aktive Sicherheit und Komfort, ed. by H. Winner, S. Hakuli, G.W. Wiesbaden (Vieweg+Teubner, Wiesbaden, 2009), pp. 110–122. https://doi.org/10.1007/978-3-8348-9977-4_12. ISBN 978-38348-9977-4
On-Road Automated Driving (ORAD) Committee. Taxonomy and definitions for terms related to driving automation systems for on-road motor vehicles. Technical repport (SAE International). https://doi.org/10.4271/J3016_202104. https://www.sae.org/content/j3016_202104 (visited on 05/30/2022)
A.E.B. Pedestrian—Euro NCAP, https://www.euroncap.com:443/en/vehicle-safety/the-ratings-explained/vulnerable-road-user-vru-protection/aeb-pedestrian/ (visited on 05/30/2022)
M. Punke, S. Menzel, B. Werthessen et al., Automotive camera (hardware), in Handbook of Driver Assistance Systems: Basic Information, Components and Systems for Active Safety and Comfort, ed. by H. Winner et al. (Springer, Cham, 2016), pp. 431–460. https://doi.org/10.1007/978-3-319-12352-3_20. ISBN 978-3-319-123523
T. Raj, F.H. Hashim, A.B. Huddin et al., A survey on LiDAR scanning mechanisms. Electronics 9, 741 (2020). https://doi.org/10.3390/electronics9050741. https://www.mdpi.eom/2079-9292/9/5/741
F. Schuldt, F. Saust, B. Lichte et al., Effiziente systematische Testgenerierung fiir Fahrerassistenzsysteme in virtuellen Umgebungen (2013). https://doi.org/10.24355/dbbs.084-201307101421-0. https://publikationsserver.tu-braunschweig.de/receive/dbbs_mods_00052570
P. Seiniger, A. Weitzel, Testverfahren für Verbraucherschutz und Gesetzgebung, in Handbuch Fahrerassistenzsysteme, Grundlagen, Komponenten und Systeme für aktive Sicherheit und Komfort, ed. by H. Winner et al. (Springer, Wiesbaden, 2015), pp. 167–182. https://doi.org/10.1007/978-3-658-05734-3_11. ISBN 978-3658-05734-3
M. Sieber, G. Berg, I. Karl et al., Validation of driving behavior in the vehicle in the loop: steering responses in critical situations, in 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013) (2013), pp. 1101–1106. https://doi.org/10.1109/ITSC.2013.6728379
J.E. Stellet, M.R. Zofka, J. Schumacher et al., Testing of advanced driver assistance towards automated driving: a survey and taxonomy on existing approaches and open questions, in 2015 IEEE 18th International Conference on Intelligent Transportation Systems (2015), pp. 1455–1462. https://doi.org/10.1109/ITSC.2015.236
T. Taketomi, H. Uchiyama, S. Ikeda, Visual SLAM algorithms: a survey from 2010 to 2016. IPSJ Trans. Comput. Vis. Appl. 9, 16 (2017). https://doi.org/10.1186/s41074-017-0027-2
H. Winner, Radarsensorik, in Handbuch Fahrerassistenzsysteme: Grundlagen, Komponenten und Systeme für aktive Sicherheit und Komfort, ed. by H. Winner, S. Hakuli, G. Wolf (Vieweg+Teubner, Wiesbaden, 2012), pp. 123–171. https://doi.org/10.1007/978-3-8348-8619-4_13. ISBN 978-3-8348-8619-4
H. Winner, S. Hakuli, F. Lotz et al., Handbuch Fahrerassistenzsysteme—Grundlagen, Komponenten und Systeme für aktive Sicherheit und Komfort (Springer, Berlin, 2015). ISBN 9783-658-05734-3
C. Yu, Z. Liu, X. Liu et al., DS-SLAM: a semantic visual SLAM towards dynamic environments, in CoRR (2018). arXiv:1809.08379