Smart data preprocessing method for remote vehicle diagnostics to increase data compression efficiency
Tóm tắt
The increasing number of functions in modern vehicle leads to an exponential increase in software complexity. The validity and reliability of all components must be ensured, making the use of appropriate vehicle diagnostics systems indispensable. The purpose of such systems is to collect and process data about the vehicle. To find issues during vehicle development, the OEMs will usually have a development fleet of thousands of vehicles. The challenge for diagnostic systems is to detect issues during these tests, as well as collecting as much data as possible about the circumstances that led to the fault. A single-vehicle produces hundreds of gigabytes of data per month. The required data bandwidth cannot be fulfilled by current mobile network subscriptions as well as WIFI or cable-based infrastructure. This limits the amount of data that can be collected during field tests and hinders big data analysis like AI training or validation. Hence a software solution for data reduction is necessary. The authors present a method for data handling that drastically reduces the amount of data consumption and optimizes the transfer delay between a remote-diagnostic systems and the cloud. Using a pipeline of data preprocessing as well as an established compression algorithm, the amount of transmitted data is reduced by a factor of nearly ten. This method will allow to collect more data in field testing and improve the understanding of issues during vehicle development.
Tài liệu tham khảo
Cars are made of Code. https://www.nxp.com/company/blog/cars-are-made-of-code:BL-CARS-MADE-CODE. Accessed 1 Oct 2021
Tiedemann, S., Mank, A.: Solving the validation challenge of automated driving with a holistic test center. Automatisiertes Fahren 2019. Proceedings. 155–164. (2019). https://doi.org/10.1007/978-3-658-27990-5_14
Visualisations: Global Data. https://www.measurementlab.net/visualizations/. Accessed 18 Jan 2021
Van Leeuwen, T., Moerman, I., Rogier, H.: Broadband wireless communication in vehicles. J Commun Netw 2, 77–82 (2003)
Peon-Quiros, M., Mancuso, V., Comite, V.: Results from Running an Experiment as a Service Platform for Mobile Networks. Proceedings of the 11th Workshop on Wireless Network Testbeds, Experimental evaluation & Characterization 9–16. (2017). https://doi.org/10.1145/3131473.3131485
Bock, U., Seifert, N., Schnieder, L.:"Always-on" - Moderne Fahrzeug-IT als Basis fuer zukunftsweisenden Schienenpersonenverkehr. ETR - Eisenbahntechnische Rundschau. 58–61 (2015)
Goerne, L.: Improved Scalability of Vehicle Diagnostic Software: Advantages of Service-Oriented Architecture. Proceedings of 21. Internationales Stuttgarter Symposium. 563–574. (2021). https://doi.org/10.1007/978-3-658-33521-2_38
Abo-Zahhad, M., Rajoub, B.: An effective coding technique for the compression of one-dimensional signals using wavelet transforms. Med Eng Phys (2002). https://doi.org/10.1016/S1350-4533(02)00004-8
Andras G, G., Levente, B., Zsolt , S.: Efficient lossless compression of CAN traffic logs. 2017 25th International Conference on Software, Telecommunications and Computer Networks (SoftCOM). (2017). https://doi.org/10.1007/s00530-019-00605-z
Grimm, D., Leiner, S., Sommer, M., Pistorius, F., Sax, E.: Flow-based Aggregation of CAN Frames with Compressed Payload. 2020 IEEE International Conference on Smart Computing (SMARTCOMP) 202–207. (2020). https://doi.org/10.1109/SMARTCOMP50058.2020.00046
Cuiling, L., Xu, J., Zeng, W., Feng, W.: Compound image compression using lossless and lossy LZMA in HEVC. 2015 IEEE International Conference on Multimedia and Expo (ICME):1–6. (2015). https://doi.org/10.1109/ICME.2015.7177430
Manz, O.: Gut gepackt—kein bit zu viel. Springer Spektrum, Wiesbaden (2020). https://doi.org/10.1007/978-3-658-31216-9
Troh, A., Ill, B.: CAN Message Filter Algorithms for Remote Diagnostics of Vehicles. III Central European Conference on Logistics. 213–220. (2013). https://doi.org/10.4028/www.scientific.net/AMM.309.213
Schoenberer, L., von der Brueggen, G., Schirmeier, H., Chen, J.: Design Optimization for Hardware-Based Message Filters in Broadcast Buses. Design, Automation & Test in Europe Conference & Exhibition. 606–609. (2019).https://doi.org/10.23919/DATE.2019.8714793
SAE J1939 Standards Collection. https://www.sae.org/standardsdev/groundvehicle/j1939a.htm. Accessed 1 Oct 2021
Automotive Power Requirements Span From "A Little" To "A Lot". https://www.electronicdesign.com/markets/automotive/article/21797859/automotive-power-requirements-span-from-a-little-to-a-lot. Accessed 3 Jan 2022
Kleine-Budde, M.: Socketcan - the official can api of the linux kernel. IEEE International Conference of Communication (2012)
Readme file for the Controller Area Network Protocol Family (aka SocketCAN). https://www.kernel.org/doc/Documentation/networking/can.txt. Accessed 1 Oct 2021
Specification of Communication. https://www.autosar.org/fileadmin/user_upload/standards/classic/21-11/AUTOSAR_SWS_COM.pdf. Accessed 10 Mai 2022
Yazdani, N., Nielsen, L., Lucani, D.: Memory-aware Online Compression of CAN Bus Data for Future Vehicular Systems. GLOBECOM 2020 - 2020 IEEE Global Communications Conference. 1–6. (2020). https://doi.org/10.1109/GLOBECOM42002.2020.9348074
Quick Benchmark: Gzip vs Bzip2 vs LZMA vs XZ vs LZ4 vs LZO. https://catchchallenger.first-world.info/wiki/Quick_Benchmark:_Gzip_vs_Bzip2_vs_LZMA_vs_XZ_vs_LZ4_vs_LZO. Accessed 1 Oct 2021
Kim, Y., Yang, Z., Chung, K.: Improved CAN compression algorithm by data reordering. 2017 International SoC Design Conference (ISOCC). 264–265. (2017). https://doi.org/10.1109/ISOCC.2017.8368886
Mert, P.: LibreCAN: Automated CAN Message Translator. Proceedings of the 2019 ACM SIGSAC Conference on Computer. 2283–2300. (2019). https://doi.org/10.1145/3319535.3363190