Stereoscopic Camera-Sensor Model for the Development of Highly Automated Driving Functions within a Virtual Test Environment
- 1 Division of Electricity, Department of Electrical Engineering, Uppsala University, Uppsala, Sweden
- 2 CAD CAM Center Cologne, Institute of Automotive Engineering Cologne (IFK), Faculty of Automotive Systems and Production, Cologne University of Applied Sciences, Cologne, Germany
- 3 Division of Electricity, Department of Electrical Engineering, Uppsala University, Uppsala, Sweden
- 4 Division of Electricity, Department of Electrical Engineering, Uppsala University, Uppsala, Sweden
- 5 Division of Electricity, Department of Electrical Engineering, Uppsala University, Uppsala, Sweden
- 6 CAD CAM Center Cologne, Institute of Automotive Engineering Cologne (IFK), Faculty of Automotive Systems and Production, Cologne University of Applied Sciences, Cologne, Germany
Abstract
The need for efficient and reproducible development processes for sensor and perception systems is growing with their increased use in modern vehicles. Such processes can be achieved by using virtual test environments and virtual sensor models. In the context of this, the present paper documents the development of a sensor model for depth estimation of virtual three-dimensional scenarios. For this purpose, the geometric and algorithmic principles of stereoscopic camera systems are recreated in a virtual form. The model is implemented as a subroutine in the Epic Games Unreal Engine, which is one of the most common Game Engines. Its architecture consists of several independent procedures that enable a local depth estimation, but also a reconstruction of a whole three-dimensional scenery. In addition, a separate programme for calibrating the model is presented. In addition to the basic principles, the architecture and the implementation, this work also documents the evaluation of the model created. It is shown that the model meets specifically defined requirements for real-time capability and the accuracy of the evaluation. Thus, it is suitable for the virtual testing of common algorithms and highly automated driving functions.
- GP Bullhound. Autotech: The Mother of All Tech Battles. https://www.gpbullhound.com/insights/autotech-2019/
- Degen, R., Ott, H., Klein, F., Shankavaram, R., Leijon, M. and Ruschitzka, M. (2021) CityInMotion—A Virtual Urban Test Environment for Automated Mobility. International Symposium for Development Metodology, Wiesbaden, 9-10 November 2021.
- Winner, H., Hakuli, S., Lotz, F. and Singer, C. (2016) Handbook of Driver Assistance Systems: Basic Information, Components and Systems for Active Safety and Comfort. Springer, Cham. https://doi.org/10.1007/978-3-319-12352-3
- De Ponte Müller, F. (2017) Survey on Ranging Sensors and Cooperative Techniques for Relative Positioning of Vehicles. Sensors, 17, Article No. 271. https://doi.org/10.3390/s17020271
- Sivaraman, S. and Trivedi, M.M. (2013) Looking at Vehicles on the Road: A Survey of Vision-Based Vehicle Detection, Tracking, and Behavior Analysis. IEEE Transactions on Intelligent Transportation Systems, 14, 1773-1795. https://doi.org/10.1109/TITS.2013.2266661
- Miknis, M., Plassmann, P. and Jones, C. (2014) Virtual Environment Stereo Image Capture Using the Unreal Development Kit. 2014 Global Summit on Computer & Information Technology (GSCIT), Sousse, 14-16 June 2014, 1-5. https://doi.org/10.1109/GSCIT.2014.6970136
- Zhang, Y., Qiu, W., Chen, Q., Hu, X. and Yuille, A. (2018) UnrealStereo: Controlling Hazardous Factors to Analyze Stereo Vision. 2018 International Conference on 3D Vision (3DV), Verona, 5-8 September 2018, 228-237. https://doi.org/10.1109/3DV.2018.00035
- IPG Automotive GmbH (2022) Products and Solutions. (In Chinese) https://ipg-automotive.com/en/products-solutions/
- CARLA Team. CARLA: Open-Source Simulator for Autonomous Driving Research. https://carla.org/
- Hartley, R. and Zisserman, A. (2003) Multiple View Geometry in Computer Vision. 2nd Edition, Cambridge University Press, Cambridge. https://doi.org/10.1017/CBO9780511811685
- Kaehler, A. and Bradski, G.R. (2017) Learning OpenCV 3: Computer Vision in C++ with the OpenCV Library. O’Reilly Media, Sebastopol.
- Konolige, K. (1998) Small Vision Systems: Hardware and Implementation. In: Shirai, Y. and Hirose, S., Eds., Robotics Research, Springer, London, 203-212. https://doi.org/10.1007/978-1-4471-1580-9_19
- Zhang, Z. (2000) A Flexible New Technique for Camera Calibration. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22, 1330-1334. https://doi.org/10.1109/34.888718