Ensuring safety has always been of utmost importance in vehicular operations, where traditionally, human drivers have been solely responsible for driving. However, with the emergence of advanced technologies, we are now on the brink of a new era with the introduction of Autonomous Vehicles (AVs), in which control over the vehicle gradually shifts to Artificial Intelligence (AI). The safety of these vehicles has raised concerns among the public. In terms of safety, human drivers heavily rely on visual perception. Key elements that contribute to safe driving include situational awareness, vehicle control, reaction capabilities, and anticipation of potential hazards. With the introduction of AVs, these fundamental factors remain unchanged. AVs rely on two primary technologies, namely LiDAR and Non-LiDAR, to perceive their surroundings. This research focuses on three primary aspects. Firstly, it involves the development of an image classification model to assess the safety of AVs. This model determines whether the images captured by LiDAR and Non-LiDAR technologies can be accurately predicted using supervised learning. An algorithm is employed to identify the input images obtained from both LiDAR and Non-LiDAR technologies. The results demonstrate that the model achieved a high accuracy rate of 94.63% in predicting the images. Secondly, a Safety Framework is established to facilitate the subsequent proposal for Experimental Research, which is the third aspect. The Safety Framework incorporates the application of LiDAR and Non-LiDAR technologies mounted on a vehicle that is operated in diverse weather conditions by both a human driver and an autonomous system. The Scenario tables, which are currently in a blank state, will be populated upon completion of the Experimental Research. The Experimental Research aims to compare and contrast the performance of LiDAR and Non-LiDAR technologies on a vehicle driven by a human operator versus an Autonomous Vehicle. The findings of this research will be documented in the Scenario table outlined within this study, ultimately shedding light on the safety implications of implementing LiDAR and Non-LiDAR technologies within an AV context.
Da Vinci Inventions (2022) Self-Propelled Cart. https://www.da-vinci-inventions.com/self-propelled-cart
Hartmans, A. (2016) How Google’s Self-Driving Car Project Rose from a Crazy Idea to a Top Contender in the Race toward a Driverless Future. Business Insider. https://www.businessinsider.com/google-driverless-car-history-photos-2016-10
Hawkins, A.J. (2017) How Tesla Changed the Auto Industry Forever. Autopilot, Electrification, and a Boot-to-Bonnet Commitment to Technology. The Verge. https://www.theverge.com/2017/7/28/16059954/tesla-model-3-2017-auto-industry-influence-elon-musk
Ziegler, C. (2015) Tesla’s Cars Can Drive Themselves Starting Tomorrow. The Verge. https://www.theverge.com/2015/10/14/9533539/teslas-cars-can-drive-themselves-starting-tomorrow
NHTSA: National Highway Traffic Safety Administration (2022) Automated Vehicles for Safety. What Does This Mean for You as a Driver? https://www.nhtsa.gov/technology-innovation/automated-vehicles-safety#topic-road-self-driving
NHTSA: National Highway Traffic Safety Administration (2022) Automated Vehicles for Safety. NHTSA Is Dedicated to Advancing the Lifesaving Potential of New Vehicle Technologies. https://www.nhtsa.gov/technology-innovation/automated-vehicles-safety#topic-road-self-driving
NHTSA: National Highway Traffic Safety Administration (2022) Automated Driving Systems 2.0 Voluntary Guidance. https://www.nhtsa.gov/document/automated-driving-systems-20-voluntary-guidance
United States department of Transportation (2019) Preparing for the Future of Transportation: Automated Vehicles 3.0. https://www.transportation.gov/av/3
United States department of Transportation (2020) Ensuring American Leadership in Automated Vehicle Technologies. Automated Vehicles 4.0. https://www.transportation.gov/sites/dot.gov/files/docs/policy-initiatives/automated-vehicles/360956/ensuringamericanleadershipav4.pdf
Blanar. L.F., Blumenthal. M.S., Anderson. J.M. and Kalra. N. (2018) Rand Corporation. Measuring Automated Vehicle Safety. https://www.rand.org/content/dam/rand/pubs/research_reports/RR2600/RR2662/RAND_RR2662.pdf
SAE (2018) SAE International Releases Updated Visual Chart for Its “Levels of Driving Automation” Standard for Self-Driving Vehicles. https://www.sae.org/news/press-room/2018/12/sae-international-releases-updated-visual-chart-for-its-%E2%80%9Clevels-of-driving-automation%E2%80%9D-standard-for-self-driving-vehicles
Landmark Dividend (2022) Self-Driving Car Technology: How Do Self-Driving Cars Work? Landmark Dividend, News & Insights. https://www.landmarkdividend.com/self-driving-car/#:~:text=Self%2Ddriving%20vehicles%20employ%20a,navigate%20safely%20on%20our%20roads
Blanar, L.F. and Holliday, M. (2020) Approaching Operational Design Domains for Automated Vehicles. RAND. https://www.rand.org/blog/2020/08/how-state-and-local-governments-might-consider-approaching.html#:~:text=An%20operational%20design%20domain%20(ODD,is%20designed%20to%20operate%20safely
Honda (2020) Honda Receives Type Designation of Level 3 Automated Driving in Japan. Global Honda, Newsroom. https://global.honda/newsroom/news/2020/4201111eng.html
Sugiura, E. (2021) Honda Launches World’s First Level 3 Self-Driving Car. Nikkei Asia. https://asia.nikkei.com/Business/Automobiles/Honda-launches-world-s-first-level-3-self-driving-car
Bigg, M. (2021) Honda Is Beating Tesla in a Driverless Car Race. Car Buzz. https://carbuzz.com/news/honda-is-beating-tesla-in-driverless-car-race
Wasser, L.A. (2020) The Basics of Lidar-Light Detection and Ranging-Remote Sensing. Neon Science. https://www.neonscience.org/lidar-basics
Siddiqui, F. (2020) Tesla Is Putting ‘Self-Driving’ in the Hands of Drivers Amid Criticism the Tech Is Not Ready. Washington Post. https://www.washingtonpost.com/technology/2020/10/21/tesla-self-driving/
Zywanowski, K., Banaszczyk, A. and Nowicki, M. (2020) Comparison of Camera-Based and 3D LiDAR-Base Place Recognition across Weather Conditions. 2020 16th International Conference on Control, Automation, Robotics and Vision (ICARCV), Shenzhen, 13-15 December 2020, 886-891. https://doi.org/10.1109/ICARCV50220.2020.9305429
Mugunthan, N., Balaji, S.B., Harini, C. and Prasannaa, V.V. (2020) Comparison Review on LiDAR vs Camera in Autonomous Vehicle. International Research Journal of Engineering and Technology (IRJET), 7, 4242-4246.
Fritz ai (2022) Image Recognition Guide. Fritz ai.
Du, S., Guo, H. and Simpson, A. (2019) Self-Driving Car Steering Angle Prediction Based on Image Recognition. Cornell University. arXiv: 1912.05440.
Kumar, A. (2021) Different Types of CNN Architectures Explained: Examples. Data Analytics. https://vitalflux.com/different-types-of-cnn-architectures-explained-examples/
Dang, A. (2021) Top 10 CNN Architectures Every Machine Learning Engineer Should Know. https://towardsdatascience.com/top-10-cnn-architectures-every-machine-learning-engineer-should-know-68e2b0e07201
Library of Congress (2022) Who Invented the Automobile? https://www.loc.gov/everyday-mysteries/item/who-invented-the-automobile/
Barla, N. (2021) Self-Driving Cars with Convolutional Neural Networks (CNN). Neptuneblog. https://neptune.ai/blog/self-driving-cars-with-convolutional-neural-networks-cnn
Wenhui, Y. and Fan, Y. (2017) Lidar Image Classification Based on Convolutional Neural Networks. 2017 International Conference on Computer Network, Electronic and Automation (ICCNEA), Xi’an, 23-25 September 2017, 221-225.
Zhang, X., Fu, H. and Dai, B. (2019) Lidar-Based Object Classification with Explicit Occlusion Modeling. Cornell University. arXiv: 1907.04057.
Song, W., Zou, S., Tian, Y., Fong, S. and Cho, K. (2018) Classifying 3D Objects in LiDAR Point Cloud with Back-Propagation Neural Network. Human-Centric Computing and Information Sciences, 8, Article No. 29.
Song, W., Zhang, L., Tian, Y., Fong, S., Liu, J. and Gozho, A. (2020) CNN-Based 3D Object Classification Using Hough Space of LiDAR Point Clouds. Human-Centric Computing and Information Sciences, 10, Article No. 19. https://doi.org/10.1186/s13673-020-00228-8
Rouse, M. (2017) Rasterization. Techopedia. https://www.techopedia.com/definition/13169/rasterization
Tesla (2022) Tesla Vision Update: Replacing Ultrasonic Sensors with Tesla Vision. https://www.tesla.com/en_CA/support/transitioning-tesla-vision#:~:text=Beginning%20with%20deliveries%20in%20May,and%20certain%20active%20safety%20features
Jahromi, B.S. (2019) Camera Technology in Self-Driving Cars. https://medium.com/@BabakShah/camera-technology-in-self-driving-cars-610371db4b0b
Fujiyoshi, H., Hirakawa, T. and Yamashita, T. (2019) Deep Learning-Based Image Recognition for Autonomous Driving. IATSS Research, 43, 244-252. https://doi.org/10.1016/j.iatssr.2019.11.008
Tyagi, M. (2021) HOG (Histogram of Oriented Gradients): An Overview. https://towardsdatascience.com/hog-histogram-of-oriented-gradients-67ecd887675f
Gandhi, R. (2018) Support Vector Machine—Introduction to Machine Learning Algorithms. https://towardsdatascience.com/support-vector-machine-introduction-to-machine-learning-algorithms-934a444fca47
Leonard, J. (2019) Image Classification and Object Detection Algorithm Based on Convolutional Neural Network. Science Insights, 31, 85-100. https://doi.org/10.15354/si.19.re117
Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Davis, A., Dean, J., Devin, M., Ghemawat, S., Goodfellow, I., Harp, A., Irving, G., Isard, M., Jia, Y., Jozefowicz, R., Kaiser, L., Kudlur, M., Zheng, X., et al. (2016) TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems. arXiv: 1603.04467.
Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., Desmaison, A., Kopf, A., Yang, E., DeVito, Z., Raison, M., Tejani, A., Chilamkurthy, S., Steiner, B., Fang, L., Bai, J. and Chintala, S. (2019) PyTorch: An Imperative Style, High-Performance Deep Learning Library. In: Wallach, H., Larochelle, H., Beygelzimer, A., d’Alché-Buc, F., Fox, E. and Garnett, R., Eds., Advances in Neural Information Processing Systems, Neural Information Processing Systems Foundation Inc. (NeurIPS), Vancouver, 8024-8035.
Simonyan, K. and Zisserman, A. (2015) Very Deep Convolutional Networks for Large-Scale Recognition. arXiv: 1409.1556.
He, K., Zhang, X., Ren, S. and Sun, J. (2016) Deep Residual Learning for Image Recognition. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, 27-30 June 2016, 770-778. https://doi.org/10.1109/CVPR.2016.90
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanchoucke, V. and Rabinovich, A. (2015) Going Deeper with Convolutions. 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, 7-12 June 2015, 1-9. https://doi.org/10.1109/CVPR.2015.7298594
Krizhevsky, A., Sutskever, I. and Hinton, G.E. (2012) ImageNet Classification with Deep Convolutional Neural Networks. Proceedings of the 25th International Conference on Neural Information Processing Systems, Carson City, 3-6 December 2012, 1097-1105.
Boesch, G. (2022) VGG Very Deep Convolutional Networks (VGGNet)—What You Need to Know. https://viso.ai/deep-learning/vgg-very-deep-convolutional-networks/
IBM (2020) Machine Learning. IBM Cloud Learn Hub. https://www.ibm.com/cloud/learn/machine-learning
Zhao, J., Liang, B. and Chen, Q. (2018) The Key Technology toward the Self-Driving Car. International Journal of Intelligent Unmanned Systems, 6, 2-20. https://doi.org/10.1108/IJIUS-08-2017-0008
Fernandes, J. (2018) Neural Networks and Convolutional Neural Networks Essential Training. https://www.linkedin.com/learning/neural-networks-and-convolutional-neural-networks-essential-training/what-you-should-know?autoSkip=true&autoplay=true&resume=false&u=2212217
Great Learning (2020) What Is Rectified Linear Unit (ReLu)? Introduction to ReLu Activation Function. https://www.mygreatlearning.com/blog/relu-activation-function/
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S. and Darell, T. (2014) Dafee: Convolutional Architecture for Fast Feature Embedding. Proceedings of the 22nd ACM International Conference on Multimedia, New York, November 2014, 675-678.%