Research ArticleOpen AccessGoogle Scholar indexed
Camera Independent Motion Deblurring in Videos Using Machine Learning
Department of Electrical Engineering and Computer Science, University of North Dakota, Grand Forks, North Dakota, USA
Department of Electrical Engineering and Computer Science, University of North Dakota, Grand Forks, North Dakota, USA
Department of Electrical Engineering and Computer Science, University of North Dakota, Grand Forks, North Dakota, USA
- 1 Department of Electrical Engineering and Computer Science, University of North Dakota, Grand Forks, North Dakota, USA
- 2 Department of Electrical Engineering and Computer Science, University of North Dakota, Grand Forks, North Dakota, USA
- 3 Department of Electrical Engineering and Computer Science, University of North Dakota, Grand Forks, North Dakota, USA
Journal of Intelligent Learning Systems and Applications·Volume 15 (2023)·Pages 89–107·Published 3 November 2023·DOI10.4236/jilsa.2023.154007
Copy link · social · email
Abstract
In this paper, we will be looking at our efforts to find a novel solution for motion deblurring in videos. In addition, our solution has the requirement of being camera-independent. This means that the solution is fully implemented in software and is not aware of any of the characteristics of the camera. We found a solution by implementing a Convolutional Neural Network-Long Short Term Memory (CNN-LSTM) hybrid model. Our CNN-LSTM is able to deblur video without any knowledge of the camera hardware. This allows it to be implemented on any system that allows the camera to be swapped out with any camera model with any physical characteristics.
KeywordsMotion BlurVideoConvolutional Neural NetworkLong Short-Term MemoryAirSimOpenCV
- Zhu, Y.-F. (2010) Blur Detection for Surveillance Video Based on Heavy-Tailed Distribution. 2010 Asia Pacific Conference on Postgraduate Research in Microelectronics and Electronics, Shanghai, 22-24 September 2010, 101-105. https://doi.org/10.1109/PRIMEASIA.2010.5604950
- Guo, C., Wang, Q., Dai, H.-N. and Li, P. (2022) VDN: Variant-Depth Network for Motion Deblurring. Computer Animation and Virtual Worlds, 33, e2066. https://doi.org/10.1002/cav.2066
- Fang, N. and Zhan, Z.Q. (2022) High-Resolution Optical Flow and Frame-Recurrent Network for Video Super-Resolution and Deblurring. Neurocomputing, 489, 128-138. https://doi.org/10.1016/j.neucom.2022.02.067
- Qi S., Jia, J.Y. and Aseem, A. (2008) High-Quality Motion Deblurring from a Single Image. ACM Transactions on Graphics, Vol. 27. https://doi.org/10.1145/1360612.1360672
- Krishnan, D., Tay, T. and Fergus, R. (2011) Blind Deconvolution Using a Normalized Sparsity Measure. CVPR 2011, Colorado Springs, 20-25 June 2011, 233-240.
- Li, X., Zheng, S.C. and Jia, J.Y. (2013) Unnatural L0 Sparse Representation for Natural Image Deblurring. 2013 IEEE Conference on Computer Vision and Pattern Recognition, Portland, 23-28 June 2013, 1107-1114. https://doi.org/10.1109/CVPR.2013.147
- Fergus, R., Singh, B., Hertzmann, A., Roweis, S.T. and Freeman, W.T. (2006) Removing Camera Shake from a Single Photograph. ACM Transactions on Graphics, 25, 787-794. https://doi.org/10.1145/1141911.1141956
- Levin, A., Weiss, Y., Durand, F. and Freeman, W.T. (2009) Understanding and Evaluating Blind Deconvolution Algorithms. 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, 20-25 June 2009, 1964-1971. https://doi.org/10.1109/CVPR.2009.5206815
- Levin, A., Weiss, Y., Durand, F. and Freeman, W.T. (2011) Efficient Marginal Likelihood Optimization in Blind Deconvolution. CVPR 2011, Colorado Springs, 20-25 June 2011, 2657-2664. https://doi.org/10.1109/CVPR.2011.5995308
- Liu, S.G., Wang, H.B., Wang, J. and Pan, C.H. (2016) Blur-Kernel Bound Estimation From Pyramid Statistics. IEEE Transactions on Circuits and Systems for Video Technology, 26, 1012-1016. https://doi.org/10.1109/TCSVT.2015.2418585
- Agrawal, A., Xu, Y. and Raskar, R. (2009) Invertible Motion Blur in Video. ACM Transactions on Graphics, 28, 1-8. https://doi.org/10.1145/1576246.1531401
- Qiao, C.B., Lau, R.W.H., Sheng, B., Zhang, B.X. and Wu, E.H. (2017) Temporal Coherence-Based Deblurring Using Non-Uniform Motion Optimization. IEEE Transactions on Image Processing, 26, 4991-5004.