In recent years, deep learning has been widely used in the field of image understanding and made breakthroughs research progress in image understanding. Because remote sensing application and image understanding are inseparable, researchers have carried out a lot of research on the application of deep learning in remote sensing field, and extended the deep learning method to various application fields of remote sensing. This paper summarizes the basic principles of deep learning and its research progress and typical applications in remote sensing, introduces the current main deep learning model and its development history, focuses on the analysis and elaboration of the research status of deep learning in remote sensing image classification, object detection and change detection, and on this basis, summarizes the typical applications and their application effects. Finally, according to the current application of deep learning in remote sensing, the main problems and future development directions are summarized.
Li, D.R., Tong, Q.X., Li, R.X., Gong, J.Y. and Zhang, L.P. (2012) Current Issues in High-Resolution Earth Observation Technology. Science China Earth Sciences, 55, 1043-1051. https://doi.org/10.1007/s11430-012-4445-9
Pagot, E. and Pesaresi, M. (2008) Systematic Study of the Urban Postconflict Change Classification Performance Using Spectral and Structural Features in a Support Vector Machine. IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing, 1, 120-128. https://doi.org/10.1109/JSTARS.2008.2001154
Li, D.R., Zhang, L.P. and Xia, G.S. (2014) Automatic Analysis and Mining of Remote Sensing Big Data. Acta Geodaetica et Cartographica Sinica, 43, 1211-121
Lecun, Y., Bengio, Y. and Hinton, G. (2015) Deep Learning. Nature, 521, 436-444. https://doi.org/10.1038/nature14539
Gong, J.Y. and Ji, S.P. (2018) Photogrammetry and Deep Learning. Acta Geodaetica et Cartographica Sinica, 47, 693-704.
Gong, J.Y. and Ji, S.P. (2017) From Photogrammetry to Computer Vision. Geomatics and Information Science of Wuhan University, 42, 1518-1522.
Ball, J.E., Anderson, D.T. and Chan, C.S. (2017) A Comprehensive Survey of Deep Learning in Remote Sensing: Theories, Tools, and Challenges for the Community. Journal of Applied Remote Sensing, 11. https://doi.org/10.1117/1.JRS.11.042609
Long, J., Shelhamer, E. and Darrell, T. (2015) Fully Convolutional Networks for Semantic Segmentation. 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, 3431-3440. https://doi.org/10.1109/CVPR.2015.7298965
Badrinarayanan, V., Kendall, A. and Cipolla, R. (2017) SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39, 2481-2495. https://doi.org/10.1109/TPAMI.2016.2644615
Chen, L., Papandreou, G., Kokkinos, I., et al. (2018) DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs. IEEE Transactions on Pattern Analysis and Machine Intelligence, 40, 834-848. https://doi.org/10.1109/TPAMI.2017.2699184
Chen, L.C., Papandreou, G., Schroff, F., et al. (2017) Rethinking Atrous Convolution for Semantic Image Segmentation. CoRR. 2017, abs/1706.05587.
Chen, L.C., Zhu, Y., Papandreou, G., Schroff, F. and Adam, H. (2018) Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation. CoRR. abs/1802.02611.
Girshick, R., Donahue, J., Darrell, T. and Malik, J. (2014) Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation. 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, 580-587. https://doi.org/10.1109/CVPR.2014.81
He, K., Zhang, X., Ren, S. and Sun, J. (2015) Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 37, 1904-1916. https://doi.org/10.1109/TPAMI.2015.2389824
Girshick, R. (2015) Fast R-CNN. 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, 1440-1448. https://doi.org/10.1109/ICCV.2015.169
Ren, S., He, K., Girshick, R. and Sun, J. (2017) Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39, 1137-1149. https://doi.org/10.1109/TPAMI.2016.2577031
Redmon, J., Divvala, S., Girshick, R. and Farhadi, A. (2016) You Only Look Once: Unified, Real-Time Object Detection. IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, 779-788. https://doi.org/10.1109/CVPR.2016.91
Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y. and Berg, A.C. (2016) SSD: Single Shot MultiBox Detector. Computer Vision-ECCV, Amsterdam, 21-37. https://doi.org/10.1007/978-3-319-46448-0_2
Fu, G., Liu, C., Zhou, R., Sun, T. and Zhang, Q. (2017) Classification for High Resolution Remote Sensing Imagery Using a Fully Convolutional Network. Remote Sensing, 9, 498-513. https://doi.org/10.3390/rs9050498
Zhang, C., Liu, J., Yu, F., Wan, S., Han, Y., Wang, J. and Wang, G. (2018) Segmentation Model Based on Convolutional Neural Networks for Extracting Vegetation from Gaofen-2 Images. Journal of Applied Remote Sensing, 12, Article ID: 042804.
Sharma, A., Liu, X., Yang, X. and Shi, D. (2017) A Patch-Based Convolutional Neural Network for Remote Sensing Image Classification. Neural Networks, 95, 19-28. https://doi.org/10.1016/j.neunet.2017.07.017
Zhang, C., Pan, X., Li, H., Gardiner, A., Sargent, A., Hare, J. and Atkinson, P. (2018) A Hybrid MLP-CNN Classifier for Very Fine Resolution Remotely Sensed Image Classification. ISPRS Journal of Photogrammetry and Remote Sensing, 140, 133-144. https://doi.org/10.1016/j.isprsjprs.2017.07.014
Yuksel, M.E., Basturk, N.S., Badem, H., Abdullah, C. and Alper, B. (2018) Classification of High Resolution Hyperspectral Remote Sensing Data Using Deep Neural Networks. Journal of Intelligent & Fuzzy Systems, 34, 2273-2285. https://doi.org/10.3233/JIFS-171307
Cai, Y., Guan, K., Peng, J., Wang, S., Seifert, C., Wardlow, B. and Li, Z. (2018) A High-Performance and In-Season Classification System of Field-Level Crop Types Using Time-Series Landsat Data and a Machine Learning Approach. Remote Sensing of Environment, 210, 35-47. https://doi.org/10.1016/j.rse.2018.02.045
Wei, W., Zhang, J., Zhang, L., Tian, C. and Zhang, Y. (2018) Deep Cube-Pair Network for Hyperspectral Imagery Classification. Remote Sensing, 10, 783. https://doi.org/10.3390/rs10050783
Chen, Y., Fan, R., Yang, X., Wang, J. and Latif, A. (2018) Extraction of Urban Water Bodies from High-Resolution Remote-Sensing Imagery Using Deep Learning. Water, 10, 585. https://doi.org/10.3390/w10050585
Zhong, Y., Han, X. and Zhang, L. (2018) Multi-Class Geospatial Object Detection Based on a Position-Sensitive Balancing Framework for High Spatial Resolution Remote Sensing Imagery. ISPRS Journal of Photogrammetry and Remote Sensing, 138, 281-294. https://doi.org/10.1016/j.isprsjprs.2018.02.014
Tian, T., Li, C., Xu, J. and Ma, J. (2018) Urban Area Detection in Very High Resolution Remote Sensing Images Using Deep Convolutional Neural Networks. Sensors, 18, 904-920. https://doi.org/10.3390/s18030904
Zhang, X., Chen, X., Li, F. and Yang, T. (2017) Change Detection Method for High Resolution Remote Sensing Images Using Deep Learning. Acta Geodaeticaet Cartographica Sinica, 46, 999-1008.
Khan, S.H., He, X., Porikli, F. and Bennamoun, M. (2017) Forest Change Detection in Incomplete Satellite Images with Deep Neural Networks. IEEE Transactions on Geoscience and Remote Sensing, 55, 5407-5423. https://doi.org/10.1109/TGRS.2017.2707528