Disparity-Based Generation of Line-of-Sight DSM for Image-Elevation Co-Registration to Support Building Detection in Off-Nadir VHR Satellite Images — Oak Academic Publishing
Research ArticleOpen AccessGoogle Scholar indexed
Disparity-Based Generation of Line-of-Sight DSM for Image-Elevation Co-Registration to Support Building Detection in Off-Nadir VHR Satellite Images
Department of Geodesy and Geomatics Engineering, University of New Brunswick, Fredericton, Canada
,
Department of Geodesy and Geomatics Engineering, University of New Brunswick, Fredericton, Canada
1 Department of Geodesy and Geomatics Engineering, University of New Brunswick, Fredericton, Canada
2 Department of Geodesy and Geomatics Engineering, University of New Brunswick, Fredericton, Canada
The integration of optical images and elevation data is of great importance for 3D-assisted mapping applications. Very high resolution (VHR) satellite images provide ideal geo-data for mapping building information. Since buildings are inherently elevated objects, these images need to be co-registered with their elevation data for reliable building detection results. However, accurate co-registration is extremely difficult for off-nadir VHR images acquired over dense urban areas. Therefore, this research proposes a Disparity-Based Elevation Co-Registration (DECR) method for generating a Line-of-Sight Digital Surface Model (LoS-DSM) to efficiently achieve image-elevation data co-registration with pixel-level accuracy. Relative to the traditional photogrammetric approach, the RMSE value of the derived elevations is found to be less than 2 pixels. The applicability of the DECR method is demonstrated through elevation-based building detection (EBD) in a challenging dense urban area. The quality of the detection result is found to be more than 90%. Additionally, the detected objects were geo-referenced successfully to their correct ground locations to allow direct integration with other maps. In comparison to the original LoS-DSM development algorithm, the DECR algorithm is more efficient by reducing the calculation steps, preserving the co-registration accuracy, and minimizing the need for elevation normalization in dense urban areas.
Salehi, B., Zhang, Y., Zhong, M. and Dey, V. (2012) A Review of the Effectiveness of Spatial Information Used in Urban Land Cover Classification of VHR Imagery. International Journal of Geoinformatics, 8, 35-51.
Salehi, B., Zhang, Y. and Zhong, M. (2011) Object-Based Land Cover Classification of Urban Areas Using VHR Imagery and Photogrammetrically-Derived DSM. Proceedings of the ASPRS Annual Conference, Milwaukee, 1-5 May 2011.
Suliman, A. and Zhang, Y. (2015) Development of Line-of-Sight Digital Surface Model for Co-registering Off-nadir VHR Satellite Imagery with Elevation Data. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 8, 1913-1923. https://doi.org/10.1109/JSTARS.2015.2407365
Suliman, A. and Zhang, Y. (2017) Double Projection Planes Method For Generating Enriched Disparity Maps From Multi-View Stereo Satellite Images. Photogrammetric Engineering and Remote Sensing, 83, 749-760.
Suliman, A., Zhang, Y. and Al-Tahir, R. (2016) Extracting Accurate Building Information from Off-Nadir VHR Images. Proceedings of the Ninth International Conference on Geographic Information Science (GIScience), Montreal, Canada, 27-30 September 2016. https://doi.org/10.21433/B3115640633B
Suliman, A. and Zhang, Y. (2017) Developing an Efficient Approach for Image-Elevation Co-Registration. The Biennial International Joint Urban Remote Sensing Event (JURSE), Dubai, 6-8 March 2017, 1-4.
Goshtasby, A. (2012) Image Registration: Principles, Tools and Methods. Springer-Verlag Ltd., London. https://doi.org/10.1007/978-1-4471-2458-0
Mishra, R. and Zhang, Y. (2012) A Review of Optical Imagery and Airborne LiDAR Data Registration Methods. The Open Remote Sensing Journal, 5, 54-63. https://doi.org/10.2174/1875413901205010054
Zitová, B. and Flusser, J. (2003) Image Registration Methods: A Survey. Image and Vision Computing, 21, 977-1000. https://doi.org/10.1016/S0262-8856(03)00137-9
Xiong, Z, and Zhang, Y. (2010) A Critical Review of Image Registration Methods. International Journal of Image and Data Fusion, 1, 137-158. https://doi.org/10.1080/19479831003802790
Wong, A. and Orchard, J. (2008) Efficient FFT-Accelerated Approach to Invariant Optical-LIDAR Registration. IEEE Transactions on Geoscience and Remote Sensing, 46, No. 3917-3925. https://doi.org/10.1109/TGRS.2008.2001685
Avbelj, J., Iwaszczuk, D., Müller, R., Reinartz, P. and Stilla, U. (2015) Coregistration Refinement of Hyperspectral Images and DSM: An Object-Based Approach Using Spectral Information. ISPRS Journal of Photogrammetry and Remote Sensing, 100, 23-34. https://doi.org/10.1016/j.isprsjprs.2014.05.010
Kwak, T.-S., Kim, Y.-I., Yu, K.-Y. and Lee, B-K. (2006) Registration of Aerial Imagery and Aerial Lidar Data Using Centroids of Plane Roof Surfaces as Control Information. KSCE journal of Civil Engineering, 10, 365-370. https://doi.org/10.1007/BF02830090
Parmehr, E.G., Fraser, C.S., Zhang, C. and Leach, J. (2014) Automatic Registration of Optical Imagery with 3D LIDAR Data Using Statistical Similarity. ISPRS Journal of Photogrammetry and Remote Sensing, 88, 28-40. https://doi.org/10.1016/j.isprsjprs.2013.11.015
Awrangjeb, M., Zhang, C. and Fraser, C.S. (2013) Automatic Extraction of Building Roofs Using LIDAR Data and Multispectral Imagery. ISPRS Journal of Photogrammetry and Remote Sensing, 83, 1-18. https://doi.org/10.1016/j.isprsjprs.2013.05.006
Awrangjeb, M., Ravanbakhsh, M. and Fraser, C.S. (2010) Automatic Detection of Residential Buildings Using LIDAR Data and Multispectral Imagery. ISPRS Journal of Photogrammetry and Remote Sensing, 65, 457-467. https://doi.org/10.1016/j.isprsjprs.2010.06.001
Guoqing, Z., Weirong, C., Kelmelis, J.A. and Zhang, D. (2005) A Comprehensive Study on Urban True Orthorectification. IEEE Transactions on Geoscience and Remote Sensing, 43, 2138-2147. https://doi.org/10.1109/TGRS.2005.848417
Habib, A., Kim, E. and Kim, C. (2007) New Methodologies for True Orthophoto Generation. Photogrammetric Engineering and Remote Sensing, 73, 25-36. https://doi.org/10.14358/PERS.73.1.25
Suliman, A., Zhang, Y. and Al-Tahir, R. (2016) Registration-Based Mapping of Aboveground Disparities (RMAD) for Building Detection in Off-Nadir VHR Stereo Satellite Imagery. Photogrammetric Engineering and Remote Sensing, 82, 535-546. https://doi.org/10.14358/PERS.82.7.535
Tao, C.V. and Hu, Y. (2002) 3D Reconstruction Methods Based on the Rational Function Model. Photogrammetric Engineering and Remote Sensing, 68, 705-714.
Grodecki, J., Dial, G. and Lutes, J. (2004) Mathematical Model for 3D Feature Extraction from Multiple Satellite Images Described by RPCs. Proceedings of the ASPRS Annual Conference, Colorado, 23-28 May 2004.
Tao, C.V. and Hu, Y. (2001) A Comprehensive Study of The Rational Function Model for Photogrammetric Processing. Photogrammetric Engineering and Remote Sensing, 67, 1347-1358.
Wang, M., Hu, F. and Li, J. (2011) Epipolar Resampling of Linear Pushbroom Satellite Imagery by a New Epipolarity Model. ISPRS Journal of Photogrammetry and Remote Sensing, 66, 347-355. https://doi.org/10.1016/j.isprsjprs.2011.01.002
Alobeid, A., Jacobsen, K. and Heipke, C. (2010) Comparison of Matching Algorithms for DSM Generation in Urban Areas from Ikonos Imagery. Photogrammetric Engineering and Remote Sensing, 76, 1041-1050. https://doi.org/10.14358/PERS.76.9.1041
Hirschmüller, H. (2008) Stereo Processing by Semiglobal Matching and Mutual Information. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30, 328-341. https://doi.org/10.1109/TPAMI.2007.1166
Zhang, J., Cao, Y., Zheng, Z., Chen, C. and Wang, Z. (2014) A New Closed Loop Method of Super-Resolution for Multi-View Images. Machine Vision and Applications, 25, 1685-1695. https://doi.org/10.1007/s00138-013-0536-7
Lowe, D.G. (2004) Distinctive Image Features from Scale-Invariant Keypoints. International Journal of Computer Vision, 60, 91-110. https://doi.org/10.1023/B:VISI.0000029664.99615.94
Zhang, Y. (2004) Understanding Image Fusion. Photogrammetric Engineering and Remote Sensing, 70, 657-661.
Dey, V. (2013) Image Segmentation Techniques for Urban Land Cover Segmentation of VHR Imagery: Recent Developments and Future Prospects. International Journal of Geoinformatics, 9, 15-35.
Baatz, M. and Schape, A. (2000) Multiresolution Segmentation: An Optimization Approach for High Quality Multi-Scale Image Segmentation. Angewandte Geographische Informationsverarbeitung, XII, 12-23.
Teillet, P. (1992) An Algorithm for The Radiometric and Atmospheric Correction of AVHRR Data in the Solar Reflective Channels. Remote Sensing of Environment, 41, 185-195. https://doi.org/10.1016/0034-4257(92)90077-W
Egnal, G. and Wildes, R.P. (2002) Detecting Binocular Half-Occlusions: Empirical Comparisons of Five Approaches. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24, 1127-1133. https://doi.org/10.1109/TPAMI.2002.1023808
Garcia-Castellanos, D. and Lombardo, U. (2007) Poles of Inaccessibility: A Calculation Algorithm for the Remotest Places on Earth. Scottish Geographical Journal, 123, 227-233. https://doi.org/10.1080/14702540801897809
Story, M. and Congalton, R. (1986) Accuracy Assessment—A User’s Perspective. Photogrammetric Engineering and Remote Sensing, 52, 397-399.
Rutzinger, M., Rottensteiner, F. and Pfeifer, N. (2009) A Comparison of Evaluation Techniques for Building Extraction From Airborne Laser Scanning. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2, 11-20. https://doi.org/10.1109/JSTARS.2009.2012488
Suliman, A., Zhang, Y. and Al-Tahir, R. (2016) Enhanced Disparity Maps from Multi-View Satellite Images. IEEE Geoscience and Remote Sensing Symposium (IGARSS), Beijing, 10-15 July 2016, 2356-2359. https://doi.org/10.1109/IGARSS.2016.7729608