Efficient Image Stitching in the Presence of Dynamic Objects and Structure Misalignment
- 1
- 2
- 3
- 4
Abstract
This paper presents a new method for simultaneously eliminating visual artifacts caused by moving objects and structure misalignment in image stitching. Given that the input images are roughly aligned, our approach is implemented in two stages. In the first stage, we discover motions between input images, and then extract their corresponding regions through a multi-seed based region growing algorithm. In the second stage, with prior information provided by the extracted regions, we perform a graph cut optimization in gradient-domain to determine which pixels to use from each image to achieve seamless stitching. Our method is simple to implement and effective. The experimental results illustrate that the proposed approach can produce comparable or superior results in comparison with state-of-the-art methods.
- R. Szeliski, “Image Alignment and Stitching: A Tutorial,” Microsoft Research, Technical Report MSR-TR-2004-92, 2004.
- M. Uyttendaele, A. Eden and R. Szeliski, “Eliminating Ghosting and Exposure Artifacts in Image Mosaics,” Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Kauai, 8-14 December 2001, pp. 509-516.
- A. Agarwala, M. Dontcheva, M. Agrawala, S. Drucker, A. Colburn, B. Curless, D. Salesin and M. Cohen, “Interactive Digital Photomontage,” Proceedings of ACM SIGGR- APH’04, Vol. 23, No. 3, 2004, pp. 294-302.
- A. Eden, M. Uyttendaele and R. Szeliski, “Seamless Image Stitching of Scenes with Large Motions and Exposure Differences,” 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2006, pp. 2498-2505.
- A. Mills and G. Dudek, “Image Stitching with Dynamic Elements,” Image and Vision Computing, Vol. 27, No. 10, 2009, pp. 1593-1602. doi:10.1016/j.imavis.2009.03.004
- A. A. Efros and W. T. Freeman, “Image Quilting for Texture Synthesis and Transfer,” Proceedings of ACM SIGGRAPH’01, 2001, pp. 341-346.
- V. Kwatra, A. Schodl, I. Essa, G. Turk and A. Bobick, “Graphcut Textures: Image and Video Synthesis Using Graph Cuts,” Proceedings of ACM SIGGRAPH’03, Vol. 22, No. 3, 2003, pp. 277-286.
- A. Levin, A. Zomet, S. Peleg and Y. Weiss, “Seamless Image Stitching in the Gradient Domain,” Proceedings of European Conference on Computer Vision, 2004.
- Y. Boykov, O. Versker and R. Zabih, “Fast Approximate Energy Minimization via Graph Cuts,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 23, No. 11, 2001, pp. 1222-1329. doi:10.1109/34.969114
- J. Y. Jia and C. K. Tang, “Image Stitching Using Structure Deformation,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 30, No. 4, 2008, pp. 617-631. doi:10.1109/TPAMI.2007.70729
- M. A. Fischler and R. C. Bolles, “Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography,” Communications of the ACM, Vol. 24, No. 6, 1981, pp. 381-395. doi:10.1145/358669.358692
- D. G. Lowe, “Distinctive Image Features from Scale-Invariant Keypoints,” International Journal of Computer Vision, Vol. 60, No. 2, 2004, pp. 91-110. doi:10.1023/B:VISI.0000029664.99615.94
- J. Wills, S. Agarwal and S. Belongie, “What Went Where,” Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2003, pp. 37-44.