Providing a New Method for Visual and Geometric Reconstruction of Environment based on Stereo Panorama

Abstract

3D urban reconstruction with access to geometric and visual information is used by many organizations. In this regard, using stereo panorama as an image-based method is attended by many manufacturers and users of the urban maps because of the simplicity and providing real visibility. In this paper, a new stereo panorama system based on stereo cameras (that is patented) is presented and three-dimensional reconstruction of urban environments using the system is expressed. Moreover in this article, the process of registration between the stereo panoramic images at different stations is also described to cover whole area. Finally, geometric and visual reconstruction of part of a street was evaluated by the mentioned stereo panorama system. The results of the reconstruction of the environment revealed that unlike most stereo panorama systems in which access to geometric information is sometimes difficult, in the proposed method, in addition to providing a visual space of the environment, geometric measurements is easily possible and achieving the desired accuracy that is needed in urban projects (large map with scale of 1:1000) is possible.

Keywords


[1]          D.  Cobzas, and  H. Zhang, H., "Mobile Robot Localization using Planar Patches and a Stereo Panoramic Model", Vision Interface, pp. 94-99, 2001.
[2]          S. E. Chen, "QuickTime VR – An Image-Based Approach to Virtual Environment Navigation", 22nd Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 95, pp. 29-38, 1995.
[3]          D. Gledhill, G. Y. Tian, D. Taylor, and D. Clarke, "3D Reconstruction of a Region of Interest using Structured Light and Stereo Panoramic Image", IEEE Eighth International Conference on Information Visualization, pp. 1007-1012, 2004.
[4]          H. C. Huang, and P. Hung, "SPISY: The Stereo Panoramic Imaging System", Third Workshop on Real-Time and Media Systems, Taiwan, pp. 71-78, 1997.
[5]          M. Varshosaz, and A. Sh. Amini, "Stereo Panoramas: Problems and Solutions", XXI International CIPA Symposium, Athens, 2007.
[6]          T. T. Lin, Y. K. Hsiung, G. L.  Hong, H. K. Chang, and F. M. Lu, "Development of a Virtual Reality GIS Using Stereo Vision", Computers and Electronics in Agriculture, Vol. 63, pp. 38–48, 2008.
[7]          D. Gledhill, 3D Panoramic Imaging for Virtual Environment Construction. PhD Thesis for the degree of Doctor of Philosophy, School of Computing and Engineering, the University of Huddersfield, UK, 149 pages, 2009.
[8]          S. Peleg, and M. Ben-Ezra, "Stereo Panorama with a Single Camera", IEEE Conference on Computer Vision and Pattern Recognition, pp. 395-401, 1999.
[9]          D. Gledhill, G. Y. Tian, D. Taylor, and D. Clarke, "Panoramic Imaging—a Review", Computers & Graphics, Vol. 27, pp. 335-345, 2003.
[10]        Y. Qu, W. L. Khoo, E. Molina, and Z. Zhigang, "Multomodal 3D Panoramic Imaging using a Precise Rotating Platform", IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM), pp. 260-265, 2010.
[11]        J. Amiri Parian, and A. Gruen, A., "Sensor Modeling, Self-Calibration and Accuracy Testing of Panoramic Cameras and Laser Scanners", ISPRS Journal of Photogrammetry and Remote Sensing, pp. 65, 60-76, 2010.
[12]        R. Li, L. Yan, K. Di, and B. Wu, "A New Ground-Based Stereo Panoramic System", International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol. 37(B5), pp. 723–727, 2008.
[13]        R. Benosman, T. Maniere, and J. Devars, Panoramic Stereovision Sensor. Chapter 9 in Panoramic Vision (Eds. R. Benosman & S. B. Kang), Springer, New York, USA, 449 pages, pp. 161–168, 2001.
[14]        S. Hua, Q. Huanga, A. Zhang, and J. Qiaoa, "3D Measurement, Reconstruction and Navigation through Panoramic Photography", International Conference of Photogrammetry, Remote Sensing and Spatial Information Sciences, China, pp. 115-118, 2008.
[15]        H. Kawasaki, K. Ikeuchi, and M. Sakauchi, "Automatic 3D City Reconstruction using Omni Camera", IEEE International conference on Multimedia and Expo, USA, pp. 1653-1656, 2000.
[16]        E. Cabral, P. Oliveira, and J. Junior, "An Omnidirectional Stereo Vision System". ABCM Symposium Series in Mechatronics, pp. 643-652, 2008.
[17]        A. Goshtasby, "Grover W. Design of a Single-Lens Stereo Camera System", Pattern Recognition, Vol. 26, pp. 923–937, 1993.
[18]        D. G. Lowe, "Object Recognition from Local Scale-Invariant Features", Proceedings of the International Conference on Computer Vision, pp. 1150–1157, 1999.
[19]        D. G. Lowe, "Distinctive Image Features from Scale-Invariant Keypoints", Computer Vision, Vol. 60, pp. 91–110, 2004.
[20]        M. A. Fischler, and R. C. Bolles, "Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography", Communications of the ACM, Vol. 24(6), 381–395, 1981.
[21]        G. H. Seedahmed, and A. F. Habib, "Linear Recovery of the Exterior Orientation Parameters in a Planar Space", ISPRS Congress, Commission III, WG III/I, 2002.
[22]        میلاد امن‌زاده، محمد سعادت‌سرشت، امیر شاهرخ امینی، "ارائه روشی بهبودیافته برای کالیبراسیون دوربین‌های استریو"، نشریه علمی-پژوهشی علوم و فنون نقشه‌برداری، دوره اول شماره 3، 1390.