3D Reconstruction and Self-calibration based on Binocular Stereo Vision

국문 초록 (Abstract)

스테레오 영상으로부터 3차원 형상을 구현함에 있어 사용자의 개입을 최소로 필요로 하는 기법을 개발하였 다. 형상구현은 특정 기하학 그룹을 평가하는 3단계로 이루어진다. 1단계는 영상에 존재하는 epipolar 기하 평가로 각 영상에서의 특정점들을 일치시킨다. 2단계는 소실점 방법을 이용하여 투영공간에서 특정평면을 찾는 affine 기하 평가 이다. 3단계에서는 카메라의 자기보정을 포함하며 3차원 모델이 얻어질 수 있는 계량 기하 변수를 구한다. 이 방법의 장점은 형상구현을 위해 스테레오 영상을 보정할 필요가 없는 것으로, 그 구현가능성을 실증하였다.

다국어 초록 (Multilingual Abstract)

A 3D reconstruction technique from stereo images that requires minimal intervention from the user has been developed. The reconstruction problem consists of three steps of estimating specific geometry groups. The first step is estimating the epipolar geometry that exists between the stereo image pairs which includes feature matching in both images. The second is estimating the affine geometry, a process to find a special plane in the projective space by means of vanishing points. The third step, which includes camera self-calibration, is obtaining a metric geometry from which a 3D model of the scene could be obtained. The major advantage of this method is that the stereo images do not need to be calibrated for reconstruction. The results of camera calibration and reconstruction have shown the possibility of obtaining a 3D model directly from features in the images.

참고문헌 (Reference)

1 R. Hartley, "The relationship between photogrammetry and computer vision" 1993

2 T. Werner, "New techniques for automated architecture reconstruction from photographs" 2 : 541-555, 2002

3 R. I. Hartley, "Multiple View Geometry in Computer Vision" Cambridge University Press 2000

4 P. Gargallo, "Minimizing the Reprojection Error in Surface Reconstruction from Images" 2007

5 G. Trombettoni, "Gpdof - a Fast Algorithm to Decompose under-constrained Geometric Constraint Systems: Application to 3d Modeling" 16 (16): 479-512, 2006

6 R. Szeliski, "Geometrically Constrained Structure from Motion: Points on Planes, SMILE '98" 1506 : 171-186, 1998

7 W. Zhang, "Extraction, matching and pose recovery based on dominant rectangular structures" 2003

8 R. Hartley, "Euclidean Reconstruction from Uncalibrated Views, Applications of Invariance in Computer Vision" Springer-Verlag 825 : 237-256, 2004

9 H. P. Trivedi, "Can multiple views make up for lack of camera registration" 6 (6): 29-32, 1988

10 M. Lourkis, "Camera Self-Calibration Using the Kruppa Equations and the SVD of the Fundamental Matrix: The Case of Varying Intrinsic Parameters" INRIA 2000

11 C. Baillard, "Automatic Reconstruction of Piecewise Planar Models from Multiple Views" 1999

12 H. Sekkati, "A variational method for the recovery of dense 3D structure from motion" 55 (55): 597-607, 2007

13 G. Xu, "A linear algorithm for Camera Self-Calibration, Motion and Structure Recovery for Multi-Planar Scenes from Two Perspective Images"

14 G. Zheng, "A 2D/3D correspondence building method for reconstruction of a patient-specific 3D bone surface model using point distribution models and calibrated X-ray images" 13 (13): 883-899, 2009

15 B. Han, "3D dense reconstruction from 2D video sequence via 3D geometric segmentation" 22 (22): 421-431, 2011