Fast and Accurate Self-calibration Using Vanishing Point Detection in Manmade Environments

다국어 초록 (Multilingual Abstract)

Interests of auto-calibration have been increased in several camera systems. This paper presents a novel self-calibration method using a fast and accurate vanishing point detection algorithm that works in manmade environments. The proposed algorithm estimates focal length assuming that the principal point is the center of an image to satisfy the orthogonality of three vanishing points. By using the proposed vanishing point detection algorithm and minimization of the proposed objective function, the proposed system detects accurate vanishing points with focal length outperforming other methods. The proposed vanishing point detection algorithm detects vanishing points by using J-linkage based method that is more delicate by fragmentation and re-merging strategies. The proposed objective function finally detects vanishing points that meet orthogonality among estimated hypotheses for vanishing points by checking several geometric relationships. We believe that the proposed method can be used for automatic camera calibration, localization of a camera in an autonomous navigation system, and three-dimensional reconstruction of a single-view image.

참고문헌 (Reference)

1 J. K. Jana, "Video compass" 476-490, 2002

2 S. Lee, "VPGNet : Vanishing point guided network for lane and road marking detection and recognition" 1965-1973, 2017

3 B. Caprile, "Using vanishing points for camera calibration" 4 (4): 127-139, 1990

4 J. M. Coughlan, "The Manhattan world assumption : regularities in scene statistics which enable Bayesian inference" 809-815, 2000

5 J. C. Bazin, "Rotation estimation and vanishing point extraction by omnidirectional vision in urban environment" 31 (31): 63-81, 2012

6 R. Toldo, "Robust multiple structures estimation with j-linkage" 537-547, 2008

7 H. Wildenauer, "Robust camera selfcalibration from monocular images of Manhattan worlds" 2831-2838, 2012

8 M. A. Fischler, "Random sample consensus : a paradigm for model fitting with applications to image analysis and automated cartography" 24 (24): 381-395, 1981

9 R. Fletcher, "Practical Methods of Optimization" John Wiley & Sons 2000

10 R. Fletcher, "Practical Methods of Optimization" John Wiley & Sons 2000

11 A. V. Lazo, "On the entropy of continuous probability distributions" 24 (24): 120-122, 1978

12 E. A. Nadaraya, "On estimating regression" 9 (9): 141-142, 1963

13 J. P. Tardif, "Non-iterative approach for fast and accurate vanishing point detection" 1250-1257, 2009

14 R. Hartley, "Multiple View Geometry n Computer Vision" Cambridge University Press 2003

15 R. G. Von Gioi, "LSD : a line segment detector" 2 : 35-55, 2012

16 P. S. Mann, "Introductory Statistics" John Wiley &Sons 2016

17 T. H. Cormen, "Introduction to Algorithms" MIT Press and McGraw-Hill 552-557, 2001

18 S. T. Barnard, "Interpreting perspective images" 21 (21): 435-462, 1983

19 J. C. Bazin, "Globally optimal line clustering and vanishing point estimation in manhattan world" 638-645, 2012

20 O. Barinova, "Geometric image parsing in man-made environments" Springer 57-70, 2010

21 S. J. Lee, "Fast and robust vanishing point detection on uncalibrated images" 2018

22 강동중, "Detection of Calibration Patterns for Camera Calibration with Irregular Lighting and Complicated Backgrounds" 제어·로봇·시스템학회 6 (6): 746-754, 2008

23 M. E. Antone, "Automatic recovery of relative camera rotations for urban scenes" 282-289, 2000

24 Van-Dung Hoang, "Automatic Calibration of Camera and LRF based on Morphological Pattern and Optimal Angular Back-projection Error" 제어·로봇·시스템학회 13 (13): 1436-1445, 2015

25 W. Feller, "An Introduction to Probability Theory and Its Applications" John Wiley & Sons Inc. 704-, 1991

26 S. Hutchinson, "A tutorial on visual servo control" 12 (12): 651-670, 1996

27 G. Nebehay, "A self-calibration method for smart video cameras" 2009

28 S. J. Lee, "A robust line merge method using Gaussian mapping" 2018

29 Y. Xu, "A minimum error vanishing point detection approach for uncalibrated monocular images of man-made environments" 1376-1383, 2013

30 S. B. Aruoba, "A comparison of programming languages in macroeconomics" 58 : 265-273, 2015

31 장국현, "A Vertical and Floor Line-based Monocular SLAM System for Corridor Environments" 제어·로봇·시스템학회 10 (10): 547-557, 2012

32 신용득, "A Study on Reliability Enhancement for Laser and Camera Calibration" 제어·로봇·시스템학회 10 (10): 109-116, 2012

33 Kaset Sirisantisamrid, "A Determination Method of Initial Camera Parameters for Coplanar Calibration" 제어·로봇·시스템학회 7 (7): 777-787, 2009