기준 평면의 설정에 의한 확장 칼만 필터 SLAM 기반 카메라 추적 방법

국문 초록 (Abstract)

본 논문에서는 시퀀스 상에서 확장 칼만필터(Extended Kalman Filter) 기반의 SLAM(Simultaneous Localization And Mapping) 시스템의 안정적인 카메라 추적과 재위치(re-localization) 방법이 제안된다. SLAM으로 얻어진 3차원 특징점에 들로네(Delaunay) 삼각화를 적용하여 기준(reference) 평면을 설정하며, 평면상에 존재하는 특징점의 BRISK(Binary Robust Invariant Scalable Keypoints) 기술자(descriptor)를 생성한다. 기존 확장 칼만필터의 오차가 누적되는 경우를 판단하여 기준 평면의 호모그래피로부터 카메라 정보를 해석한다. 또한 카메라가 급격하게 이동해서 특징점 추적이 실패하면, 저장된 강건한 기술자 정보를 매칭하여 카메라의 위치를 다시 추정한다.

다국어 초록 (Multilingual Abstract)

This paper presents a novel EKF(Extended Kalman Filter) based SLAM(Simultaneous Localization And Mapping) system for stable camera tracking and re-localization. The obtained 3D points by SLAM are triangulated using Delaunay triangulation to establish a reference plane, and features are described by BRISK(Binary Robust Invariant Scalable Keypoints). The proposed method estimates the camera parameters from the homography of the reference plane when the tracking errors of EKF SLAM are much accumulated. Using the robust descriptors over sequence enables us to re-localize the camera position for matching over sequence even though the camera is moved abruptly.

참고문헌 (Reference)

1 D. Nistér, "Visual odometry" 652-659, 2004

2 H. Bay, "SURF: speeded up robust features" 110 (110): 346-359, 2008

3 N. Engelhard, "Real-time visual odometry from dense RGB-D images" 2011

4 M. Pupilli, "Real-time camera tracking using a particle filter" 519-528, 2005

5 D. Chekhlov, "Real-time and robust monocular SLAM using predictive multi-resolution descriptors" 276-285, 2006

6 B. Williams, "Real-time SLAM relocalisation" 1-8, 2007

7 G. Klein, "Parallel tracking and mapping for small AR workspaces" 225-234, 2007

8 G. Klein, "Parallel tracking and mapping for small AR workspaces" 225-234, 2007

9 D. Chekhlov, "Ninja on a plane: automatic discovery of physical planes for augmented reality using visual SLAM" 153-156, 2007

10 R. Hartely, "Multiple View Geometry in Computer Vision" Cambridge University Press 2003

11 A. J. Davison, "MonoSLAM: real-time single camera SLAM" 29 (29): 1052-1067, 2007

12 N. Molton, "Locally planar patch features for real-timestructure from motion" 2004

13 L. M. Paz, "Large scale 6DOF SLAM with a stereo camera in hand" 24 (24): 946-957, 2008

14 D. G. Lowe, "Distinctive image features from scale-invariant keypoints" 60 (60): 91-110, 2004

15 M. I. A. Lourakis, "Detecting planes in an uncalibrated image pair" 587-596, 2002

16 S. Leutenegger, "BRISK: binary robust invariant scalablekeypoints" 2011

17 M. Calonder, "BRIEF: binary robust independentelementary features" 2010

18 B. Williams, "Automatic relocalisation for a single-camerasimultaneous localisation and mappingsystem" 2784-2790, 2007

19 G. Simon, "Automatic online walls detection for immediate use in AR tasks" 39-42, 2006

20 Z. Zhang, "A flexible new technique for camera calibration" 22 (22): 1330-1334, 2000

21 J. Civera, "1-Point RANSAC for EKF-based structure from motion" 3498-3504, 2009