PointNetLK-OBB: A Point Cloud Registration Algorithm with High Accuracy

Authors: Wenhao Lan, Ning Li, Qiang Tong

Abstract:

To improve the registration accuracy of a source point cloud and template point cloud when the initial relative deflection angle is too large, a PointNetLK algorithm combined with an oriented bounding box (PointNetLK-OBB) is proposed. In this algorithm, the OBB of a 3D point cloud is used to represent the macro feature of source and template point clouds. Under the guidance of the iterative closest point algorithm, the OBB of the source and template point clouds is aligned, and a mirror symmetry effect is produced between them. According to the fitting degree of the source and template point clouds, the mirror symmetry plane is detected, and the optimal rotation and translation of the source point cloud is obtained to complete the 3D point cloud registration task. To verify the effectiveness of the proposed algorithm, a comparative experiment was performed using the publicly available ModelNet40 dataset. The experimental results demonstrate that, compared with PointNetLK, PointNetLK-OBB improves the registration accuracy of the source and template point clouds when the initial relative deflection angle is too large, and the sensitivity of the initial relative position between the source point cloud and template point cloud is reduced. The primary contribution of this paper is the use of PointNetLK to avoid the non-convex problem of traditional point cloud registration and leveraging the regularity of the OBB to avoid the local optimization problem in the PointNetLK context.

Keywords: Mirror symmetry, oriented bounding box, point cloud registration, PointNetLK-OBB.

References:

[1] Choy C, Park J, Koltun V. Fully convolutional geometric features (C)//Proceedings of the IEEE International Conference on Computer Vision. 2019: 8958-8966.
[2] Eckart B, Kim K, Kautz J. Fast and accurate point cloud registration using trees of gaussian mixtures (J). arXiv preprint arXiv:1807.02587, 2018.
[3] Gojcic Z, Zhou C, Wegner J D, et al. The perfect match: 3d point cloud matching with smoothed densities (C)//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2019: 5545-5554.
[4] Wang Y, Solomon J M. Deep closest point: Learning representations for point cloud registration (C)//Proceedings of the IEEE International Conference on Computer Vision. 2019: 3523-3532.
[5] Besl P J, McKay N D. Method for registration of 3-D shapes (C)//Sensor fusion IV: control paradigms and data structures. International Society for Optics and Photonics, 1992, 1611: 586-606.
[6] Segal A, Haehnel D, Thrun S. Generalized-icp (C)//Robotics: science and systems. 2009, 2(4): 435.
[7] Bouaziz S, Tagliasacchi A, Pauly M. Sparse iterative closest point (C)//Computer graphics forum. Oxford, UK: Blackwell Publishing Ltd, 2013, 32(5): 113-123.
[8] Biber P, Straßer W. The normal distributions transform: A new approach to laser scan matching (C)//Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No. 03CH37453). IEEE, 2003, 3: 2743-2748.
[9] Agamennoni G, Fontana S, Siegwart R Y, et al. Point clouds registration with probabilistic data association (C)//2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2016: 4092-4098.
[10] Yang H, Shi J, Carlone L. Teaser: Fast and certifiable point cloud registration (J). arXiv preprint arXiv:2001.07715, 2020.
[11] Yang J, Li H, Campbell D, et al. Go-ICP: A globally optimal solution to 3D ICP point-set registration (J). IEEE transactions on pattern analysis and machine intelligence, 2015, 38(11): 2241-2254.
[12] Rosen D M, Carlone L, Bandeira A S, et al. SE-Sync: A certifiably correct algorithm for synchronization over the special Euclidean group (J). The International Journal of Robotics Research, 2019, 38(2-3): 95-125.
[13] Maron H, Dym N, Kezurer I, et al. Point registration via efficient convex relaxation (J). ACM Transactions on Graphics (TOG), 2016, 35(4): 1-12.
[14] Izatt G, Dai H, Tedrake R. Globally optimal object pose estimation in point clouds with mixed-integer programming (M)// Robotics Research. Springer, Cham, 2020: 695-710.
[15] Qi C R, Yi L, Su H, et al. Pointnet++: Deep hierarchical feature learning on point sets in a metric space (C)//Advances in neural information processing systems. 2017: 5099-5108.
[16] Phan A V, Le Nguyen M, Nguyen Y L H, et al. DGCNN: A convolutional neural network over large-scale labeled graphs (J). Neural Networks, 2018, 108: 533-543.
[17] Wu W, Qi Z, Fuxin L. Pointconv: Deep convolutional networks on 3d point clouds (C)//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2019: 9621-9630.
[18] Aoki Y, Goforth H, Srivatsan R A, et al. Pointnetlk: Robust & efficient point cloud registration using pointnet (C)//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2019: 7163-7172.
[19] Qi C R, Su H, Mo K, et al. Pointnet: Deep learning on point sets for 3d classification and segmentation (C)//Proceedings of the IEEE conference on computer vision and pattern recognition. 2017: 652-660.
[20] Lucas B D, Kanade T. An iterative image registration technique with an application to stereo vision (J). 1981.
[21] Sarode V, Li X, Goforth H, et al. Pcrnet: point cloud registration network using pointnet encoding (J). arXiv preprint arXiv:1908.07906, 2019.
[22] Gelfand N, Mitra N J, Guibas L J, et al. Robust global registration (C)//Symposium on geometry processing. 2005, 2(3): 5.
[23] Rusu R B, Blodow N, Beetz M. Fast point feature histograms (FPFH) for 3D registration (C)//2009 IEEE international conference on robotics and automation. IEEE, 2009: 3212-3217.
[24] Zeng A, Song S, Nießner M, et al. 3dmatch: Learning local geometric descriptors from rgb-d reconstructions (C)//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2017: 1802-1811.
[25] Deng H, Birdal T, Ilic S. Ppfnet: Global context aware local features for robust 3d point matching (C)//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2018: 195-205.
[26] Deng H, Birdal T, Ilic S. Ppf-foldnet: Unsupervised learning of rotation invariant 3d local descriptors (C)//Proceedings of the European Conference on Computer Vision (ECCV). 2018: 602-618.
[27] Baker S, Matthews I. Lucas-kanade 20 years on: A unifying framework (J). International journal of computer vision, 2004, 56(3): 221-255.
[28] Schneider P, Eberly D H. Geometric tools for computer graphics (M). Elsevier, 2002.
[29] Chang C T, Gorissen B, Melchior S. Fast oriented bounding box optimization on the rotation group SO (3, ℝ) (J). ACM Transactions on Graphics (TOG), 2011, 30(5): 1-16.
[30] Wu Z, Song S, Khosla A, et al. 3d shapenets: A deep representation for volumetric shapes (C)//Proceedings of the IEEE conference on computer vision and pattern recognition. 2015: 1912-1920.