CVFX Lecture 26: 3D features and registration

ECSE-6969 Computer Vision for Visual Effects
Rich Radke, Rensselaer Polytechnic Institute
Lecture 26: 3D features and registration (5/1/14)

0:00:04 Algorithms for processing 3D data
0:04:24 3D feature detection
0:05:42 Spin images
0:13:38 Shape contexts
0:14:55 Features in 3D+color scans
0:15:43 Backprojected SIFT features
0:16:43 Physical scale keypoints
0:22:16 3D registration
0:24:27 Iterative Closest Points (ICP)
0:30:42 ICP refinements
0:35:24 3D registration example
0:38:23 Exploiting free space
0:39:41 Multiscan fusion
0:42:57 Combining triangulated meshes
0:44:31 VRIP
0:47:40 Scattered data interpolation
0:51:38 Poisson surface reconstruction
0:53:39 3D object detection
0:55:29 3D stroke-based segmentation
0:56:09 3D inpainting

Follows Section 8.4 of the textbook. http://cvfxbook.com

Key references:

A. Johnson and M. Hebert. Using spin images for efficient object recognition in cluttered 3D scenes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 21(5):433--49, May 2002.
http://dx.doi.org/10.1109/34.765655

A. Frome, D. Huber, R. Kolluri, T. Bülow, and J. Malik. Recognizing objects in range data using regional point descriptors. In European Conference on Computer Vision (ECCV), 2004.
http://dx.doi.org/10.1007/978-3-540-2...

E. Smith, R. J. Radke, and C. Stewart. Physical scale keypoints: Matching and registration for combined intensity/range images. International Journal of Computer Vision, 97(1):2--17, Mar. 2012.
http://dx.doi.org/10.1007/s11263-011-...

E. R. Smith, B. J. King, C. V. Stewart, and R. J. Radke. Registration of combined range-intensity scans: Initialization through verification. Computer Vision and Image Understanding, 110(2):226--44, May 2008.
http://dx.doi.org/10.1016/j.cviu.2007...

S. Rusinkiewicz and M. Levoy. Efficient variants of the ICP algorithm. In International Conference on 3-D Digital Imaging and Modeling (3DIM), 2001.
http://dx.doi.org/10.1109/IM.2001.924423

B. Curless and M. Levoy. A volumetric method for building complex models from range images. In ACM SIGGRAPH (ACM Transactions on Graphics), 1996.
http://dx.doi.org/10.1145/237170.237269

G. Turk and J. F. O'Brien. Shape transformation using variational implicit functions. In ACM SIGGRAPH (ACM Transactions on Graphics), 1999.
http://dx.doi.org/10.1145/311535.311580

J. C. Carr, R. K. Beatson, J. B. Cherrie, T. J. Mitchell, W. R. Fright, B. C. McCallum, and T. R. Evans. Reconstruction and representation of 3D objects with radial basis functions. In ACM SIGGRAPH (ACM Transactions on Graphics), 2001.
http://dx.doi.org/10.1145/383259.383266

M. Kazhdan, M. Bolitho, and H. Hoppe. Poisson surface reconstruction. In Eurographics Symposium on Geometry Processing, 2006.
http://dl.acm.org/citation.cfm?id=128...