I developed an deformable surface tracking demo based on Ngo's work.
The blue mesh in the video is the projection of the resulting 3D surfaces using ground truth keypoint matches while the red dots denote the projections of the mesh vertices onto the ground-truth surface.
Notes on the paper:
Ngo, Dat Tien, Jonas Östlund, and Pascal Fua. "Template-based monocular 3D shape recovery using laplacian meshes." IEEE transactions on pattern analysis and machine intelligence 38.1 (2015): 172-187. ↩