Solving the Occlusion Problem
Treat the image as a texture-mapped triangular mesh with depth encoded in the Z coordinate.
To interpolate, perform a standard 3-D warp using triangulation and geometry
Depth-buffering should suffice to solve occlusion and ensure no holes in surfaces