Precisely that. Kinect is a great depth sensing camera from a single orientation. Triangulate three or more of them, and you can capture 3d meshes of objects in real time. Capture yhese meshes sequentially and you can play them back like huge animations. Unlike conventional film, in this instance, these captures can be walked through as you play them back from any angle. It becomes, essentially, a holographic capture of a moment in time.
Look up dr. Kreylos' research to see this in practice. Look up infinite realities to see a very high end, non-consumer version of this.
I am convinced that sequentially captured 3d scan will ultimately replace home movies in the future. Why film from a single vantage point when you can just place some 3d sensors in the corner of your room and get to relive any moment whenever you'd like. Imagine as an adult getting to walk around your own 5th birthday.