IMPOSSIBLE to project detailed and moving images, especially of the size shown, using such a little projector. and how the fuck do you diffract the light so that images both fit and align with the walls.
Have you calibrated Kinect guys? Do you imagine the process of calibrating that thing?
The calibration could be quite easy and automatic actually. A depth sensor would already know the shape of the objects in the scene, what it needs to know it the relative position of the projector. And since both can be "talking" to each other (assuming they're both controlled by the same "computer"), the projector can emit a specific visual pattern that the kinect will match with the shapes it detects (actually that's already similar to how the primesense depth sensor works).
But as someone who plays both with kinect and projectors, I can see a big difficulty for such a system : most objects in a living room are not reflective enough for image projection. If you have a coloured couch, whatever you project on it will be barely visible. (it's even worse if it's in a material that doesn't reflect IR, since the depth sensor won't "see" it anyway).
I also wonder if the image projections won't disturb the depth measurements, but that could be avoided by having non-overlapping wavelengths.
So, I don't really expect to see such a thing in living rooms soon (not at this scale anyway). But it could be done for smaller applications (like having a "screen extension" on a wall), or in other contexts (amusement parks, simulators, ...)
