I think that before VR goes mainstream, 5 things need to be worked out (and I've got both an Oculus Rift CV1 and a Vive setup and I've spent hundreds of hours in VR):
1. The headset and controllers need to use inside-out tracking. The mainstream gamer isn't willing to do any setup, mounting sensors, etc.
2. The headset needs to be wireless. The mainstream gamer isn't going to deal with a wire hanging out the back.
3. The optics need to be better. Headsets need automatic IPD adjustment, automatic focus adjustment, bigger focus sweetspots, no more Fresnel ringing artifacts, etc.
4. The sweating and fogging in your headset problem needs to be fixed. Whether that is with some sort of active face cooling or what, I don't know.
5. The resolution of the panels needs to at least double. 2k x 2k for a start. The fill factor needs to improve too (screendoor effect).
I think MS is waiting until they can fix all 5 of these things before they commit to VR on a console.