VR doesn't have a viable and sustainable market not only from a hardware perspective but also in terms of developers. The install base is tiny, the hardware is expensive, the experiences are hard to elongate due to fatigue, not everyone can enjoy it without getting motion sickness, and most of the games which release for it are indie level development, bite sized experiences or shovelware.
Does VR have a place in gaming? Sure, but it's not worth its salt yet to bother with from an investment standpoint. Even if you look at something like PSVR it has completely stagnated, there's rarely anything new or worth getting and few bother porting their games to it.
Microsoft has more important things to worry about that will actually reach people.