• Hey, guest user. Hope you're enjoying NeoGAF! Have you considered registering for an account? Come join us and add your take to the daily discourse.

HoloLens - Xbox One streaming AR

DorkyMohr

Banned
you realize, this is a simulated depiction of how a device with unrestricted FoV would display these kinds of things.

The first time the dude says "make bigger", we're beyond what the technology is currently (and, according to Spencer, anytime soon) is capable of.

These are fake. I've worn HoloLens. There's no way in hell this is real. The FoV is literally 1/3 the size of this.

Watching a video feed out of the headset will never be 1:1 to wearing the device, but I don't see how that's not an accurate representation of the FOV. Meaning it still doesn't look great. Watch it again and pay attention to the background behind the 'hologram'. It's like walking through your house with binoculars. Now imagine your normal field of view walking through your house and you can get an idea of how big these youtube videos would be in the headset.
 
We haven't seen anything on the new FOV and likely it isn't this big, but I'm struggle to figure out why these videos would be completely fake?

Maybe they're like forecasted goals of the device.

I wouldn't put it past MS marketing to keep the device fresh in peoples minds with continuous vids like this
 
Maybe they're like forecasted goals of the device.

I wouldn't put it past MS marketing to keep the device fresh in peoples minds with continuous vids like this

This isn't from marketing. So you are saying that each of these guys is having a MS team come to their houses around the world and record their families doing random boring stuff then then recreating holograms on them back in Seattle, having them then post it on their twitter feeds?

Did I get that right?
 

Fliesen

Member
Watching a video feed out of the headset will never be 1:1 to wearing the device, but I don't see how that's not an accurate representation of the FOV. Meaning it still doesn't look great. Watch it again and pay attention to the background behind the 'hologram'. It's like walking through your house with binoculars. Now imagine your normal field of view walking through your house and you can get an idea of how big these youtube videos would be in the headset.

Still, they're filling the entire frame of the video. It's a misrepresentation, still.

It's like sharing a 4K video from your iPhone 6S. Sure, that's what the device can "create", it's still not what you're going to see, because the display technology (the visor and its limited FOV / the roughly 720p display of the iPhone) isn't on par.

I understand what these videos are. These videos are simply AR projected over a video. I have no doubts that HoloLens can do that.
Any modern phone can do that. It's all about the DISPLAY TECHNOLOGY. and no video on youtube can emulate this, and any video that still shows frame-filling AR projections is a misrepresentation of the technology.

What is shown in these videos is nothing groundbreaking. It's AR, it's been around for ages. What's groundbreaking is the holographic display technology.
 

jax

Banned
The tech in HoloLens is probably the most innovative thing I've ever had the pleasure of using. Just how it is in its current state is too expensive for what you get. I wouldn't be surprised if HoloLens technology really took off by the year 2020. It might even replace smartphones, it's just that good.
 

hawk2025

Member
Wait, so this is a little confusing.

The device itself can record what is being displayed to the user. That makes sense if all we saw is the hologram itself on the twitter videos, but we are also seeing the "frame" -- that is, the part of a person's vision that would simply not be rendered by the Hololens at all.

So, is there a *second* camera on the Hololens that's capturing these videos and then reprojecting the AR bits onto the video itself?
 

DorkyMohr

Banned
Still, they're filling the entire frame of the video. It's a misrepresentation, still.

It's like sharing a 4K video from your iPhone 6S. Sure, that's what the device can "create", it's still not what you're going to see, because the display technology (the visor and its limited FOV / the roughly 720p display of the iPhone) isn't on par.

It might be all the device is capable of outputting (hologram rendering + camera feed from the front). But I agree if this is meant to drum up hype for the device then it's still misleading given the "oh cool they fixed the fov" posts.
 
The tech in HoloLens is probably the most innovative thing I've ever had the pleasure of using. Just how it is in its current state is too expensive for what you get. I wouldn't be surprised if HoloLens technology really took off by the year 2020. It might even replace smartphones, it's just that good.
Yeah. It won't be on a bulky headset forever, that's for sure (imo).

There's a recent video with Volvo which has a moment where the field of view is shown. Still impressive.
 
This isn't from marketing. So you are saying that each of these guys is having a MS team come to their houses around the world and record their families doing random boring stuff then then recreating holograms on them back in Seattle, having them then post it on their twitter feeds?

Did I get that right?

Relax, you sound agitated by my hypothetical

I was implying that these could be made by MS just to keep hype going, I'm not 100% in the loop but dev kits haven't even gone out, have they?

Who are these people that get access to these dev kits so far ahead of time, random bloggers?

Looks like all of those videos are being posted by MS employess. Maybe a marketing thing is not a bad bet here

See what I mean.
 
Well, i don't think anyone doubts that this depiction of basic AR is "fake".

what's fake is that this is not a rendition of what you can actually perceive wearing a HoloLens device.

"AR" is nothing new. You could export a video showing some AR app on your smartphone. What HoloLens brings to the table that is new is the actual physical device. And that device is just not capable of what is shown in these "exported" videos

Still, they're filling the entire frame of the video. It's a misrepresentation, still.

It's like sharing a 4K video from your iPhone 6S. Sure, that's what the device can "create", it's still not what you're going to see, because the display technology (the visor and its limited FOV / the roughly 720p display of the iPhone) isn't on par.

I understand what these videos are. These videos are simply AR projected over a video. I have no doubts that HoloLens can do that.
Any modern phone can do that. It's all about the DISPLAY TECHNOLOGY. and no video on youtube can emulate this, and any video that still shows frame-filling AR projections is a misrepresentation of the technology.

What is shown in these videos is nothing groundbreaking. It's AR, it's been around for ages. What's groundbreaking is the holographic display technology.

so is the device not capable of showing what is seen here or is it capable but not at the same FoV? you seem to have very strong views on this despite presumably never using the device.
 

Fliesen

Member
Wait, so this is a little confusing.

The device itself can record what is being displayed to the user. That makes sense if all we saw is the hologram itself on the twitter videos, but we are also seeing the "frame" -- that is, the part of a person's vision that would simply not be rendered by the Hololens at all.

So, is there a *second* camera on the Hololens that's capturing these videos and then reprojecting the AR bits onto the video itself?

Afaik, HoloLens has some intricate camera / sensor setup that also does depth perception, so it can match up the holographic image to your view. Imagine some sort of Kinect pointing forward + gyroscope / accelerometer.

Otherwise it couldn't really match up the image and it'd be super wonky.

I have no doubts that this is what the HoloLens sees and creates. It's not, however what the user sees.
And i couldn't care less about what the HoloLens sees. My phone can do the same thing.
 

Bsigg12

Member
Looks like all of those videos are being posted by MS employess. Maybe a marketing thing is not a bad bet here

They are literally the only ones with the device and looking around on Twitter it seems most of the videos are from people on the engineering team.
 
This is my most anticipated piece of technology, I hope they don't release it until the FoV is somewhat better. I really want HoloLens to succeed.
 

etta

my hard graphic balls
Who are these people that get access to these dev kits so far ahead of time, random bloggers?

Some of these people have no YouTube subscribers, so no, they are not random bloggers. It's clear they were selected specifically.
 

Shpeshal Nick

aka Collingwood
This as it was in that video seems so much more practical to me than VR. But that dudes lip smacking was fucking driving my misophonia into overdrive. Fuck. Had to stop it.
 

Fliesen

Member
Yep, either a MS employee or a CGI expert trying to go viral.

no need for that. It's perfectly plausible that this is what the HoloLens creates and exports.

ClutteredAdoredCrab.gif


The PS VITA could do AR. the video feed of an AR device will always look super immersive.
It's all about what it's gonna look like when you wear it on your head, and no video on youtube or wherever else, will ever be an indication of that, unless they show you the image overlaid to the actual viewer's FoV.
 
Some of these people have no YouTube subscribers, so no, they are not random bloggers. It's clear they were selected specifically.

Thank you for proving my point, the poster "gamechanger" was implying these were non-MS employees... which is why I said what I did
 
Relax, you sound agitated by my hypothetical

I was implying that these could be made by MS just to keep hype going, I'm not 100% in the loop but dev kits haven't even gone out, have they?

Who are these people that get access to these dev kits so far ahead of time, random bloggers?

See what I mean.

Devkits aren't out yet. You can sign up next month and get two kits delivered in Q1 2016. These videos are from MS employees working on the project. According to them, they are now allowed to post short videos that have been recorded by the hololens. Obviously they are part of a marketing program, but I don't see how these are fake videos. You may not be saying that directly, but lots of others are.

If you are going to fake something you make it more impressive and you don't go to peoples houses to do it.

I never said they were not MS employees. Everyone else is out there claiming that this is all a lie. I read the Zdnet article and looked through the hashtag there to get my info on where it is coming from.

Microsoft is allowing some employees to post short home videos with the #MadeWithHoloLens hashtag to show off more ideas about how the coming augmented-reality technology could be used.

The new videos began showing up on Twitter over the past couple of days. One from @ShireWisdom (Noble Smith) shows a glimpse of an interactive solar system demo. Another from @TheSparkly (Andrea Chang) is of a mime walking along a keyboard. Chang also hashtagged her video clip with #HoloLensHYPE.
The HoloLens video clips come a month before Microsoft allows developers in U.S. and Canada to sign up to request access to HoloLens developer kits, which will be $3,000 a piece, with a limit of two per developer. Those kits will go out to those selected during the first quarter of 2016. There's no public information at this point as to what's included in the kits.

Earlier this week, there was a report from Ynet that said Microsoft had cut 60 people in Israel who were working on the HoloLens. The group affected consisted of 30 full time employees and 30 contractors, the report said, and was part of an Israeli startup Microsoft acquired six years ago. (I'm assuming that acquisition was 3D CMOS camera-chipmaker Canesta, which Microsoft bought in November 2010.) Ynet reported that Microsoft planned to use its own technology in place of that developed by the Israeli team.

Microsoft CEO Satya Nadella has said that Microsoft's first priority with HoloLens will be to get enterprise applications developed for the product. Microsoft's partnership with Autodesk Fusion 360 on an industrial-design offering is an example of the type of application Microsoft is pushing to debut first for HoloLens users.
 
Huh? I tried what's shown in this video half a year ago at Microsoft and it's definitely real.

We played Ori on it and from what I remember, resolution and lag was OK.
Yeah, haven't tried it myself but colleagues *and customers* have used it and been absolutely blown away. As ever tho, not sure hololens chat belongs in the gaming forum. It will have games I'm sure but gaming is not the target market. (tbf to OP, this is a gaming video though!)
 

Fliesen

Member
Devkits aren't out yet. You can sign up next month and get two kits delivered in Q1 2016. These videos are from MS employees working on the project. According to them, they are now allowed to post short videos that have been recorded by the hololens. Obviously they are part of a marketing program, but I don't see how these are fake videos. You may not be saying that directly, but everyone else is.

If you are going to fake something you make it more impressive and you don't go to peoples houses to do it.

Not everyone. Disgregard those people. :p

No need to fake something that is very basic (though impressively well motion tracked) AR. The tracking / motion matching of the device seems to be rather superb.

so is the device not capable of showing what is seen here or is it capable but not at the same FoV? you seem to have very strong views on this despite presumably never using the device.

https://twitter.com/ShireWisdom/status/670744589612007424

the short video shows AR imagery across the entire video's(!) FoV, which is a misrepresentation, since the video itself is a very limited FoV.
Again - i am not saying this isn't impressive (it tracks really nicely) - the issue is, however, that it's still somewhat misleading.
The first video (in the OP) projects a "TV screen" that is half as tall as a DOOR! given the small FoV that any media representative who's worn the device has described, the image created could only be fully perceptible at a relatively "far" viewing distance.
 

hawk2025

Member
Afaik, HoloLens has some intricate camera / sensor setup that also does depth perception, so it can match up the holographic image to your view. Imagine some sort of Kinect pointing forward + gyroscope / accelerometer.

Otherwise it couldn't really match up the image and it'd be super wonky.

I have no doubts that this is what the HoloLens sees and creates. It's not, however what the user sees.
And i couldn't care less about what the HoloLens sees. My phone can do the same thing.

I see, so we are basically seeing the view-within-a-view-within-a-view.

If the actual Hologram bits have an FOV of, say, 90 degrees, while the additional camera rendering has an FOV of 110 degrees, then the implied FOV coverage of the twitter videos we are seeing is ~82%, while in reality it would be around 60%.

Cool, makes sense!
 
Yeah, haven't tried it myself but colleagues *and customers* have used it and been absolutely blown away. As ever tho, not sure hololens chat belongs in the gaming forum. It will have games I'm sure but gaming is not the target market.

To be fair, the first video was of Xbox streaming.
 

Trup1aya

Member
So you don't need a tv at all?

Runs at the same resolution, no lag, etc?

It's the same comprises that come with streaming to any other Windows PC I would imagine...

FPS is capped at 30fps... Lag has been negligable for me, but will depend on your network.
 
To be fair, the first video was of Xbox streaming.
Yeah, was just about to edit my post to say that. Just think the demands of the gaming forum side are not necessarily the same as the target of the product so it just ends up in a mix of "fake" , "lol dad" and "fov sux" posts :)
 

etta

my hard graphic balls
It's the same comprises that come with streaming to any other Windows PC I would imagine...

FPS is capped at 30fps... Lag has been negligable for me, but will depend on your network.

Stream does 60fps on Very High.

Yeah, was just about to edit my post to say that. Just think the demands of the gaming forum side are not necessarily the same as the target of the product so it just ends up in a mix of "fake" , "lol dad" and "fov sux" posts :)

Then this helps with the ignore list by weeding those posters out! :p
 

Fliesen

Member
I see, so we are basically seeing the view-within-a-view-within-a-view.

If the actual Hologram bits have an FOV of, say, 90 degrees, while the additional camera rendering has an FOV of 110 degrees, then the implied FOV coverage of the twitter videos we are seeing is ~82%, while in reality it would be around 60%.

Cool, makes sense!

i suppose we're seeing the full image of what the HoloLens would be outputting onto the display within the visor. which is still a limited 'window' inside your FoV.

btw, those are like, super arbitrary numbers and percentages :p

these are the displays of the HoloLens Prototype units. If you wear glasses, just pull them 2 inches from your eyes. I suppose that's a decent rendition of how big / small the AR overlay display is going to be.
I'm optimistic they'll make it bigger for the release version.
 

Vintage

Member
Pretty sure it's all real, only recorded through device itself, so obviously the actual experience may be different.
 

hawk2025

Member
i suppose we're seeing the full image of what the HoloLens would be outputting onto the display within the visor. which is still a limited 'window' inside your FoV.

btw, those are like, super arbitrary numbers and percentages :p

I didn't even bother to calculate the percentages correctly or look up the typical human field of view!


Science!
 

Sydle

Member
I don't understand why Microsoft or anyone else is showing everyday consumer things like this off when it's going to cost thousands of dollars.
 

Fliesen

Member
So all of those are fake?

Nope. They're just feeds of what HoloLens outputs to the screens inside the visor.

i think some people who call it "fake" don't mean "this video isn't technically feasible by the camera / holographc processing unit (i made that term up!) on the device itself, but rather mean that it's not a meaningful representation of what it'll look like to the user.

I don't understand why Microsoft or anyone else is showing everyday consumer things like this off when it's going to cost thousands of dollars.

because they're excited about the technology. It is pretty fascinating.
 
Nope. They're just feeds of what HoloLens outputs to the screens inside the visor.

i think some people who call it "fake" don't mean "this video isn't technically feasible by the camera / holographc processing unit (i made that term up!) on the device itself, but rather mean that it's not a meaningful representation of what it'll look like to the user.

You have more faith in humanity than I do. The usual drive-bys don't use that many words.
 

Bsigg12

Member
Nope. They're just feeds of what HoloLens outputs to the screens inside the visor.

i think some people who call it "fake" don't mean "this video isn't technically feasible by the camera / holographc processing unit (i made that term up!) on the device itself, but rather mean that it's not a meaningful representation of what it'll look like to the user.

HPU? Na...
 

etta

my hard graphic balls
I don't understand why Microsoft or anyone else is showing everyday consumer things like this off when it's going to cost thousands of dollars.

Because it won't cost nearly that much, at least not the consumer version.
Only the devkit is $3,000, and the first model is mostly for business/science use as far as I know, so by the time it comes to consumers in general, it will probably be priced appropriately.
 

Pie and Beans

Look for me on the local news, I'll be the guy arrested for trying to burn down a Nintendo exec's house.
Oy. So HoloLens has a built in way of recording a misrepresentation of what it can actually do FOV wise.

Microsoft are courting the biggest fucking blowback on a product conceivable. Whoever the idiot is that keeps saying "It'll be fine!" needs turfing out onto the street pronto.
 
Top Bottom