Support NeoGAF

[onQ123]

Not a fully detailed scan where it's keeping track of what's in your home but a rough scan where it locate your TV & seating area & measure the distance between the walls , ceiling & floor to create a virtual representation to use for enhancing your games.


I'm pretty sure they will do this for the 3D audio but what about view dependent rendering & tracking the controller in 3D space ?

 

[jshackles]

 

[reconminicon]

Is the question and video related? I'm confused.

 

[Enjay]

Hell no

 

[Tarin02543]

You mean the controller will use echo location like bats do?

 

[JareBear: Remastered]

Nice try, SkyNet

 

[onQ123]

Is the question and video related? I'm confused.

The video is a example of view dependent rendering & yes they are related because if the system know where your TV is & the size of your TV it can use the location of your controller to adjust the view.

 

[Sota4077]

Fucking absolutely not. I wasn't a fan of Kinect at the time and I am certainly not a fan of giving a company pictures of the inside of my house.

 

[Fake]

No.

 

[Vawn]

Of course I would. What bad things do you guys honestly believe are going to happen?

I'm sure evil Sony will see you have two coffee tables in your living room or something then their plans to conquer the world will be one step closer.

 

[Mihos]

You mean like my denon receiver already does?

Of course I would...... that's sound system setup 101

 

[Virex]

It's time to stop OP

 

[yurinka]

To make a one time 3D audio callibration using sound to know the distance between the tv speakers and controller, or maybe (not sure if possible) even walls/ceiling/floor absolutely yes.

Something like an always on Kinect no. In fact, I think there won't be a PS5 camera, even for PSVR2.

In any case, I don't understand what the video has to do with PS5.

 

[CobraXT]

If you have a smartphone your privacy
is compormised anyway .. yes if
there is a good reason and will
improve the experince

 

[PropellerEar]

I don't see problem with one time scan that is opt in.

That said...I have my PS camera turned to the wall, when not using it.

 

[onQ123]

You mean the controller will use echo location like bats do?

Yes & use acoustic imaging to get a rough 3D scan of the room to use in games

 

[CatLady]

Absolutely NOT.

 

[Wonko_C]

Video is cool. It's kind of an in-between of VR and TV-gaming.

 

[ThatStupidLion]

thats neat, but i dont trust it.

 

[Zannegan]

There has to be a better way to do head-tracking 3D. I'm all for the tech, but I see no reason to let it "scan my living room" or what have you. There's also a limited benefit unless you have a large TV and you're mobile during gameplay. This might be cool for fishing, golfing, boxing, a sniping game, etc.; but for most things where you're reclining on a couch and playing with a regular controller, I just don't see it.

That said, after the New 3DS, I was really hoping to see something like this become standard on Nintendo's next handheld. They'd already done eye-tracking, the feature would be cheap and easy to add to both hardware and software, and you'd be a lot more likely to tilt and move a handheld screen then move your head around to look at your TV. It would have been so easy and would have had such a big visual impact, especially for 3rd person games. Alas, the Switch dumped its forward facing camera so no dice. Maybe the Switch 2 will make a different kind of glasses-free TV its gimmick, but I won't hold my breath.

EDIT: I'm glad you brought it up. I've been interested in head-tracking 3D since Johnny Chung Lee was doing his experiments with the the Wii. I'd like to see someone really go for it.

 

[jshackles]

You mean like my denon receiver already does?

Of course I would...... that's sound system setup 101

Is your Denon receiver connected to the internet at all times, sending telemetry data to a company that's known for doing shifty and/or invasive things with said data it collects?

 

[Mihos]

Is your Denon receiver connected to the internet at all times, sending telemetry data to a company that's known for doing shifty and/or invasive things with said data it collects?

Yes, and also connects to my Echo speakers, all my streaming services, downloads firmware, SmartThings, my Harmony remote account,, etc, etc, etc

 

[DoctaThompson]

So now ps5 ssd can perform beamforming acoustics and room correction?! I thought I've heard it all, but apparently not.

 

[CyberChulo]

Hell yes.

 

[onQ123]

There has to be a better way to do head-tracking 3D. I'm all for the tech, but I see no reason to let it "scan my living room" or what have you. There's also a limited benefit unless you have a large TV and you're mobile during gameplay. This might be cool for fishing, golfing, boxing, a sniping game, etc.; but for most things where you're reclining on a couch and playing with a regular controller, I just don't see it.

That said, after the New 3DS, I was really hoping to see something like this become standard on Nintendo's next handheld. They'd already done eye-tracking, the feature would be cheap and easy to add to both hardware and software, and you'd be a lot more likely to tilt and move a handheld screen then move your head around to look at your TV. It would have been so easy and would have had such a big visual impact, especially for 3rd person games. Alas, the Switch dumped its forward facing camera so no dice. Maybe the Switch 2 will make a different kind of glasses-free TV its gimmick, but I won't hold my breath.

EDIT: I'm glad you brought it up. I've been interested in head-tracking 3D since Johnny Chung Lee was doing his experiments with the the Wii. I'd like to see someone really go for it.

It can be useful for all games because they can use your distance from the TV & inverse kinematics for Foveated Rendering

 

[phil_t98]

I am guessing it will be more than once as there are different seating positions usually in a living room and it will maybe setup for were you are sat in that instance

 

[waltyftmus Prime]

Yes, pretty cool idea.

 

[Insane Metal]

Nope. Fuck this kind of thing.

 

[The Alien]

Sounds like next gen's version of the kinect concerns from last gen.

C'mon guys, if we cant trust a big company to scan our living room....who can we trust? I'm sure they have OUR best interest in mind cuz gaming.

 

[tasos]

A one time calibration , maybe , although i don't think it's necessary .
Otherwise a big No .

 

[GenericUser]

Lol, no. I'm still laughing

 

[Kuranghi]

No thank you! I wouldn't want them to see all my manequins of Rico Rodriquez.

 

[deriks]

I'm fine with it, but I guess that I'll allow just for some games, and not for the console itself

 

[Self]

I am certainly not a fan of giving a company pictures of the inside of my house.

Pictures? We talk microphone... meaning room measurements for accurate sound positioning.

Since every AVR does it, yes.

 

[Venom Snake]

Of course, why not? It's not like it'll send dick-pics to my grandma.

 

[TBiddy]

Something like Sonos Trueplay? Sure, why not.

 

[zeorhymer]

Not really. They'll make it into a cluster fuck mechanic.

 

[Zannegan]

It can be useful for all games because they can use your distance from the TV & inverse kinematics for Foveated Rendering

There's just no way.

I mean, it sounds awesome, but how could a mic array tell where on the screen you are looking? I'd believe that this could track the general position of your body in space (by tracking the controller), but how would it track your head, let alone your eyes? Even if there was a completely separate camera peripheral a la Kinect that sat by the TV, I still wouldn't believe that it could track your gaze with enough accuracy to do foveated rendering. They haven't even gotten that working with VR headsets yet, and those are strapped to your face, so the eye-tracking would be reasonably accurate.

 

[onQ123]

There's just no way.

I mean, it sounds awesome, but how could a mic array tell where on the screen you are looking? I'd believe that this could track the general position of your body in space (by tracking the controller), but how would it track your head, let alone your eyes? Even if there was a completely separate camera peripheral a la Kinect that sat by the TV, I still wouldn't believe that it could track your gaze with enough accuracy to do foveated rendering. They haven't even gotten that working with VR headsets yet, and those are strapped to your face, so the eye-tracking would be reasonably accurate.

By doing studies of how people view TVs from a certain distance make profiles let the user choose the profile that fit them & boom you have something to work with that can lower the rendering budget while not losing visual quality

 

[Zannegan]

By doing studies of how people view TVs from a certain distance make profiles let the user choose the profile that fit them & boom you have something to work with that can lower the rendering budget while not losing visual quality

So, not eye-tracking, per se, just lowering the resolution to what Apple would call "retina" levels to save on the rendering budget? That could work if the system also knew the size of the screen, but I doubt you'd have people voluntarily cutting their resolutions, not with the way people are arguing about the relative strengths of the PS5/XSX already and which will be able to do true 4K. And doesn't running at a higher resolution, even if you "can't see the difference with the naked eye," cut down on shimmering/jaggies?

Personally, I'm more interested in the machine-learning driven upscaling that NVidia's been demoing. With that, you get all the benefits of dropping the resolution without having to sacrifice actual pixels. Barring that, just letting people choose between image quality and performance modes (without all the invasive scanning/study) seems like a much simpler solution.

I dunno, scanning the room to determine optimal resolution for your viewing distance just seems like a lot of work for very little benefit (and one that many wouldn't appreciate).

 

[Thaedolus]

All I do in the room my PS5 would be in is play games or watch movies, so have at it.

 

[onQ123]

So, not eye-tracking, per se, just lowering the resolution to what Apple would call "retina" levels to save on the rendering budget? That could work if the system also knew the size of the screen, but I doubt you'd have people voluntarily cutting their resolutions, not with the way people are arguing about the relative strengths of the PS5/XSX already and which will be able to do true 4K. And doesn't running at a higher resolution, even if you "can't see the difference with the naked eye," cut down on shimmering/jaggies?

Personally, I'm more interested in the machine-learning driven upscaling that NVidia's been demoing. With that, you get all the benefits of dropping the resolution without having to sacrifice actual pixels. Barring that, just letting people choose between image quality and performance modes (without all the invasive scanning/study) seems like a much simpler solution.

I dunno, scanning the room to determine optimal resolution for your viewing distance just seems like a lot of work for very little benefit (and one that many wouldn't appreciate).

The aim is to put more detail where it's useful

 

[Zannegan]

The aim is to put more detail where it's useful

Right, but for that you would have to do eye-tracking, unless you're going to assume people are just looking at the center of the screen. *shrug*

 

[michaelius]

Once if it's during setup I'd be ok with it.
Constantly scanning during gameplay - hell no.

 

[polybius80]

Is your Denon receiver connected to the internet at all times, sending telemetry data to a company that's known for doing shifty and/or invasive things with said data it collects?

we are talking about Sony not MS, Google or Facebook that invest a lot in this, a speaker and mic array can give you a position of objects not a very accurate image of face features, written text, body shape and thermal data of a person like cameras can do, it can be invasive if they record what you say but scanning the room for the position of objects is not invasive because doesn't collect useful data

 

[LostDonkey]

first thing I do when I get the new pad is muting the fucker. if that doesn't work I'll cram mash potato in it's Mic

then I'll laugh really loud even though it can't hear me

 

[onQ123]

Right, but for that you would have to do eye-tracking, unless you're going to assume people are just looking at the center of the screen. *shrug*

this is for Oculus but it doesn't use Eye tracking

Foveated Rendering Doesn't Need Eye Tracking Hardware Thanks to Some Oculus/Unreal Engine Wizardry - GMW3

It currently only works with Unreal Engine 4.19 and 4.20-preview versions.

www.vrfocus.com

 

[Jesb]

I actually assumed vr was already doing this, I don’t really see it being necessary to be honest.

 

[baphomet]

Most good audio setups have been doing this for many, many years.

 

[DrAspirino]

Not in a million years, for the same reason I don't have Alexa, Google or Apple speakers and use MacOS: privacy. Heck, if it wasn't for Mendeley, Atlas.ti and Word to write my thesis, I'd already be using Linux.