Support NeoGAF

Monumental · Jul 17, 2013

Source: Microsoft Research via Neowin

Today, Microsoft announced a new project from their Microsoft Research team in Asia that is trying to create a new and better way to translate sign language.

In a blog post, Microsoft states the team, working with another group at the Institute of Computing Technology at the Chinese Academy of Sciences, has created software that uses the Kinect for Windows hardware for its project.

The software has two modes. The first, Translation Mode, is self explanatory. It translate the sign language from a person into either text or speech. The second, Communications Mode, has a hearing person using the software who types in words that are then displayed on screen as sign language via a 3D avatar. The person on the other end then uses sign language that is then translated to text or speech.

Youtube Video Demonstration: http://www.youtube.com/watch?v=pFUClV1FNYo

If Kinect is becoming powerful enough to identify and translate sign language, imagine the possibilities and precision of the software for upcoming games. Sign for spells and magic in things like Naurto, Fable, Oblivion.

Deleted member 80556 · Jul 17, 2013

Man, that is an awesome application for Kinect. Hadn't thought about it. I guess people who want this need to purchase the rather expensive PC dev kit?

Amagon · Jul 17, 2013

Well, thats one positive I will give to the Kinect.

Kromis1 · Jul 17, 2013

As much as I dislike the business and corporate side of Microsoft, I absolutely adore their Research branch. Absolutely amazing the things they're trying to do!

Monumental · Jul 17, 2013

Juan29.zapata said:
Man, that is an awesome application for Kinect. Hadn't thought about it. I guess people who want this need to purchase the rather expensive PC dev kit?

The one that comes with development support and two Kinects? Why would they need to do that?
Why wouldn't they just purchase the inevitable regular consumer version?

B.O.O.M · Jul 17, 2013

That actually sounds cool

Let's get our Raikiri on

injurai · Jul 17, 2013

Speak to Alyx and Dog?

HL3 Xbone exclusive confirmed.

Garrett 2U · Jul 17, 2013

But Kinect is just a gimmick?!?

This is awesome.

enzo_gt · Jul 17, 2013

Microsoft Research is so awesome. Consistently awesome stuff coming out of there. Kinect is and has always been awesome too.

AstroNut325 · Jul 17, 2013

This is amazing! Kudos to MS. I'm one of the few who like Kinect.

ThoughtsOfSpeaking · Jul 17, 2013

THE NO LIFE KING said:
Well, thats one positive I will give to the Kinect.

credit where it is due indeed.

CorrisD · Jul 17, 2013

That's great, but I don't see many people complaining about Kinects uses outside of gaming, the device is great for many applications as we have seen already in multiple different industries. Most people just don't want it shoved into games, I have less than zero interest in waving my arms and hands about for a spell in oblivion or similar game.

Bsigg12 · Jul 17, 2013

enzo_gt said:
Microsoft Research is so awesome. Consistently awesome stuff coming out of there. Kinect is and has always been awesome too.

I wish the onboard processor would have never been cut....other than that its great tech

TheHater · Jul 17, 2013

This actually sounds pretty cool.

FINALBOSS · Jul 17, 2013

That is so awesome.

Atomski · Jul 17, 2013

Actually something neat from Kinect.. been a while.

I cant imagine this will get much use on the xbone though.. on pc on the other hand it would be perfect for maybe a sign language training program.

Platy · Jul 17, 2013

Deaf people will be able to talk and understand other people talking !

...

IMAGINE HOW AWESOME WOULD BE A NARUTO GAME !

Salamando · Jul 17, 2013

Using IR Cameras to aid in sign language translation has been worked on in a good number of labs since the 90's. http://wearables.cc.gatech.edu/publications/iswc2000-pendant/index.html

Zoramon089 · Jul 17, 2013

It won't ever be used for cool gaming applications just like the wiimote really wasn't, the kinect wasn't and the Move weren't. Devs have shown time and time again they only care about stronger hardware and traditional control methods

Tonguer · Jul 17, 2013

That's pretty cool. I've always thought Kinect has awesome possibilities....

... it's the execution.... the execution...

jayu26 · Jul 17, 2013

I agree. This is very cool.

BigDug13 · Jul 17, 2013

Garrett 2U said:
But Kinect is just a gimmick?!?

This is awesome.

It is a gimmick...for gaming. It's an incredible piece of tech with a ton of great applications. It's just most people don't want to pay more for it on their game system as its gaming specific applications have yet to be proven to be necessary or revolutionary.

Anyway, for stuff like this it is awesome and I'm happy to see any tech to assist with things like this.

mrjohill · Jul 17, 2013

That's pretty cool

davepoobond · Jul 17, 2013

can you still be a total asshole using sign language?

Sub_Level · Jul 17, 2013

I actually thought it would be cool to have a game where, when you cast a spell, you're prompted to do weird pattern of formations with your hand rapidly to cast it. And you have to remember the formations because they're not shown to you after the tutorial and they're different for each spell.

Zaptruder · Jul 17, 2013

I want this all over my... Google Glasses.

Router · Jul 17, 2013

The Microsoft Labs are a cool place. I'm always interested to see what crap they are messing around with in there.

sharath_kumar · Jul 17, 2013

I don't own an xbox 360 and possibly will never own an Xbone. But this research news is amazing and very good. Good luck to MS Research...

twinturbo2 · Jul 17, 2013

davepoobond said:
can you still be a total asshole using sign language?

Yeah, there's the middle finger, the shocker...

http://en.m.wikipedia.org/wiki/Obscene_hand_gesture

I like The Wanker myself.

CadetMahoney · Jul 17, 2013

a positive news article for MS? won't go past page 2 round these parts. :0)

Insaniac · Jul 17, 2013

I won't lie, using kinect to make hand seals in naruto game would be fucking cool

NewGame · Jul 17, 2013

I know a bit of sign language and I don't think the kinect could properly translate some of the finer uses of the gestures and subtle finger directions required for the language. No point in not trying though!

Karsticles · Jul 17, 2013

enzo_gt said:
Microsoft Research is so awesome. Consistently awesome stuff coming out of there. Kinect is and has always been awesome too.

Yeah, the problem with Kinect has never been Kinect per se, but rather Kinect as a gaming tool.

mr_toa · Jul 17, 2013

Brilliant idea!

beast786 · Jul 17, 2013

CadetMahoney said:
a positive news article for MS? won't go past page 2 round these parts. :0)

especially when it's gaming /games related

GamerJM · Jul 17, 2013

This is pretty cool just in general, but I don't think the potential for actual games is as incredible as people in this topic are making it out to be. It's still pretty neat even in that respect though.

Foolworm · Jul 17, 2013

CadetMahoney said:
a positive news article for MS? won't go past page 2 round these parts. :0)

Shall I start? Oh noes, now the NSA can wiretap deaf people!

In all seriousness though, this looks more impressive than many of the other attempts at cracking sign language interpretation. While the applications for gaming are there, I wouldn't presume that people would put their controllers down to make a hand signal or gesture.The controller itself has to involve more than finger movements (a la wiimote) for the Kinect to really have a chance, right now the control schemes for the XB1 are conflicting rather than complementary.

rpmurphy · Jul 17, 2013

Garrett 2U said:
But Kinect is just a gimmick?!?

This is awesome.

Kinect is a genuinely cool piece of technology. It's just the lot of stupid applications they make for it are not.

thelurkinghorror · Jul 17, 2013

rpmurphy said:
Kinect is a genuinely cool piece of technology. It's just the lot of stupid applications they make for it are not.

True.

They should be ashamed for not showing something similar to Sony playroom. Microsoft I have to pay 100 more Euros for this camera, please show me sonething cool, NOW.

GoofsterStud · Jul 17, 2013

That's pretty cool if it works well.

rpmurphy · Jul 17, 2013

thelurkinghorror said:
True.

They should be ashamed for not showing something similar to Sony playroom. Microsoft I have to pay 100 more Euros for this camera, please show me sonething cool, NOW.

Well, I think the problem with it primarily being marketed as a controller for a gaming device is that the applications are games. And let's face it, there's a large market of gamers who have established perceptions and expectations for what a gaming experience should be like, and the Kinect (along with other motion-based gaming controllers) just don't fit into that many cases where it absolutely is a better controller than the traditional button and stick setup, or even touchscreen. Not to mention game development having severe limitations in of itself, I think we're way more likely to see cool applications (that actually have solutions to problems that are difficult to achieve with other technologies) coming from research and pet projects that aren't necessarily going to be used on an Xbox.

ArjanN · Jul 17, 2013

Platy said:
Deaf people will be able to talk and understand other people talking !

...

IMAGINE HOW AWESOME WOULD BE A NARUTO GAME !

lol, yeah. That jumped out at me as well.

Fuck deaf people this could be a neat gimmick in a mediocre licensed game!

MCD · Jul 17, 2013

http://www.eurogamer.net/articles/2...t-killer-instinct-tournament-play-on-xbox-one

This is neater.

Ushae · Jul 17, 2013

Wow this is amazing. Imagine the in game possibilities if this came out as an accurate piece of software/tech? MS research impressive as always.

mocolostrocolos · Jul 17, 2013

This is great news.

Support NeoGAF

Microsoft Research uses Kinect to translate Sign Language

Banned

Deleted member 80556

Unconfirmed Member

Member

Member

Banned

Member

Banned

Member

tagged by Blackace

Member

Banned

badchoiceboobies

Member

Member

Banned

Member

Member

Member

Banned

Member

Member

Member

Member

you can't put a price on sparks

wants to fuck an Asian grill.

Banned

Hopsiah the Kanga-Jew

Neo Member

butthurt Heat fan

Member

Member

Banned

Member

Member

Member

Banned

Member

Member

Member

Member

Member

Member

Junior Member

Banned

Member

Similar threads