The Inquirer-Home

Kinect will identify sign language gestures

Sign of the times
Mon Aug 09 2010, 14:46

NOT VERY PROFITABLE GAMES CONSOLE MAKER Microsoft has filed for a "Gesture Keyboarding" patent for technology that will allow the Kinect to read sign language.

While no console names are mentioned in the patent application, it's obvious that it will be used in the Vole's future gaming technology. The patent requires a "keyboard-like input to a computer system that accepts gesture input" and "depth camera". So that'll be, we don't know, er, Kinect?

"Systems, methods and computer readable media are disclosed for gesture keyboarding. A user makes a gesture by either making a pose or moving in a pre-defined way that is captured by a depth camera.

"The depth information provided by the depth camera is parsed to determine at least that part of the user that is making the gesture. When parsed, the character or action signified by this gesture is identified."

There are about 43 different types of sign language but the patent is listed unsurprisingly as the American version. However, it looks like it will be possible to translate to other languages. Point 13 is a system including a media translator capable of converting gestured characters into a spoken equivalent or a text equivalent.

The patent also shows that the technology can translate the gesture characters from a first language to a second language.

It also looks like Microsoft has thought about online networked multi-play over Xbox Live. According to the patent, the gesture characters can be translated to a text or spoken word locally or remotely. That means players can sign over Xbox Live and have their gestures instantly translated. For a change, it looks like the Vole might be onto something worthwhile. µ

Share this:

Comments
Wonder how M$ will handle the only gesture they deserve?

Perhaps it'll be sent as email to customer relations.

posted by : bigger_luddite, 10 August 2010 Complain about this comment
Promising, but is it patentable?

2009: "Computer learns to understand sign language"
http://www.guardian.co.uk/technology/blog/2009/jul/10/computer-sign-language

Admittedly that's only from New Scientist, so it may be dodgy...

A computer that has a camera and understands sign language isn't an invention in itself, it's only an idea. It probably appears in science fiction... oh yeah, in the movie _2001_, made in 1968, the HAL computer lip reads (secretly). Does that count?

But as to how it's done, there's the whole software-patent question.

If Microsoft nevertheless successfully owns gestural language recognition, and does reserve it for video games, that would be dreadful. We need this for PCs. (And speech recognition, but in fact we already have that.)

posted by : Robert Carnegie, 10 August 2010 Complain about this comment
aboutus
Advertisement
Subscribe to INQ newsletters
Advertisement
INQ Poll

Facebook starts selling shares

Will you buy Facebook shares?