Global Sources
EE Times-Asia
Stay in touch with EE Times Asia
EE Times-Asia > Processors/DSPs

New smart glasses offer virtual keyboard

Posted: 29 Feb 2016 ?? ?Print Version ?Bookmark and Share

Keywords:smart glasses? augmented reality? 3D?

In 2014, Korea Advanced Institute of Science and Technology (KAIST) released K-Glass, a pair of smart glasses reinforced with augmented reality (AR). The latest version, called K-Glass 3, released in 2015 is an upgrade that allows users to text message or type in keywords for Internet surfing through a virtual keyboard and offers even one for a piano.

Currently, most wearable head-mounted displays (HMDs) suffer from a lack of rich user interfaces, short battery lives, and heavy weight. Some HMDs, such as Google Glass, use a touch panel and voice commands as an interface, but they are considered merely an extension of smartphones and are not optimised for wearable smart glasses. Recently, gaze recognition was proposed for HMDs including K-Glass 2, but gaze cannot be realised as a natural user interface (UI) and experience (UX) due to its limited interactivity and lengthy gaze-calibration time, which can be up to several minutes.

As a solution, Professor Hoi-Jun Yoo and his team from the Electrical Engineering Department recently developed K-Glass 3 with a low-power natural UI and UX processor. This processor is composed of a pre-processing core to implement stereo vision, seven deep-learning cores to accelerate real-time scene recognition within 33ms, and one rendering engine for the display.


Figure 1: K-Glass 3 is equipped with a stereo camera, dual microphones, a WiFi module, and eight batteries to offer higher recognition accuracy and enhanced augmented reality experiences than previous models.

The stereo-vision camera, located on the front of K-Glass 3, works in a manner similar to three dimension (3D) sensing in human vision. The camera's two lenses, displayed horizontally from one another just like depth perception produced by left and right eyes, take pictures of the same objects or scenes and combine these two different images to extract spatial depth information, which is necessary to reconstruct 3D environments. The camera's vision algorithm has an energy efficiency of 20 milliwatts on average, allowing it to operate in the Glass more than 24 hours without interruption.

The research team adopted a multi core technology dedicated for mobile devices. This technology has greatly improved the Glass's recognition accuracy with images and speech, while shortening the time needed to process and analyse data. In addition, the Glass's multi-core processor is advanced enough to become idle when it detects no motion from users. Instead, it executes complex deep-learning algorithms with a minimal power to achieve high performance.

low power mpu

Figure 2: K-Glass 3's processor is designed to include several cores for pre-processing, deep-learning, and graphic rendering.

Professor Yoo said, "We have succeeded in fabricating a low-power multi-core processor that consumes only 126 milliwatts of power with a high efficiency rate. It is essential to develop a smaller, lighter, and low-power processor if we want to incorporate the widespread use of smart glasses and wearable devices into everyday life. K-Glass 3's more intuitive UI and convenient UX permit users to enjoy enhanced AR experiences such as a keyboard or a better, more responsive mouse."

Along with the research team, UX Factory, a Korean UI and UX developer, participated in the K-Glass 3 project.

text and piano keyboard

Figure 3: K-Glass 3 can detect hands and recognise their movements to provide users with such augmented reality applications as a virtual text or piano keyboard.

These research results entitled "A 126.1mW Real-Time Natural UI/UX Processor with Embedded Deep-Learning Core for Low-Power Smart Glasses" (lead author: Seong-Wook Park, a doctoral student in the Electrical Engineering Department, KAIST) were presented at the 2016 IEEE (Institute of Electrical and Electronics Engineers) International Solid-State Circuits Conference (ISSCC) that took place January 31-February 4, 2016 in San Francisco, California.

Article Comments - New smart glasses offer virtual keyb...
*? You can enter [0] more charecters.
*Verify code:


Visit Asia Webinars to learn about the latest in technology and get practical design tips.

Back to Top