# US 2014/0195983 A1 · 3d graphical user interface

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2014/0195983 A1
- Document ID: US20140195983A1
- Status: Published application
- Kind: A1
- Application number: 13/977,353
- Filed: 2012-06-30
- Published: 2014-07-10
- Earliest claimed: 2012-06-30
- Inventors: Yangzhou Du; Qing Jian Song; Wenlong Li; Tao Wang; Yimin Zhang
- Web page: https://patentgrep.com/patent/US20140195983A1

## CPC

- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/038: Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06T 15/20: Perspective computation
- G06V 20/64: Three-dimensional [3D] objects
- G06V 40/171: {Local features and components; Facial parts (eye characteristics G06V40/18); Occluding parts, e.g. glasses; Geometrical relationships}
- H04N 13/128: Adjusting depth or disparity
- H04N 13/183: On-screen display [OSD] information, e.g. subtitles or menus
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Systems, apparatus, articles, and methods are described including operations for a 3D graphical user interface.

## Claims

### Claim at position 1

1-22. (canceled)

### Claim 23

A computer-implemented method for a 3D graphical user interface, comprising:
receiving visual data of a user, wherein the visual data includes 3D visual data;
determining a 3D distance from a 3D display to the user based at least in part on the received 3D visual data; and
adjusting a 3D projection distance from the 3D display to the user based at least in part on the determined 3D distance to the user.

### Claim 24 (depends on 23)

The method of claim 23, wherein the 3D visual data is obtained from one or more of the following 3D sensor types: a depth camera-type sensor, a structured light-type sensor, a stereo-type sensor, a proximity-type sensor, and a 3D camera-type sensor.

### Claim 25 (depends on 23)

The method of claim 23, wherein the 3D display comprises one or more of the following types of 3D displays: a 3D television, a holographic 3D television, a 3D cell phone, and a 3D tablet.

### Claim 26 (depends on 23)

The method of claim 23, further comprising:
performing facial detection based at least in part on the received 3D visual data, and
wherein the determination of the 3D distance from the 3D display to the user is between the 3D display and the detected face of the user.

### Claim 27 (depends on 23)

The method of claim 23, further comprising:
performing facial detection for one of one or more users based at least in part on the received visual data; and
identifying a target user based at least in part on the performed facial detection,
wherein the determination of the 3D distance from the 3D display to the user is between the 3D display and the identified target user.

### Claim 28 (depends on 23)

The method of claim 23, further comprising:
performing facial detection for one of one or more users based at least in part on the received visual data; and
identifying a target user based at least in part on the performed facial detection,
wherein the determination of the 3D distance from the 3D display to the user is between the 3D display and the detected face of the identified target user.

### Claim 29 (depends on 23)

The method of claim 23, further comprising:
calculating a parallax for the 3D graphical user interface during the adjustment of the 3D projection distance based at least in part on the determined 3D distance to the user, and
overlaying right and left views based at least in part on the calculated parallax.

### Claim 30 (depends on 23)

The method of claim 23, further comprising:
performing hand gesture recognition based at least in part on the received visual data; and
determining a user interface command in response to the hand gesture recognition.

### Claim 31 (depends on 23)

The method of claim 23, further comprising:
performing hand gesture recognition based at least in part on the received visual data, wherein the hand gesture recognition is performed without a user input device;
determining a user interface command in response to the hand gesture recognition; and
adjusting the appearance of the 3D graphical user interface in response to the determined user interface command.

### Claim 32 (depends on 23)

The method of claim 23, further comprising:
performing facial detection for one of one or more users based at least in part on the received visual data;
identifying a target user based at least in part on the performed facial detection, wherein the determination of the 3D distance from the 3D display to the user is between the 3D display and the detected face of the identified target user;
calculating a parallax for the 3D graphical user interface during the adjustment of the 3D projection distance based at least in part on the determined 3D distance to the identified target user;
overlaying right and left views based at least in part on the calculated parallax;
performing hand gesture recognition based at least in part on the received visual data for the identified target user, wherein the hand gesture recognition is performed without a user input device;
determining a user interface command in response to the hand gesture recognition;
adjusting the appearance of the 3D graphical user interface in response to the determined user interface command,
wherein the 3D visual data is obtained from one or more of the following 3D sensor types: a depth camera-type sensor, a structured light-type sensor, a stereo-type sensor, a proximity-type sensor, and a 3D camera-type sensor,
wherein the 3D display comprises one or more of the following types of 3D displays: a 3D television, a holographic 3D television, a 3D cell phone, and a 3D tablet.

### Claim 33

A system for presenting a 3D graphical user interface on a computer, comprising:
an imaging device configured to capture visual data of a user, wherein the visual data includes 3D visual data;
a 3D display device configured to present video data;
one or more processors communicatively coupled to the 3D display device;
one or more memory stores communicatively coupled to the one or more processors;
a position detection logic module communicatively coupled to the imaging device and configured to determine a 3D distance from the 3D display to the user based at least in part on the received 3D visual data; and
a projection distance logic module communicatively coupled to the position detection logic module and configured to adjust a 3D projection distance from the 3D display to the user based at least in part on the determined 3D distance to the user.

### Claim 34 (depends on 33)

The system of claim 33, wherein the 3D visual data is obtained from one or more of the following 3D sensor types: a depth camera-type sensor, a structured light-type sensor, a stereo-type sensor, a proximity-type sensor, and a 3D camera-type sensor.

### Claim 35 (depends on 33)

The system of claim 33, wherein the 3D display comprises one or more of the following types of 3D displays: a 3D television, a holographic 3D television, a 3D cell phone, and a 3D tablet.

### Claim 36 (depends on 33)

The system of claim 33, wherein the position detection logic module is further configured to:
perform facial detection based at least in part on the received 3D visual data, and
wherein the determination of the 3D distance from the 3D display to the user is between the 3D display and the detected face of the user.

### Claim 37 (depends on 33)

The system of claim 33, wherein the position detection logic module is further configured to:
perform facial detection for one of one or more users based at least in part on the received visual data; and
identify a target user based at least in part on the performed facial detection,
wherein the determination of the 3D distance from the 3D display to the user is between the 3D display and the identified target user.

### Claim 38 (depends on 33)

The system of claim 33, wherein the position detection logic module is further configured to:
perform facial detection for one of one or more users based at least in part on the received visual data; and
identify a target user based at least in part on the performed facial detection,
wherein the determination of the 3D distance from the 3D display to the user is between the 3D display and the detected face of the identified target user.

### Claim 39 (depends on 33)

The system of claim 33, wherein the projection distance logic module is further configured to:
calculate a parallax for the 3D graphical user interface during the adjustment of the 3D projection distance based at least in part on the determined 3D distance to the user, and
overlay right and left views based at least in part on the calculated parallax.

### Claim 40 (depends on 33)

The system of claim 33, further comprising a hand gesture logic module configured to:
perform hand gesture recognition based at least in part on the received visual data; and
determine a user interface command in response to the hand gesture recognition.

### Claim 41 (depends on 33)

The system of claim 33, further comprising a hand gesture logic module configured to:
perform hand gesture recognition based at least in part on the received visual data, wherein the hand gesture recognition is performed without a user input device;
determine a user interface command in response to the hand gesture recognition; and
wherein the projection distance logic module is further configured to adjust the appearance of the 3D graphical user interface in response to the determined user interface command.

### Claim 42 (depends on 33)

The system of claim 33, further comprising:
wherein the position detection logic module is further configured to: perform facial detection for one of one or more users based at least in part on the received visual data, and identify a target user based at least in part on the performed facial detection, wherein the determination of the 3D distance from the 3D display to the user is between the 3D display and the detected face of the identified target user;
wherein the projection distance logic module is further configured to: calculate a parallax for the 3D graphical user interface during the adjustment of the 3D projection distance based at least in part on the determined 3D distance to the identified target user, and overlay right and left views based at least in part on the calculated parallax;
a hand gesture logic module configured to perform hand gesture recognition based at least in part on the received visual data for the identified target user, wherein the hand gesture recognition is performed without a user input device; and determine a user interface command in response to the hand gesture recognition;
wherein the projection distance logic module is further configured to adjust the appearance of the 3D graphical user interface in response to the determined user interface command;
wherein the 3D visual data is obtained from one or more of the following 3D sensor types: a depth camera-type sensor, a structured light-type sensor, a stereo-type sensor, a proximity-type sensor, and a 3D camera-type sensor; and
wherein the 3D display comprises one or more of the following types of 3D displays: a 3D television, a holographic 3D television, a 3D cell phone, and a 3D tablet.

### Claim 43

At least one machine readable medium comprising a plurality of instructions that in response to being executed on a computing device, cause the computing device to code data by:
receiving visual data of a user, wherein the visual data includes 3D visual data;
determining a 3D distance from a 3D display to the user based at least in part on the received 3D visual data; and
adjusting a 3D projection distance from the 3D display to the user based at least in part on the determined 3D distance to the user.

### Claim 44 (depends on 43)

The machine readable medium of claim 43, further comprising instructions that in response to being executed on the computing device, cause the computing device to operate by:
performing facial detection for one of one or more users based at least in part on the received visual data;
identifying a target user based at least in part on the performed facial detection, wherein the determination of the 3D distance from the 3D display to the user is between the 3D display and the detected face of the identified target user;
calculating a parallax for the 3D graphical user interface during the adjustment of the 3D projection distance based at least in part on the determined 3D distance to the identified target user;
overlaying right and left views based at least in part on the calculated parallax;
performing hand gesture recognition based at least in part on the received visual data for the identified target user, wherein the hand gesture recognition is performed without a user input device;
determining a user interface command in response to the hand gesture recognition;
adjusting the appearance of the 3D graphical user interface in response to the determined user interface command,
wherein the 3D visual data is obtained from one or more of the following 3D sensor types: a depth camera-type sensor, a structured light-type sensor, a stereo-type sensor, a proximity-type sensor, and a 3D camera-type sensor,
wherein the 3D display comprises one or more of the following types of 3D displays: a 3D television, a holographic 3D television, a 3D cell phone, and a 3D tablet.