# US 2016/0260257 A1 · Information processing method and apparatus thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0260257 A1
- Document ID: US20160260257A1
- Status: Published application
- Kind: A1
- Application number: 14/753,877
- Filed: 2015-06-29
- Published: 2016-09-08
- Earliest claimed: 2015-03-02
- Assignees: Lenovo (Beijing) Limited
- Applicants: Lenovo (Beijing) Co., Ltd.
- Inventors: Ligang LI
- Web page: https://patentgrep.com/patent/US20160260257A1

## CPC

- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G02B 27/0172: {characterised by optical features}
- G02B 27/017: {Head mounted}
- G02B 2027/014: {comprising information/image processing systems}
- G02B 2027/0178: {Eyeglass type (eyeglass details G02C)}
- G06F 18/22: Matching criteria, e.g. proximity measures
- G06T 7/00: Image analysis
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An information processing method and an apparatus thereof are provided, which are applicable to a head-mounted device with a display unit. The information processing method includes: determining a virtual vision area for a user in a case that the user wears the head-mounted device; searching an environment space for a first object which is located in the virtual vision area and satisfies a predetermined condition; determining a first display area of the display unit which matches the first object; and outputting first display content in the first display area, such that when the user watches the display unit, the user sees that the first display content is presented on the first object in the virtual vision area. Display effect of the head-mounted device is improved according to the embodiments of the disclosure.

## Claims

### Claim 1

An information processing method comprising:
determining a virtual vision area for a user in a case that the user wears a head-mounted device;
searching an environment space for a first object which is located in the virtual vision area and satisfies a predetermined condition;
determining a first display area of a display unit of the head-mounted device which matches the first object; and
outputting first display content in the first display area, such that when the user watches the display unit, the user sees that the first display content is presented on the first object in the virtual vision area.

### Claim 2 (depends on 1)

The information processing method according to claim 1, wherein the determining the first display area of the display unit which matches the first object comprises:
determining a correspondence between the display unit and the virtual vision area;
determining a spatial position of the first object in the virtual vision area; and
determining a display area of the display unit corresponding to the spatial position as the first display area according to the spatial position and the correspondence between the display unit and the virtual vision area.

### Claim 3 (depends on 1)

The information processing method according to claim 1, wherein, after the outputting first display content in the first display area, such that when the user watches the display unit, the user sees that the first display content is presented on the first object in the virtual vision area, the method further comprises:
detecting whether the shape and/or position of the first object changes;
determining a second display area of the display unit which matches the first object if the shape and/or position of the first object changes; and
outputting the first display content in the second display area, such that when the user watches the display unit, the user sees that the first display content is presented on the first object in the virtual vision area.

### Claim 4 (depends on 1)

The information processing method according to claim 1, wherein, the outputting first display content in the first display area, such that when the user watches the display unit, the user sees that the first display content is presented on the first object in the virtual vision area, the method further comprises:
searching, according to recorded characteristics of the first object, the virtual vision area for a second object matching characteristics of the first object in a case that a portion of the first object, or the whole first object, moves out of the virtual vision area;
determining a third display area of the display unit which matches the second object; and
outputting the first display content in the third display area, such that when the user watches the display unit, the user sees that the first display content is presented on the second object in the virtual vision area.

### Claim 5 (depends on 3)

The information processing method according to claim 3, wherein, the outputting first display content in the first display area, such that when the user watches the display unit, the user sees that the first display content is presented on the first object in the virtual vision area, the method further comprises:
searching, according to recorded characteristics of the first object, the virtual vision area for a second object matching characteristics of the first object in a case that a portion of the first object, or the whole first object, moves out of the virtual vision area;
determining a third display area of the display unit which matches the second object; and
outputting the first display content in the third display area, such that when the user watches the display unit, the user sees that the first display content is presented on the second object in the virtual vision area.

### Claim 6 (depends on 1)

The information processing method according to claim 1, wherein the searching an environment space for a first object which is located in the virtual vision area and satisfies a predetermined condition comprises:
acquiring K display objects of the first display content of the display unit; and
searching a space corresponding to the virtual vision area of the environment space for a first object including L physical objects matching the K display objects, such that the first display content is output in the first display area, the user may see from the display unit that in the virtual vision area, the first content is presented on the first object, and the K displayed objects are merged with the L physical objects where K is an integer greater than or equal to 1, and L is an integer greater than or equal to 1.

### Claim 7

An information processing apparatus applicable to a head-mounted device with a display unit, comprising:
a first area determining module, configured to determine a virtual vision area for a user in a case that the user wears the head-mounted device;
a first searching module, configured to search an environment space for a first object which is located in the virtual vision area and satisfies a predetermined condition;
a second area determining module, configured to determine a first display area of the display unit which matches the first object; and
a first outputting module, configured to output first display content in the first display area, such that when a user watches the display unit, the user sees that the first display content is presented on the first object in the virtual vision area.

### Claim 8 (depends on 7)

The information processing apparatus according to claim 7, wherein the second area determining module comprises:
a relation determining unit, configured to determine a correspondence between the display unit and the virtual vision area;
a position determining unit, configured to determine a spatial position of the first object in the virtual vision area; and
an area determining unit, configured to determine a display area of the display unit corresponding to the spatial position as the first display area according to the spatial position and the correspondence between the display unit and the virtual vision area.

### Claim 9 (depends on 7)

The information processing apparatus according to claim 7, further comprising:
a detecting module, configured to detect whether the shape and/or position of the first object changes;
a third area determining module, configured to determine a second display area of the display unit which matches the first object if the shape and/or position of the first object changes; and
a second output module, configured to output the first display content in the second display area, such that when the user watches the display unit, the user sees that the first display content is presented on the first object in the virtual vision area.

### Claim 10 (depends on 7)

The information processing apparatus according to claim 7, further comprising:
a second searching module, configured to search, according to recorded characteristics of the first object, the virtual vision area for a second object matching the characteristics of the first object in a case that a portion of the first object or the whole first object moves out of the virtual vision area;
a fourth area determining module, configured to determine a third display area of the display unit which matches the second object; and
a third outputting module, configured to output the first display content in the third display area, such that when the user watches the display unit, the user sees that the first display content is presented on the second object in the virtual vision area.

### Claim 11 (depends on 9)

The information processing apparatus according to claim 9, further comprising:
a second searching module, configured to search, according to recorded characteristics of the first object, the virtual vision area for a second object matching the characteristics of the first object in a case that a portion of the first object or the whole first object moves out of the virtual vision area;
a fourth area determining module, configured to determine a third display area of the display unit which matches the second object; and
a third outputting module, configured to output the first display content in the third display area, such that when the user watches the display unit, the user sees that the first display content is presented on the second object in the virtual vision area.

### Claim 12 (depends on 7)

The information processing apparatus according to claim 7, wherein the first searching module comprises:
an acquiring unit, configured to acquire K display objects of the first display content on the display unit wherein K is an integer greater than or equal to 1; and
a searching unit, configured to search a space corresponding to the virtual vision area of the environment space for an object including L physical objects matching the K display objects such that when the first output module outputs the first display content in the first display area, and the user watches the display unit, the user sees that the first display content is presented on the first object and the K displayed objects are merged with the L physical objects, where K is an integer greater than or equal to 1, and L is an integer greater than or equal to 1.
