# US 9,436,874 B2 · Method for discovering augmented reality object, and terminal

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 9,436,874 B2
- Document ID: US9436874B2
- Status: Granted
- Kind: B2
- Application number: 14/573,178
- Filed: 2014-12-17
- Published: 2015-04-16
- Granted: 2016-09-06
- Earliest claimed: 2013-01-28
- Assignees: Huawei Device Co., Ltd.
- Applicants: Huawei Device Co., Ltd.
- Inventors: Guoqing Li; Zhihao Jin
- Web page: https://patentgrep.com/patent/US9436874B2

## CPC

- G01C 21/3647: {Guidance involving output of stored or live camera images or video streams}
- H04W 4/024: Guidance services
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

A method for discovering an augmented reality (AR) object is provided that is applicable to the field of AR technologies. The method for discovering an AR object includes, when it is determined, according to a pre-generated navigation route and a movement speed of a terminal, that a vicinity of a preselected AR object is reached, determining a status of the terminal; when it is determined that the terminal is in a searching state, starting a camera and acquiring a picture; and when the acquired picture includes the AR object, notifying of the AR object.

## Claims

### Claim 1

A method for discovering an augmented reality (AR) object, comprising:
determining a status of a terminal when it is determined, according to a pre-generated navigation route and a movement speed of the terminal, that a vicinity of a preselected AR object is reached;
starting a camera and acquiring a picture when it is determined that the terminal is in a searching state;
extracting N focused objects from the picture using an image recognition algorithm, wherein N is an integer greater than or equal to one;
processing M of the N focused objects using a high-speed and low-precision algorithm, wherein M is an integer greater than or equal to one and less than or equal to N;
processing N-M of the N focused objects using a precise recognition algorithm;
determining whether the M and the N-M of the N focused objects in the picture include the AR object; and
notifying of the AR object when the picture comprises the AR object.

### Claim 2 (depends on 1)

The method according to claim 1, wherein that it is determined, according to the pre-generated navigation route and the movement speed of the terminal, that the vicinity of the preselected AR object is reached comprises:
acquiring a distance between a position of the AR object and a starting position of the terminal according to the pre-generated navigation route;
acquiring, according to a movement manner preselected by the user, an average movement speed of the movement manner, wherein the movement manner selected from walking, bicycling, and driving;
calculating, according to the distance and the average movement speed, an expected time for the terminal to reach the vicinity of the AR object; and
determining that the vicinity of the AR object is reached after the terminal starts from the starting position of the terminal and has moved the expected time.

### Claim 3 (depends on 1)

The method according to claim 1, wherein the method further comprises:
collecting a current position parameter of the terminal by using a navigation and positioning system when the picture does not comprise the AR object; and
correcting the navigation route according to the position parameter.

### Claim 4 (depends on 3)

The method according to claim 3, wherein the position parameter comprises at least one of positioning parameter information of a current position of the terminal and an obvious sign of the current position of the terminal.

### Claim 5 (depends on 1)

The method according to claim 1, wherein determining the status of the terminal comprises determining, according to whether a gyroscope and preset functions are used, whether the terminal is in the searching state, wherein the preset functions comprise a voice call, a short message service message, a multimedia messaging service, an alarm, and a calendar event.

### Claim 6 (depends on 1)

The method according to claim 1, further comprising outputting warning information when it is determined that the terminal moves irregularly in the vicinity of the AR object and finally goes far away from the AR object, wherein the warning information comprises vibration, ringing, and light emitting.

### Claim 7

A terminal, comprising:
a computer processor configured to:
determine a status of the terminal when it is determined, according to a pre-generated navigation route and a movement speed of the terminal, that a vicinity of a preselected augmented reality (AR) object is reached;
start a camera and acquire a picture when determined that the terminal is in a searching state;
extract N focused objects from the picture using an image recognition algorithm, wherein N is an integer greater than or equal to one;
process M of the N focused objects using a high-speed and low-precision algorithm, wherein M is an integer greater than or equal to one and less than or equal to N;
process N-M of the N focused objects using a precise recognition algorithm;
determine whether the M and the N-M of the N focused objects in the picture include the AR object; and
notify of the AR object when the picture comprises the AR object.

### Claim 8 (depends on 7)

The terminal according to claim 7, wherein the computer processor is configured to:
acquire a distance between a position of the AR object and a starting position of the terminal according to the pre-generated navigation route;
acquire, according to a movement manner preselected by the user, an average movement speed of the movement manner, wherein the movement manner is selected from walking, bicycling, and driving;
calculate, according to the distance and the average movement speed, an expected time for the terminal to reach the vicinity of the AR object; and
determine that the vicinity of the AR object is reached after the terminal starts from the starting position of the terminal and has moved the expected time.

### Claim 9 (depends on 7)

The terminal according to claim 7, wherein the computer processor is configured to:
collect a current position parameter of the terminal by using a navigation and positioning system when the picture does not comprise the AR object; and
correct the navigation route according to the position parameter.

### Claim 10 (depends on 9)

The terminal according to claim 9, wherein the position parameter comprises at least one of positioning parameter information of a current position of the terminal and an obvious sign of the current position of the terminal.

### Claim 11 (depends on 7)

The terminal according to claim 7, wherein the computer processor is configured to determine, according to whether a gyroscope and preset functions are used, whether the terminal is in the searching state when it is determined, according to the pre-generated navigation route and the movement speed of the terminal, that the vicinity of the preselected AR object is reached, wherein the preset functions comprise a voice call, a short message service message, a multimedia messaging service, an alarm, and a calendar event.

### Claim 12 (depends on 7)

The terminal according to claim 7, wherein the computer processor is configured to output warning information when it is determined that the terminal moves irregularly in the vicinity of the AR object and finally goes far away from the AR object, wherein the warning information comprises vibration, ringing, and light emitting.

### Claim 13 (depends on 1)

The method according to claim 1, further comprising:
determining a difference value by which a current movement speed of the terminal is lower than an average movement speed of the terminal; and
determining that the terminal is in a searching state when the difference value is greater than a preset threshold.

### Claim 14 (depends on 1)

The method according to claim 1, further comprising:
determining that the terminal is in a focusing state when a change in an angle of view of a user during a particular time is less than a threshold value; and
processing the picture after determining that the terminal is in the focusing state.

### Claim 15 (depends on 7)

The terminal according to claim 7, wherein the computer processor is configured to:
determine a difference value by which a current movement speed of the terminal is lower than an average movement speed of the terminal; and
determine that the terminal is in a searching state when the difference value is greater than a preset threshold.

### Claim 16 (depends on 7)

The terminal according to claim 7, wherein the computer processor is configured to:
determine that the terminal is in a focusing state when a change in an angle of view of a user during a particular time is less than a threshold value; and
process the picture after determining that the terminal is in the focusing state.

### Claim 17

A non-transitory computer-readable medium having instructions stored thereon, that when executed by a computer processor, cause the computer processor to perform a method comprising:
determining a status of a terminal when it is determined, according to a pre-generated navigation route and a movement speed of the terminal, that a vicinity of a preselected AR object is reached;
starting a camera and acquiring a picture when it is determined that the terminal is in a searching state;
extracting N focused objects from the picture using an image recognition algorithm, wherein N is an integer greater than or equal to one;
processing M of the N focused objects using a high-speed and low-precision algorithm, wherein M is an integer greater than or equal to one and less than or equal to N;
processing N-M of the N focused objects using a precise recognition algorithm;
determining whether the M and the N-M of the N focused objects in the picture include the AR object; and
notifying of the AR object when the picture comprises the AR object.