# US 2014/0152853 A1 · Terminal for generating augmented reality and method thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2014/0152853 A1
- Document ID: US20140152853A1
- Status: Published application
- Kind: A1
- Application number: 14/095,205
- Filed: 2013-12-03
- Published: 2014-06-05
- Earliest claimed: 2012-12-03
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Kyu-Sung CHO; Dae-Kyu SHIN; Ik-Hwan CHO
- Web page: https://patentgrep.com/patent/US20140152853A1

## CPC

- G06V 20/20: in augmented reality scenes
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A terminal for generating an augmented reality and a method thereof are provided. The terminal includes a camera property information providing server configured to store camera property information associated with one or more cameras, and the terminal is configured to receive, from the camera property information providing server, camera property information associated with a camera included in the terminal and generate an augmented reality based on the stored camera property information when an augmented reality-based application is driven and thus, may provide an augmented reality in which a virtual object is accurately matched to an image.

## Claims

### Claim 1

A terminal for generating an augmented reality, the terminal comprising:
a sensor configured to detect a position or a direction associated with the terminal;
a camera unit configured to output an image;
a terminal posture estimator configured to estimate a posture of the terminal based on the position and the direction associated with the terminal detected by the sensor;
a virtual object composition unit configured to compose a virtual object and the image input by the camera unit; and
a controller configured to determine whether camera property information is stored when generating an augmented reality is requested, to request camera property information of the terminal from a camera property information providing server when the camera property information is not stored, and to compose the virtual object and the image based on the camera property information and the estimated posture when the requested camera property information is received.

### Claim 2 (depends on 1)

The terminal of claim 1, wherein the camera property information includes at least one of a field of view in which the camera views the world and a focal length from a lens to a camera sensor.

### Claim 3 (depends on 1)

The terminal of claim 1, wherein, when the camera property information is not stored, the controller generates a request message for requesting the camera property information of the terminal, and transfers the generated request message to the camera property information providing server.

### Claim 4 (depends on 3)

The terminal of claim 3, wherein the request message includes a camera property search keyword used for searching for the camera property information of the terminal.

### Claim 5 (depends on 3)

The terminal of claim 3, wherein, when a response message is received from the camera property information providing server in response to the request message, the controller stores the camera property information of the terminal included in the received response message.

### Claim 6 (depends on 1)

The terminal of claim 1, wherein, when the camera property information is stored, the controller composes the virtual object and the image based on the stored camera property information and the estimated posture.

### Claim 7 (depends on 1)

The terminal of claim 1, wherein the camera property information providing server comprises:
a camera property storage unit configured to store camera property information associated with one or more terminals; and
a controller configured to search for camera property information of a terminal corresponding to a camera property search keyword included in a request message, when the request message is received from the terminal, to generate a response message including the retrieved camera property information of the terminal, and to transfer the generated response message to the terminal.

### Claim 8 (depends on 7)

The terminal of claim 7, wherein the controller of the camera property information providing server includes, in the response message, common camera property information obtained by generalizing camera property information of all terminals, and transfers the response message to the terminal, when the camera property information of the terminal corresponding to the camera property search keyword does not exist.

### Claim 9

A method of generating an augmented reality in a terminal, the method comprising:
detecting a position or a direction associated with the terminal when generating an augmented reality is requested;
estimating a posture of the terminal based on the position and the direction associated with the terminal detected by a sensor;
determining whether camera property information is stored;
requesting the camera property information of the terminal from a camera property information providing server when the camera property information is not stored; and
composing a virtual object and an image based on received camera property information and the estimated posture when the requested camera property information is received.

### Claim 10 (depends on 9)

The method of claim 9, wherein the camera property information includes at least one of a field of view in which the camera views the world and a focal length from a lens to a camera sensor.

### Claim 11 (depends on 9)

The method of claim 9, wherein the requesting of the camera property information of the terminal comprises:
generating a request message to request the camera property information of the terminal when the camera property information is not stored; and
transferring the generated request message to the camera property information providing server.

### Claim 12 (depends on 11)

The method of claim 11, wherein the request message includes a camera property search keyword used for searching for the camera property information of the terminal.

### Claim 13 (depends on 9)

The method of claim 9, further comprising:
storing the camera property information of the terminal included in a received response message when the response message is received from the camera property information providing server in response to the request message.

### Claim 14 (depends on 9)

The method of claim 9, further comprising:
composing the virtual object and the image based on stored camera property information and the estimated posture when the camera property information is stored.

### Claim 15 (depends on 9)

The method of claim 9, wherein the camera property information providing server comprises:
a camera property storage unit configured to store camera property information associated with one or more terminals; and
a controller configured to search for camera property information of a terminal corresponding to a camera property search keyword included in a request message, when the request message is received from the terminal, to generate a response message including the retrieved camera property information of the terminal, and to transfer the response message to the terminal.

### Claim 16 (depends on 15)

The method of claim 15, wherein the controller of the camera property information providing server includes, in the response message, common camera property information obtained by generalizing camera property information of all terminals, and transfers the response message to the terminal, when the camera property information of the terminal corresponding to the camera property search keyword does not exist.

### Claim 17 (depends on 1)

A non-transitory processor readable medium for storing a computer program of instructions configured to be readable by at least one processor for instructing the at least one processor to execute a computer process for performing the method as recited in claim 1.
