# US 2014/0210710 A1 · Method for generating an augmented reality content and terminal using the same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2014/0210710 A1
- Document ID: US20140210710A1
- Status: Published application
- Kind: A1
- Application number: 14/166,321
- Filed: 2014-01-28
- Published: 2014-07-31
- Earliest claimed: 2013-01-28
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Daekyu SHIN; Kyusung CHO; Ikhwan CHO
- Web page: https://patentgrep.com/patent/US20140210710A1

## CPC

- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06T 11/60: Creating or editing images; Combining images with text
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A method for generating augmented reality content includes receiving an augmented reality mode execution request for generating augmented reality content based on electronic book content, activating a camera in response to the request to provide a preview image, loading book data of the electronic book on the preview image, detecting an event occurring in the augmented reality mode, retrieving reaction data pre-mapped to the event, and loading the reaction data on the preview image.

## Claims

### Claim 1

An augmented reality content generation method, comprising:
receiving an augmented reality mode execution request for generating the augmented reality content based on electronic book content;
executing a camera in response to the request, and providing a preview image;
loading book data of the electronic book on the preview image;
detecting an event occurring in the augmented reality mode;
extracting reaction data pre-mapped to the event; and
loading the extracted reaction data on the preview image.

### Claim 2 (depends on 1)

The method of claim 1, further comprising selecting default data to be presented on the preview image from the book data of the electronic book in the augmented reality mode.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
recognizing an object, person, and background of a real environment provided as the preview image; and
determining the coordinates of the object, person, and background on the preview image.

### Claim 4 (depends on 3)

The method of claim 3, wherein the reaction data is loaded at an identical coordinate area as the book data or another coordinate area adjacent to the book data.

### Claim 5 (depends on 3)

The method of claim 3, wherein the book data is loaded on an area of reference coordinates recognized as a flat surface through coordinate detection on the preview image.

### Claim 6 (depends on 1)

The method of claim 1, wherein detecting the event comprises at least one of:
detecting a motion of a user in the preview image; and
detecting sensor values obtained by a sensor unit of the mobile terminal.

### Claim 7 (depends on 6)

The method of claim 6, wherein the sensor unit comprises at least one of acceleration sensor, gravity sensor, compass sensor, gyro sensor, temperature sensor, and motion sensor.

### Claim 8 (depends on 6)

The method of claim 6, further comprising storing the reaction data mapped to motions of the user and sensor values, in a mapping table.

### Claim 9 (depends on 6)

The method of claim 6, wherein the reaction data changes a shape of the book data or replaces the book data according to the detection of the event.

### Claim 10 (depends on 1)

The method of claim 1, wherein the book data of the electronic book comprises at least one of character image data, audio data, vibration data, video data, 2-Dimensional (2D) graphic data, and 3D graphic data, with the exception of basic background image data.

### Claim 11 (depends on 1)

The method of claim 1, wherein loading the book data of the electronic book comprises:
converting text data of the electronic book to speech data; and
outputting the speech data.

### Claim 12 (depends on 1)

The method of claim 1, further comprising storing the preview image, on which the reaction data and the book data are loaded.

### Claim 13

A mobile terminal configured to generate augmented reality content, the terminal comprising:
a display unit configured to display a preview image converted from an execution screen of an electronic book in an augmented reality mode and present book data of the electronic book and reaction data retrieved according to an event;
a storage unit configured to store the book data, the reaction data, and the preview image on which the book data and reaction data are loaded; and
a control unit configured to activate a camera to acquire the preview image, obtain motion of a user or sensor values in the augmented reality mode, retrieve reaction data based on the motion of the user or sensor values, and load the book data and reaction data to generate the augmented reality content.

### Claim 14 (depends on 13)

The terminal of claim 13, wherein the control unit comprising:
an electronic book data acquisition module which parses at least one page of the electronic book to extract the book data and sends the book data to the display unit;
a preview image acquirer which acquires the preview image from the camera;
a default data extractor which extracts default data from the book data to be output onto the preview image in the augmented reality mode;
a specific event detector which detects motion of the user or acquires sensor values in the augmented reality mode;
a reaction data extractor which extracts the reaction data pre-mapped to the motion of the user or the sensor values; and
a manager module which activates the preview image acquirer, default data extractor, specific event detector, and reaction data extractor in response to the augmented reality mode execution request.

### Claim 15 (depends on 13)

The terminal of claim 13, wherein the control unit recognizes an object, person, and background of a real environment provided as the preview image and determines the coordinates of the object, person, and background on the preview image.

### Claim 16 (depends on 15)

The terminal of claim 15, wherein the reaction data is loaded at an identical coordinate area as the book data or other coordinate area adjacent to the book data.

### Claim 17 (depends on 15)

The terminal of claim 15, wherein the book data is loaded on an area of reference coordinates recognized as a flat surface through coordinate detection on the preview image.

### Claim 18 (depends on 15)

The terminal of claim 15, wherein the control unit stores the reaction data mapped to motions of the user and sensor values in a mapping table, converts text data of the electronic book to speech data, and outputs the speech data.

### Claim 19 (depends on 13)

The terminal of claim 13, wherein the reaction data changes a shape of the book data or replaces the book data according to the detection of the event.

### Claim 20 (depends on 13)

The terminal of claim 13, wherein the book data of the electronic book comprises at least one of character image data, audio data, vibration data, video data, 2-Dimensional (2D) graphic data, and 3D graphic data, with the exception of basic background image data.
