# US 2006/0153425 A1 · Method of processing three-dimensional image in mobile device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2006/0153425 A1
- Document ID: US20060153425A1
- Status: Published application
- Kind: A1
- Application number: 11/326,839
- Filed: 2006-01-06
- Published: 2006-07-13
- Earliest claimed: 2005-01-07
- Assignees: LG Electronics Inc.
- Inventors: Tae Kim; Min Lee; Hang Cho
- Web page: https://patentgrep.com/patent/US20060153425A1

## CPC

- H04N 13/275: from three-dimensional [3D] object models, e.g. computer-generated stereoscopic image signals
- A63F 13/10
- A63F 13/213: comprising photodetecting means, e.g. cameras, photodiodes or infrared cells (A63F13/219 takes precedence)
- A63F 13/45: Controlling the progress of the video game
- A63F 13/65: automatically by game devices or servers from real world data, e.g. measurement in live racing competition
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- A63F 2300/1087: comprising photodetecting means, e.g. a camera
- A63F 2300/406: Transmission via wireless network, e.g. pager or GSM
- A63F 2300/6045: for mapping control signals received from the input arrangement into game commands
- H04N 13/10: Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N 13/261: with monoscopic-to-stereoscopic image conversion
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A processing method of interfacing a 3D image and a camera image is provided. In the processing method, a specific image pattern defined by a user is recognized, the recognized pattern is traced within an image, and a camera image and a 3D image are interfaced based on the tracing result. A 3D object is animated and rendered using a 3D graphic engine. The rendered image of the 3D object and the camera image are integrated and displayed.

## Claims

### Claim 1

A method of processing a 3D image in a mobile device, the mobile device having a camera and a 3D graphic engine, the method comprising:
recognizing a specific pattern designated by a user based on images inputted by the camera, and setting the recognized pattern as a defined pattern;
tracing the defined pattern among the images inputted by the camera, and interfacing the pattern and a 3D image; and
performing an animation process followed by a response of a corresponding 3D image in accordance with the tracing result of the pattern interfaced with the 3D image, integrating the processed image and the camera image, and displaying the integrated image.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the mobile device includes mobile phone, PDA, PDA phone, smart phone, notebook computer, and PMP, all of which has a camera mounted thereon.

### Claim 3 (depends on 1)

The method according to claim 1, wherein the tracing result of the defined pattern within the camera image is used as a user interface.

### Claim 4 (depends on 1)

The method according to claim 1, wherein the specific pattern is manually designated by the user or designated by a previously stored image file.

### Claim 5 (depends on 1)

The method according to claim 1, wherein the specific pattern is selected in accordance with a color, a region, or an inputted image.

### Claim 6 (depends on 1)

The method according to claim 1, wherein the specific pattern is designated from the previously stored image file; regions similar to the image file are detected within the camera image and are set as candidate patterns; and the user approves the desired pattern of the detected candidate patterns.

### Claim 7 (depends on 1)

The method according to claim 1, wherein the response of an animation image followed by the tracing of the specific pattern is based on a collision process between the specific pattern within the camera and a 3D object.

### Claim 8 (depends on 1)

The method according to claim 1, wherein the interface between the camera image and the 3D image includes:
extracting a region where a 3D object is rendered;
extracting a region where the pattern of the camera image exists; and
checking whether or not the two regions are intersected with each other.

### Claim 9 (depends on 1)

The method according to claim 1, wherein the recognition and setting of the specific pattern are executed when a system starts, are called and executed for re-designating the pattern when the pattern tracing fails, and are executed when there is a forced call of an application program level, including a designation of a new pattern by the user.

### Claim 10 (depends on 1)

The method according to claim 1, wherein the pattern is traced in real time by referring to a position information of the pattern in a previous frame of the camera image and estimating a motion of a pattern of a next frame.

### Claim 11

A method of processing an interface between a camera image and a graphic image, comprising:
setting a specific pattern of an image as an image-based interface tool;
recognizing the set pattern among images inputted by a camera, and tracing the recognized pattern;
generating a response of a graphic image in accordance with the pattern tracing; and
combining the traced pattern and the responding graphic image, and displaying the combined image.

### Claim 12 (depends on 11)

The method according to claim 11, wherein the specific pattern is set among image acquired by the camera.

### Claim 13 (depends on 11)

The method according to claim 11, wherein characteristic of the specific pattern is manually designated by a user.

### Claim 14 (depends on 11)

The method according to claim 11, wherein characteristic of the specific pattern is designated by setting a color of the pattern, or setting a region of the pattern, or selecting a previously stored image.

### Claim 15 (depends on 11)

The method according to claim 11, wherein the setting of the specific pattern includes:
designating an image for the setting of the pattern;
detecting a pattern similar to the designated image within images acquired by the camera; and
setting the pattern selected among the detected candidate patterns by the user.

### Claim 16 (depends on 11)

The method according to claim 11, wherein a specific operation of the device is carried out from the response of the graphic image according to the pattern tracing.

### Claim 17 (depends on 11)

The method according to claim 11, wherein the response of the graphic image in accordance with the pattern tracing is an animation effect.

### Claim 18 (depends on 11)

The method according to claim 11, wherein the set pattern is mapped into a specific object within the graphic image, the mapped image is combined with the graphic image in real time, and the combined image is displayed.

### Claim 19 (depends on 11)

The method according to claim 11, wherein the generation of the response of the graphic image in accordance with the pattern tracing includes:
extracting a region where a specific object is rendered within the graphic image;
extracting a region where the set pattern of the camera image exists; and
generating the response of the graphic image according to whether the two regions are intersected with each other.

### Claim 20 (depends on 11)

The method according to claim 11, wherein the interfaced image is a 2D camera image and a 3D graphic image.
