# US 2020/0265234 A1 · Electronic device for providing shooting mode based on virtual character and operation method thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0265234 A1
- Document ID: US20200265234A1
- Status: Published application
- Kind: A1
- Application number: 16/793,341
- Filed: 2020-02-18
- Published: 2020-08-20
- Earliest claimed: 2019-02-19
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Wooyong LEE; Seunghyup BAIK; Chanmin PARK; Hyejin KANG; Jungeun LEE
- Web page: https://patentgrep.com/patent/US20200265234A1

## CPC

- H04N 5/272: Means for inserting a foreground image in a background image, i.e. inlay, outlay
- G06T 11/60: Creating or editing images; Combining images with text
- G06T 13/40: of characters, e.g. humans, animals or virtual beings
- G06V 20/20: in augmented reality scenes
- G06V 20/64: Three-dimensional [3D] objects
- G06V 40/10: Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V 40/161: {Detection; Localisation; Normalisation}
- G06V 40/168: {Feature extraction; Face representation}
- H04N 23/61: based on recognised objects
- H04N 23/611: where the recognised objects include parts of the human body
- H04N 23/63: by using electronic viewfinders
- H04N 23/632: {for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters}
- H04N 23/667: Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
- H04N 23/80: Camera processing pipelines; Components thereof
- H04N 23/95: Computational photography systems, e.g. light-field imaging systems
- A63F 13/655: by importing photos, e.g. of the player
- G06V 10/62: relating to a temporal dimension, e.g. time-based feature extraction; Pattern tracking
- H04N 2005/2726: {for simulating a person's appearance, e.g. hair style, glasses, clothes}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR

## Abstract

An electronic device according to an embodiment may include: a camera module; a display; and a processor, wherein the processor may be configured to: obtain a preview image corresponding to an external object using the camera module; determine attributes of the external object, based on the obtained preview image; synthesize the preview image with a virtual character image, based on the attributes of the external object; and output the synthesized preview image through the display. Other embodiments may be provided.

## Claims

### Claim 1

An electronic device comprising:
a camera module;
a display; and
a processor,
wherein the processor is configured to:
obtain a preview image corresponding to an external object using the camera module;
determine attributes of the external object, based on the obtained preview image;
synthesize the preview image with a virtual character image, based on the attributes of the external object; and
output the synthesized preview image through the display.

### Claim 2 (depends on 1)

The electronic device of claim 1, wherein the processor is further configured to:
track distinguished features of the external object in the obtained preview image, based on the attributes of the external object;
virtual character image based on the distinguished features;
synthesize the preview image with the produced virtual character image; and
output the synthesized preview image through the display.

### Claim 3 (depends on 2)

The electronic device of claim 2, wherein the processor is further configured to:
when the external object is a person, based on the attributes of the external object, track distinguished features of the person; and
produce the virtual character image based on the distinguished features of the person.

### Claim 4 (depends on 2)

The electronic device of claim 2, wherein the processor is further configured to:
determine a tracking level with respect to the external object; and
track the distinguished features of the external object, based on the determined tracking level.

### Claim 5 (depends on 4)

The electronic device of claim 4, wherein the tracking level is determined based on a distance between the electronic device and the external object.

### Claim 6 (depends on 4)

The electronic device of claim 4, wherein the tracking level is determined based on a size of an imaging area corresponding to the external object in the preview image.

### Claim 7 (depends on 4)

The electronic device of claim 4, wherein the tracked distinguished features correspond to a face contour, a pupil, a mouth, a hand, a finger, and/or a body included in the external object.

### Claim 8 (depends on 1)

The electronic device of claim 1, wherein the processor is further configured to synthesize the preview image with the virtual character image such that the virtual character image is displayed together with an image corresponding to the external object of the preview image in a background area of the preview image.

### Claim 9 (depends on 1)

The electronic device of claim 1, wherein the processor is further configured to:
identify a face area of the external object in the preview image; and
synthesize the preview image with virtual character image such that at least a face portion of the virtual character image replaces the face area of the preview image.

### Claim 10 (depends on 1)

The electronic device of claim 1, wherein the processor is further configured to:
when the external object is not a person, based on the attributes of the external object, detect a plane area in the preview image; and
synthesize the preview image with virtual character image such that the virtual character image is displayed at a position corresponding to the plane area.

### Claim 11 (depends on 1)

The electronic device of claim 1, wherein the processor is further configured to output a user interface for changing at least one aspect of the virtual character image.

### Claim 12

A method of outputting a virtual character image of an electronic device, the method comprising:
obtaining a preview image corresponding to an external object using a camera module;
determining attributes of the external object, based on the obtained preview image;
synthesizing the preview image with a virtual character image, based on the attributes of the external object; and
outputting the synthesized preview image through a display.

### Claim 13 (depends on 12)

The method of claim 12, wherein synthesizing of the preview image with the virtual character image further comprises:
tracking distinguished features of the external object in the obtained preview image, based on the attributes of the external object;
producing the virtual character image, based on the distinguished features; and
synthesizing the preview image with the produced virtual character image.

### Claim 14 (depends on 13)

The method of claim 13, further comprising:
when the external object is a person, based on the attributes of the external object, tracking distinguished features of the person; and
producing the virtual character image based on the distinguished features of the person.

### Claim 15 (depends on 13)

The method of claim 13, further comprising:
determining a tracking level with respect to the external object; and
tracking the distinguished features of the external object, based on the determined tracking level.

### Claim 16 (depends on 15)

The method of claim 15, wherein the tracking level is determined based on a distance between the electronic device and the external object.

### Claim 17 (depends on 15)

The method of claim 15, wherein the tracking level is determined based on a size of an imaging area corresponding to the external object in the preview image.

### Claim 18 (depends on 15)

The method of claim 15, wherein the tracked distinguished features correspond to a face contour, a pupil, a mouth, a hand, a finger, and/or a body included in the external object.

### Claim 19 (depends on 12)

The method of claim 12, wherein the synthesizing of the preview image with the virtual character image further comprises:
synthesizing the preview image with the virtual character image such that the virtual character image is displayed together with an image corresponding to the external object of the preview image in a background area of the preview image;
synthesizing the preview image with virtual character image such that at least a face portion of the virtual character image replaces a face area of the preview image; or
synthesizing the preview image with virtual character image such that the virtual character image is displayed at a position corresponding to a plane area in the preview image.

### Claim 20 (depends on 12)

The method of claim 12, further comprising outputting a user interface for changing at least one aspect of the virtual character image.
