# US 2021/0241537 A1 · Electronic device for displaying additional object in augmented reality image, and method for driving electronic device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0241537 A1
- Document ID: US20210241537A1
- Status: Published application
- Kind: A1
- Application number: 17/265,880
- Filed: 2019-08-05
- Published: 2021-08-05
- Earliest claimed: 2018-09-04
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Stephanie Kim AHN
- Web page: https://patentgrep.com/patent/US20210241537A1

## CPC

- G06T 11/60: Creating or editing images; Combining images with text
- G02B 27/0172: {characterised by optical features}
- G06Q 30/0623: {by investigating goods or services}
- G06Q 30/0643: {graphically representing goods, e.g. 3D product representation}
- G06T 13/40: of characters, e.g. humans, animals or virtual beings
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06V 20/20: in augmented reality scenes
- G06V 20/64: Three-dimensional [3D] objects
- G06V 20/70: Labelling scene content, e.g. deriving syntactic or semantic representations
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/014: {comprising information/image processing systems}
- G09G 2340/12: Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
- G09G 2354/00: Aspects of interface with display user
- G09G 2370/06: Consumer Electronics Control, i.e. control of another device by a display or vice versa
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

An electronic device includes a communication module, a display, and at least one processor operatively connected with the communication module and the display. The at least one processor may be configured to receive an augmented reality image from at least one external device which performs wireless communication with the communication module via the communication module, display a running screen of an application associated with the augmented reality image on the display, determine whether an object associated with input information input to the electronic device is included in the augmented reality image, and display an additional object on the object based at least in part on the input information. In addition, various embodiments recognized through the specification are possible.

## Claims

### Claim 1

An electronic device, comprising:
a communication module;
a display; and
at least one processor operatively connected with the communication module and the display,
wherein the at least one processor is configured to:
receive an augmented reality image from at least one external device performing wireless communication with the communication module via the communication module;
display a running screen of an application associated with the augmented reality image on the display;
determine whether an object associated with input information input to the electronic device is included in the augmented reality image; and
display an additional object on the object based at least in part on the input information.

### Claim 2 (depends on 1)

The electronic device of claim 1, wherein the at least one processor is configured to:
generate the input information based at least in part on information set directly by user or information according to a situation outside the electronic device.

### Claim 3 (depends on 1)

The electronic device of claim 1, wherein the at least one processor is configured to:
set a priority of the object based at least in part on information set directly by user or a situation outside the electronic device and recognize the object, the priority of which is high.

### Claim 4 (depends on 1)

The electronic device of claim 1, wherein the at least one processor is configured to:
determine whether the object is meaningful to user based at least in part on information set directly by the user or a situation outside the electronic device and recognize the meaningful object.

### Claim 5 (depends on 1)

The electronic device of claim 1, wherein the at least one processor is configured to:
generate the additional object to be at least partially overlapped with the object and allow the additional object to have a face shape representing an emotion.

### Claim 6 (depends on 5)

The electronic device of claim 5, wherein the at least one processor is configured to:
allow the additional object to express the emotion as any one of a plurality of emotion stages included between a positive emotion and a negative emotion based at least in part on the input information.

### Claim 7 (depends on 5)

The electronic device of claim 5, wherein the at least one processor is configured to:
change an emotion expressed by the additional object or a shape of the additional object depending on a type of the object or a change in a state of the object.

### Claim 8 (depends on 1)

The electronic device of claim 1, wherein the at least one processor is configured to:
generate a shape of the additional object based at least in part on a shape of the object or a length ratio of the object.

### Claim 9

An electronic device, comprising:
a communication module;
a display;
a memory; and
at least one processor operatively connected with the communication module, the display, and the memory,
wherein the at least one processor is configured to:
receive an augmented reality image from at least one external device performing wireless communication with the communication module via the communication module;
display a running screen of an application associated with the augmented reality image on the display;
determine whether an object associated with stored information stored in the memory is included in the augmented reality image; and
display an additional object on the object based at least in part on the stored information.

### Claim 10 (depends on 9)

The electronic device of claim 9, wherein the at least one processor is configured to:
generate the stored information based at least in part on usage pattern data in which usage patterns of user are accumulated.

### Claim 11 (depends on 9)

The electronic device of claim 9, wherein the at least one processor is configured to:
set a priority of the object based at least in part on usage pattern data in which usage patterns of user are accumulated and recognize the object, the priority of which is high.

### Claim 12 (depends on 9)

The electronic device of claim 9, wherein the at least one processor is configured to:
determine whether the object is meaningful to user based at least in part on usage pattern data in which usage patterns of the user are accumulated and recognize the meaningful object.

### Claim 13 (depends on 9)

The electronic device of claim 9, wherein the at least one processor is configured to:
generate the additional object to be at least partially overlapped with the object and allow the additional object to have a face shape representing an emotion.

### Claim 14 (depends on 13)

The electronic device of claim 13, wherein the at least one processor is configured to:
allow the additional object to express the emotion as any one of a plurality of emotion stages included between a positive emotion and a negative emotion based at least in part on the stored information.

### Claim 15 (depends on 13)

The electronic device of claim 13, wherein the at least one processor is configured to:
change an emotion expressed by the additional object or a shape of the additional object depending on a type of the object or a change in a state of the object.