# US 2019/0318545 A1 · Command displaying method and command displaying device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0318545 A1
- Document ID: US20190318545A1
- Status: Published application
- Kind: A1
- Application number: 16/447,029
- Filed: 2019-06-20
- Published: 2019-10-17
- Earliest claimed: 2014-04-30
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Oleksandr SHOLUDKO; Olexandr KHOMYAKOV; Stanislav KUPCHANKO; Ievgen LIASHCHENKO
- Web page: https://patentgrep.com/patent/US20190318545A1

## CPC

- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06F 3/005: {Input arrangements through a video camera}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)}
- G06F 3/16: Sound input; Sound output (speech processing G10L)
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G10L 15/26: Speech to text systems (G10L15/08 takes precedence)
- G06F 9/453: {Help systems}
- G06F 2203/0381: Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
- G06F 2203/04806: Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
- G10L 2015/223: {Execution procedure of a spoken command}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

An electronic device is provided. The electronic device includes a display configured to display information, and an augmented reality module that is implemented by a processor, the augmented reality module configured to recognize an external object for the electronic device, and display at least one text corresponding to a voice command corresponding to an application or function related to the external object, through the display.

## Claims

### Claim 1

An electronic device comprising:
a short range wireless communication circuit;
an input device;
a display; and
a processor operatively connected to the communication circuit, the input device, and the display, and configured to:
acquire information of an external electronic device using the short range wireless communication circuit,
based at least in part on the acquired information of the external electronic device, display a text corresponding to a function to be performed by the external electronic device, through the display,
acquire a user input corresponding to the displayed text through the input device, and
transmit the user input to the external electronic device through the communication circuit so that the function is performed by the external electronic device.

### Claim 2 (depends on 1)

The electronic device of claim 1,
wherein the input device comprises a microphone, and
wherein the processor is further configured to acquire a voice input corresponding to the displayed text through the microphone.

### Claim 3 (depends on 1)

The electronic device of claim 1, wherein the processor is further configured to display an image for identifying the function through the display.

### Claim 4 (depends on 1)

The electronic device of claim 1, wherein the processor is further configured to, based at least in part on the acquired information, determine the function performable in the external electronic device.

### Claim 5 (depends on 4)

The electronic device of claim 4, wherein the function comprises a function of a schedule application, a calendar application, a weather application, a time application, a message application, a map application, or a multimedia application.

### Claim 6 (depends on 1)

The electronic device of claim 1, wherein the processor is further configured to, based at least in part on the external electronic device being identified as a device having a display, display the text for turning on or off the display of the external electronic device.

### Claim 7 (depends on 1)

The electronic device of claim 1,
wherein the external electronic device comprises a first external electronic device and a second external electronic device, and
wherein the processor is further configure to display a first text related to the first external object and a second text related to the second external object at the same time.

### Claim 8 (depends on 7)

The electronic device of claim 7, further comprising:
a camera operatively connected to the processor,
wherein the processor is further configured to display the first text and the second text over an image acquired through the camera.

### Claim 9

A method for operating an electronic device comprising:
acquiring information of an external electronic device using a short range wireless communication circuit of the electronic device;
based at least in part on the acquired information of the external electronic device, displaying a text corresponding to a function to be performed by the external electronic device, through a display of the electronic device;
acquiring a user input corresponding to the displayed text through an input device of the electronic device; and
transmitting the user input to the external electronic device through the communication circuit so that the function is performed by the external electronic device.

### Claim 10

A non-transitory computer readable recording medium having written thereon a program for executing operations of:
acquiring information of an external electronic device using a short range wireless communication circuit of an electronic device;
based at least in part on the acquired information of the external electronic device, displaying a text corresponding to a function to be performed by the external electronic device, through a display of the electronic device;
acquiring a user input corresponding to the displayed text through an input device of the electronic device; and
transmitting the user input to the external electronic device through the communication circuit so that the function is performed by the external electronic device.
