# US 10,482,672 B2 · Electronic device and method for transmitting and receiving image data in electronic device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,482,672 B2
- Document ID: US10482672B2
- Status: Granted
- Kind: B2
- Application number: 15/886,989
- Filed: 2018-02-02
- Published: 2018-08-16
- Granted: 2019-11-19
- Earliest claimed: 2017-02-15
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Bo-Ram Namgoong; Ja Min Goo; Ji Hyun Park
- Web page: https://patentgrep.com/patent/US10482672B2

## CPC

- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G02B 27/017: {Head mounted}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/012: {Head tracking input arrangements}
- H04N 13/117: the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
- H04N 13/344: with head-mounted left-right displays
- H04N 13/366: using viewer tracking
- H04N 21/234345: {the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment}
- H04N 21/23439: {for generating different versions}
- H04N 21/414: Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
- H04N 21/42202: {environmental sensors, e.g. for detecting temperature, luminosity, pressure, earthquakes}
- H04N 21/4728: for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
- H04N 21/6587: Control parameters, e.g. trick play commands, viewpoint selection
- H04N 21/816: {involving special video data, e.g 3D video}
- G02B 2027/0123: {comprising devices increasing the field of view}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An electronic device and method are disclosed herein. The electronic device includes a communication circuit, a memory and a processor. The processor implements the method including: receiving first data of a first quality, and second data of a second quality, the second quality different from the first quality, controlling a display device to display the first data and the second data, the first data corresponding to a first field of view of a user, transmitting information indicating a second field of view of the user through the communication circuit to the external electronic device, receiving third data of the second quality corresponding to the first field of view and fourth data of the first quality corresponding to the second field of view from the external electronic device, and controlling the display device to display the fourth data corresponding to the second field of view of the user.

## Claims

### Claim 1

An electronic device, comprising:
a communication circuit configured to communicate by using a plurality of communication connections;
a display device;
a memory storing program instructions; and
a processor electrically connected with the communication circuit and the memory, wherein the program instructions are executable by the processor to enable the processor to:
in response to determining that a user's field of view corresponds to a first field of view, receive from an external electronic device first data of a first quality, and second data of a second quality which is different from the first quality, wherein the first data corresponds to the first field of view,
control the display device to display the first data and the second data, the first data corresponding to a first field of view of a user,
in response to determining that the user's field of view is changed to a second field of view, control the communication circuit to transmit information indicating the second field of view to the external electronic device,
receive third data of the second quality corresponding to the first field of view and fourth data of the first quality corresponding to the second field of view from the external electronic device, and
control the display device to display the fourth data corresponding to the second field of view,
wherein the instructions are further executable by the processor to receive the first data and the third data through a first communication connection and the second data and the fourth data through a second communication connection, and
wherein the first communication connection has a higher communication quality than the second communication connection.

### Claim 2 (depends on 1)

The electronic device of claim 1, further comprising a sensor device including at least one of a gyroscope sensor and an acceleration sensor, wherein the instructions are further executable by the processor to:
transmit to the external electronic device, through the communication circuit, additional information related to the second field of view including at least one of an angle and a speed of a motion of the display device based on sensing information detected through the sensor device.

### Claim 3 (depends on 2)

The electronic device of claim 2, wherein the instructions are further executable by the processor to:
receive, from the external electronic device, seventh data of the first quality corresponding to a fifth field of view, the fifth field of view predicted by the external electronic device based on motion information of the display device received by the external electronic device for a predetermined threshold time.

### Claim 4 (depends on 1)

The electronic device of claim 1, wherein the instructions are further executable by the processor to:
control the display device to display the third data corresponding to the second field of view when the third data and the fourth data are stored in the memory for a predetermined time after the first data is displayed.

### Claim 5 (depends on 1)

The electronic device of claim 1, wherein the first data and the second data are part of a first frame of an omni-directional video, and the third data and the fourth data are included in a second frame of the omni-directional video, and
wherein the instructions are further executable by the processor to control the display device to display at least one of the first frame and the second frame of the omni-directional video according to a predetermined timing signal.

### Claim 6 (depends on 2)

The electronic device of claim 2, further comprising an infrared (IR) sensor configured to detect a user's present field of view, wherein the second field of view is detected using the IR sensor.

### Claim 7 (depends on 1)

The electronic device of claim 1, wherein the instructions are further executable by the processor to:
receive fifth data of the first quality corresponding to a third field of view from the external electronic device through the communication circuit, and
control the display device to display at least one of information indicating a reception of the fifth data while the fourth data is displayed, and the fifth data corresponding to the third field of view.

### Claim 8 (depends on 1)

The electronic device of claim 1, wherein the instructions are further executable by the processor to
when a communication speed of the first communication connection is greater than or equal to a predetermined threshold speed, receive the fourth data through the first communication connection.

### Claim 9 (depends on 1)

The electronic device of claim 1, wherein the instructions are further executable by the processor to receive sixth data of the first quality corresponding to a fourth field of view of a user, the sixth data including a predetermined object disposed in the fourth field of view, and
control the display device to display data indicating at least one of:
reception of the sixth data while the fourth data is displayed, and
the sixth data corresponding to the fourth field of view.

### Claim 10

An electronic device, comprising:
a communication circuit configured to communicate by using a plurality of communication connections;
a memory; and
a processor operatively coupled to the communication circuit and the memory and configured to:
control the communication circuit to transmit first data of a first quality and second data of a second quality different from the first quality through the communication circuit to an external electronic device, the first data corresponding to a first field of view of a user;
receive information related to a second field of view of the user from the external electronic device, and
control the communication circuit to transmit to the external electronic device, third data of the second quality of data corresponding to the first field of view and fourth data of the first quality of data corresponding to the second field of view,
wherein the processor is further configured to control the communication circuit to transmit the first data and the third data through a first communication connection and the second data and the fourth data through a second communication connection, and
wherein the first communication connection has a higher communication quality than the second communication connection.

### Claim 11 (depends on 10)

The electronic device of claim 10, wherein the processor is further configured to
when a communication speed of the first communication connection is greater than or equal to a predetermined threshold speed, control the communication circuit to transmit the fourth data through the first communication connection.

### Claim 12 (depends on 10)

The electronic device of claim 10, wherein the memory stores per-data captured object information and motion information about a plurality of external electronic devices, wherein the processor is further configured to:
process fifth data or sixth data into the first quality, wherein the fifth data includes predetermined object identification information from among stored data based on the object information and wherein the sixth data corresponds to a third view direction and is transmit to the plurality of external electronic devices a predetermined number of times, and
control the communication circuit to transmit the processed fifth data or the processed sixth data through the communication circuit to the plurality of external electronic devices.

### Claim 13

A method in an electronic device, comprising:
in response to determining that a user's field of view corresponds to a first field of view, receiving from an external electronic device, through a communication circuit which is configured to communicate by using a plurality of communication connections, first data of a first quality, and second data of a second quality which is different from the first quality, wherein the first data corresponds to the first field of view;
displaying the first data and the second data, the first data corresponding to a first field of view of a user;
in response to determining that the user's field of view is changed to a second field of view, transmitting information indicating the second field of view through the communication circuit to the external electronic device;
receiving third data of the second quality corresponding to the first field of view and fourth data of the first quality corresponding to the second field of view from the external electronic device; and
displaying the fourth data corresponding to the second field of view,
wherein the first data and the third data are received through a first communication connection and the second data and the fourth data are received through a second communication connection, and
wherein the first communication connection has a higher communication quality than the second communication connection.

### Claim 14 (depends on 13)

The method of claim 13, further comprising transmitting to the external electronic device, through the communication circuit, additional information related to the second field of view including at least one of an angle and a speed of a motion of the electronic device based on sensing information detected through a sensor device.

### Claim 15 (depends on 13)

The method of claim 13, further comprising displaying the third data corresponding to the second field of view when the third data and the fourth data are stored in a memory for a predetermined time after the first data is displayed.

### Claim 16 (depends on 13)

The method of claim 13, wherein the first data and the second data are part of a first frame of an omni-directional video, and the third data and the fourth data are included in a second frame of the omni-directional video, and
further comprising displaying at least one of the first frame and the second frame of the omni-directional video according to a predetermined timing signal.

### Claim 17 (depends on 13)

The method of claim 13, wherein the second field of view of the user is detected using an infrared (IR) sensor of the electronic device.

### Claim 18 (depends on 13)

The method of claim 13, further comprising:
receiving fifth data of the first quality corresponding to a third field of view from the external electronic device through the communication circuit, and
displaying at least one of information indicating a reception of the fifth data while the fourth data is displayed, and the fifth data corresponds to the third field of view.

### Claim 19 (depends on 13)

The method of claim 13, further comprising:
when a communication speed of the first communication connection is greater than or equal to a predetermined threshold speed, receiving the fourth data through the first communication connection.