# US 2018/0324475 A1 · Transmission device, transmission method, reception device, reception method, and transmission/reception system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0324475 A1
- Document ID: US20180324475A1
- Status: Published application
- Kind: A1
- Application number: 15/773,080
- Filed: 2016-11-16
- Published: 2018-11-08
- Earliest claimed: 2015-11-17
- Assignees: Sony Corporation
- Applicants: Sony Corporation
- Inventors: SHINNOSUKE USAMI; TETSUO KANEKO; YASUHIRO IIZUKA; KAZUHIRO UCHIDA; SHIGEO NAKATSUKA
- Web page: https://patentgrep.com/patent/US20180324475A1

## CPC

- H04N 21/234345: {the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment}
- H04N 5/2624: {for obtaining an image which is composed of whole input images, e.g. splitscreen}
- H04N 21/2343: involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements {(video transcoding H04N19/40; media packet handling at the source H04L65/762)}
- H04N 21/234318: {by decomposing into objects, e.g. MPEG-4 objects}
- H04N 21/431: Generation of visual interfaces {for content selection or interaction}; Content or additional data rendering
- H04N 21/4318: {by altering the content in the rendering process, e.g. blanking, blurring or masking an image region (image enhancement or restoration in general G06T5/00)}
- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
- H04N 25/41: {Extracting pixel data from a plurality of image sensors simultaneously picking up an image, e.g. for increasing the field of view by combining the outputs of a plurality of sensors}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A usage amount of a network bandwidth is kept small such that the network bandwidth is utilized. Data items of images captured by imaging with a plurality of cameras in a manner that adjacent ones of the captured images overlap with each other are stored into a storage unit. Cutting-out-target-region information items for a predetermined number of cameras selected from the plurality of cameras are received from an external device via a network. On the basis of the cutting-out-target-region information items for the predetermined number of cameras, data items of images of cutting-out-target regions are cut out from corresponding ones of the data items of the images captured by the plurality of cameras, the data items of the captured images being stored in the storage unit, and are transmitted to the external device via the network.

## Claims

### Claim 1

A transmission device, comprising:
a storage unit that stores data items of images captured by imaging with a plurality of cameras in a manner that adjacent ones of the captured images overlap with each other;
an information reception unit that receives, from an external device via a network, cutting-out-target-region information items for a predetermined number of cameras selected from the plurality of cameras; and
an image-data transmission unit that
cuts out, on the basis of the cutting-out-target-region information items for the predetermined number of cameras, data items of images of cutting-out-target regions from corresponding ones of the data items of the images captured by the plurality of cameras, the data items of the captured images being stored in the storage unit, and
transmits the data items of the images of the cutting-out-target regions to the external device via the network.

### Claim 2 (depends on 1)

The transmission device according to claim 1, wherein
the image-data transmission unit transmits, to the external device, the data items of the images of the cutting-out-target regions from the predetermined number of cameras after execution of a compression-coding process on the data items of the images of the cutting-out-target regions.

### Claim 3

A transmission method including an information reception step of receiving, from an external device via a network, cutting-out-target-region information items for a predetermined number of cameras selected from a plurality of cameras, the plurality of cameras performing imaging in a manner that adjacent ones of captured images overlap with each other,
the transmission method further comprising
an image-data transmission step of causing an image-data transmission unit
to cut out, on the basis of the cutting-out-target-region information items for the predetermined number of cameras, data items of images of cutting-out-target regions from corresponding ones of data items of the images captured by the plurality of cameras, and
to transmit the data items of the images of the cutting-out-target regions to the external device via the network.

### Claim 4

A transmission device, comprising:
a plurality of cameras that perform imaging in a manner that adjacent ones of captured images overlap with each other; and
a plurality of adapters provided to correspond respectively to the plurality of cameras,
the plurality of adapters respectively including
storage units that store data items of the images captured by imaging with corresponding ones of the plurality of cameras,
information reception units that receive, from an external device via a network, cutting-out-target-region information items for the corresponding ones of the plurality of cameras, and
image-data transmission units that
cut out, on the basis of the cutting-out-target-region information items, data items of images of cutting-out-target regions from corresponding ones of the data items of the captured images, the data items of the captured images being stored in the storage units, and
transmit the data items of the images of the cutting-out-target regions to the external device via the network.

### Claim 5

A transmission device, comprising
a plurality of cameras that perform imaging in a manner that adjacent ones of captured images overlap with each other,
the plurality of cameras respectively including
information reception units that receive cutting-out-target-region information items from an external device via a network, and
image-data transmission units that
cut out, on the basis of the cutting-out-target-region information items, data items of images of cutting-out-target regions from data items of the captured images, and
transmit the data items of the images of the cutting-out-target regions to the external device via the network.

### Claim 6

A transmission device, comprising
a plurality of servers provided to correspond respectively to a plurality of cameras that perform imaging in a manner that adjacent ones of captured images overlap with each other,
the plurality of servers respectively including
storage units that store data items of the images captured by imaging with corresponding ones of the plurality of cameras,
information reception units that receive, from an external device via a network, cutting-out-target-region information items for the corresponding ones of the plurality of cameras, and
image-data transmission units that
cut out, on the basis of the cutting-out-target-region information items, data items of images of cutting-out-target regions from the data items of the captured images, the data items of the captured images being stored in the storage units, and
transmit the data items of the images of the cutting-out-target regions to the external device via the network.

### Claim 7

A reception device, comprising:
a cutting-out-target-region determination unit that
sets a display region in a composite image formed of images captured by imaging with a plurality of cameras in a manner that adjacent ones of the captured images overlap with each other, and
determines regions in images captured by a predetermined number of cameras as cutting-out-target regions, the regions in the captured images including at least regions that overlap with the display region;
an information transmission unit that transmits cutting-out-target-region information items for the predetermined number of cameras to an external device via a network;
an image-data reception unit that receives, from the external device via the network, data items of images of the cutting-out-target regions from the predetermined number of cameras; and
an image-data processing unit that executes a stitching process on the received data items of the images of the cutting-out-target regions from the predetermined number of cameras to generate a data item of an image in the composite image, the image in the composite image corresponding to the display region.

### Claim 8 (depends on 7)

The reception device according to claim 7, wherein
the cutting-out-target-region determination unit sets the display region on the basis of control information for the display region, the control information being supplied from a display device that displays an image generated from the data item of the image in the composite image.

### Claim 9 (depends on 8)

The reception device according to claim 8, wherein
the display device is a head mounted display, and
the control information for the display region is orientation information.

### Claim 10 (depends on 8)

The reception device according to claim 8, wherein
the display device is
a personal computer,
a tablet, or
a smartphone, and
the control information for the display region is movement information based on an operation by a user.

### Claim 11 (depends on 7)

The reception device according to claim 7, wherein
the received data items of the images of the cutting-out-target regions from the predetermined number of cameras have been subjected to a compression-coding process, and
the image-data processing unit executes a compression-decoding process on the data items of the images of the cutting-out-target regions from the predetermined number of cameras, and then executes the stitching process to generate the data item of the image in the composite image, the image in the composite image corresponding to the display region.

### Claim 12

A reception method, comprising:
a cutting-out-target-region determination step of
setting a display region in a composite image formed of images captured by imaging with a plurality of cameras in a manner that adjacent ones of the captured images overlap with each other, and
determining regions in images captured by a predetermined number of cameras as cutting-out-target regions, the regions in the captured images including at least regions that overlap with the display region;
an information transmission step of transmitting cutting-out-target-region information items for the predetermined number of cameras to an external device via a network;
an image-data reception step of causing an image-data reception unit to receive, from the external device, data items of images of the cutting-out-target regions from the predetermined number of cameras; and
an image-data processing step of executing a stitching process on the data items of the images of the cutting-out-target regions from the predetermined number of cameras to generate a data item of an image in the composite image, the image in the composite image corresponding to the display region.

### Claim 13

A transmission/reception system, comprising:
a transmission device; and
a reception device connected to the transmission device via a network,
the transmission device including
a storage unit that stores data items of images captured by imaging with a plurality of cameras in a manner that adjacent ones of the captured images overlap with each other,
an information reception unit that receives, from the reception device via the network, cutting-out-target-region information items for a predetermined number of cameras selected from the plurality of cameras, and
an image-data transmission unit that
cuts out, on the basis of the cutting-out-target-region information items for the predetermined number of cameras, data items of images of cutting-out-target regions from corresponding ones of the data items of the images captured by the plurality of cameras, the data items of the captured images being stored in the storage unit, and
transmits the data items of the images of the cutting-out-target regions to the reception device via the network,
the reception device including
a cutting-out-target-region determination unit that
sets a display region in a composite image formed of the images captured by the plurality of cameras, and
determines regions in images captured by the predetermined number of cameras as the cutting-out-target regions, the regions in the captured images including at least regions that overlap with the display region,
an information transmission unit that transmits the cutting-out-target-region information items for the predetermined number of cameras to the transmission device via the network,
an image-data reception unit that receives, from the transmission device via the network, the data items of the images of the cutting-out-target regions from the predetermined number of cameras, and
an image-data processing unit that executes a stitching process on the received data items of the images of the cutting-out-target regions from the predetermined number of cameras to generate a data item of an image in the composite image, the image in the composite image corresponding to the display region.

### Claim 14

A transmission device, comprising:
a storage unit that stores data items of images captured by imaging with a plurality of cameras in a manner that adjacent ones of the captured images overlap with each other;
an information reception unit that receives, from an external device via a network, cutting-out-target-region information items for a predetermined number of cameras selected from the plurality of cameras;
an image-data cutting-out unit that cuts out, on the basis of the cutting-out-target-region information items for the predetermined number of cameras, data items of images of cutting-out-target regions from corresponding ones of the data items of the images captured by the plurality of cameras, the data items of the captured images being stored in the storage unit;
an image-data processing unit that executes a stitching process on the data items of the images of the cutting-out-target regions from the predetermined number of cameras to generate a data item of an image in a composite image; and
an image-data transmission unit that transmits the data item of the image in the composite image to the external device via the network.

### Claim 15

A reception device, comprising:
a cutting-out-target-region determination unit that
sets a display region in a composite image formed of images captured by imaging with a plurality of cameras in a manner that adjacent ones of the captured images overlap with each other, and
determines regions in images captured by a predetermined number of cameras as cutting-out-target regions, the regions in the captured images including at least regions that overlap with the display region;
an information transmission unit that transmits cutting-out-target-region information items for the predetermined number of cameras to an external device via a network; and
an image-data reception unit that receives, from the external device via the network, a data item of an image in the composite image, the image in the composite image having been generated by execution of a stitching process on data items of images of the cutting-out-target regions from the predetermined number of cameras.
