# US 2023/0421718 A1 · Processing apparatus, processing method and program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0421718 A1
- Document ID: US20230421718A1
- Status: Published application
- Kind: A1
- Application number: 18/039,355
- Filed: 2020-12-03
- Published: 2023-12-28
- Earliest claimed: 2020-12-03
- Assignees: Nippon Telegraph and Telephone Corporation
- Applicants: Nippon Telegraph and Telephone Corporation
- Inventors: Takahide Hoshide; Masato Ono; Shinji Fukatsu
- Web page: https://patentgrep.com/patent/US20230421718A1

## CPC

- H04N 5/265: Mixing
- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- G06T 3/4038: Image mosaicing, e.g. composing plane images from plane sub-images
- H04N 23/951: by using two or more images to influence resolution, frame rate or aspect ratio
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A processing apparatus 1 includes: an acquisition unit 21 that acquires a plurality of pieces of frame data captured simultaneously from a plurality of pieces of video data captured while parts of capturing regions are superimposed; a specification unit 22 that specifies a blend region which includes a pixel forming a seam line connecting the plurality of pieces of frame data and is provided in a direction in which the plurality of pieces of frame data overlap; and an output unit that outputs connected frame data FO in which each pixel of the blend region has a pixel value obtained by blending pixel values of the plurality of pieces of frame data, and the plurality of pieces of frame data are connected by the seam line. The specification unit 22 specifies, as the blend region, consecutive pixels that include a pixel forming a seam line and in which a luminance difference between corresponding pixels of the plurality of pieces of frame data is within a predetermined value.

## Claims

### Claim 1

A processing apparatus comprising:
an acquisition unit, comprising one or more processors, configured to, acquire a plurality of pieces of frame data captured simultaneously from a plurality of pieces of video data captured while parts of capturing regions are superimposed;
a specification unit, comprising one or more processors, configured to, specify a blend region which includes a pixel forming a seam line connecting the plurality of pieces of frame data and is provided in a direction in which the plurality of pieces of frame data overlap; and
an output unit, comprising one or more processors, configured to, output connected frame data in which each pixel of the blend region has a pixel value obtained by blending pixel values of the plurality of pieces of frame data, and the plurality of pieces of frame data are connected by the seam line, wherein
the specification unit is configured to specify, as the blend region, consecutive pixels that include a pixel forming the seam line and in which a luminance difference between corresponding pixels of the plurality of pieces of frame data is within a predetermined value.

### Claim 2 (depends on 1)

The processing apparatus according to claim 1, wherein in a default blend region set to include a pixel forming the seam line, the specification unit is configured to specify, as the blend region, consecutive pixels that include the pixel forming the seam line and in which a luminance difference between the corresponding pixels of the plurality of pieces of frame data is within a predetermined value.

### Claim 3 (depends on 1)

The processing apparatus according to claim 1, wherein in a case where a distance between an end of the blend region and an end of a prohibited region excluded at a time of forming the seam line is within a predetermined distance and the blend region and the prohibited region overlap in subsequent frame data, the specification unit configured to adjust the blend region so that the blend region overlaps the prohibited region, and in a case where the blend region and the prohibited region do not overlap, the specification unit configured to adjust the blend region so that the blend region does not overlap the prohibited region.

### Claim 4 (depends on 3)

The processing apparatus according to claim 3, wherein in a case where the prohibited region moves in a direction toward the seam line in subsequent frame data, the specification unit configured to determine that the blend region and the prohibited region overlap.

### Claim 5

A processing method comprising:
acquiring, by a computer, a plurality of pieces of frame data captured simultaneously from a plurality of pieces of video data captured while parts of capturing regions are superimposed;
specifying, by the computer, a blend region which includes a pixel forming a seam line connecting the plurality of pieces of frame data and is provided in a direction in which the plurality of pieces of frame data overlap; and
outputting, by the computer, connected frame data in which each pixel of the blend region has a pixel value obtained by blending pixel values of the plurality of pieces of frame data, and the plurality of pieces of frame data are connected by the seam line, wherein
specifying, as the blend region, consecutive pixels that include pixels a pixel forming the seam line and in which a luminance difference between corresponding pixels of the plurality of pieces of frame data is within a predetermined value.

### Claim 6

A non-transitory, computer readable medium storing one or more instructions executable by a computer system to perform operations comprising
acquiring, by a computer, a plurality of pieces of frame data captured simultaneously from a plurality of pieces of video data captured while parts of capturing regions are superimposed;
specifying, by the computer, a blend region which includes a pixel forming a seam line connecting the plurality of pieces of frame data and is provided in a direction in which the plurality of pieces of frame data overlap; and
outputting, by the computer, connected frame data in which each pixel of the blend region has a pixel value obtained by blending pixel values of the plurality of pieces of frame data, and the plurality of pieces of frame data are connected by the seam line, wherein
specifying, as the blend region, consecutive pixels that include pixels a pixel forming the seam line and in which a luminance difference between corresponding pixels of the plurality of pieces of frame data is within a predetermined value.
