# US 2013/0156406 A1 · Moving picture processing device, moving picture processing method and program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0156406 A1
- Document ID: US20130156406A1
- Status: Published application
- Kind: A1
- Application number: 13/819,931
- Filed: 2011-08-29
- Published: 2013-06-20
- Earliest claimed: 2010-09-06
- Assignees: Sony Corporation
- Inventors: Yoshinori Takagi
- Web page: https://patentgrep.com/patent/US20130156406A1

## CPC

- H04N 9/87: Regeneration of colour television signals (H04N9/80 takes precedence)
- G06V 20/49: {Segmenting video sequences, i.e. computational techniques such as parsing or cutting the sequence, low-level clustering or determining units such as shots or scenes}
- G11B 27/28: by using information signals recorded by the same method as the main recording {(G11B27/22 takes precedence)}
- G11B 27/34: Indicating arrangements {(indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D)}
- H04N 5/147: {Scene change detection}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)

## Abstract

Transitions between cuts are detected from a moving picture containing a plurality of cuts, the plurality of cuts are categorized into a plurality of cut groups having mutually different feature amounts, and a plurality of cut pairs including two or more sequential cuts belonging to the mutually different cut groups and being repeated in the moving picture are identified, a predetermined number of the cut pairs, which are less than the plurality of cut pairs in number, are generated from the plurality of cut pairs by combining at least a portion of the plurality of cuts in a manner that two or more cuts constituting each cut pair belong to mutually different cut groups and a context of cut transitions in the moving picture is maintained, and a cut composition image including the generated cut pairs is generated.

## Claims

### Claim 1

A moving picture processing device, comprising:
a cut transition detection unit that detects, from a moving picture containing a plurality of cuts, transitions between the cuts;
a cut pair identification unit that categorizes the plurality of cuts into a plurality of cut groups having mutually different feature amounts, and identifies a plurality of cut pairs including two or more sequential cuts belonging to the mutually different cut groups and being repeated in the moving picture;
a cut pair generation unit that generates a predetermined number of the cut pairs, which are less than the plurality of cut pairs in number, from the plurality of cut pairs by combining at least a portion of the plurality of cuts in a manner that two or more cuts constituting each cut pair belong to mutually different cut groups and a context of cut transitions in the moving picture is maintained; and
a cut composition image generation unit that generates a cut composition image including the generated cut pairs.

### Claim 2 (depends on 1)

The moving picture processing device according to claim 1, wherein the cut pair generation unit categorizes the plurality of cut pairs into the predetermined number of pair groups, and then, for each of the pair groups, generates one cut pair from cut pairs contained in each of the pair groups by combining at least a portion of the cuts contained in each of the pair groups in a manner that two or more cuts constituting each cut pair belong to mutually different cut groups and a context of cut transitions in the moving picture is maintained.

### Claim 3 (depends on 2)

The moving picture processing device according to claim 2, wherein the cut pair generation unit categorizes the plurality of cut pairs into the predetermined number of pair groups based on feature amounts of cuts.

### Claim 4 (depends on 2)

The moving picture processing device according to claim 2, wherein the cut pair generation unit categorizes the plurality of cut pairs into the predetermined number of pair groups based on feature amounts of cut pairs.

### Claim 5 (depends on 1)

The moving picture processing device according to claim 1, wherein the cut pair generation unit generates one cut pair by combining the plurality of cuts based on feature amounts of cuts.

### Claim 6 (depends on 1)

The moving picture processing device according to claim 1, wherein the cut pair generation unit generates one cut pair by combining the plurality of cuts based on feature amounts of cut pairs.

### Claim 7 (depends on 1)

The moving picture processing device according to claim 1, wherein the cut pair generation unit sorts out cuts based on feature amounts of cuts for each cut group, and generates one cut pair by combining the plurality of sorted cuts.

### Claim 8 (depends on 1)

The moving picture processing device according to claim 1, wherein the cut pair generation unit sorts out cuts based on feature amounts of cuts for a first cut group, and generates one cut pair by combining a plurality of cuts belonging to a same cut pair as the sorted cuts.

### Claim 9 (depends on 1)

The moving picture processing device according to claim 1, wherein the cut pair is generated based on an inner product of similarity matrices indicating a similarity between cut pairs.

### Claim 10 (depends on 9)

The moving picture processing device according to claim 9, wherein the cut pair with a maximum total of the inner products of the similarity matrices is generated as a representative cut pair representing the plurality of cut pairs.

### Claim 11 (depends on 10)

The moving picture processing device according to claim 10, wherein the cut pair whose similarity to the representative cut pair is low is generated together with the representative cut pair.

### Claim 12 (depends on 1)

The moving picture processing device according to claim 1, wherein the cut pair is generated based on a scalar value of a similarity matrix indicating a similarity between cut pairs.

### Claim 13 (depends on 12)

The moving picture processing device according to claim 12, wherein the cut pair with a maximum scalar value of the similarity matrix is generated as a representative cut pair representing the plurality of cut pairs.

### Claim 14 (depends on 13)

The moving picture processing device according to claim 13, wherein the cut pair whose similarity to the representative cut pair is low is generated together with the representative cut pair.

### Claim 15 (depends on 1)

The moving picture processing device according to claim 1, wherein the predetermined number is set in accordance with display conditions of the cut composition image.

### Claim 16

A moving picture processing method, comprising:
detecting, from a moving picture containing a plurality of cuts, transitions between the cuts;
categorizing the plurality of cuts into a plurality of cut groups having mutually different feature amounts, and identifies a plurality of cut pairs including two or more sequential cuts belonging to the mutually different cut groups and being repeated in the moving picture;
generating a predetermined number of the cut pairs, which are less than the plurality of cut pairs in number, from the plurality of cut pairs by combining at least a portion of the plurality of cuts in a manner that the two or more cuts constituting each cut pair belong to mutually different cut groups and a context of cut transitions in the moving picture is maintained; and
generating a cut composition image including the generated cut pairs.

### Claim 17

A program causing a computer to execute a moving picture processing method, comprising:
detecting, from a moving picture containing a plurality of cuts, transitions between the cuts;
categorizing the plurality of cuts into a plurality of cut groups having mutually different feature amounts, and identifies a plurality of cut pairs including two or more sequential cuts belonging to the mutually different cut groups and being repeated in the moving picture;
generating a predetermined number of the cut pairs, which are less than the plurality of cut pairs in number, from the plurality of cut pairs by combining at least a portion of the plurality of cuts in a manner that the two or more cuts constituting each cut pair belong to mutually different cut groups and a context of cut transitions in the moving picture is maintained; and
generating a cut composition image including the generated cut pairs.
