# US 12,190,912 B2 · Slide show generation method, recording medium, and slide show generation device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,190,912 B2
- Document ID: US12190912B2
- Status: Granted
- Kind: B2
- Application number: 18/024,665
- Filed: 2021-09-07
- Published: 2023-09-07
- Granted: 2025-01-07
- Earliest claimed: 2020-09-25
- Assignees: Panasonic Intellectual Property Management Co., Ltd.
- Applicants: Panasonic Intellectual Property Management Co., Ltd.
- Inventors: Tokuo Nakatani; Shota Kubo
- Web page: https://patentgrep.com/patent/US12190912B2

## CPC

- G11B 27/031: Electronic editing of digitised analogue information signals, e.g. audio or video signals
- H04N 21/440236: {by media transcoding, e.g. video is transformed into a slideshow of still pictures, audio is converted into text}
- G06V 20/41: {Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items (segmenting video sequences G06V20/49)}
- G06V 20/44: {Event detection}
- G11B 27/034: on discs (G11B27/036, G11B27/038 take precedence)
- G11B 27/28: by using information signals recorded by the same method as the main recording {(G11B27/22 takes precedence)}
- H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/8456: {by decomposing the content in the time domain, e.g. in time segments}
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A slide show generation method according to the present disclosure includes: obtaining a plurality of video data items; classifying first video data items, among the plurality of video data items, which were generated at the same generation location on the same generation date into the first group; classifying, into the first group, a second video data item among the plurality of video data items which was generated between the generation dates and times, in chronological order, of any two first video data items among the first video data items belonging to the first group; and selecting one or more video data items from among a plurality of video data items which belong to the first group and each of which is a first video data item or a second video data item, and generating slide show data for sequentially playing back the selected one or more video data items.

## Claims

### Claim 1

A slide show generation method comprising:
obtaining a plurality of video data items;
classifying, into a first group, a first video data item among the plurality of video data items obtained in the obtaining, a plurality of first video data items being generated at a generation location that is same among the plurality of first video data items on a generation date that is same among the plurality of first video data items, each of the plurality of first video data items being the first video data item;
classifying, into the first group, a second video data item among the plurality of video data items obtained in the obtaining, the second video data item being a video data item that does not include location information and was generated between generation dates and times, in chronological order, of any two first video data items among the plurality of first video data items belonging to the first group, the location information indicating a generation location of the video data item;
selecting one or more video data items from among a plurality of video data items each of which is the first video data item or the second video data item, and generating slide show data; and
sequentially playing back the one or more video data items selected, wherein:
the classifying of the first video data item includes:
calculating a distance between a predetermined first location and a generation location of each of the plurality of first video data items among the plurality of video data items obtained in the obtaining;
classifying a near-distance first video data item and a far-distance first video data item into different groups, the near-distance first video data item being the first video data item whose calculated distance is less than a predetermined first distance, the far-distance first video data item being the first video data item whose calculated distance is at least the predetermined first distance; and
classifying, into a second group, a third video data item among the plurality of video data items obtained in the obtaining, the third video data item having a generation date and a generation location at least one of which is different from the generation date and the generation location of the plurality of first video data items belonging to the first group, and
the classifying of the second video data item includes:
when a generation date and time of the second video data item is, in chronological order, between a generation date and time of any one of the plurality of first video data items belonging to the first group and a generation date and time of any one of a plurality of third video data items which belong to the second group and each of which is the third video data item, classifying the second video data item into a group to which a video data item belongs, the video data item being a video data item with a generation date and time closest to the generation date and time of the second video data item among a plurality of video data items each of which is classified into either the first group or the second group.

### Claim 2 (depends on 1)

The slide show generation method according to claim 1, wherein
each of the plurality of video data items includes identification data indicating an imaging device that has generated the video data item, and
in the classifying of the second video data item, the second video data item is classified into the first group when (i) a generation date and time of the second video data item is between generation dates and times, in chronological order, of any two first video data items among the plurality of first video data items belonging to the first group, and (ii) an imaging device indicated by identification data included in the second video data item is same as an imaging device indicated by identification data included in each of the plurality of first video data items belonging to the first group.

### Claim 3 (depends on 1)

The slide show generation method according to claim 1, further comprising:
determining whether a total number of a plurality of video data items belonging to the first group is less than a predetermined number, wherein
in the determining:
when it is determined that the total number of the plurality of video data items belonging to the first group is less than the predetermined number, determining whether the generation location of the plurality of first video data items belonging to the first group is at least a predetermined second distance away from a predetermined second location;
when it is determined that the generation location of the plurality of first video data items belonging to the first group is at least the predetermined second distance away from the predetermined second location, extracting, from the plurality of video data items obtained in the obtaining, the video data item generated a next day or thereafter of the generation date of the plurality of video data items belonging to the first group, and determining whether a generation location of the extracted video data item is same as the generation location of the plurality of first video data items belonging to the first group; and
when it is determined that the generation location of the extracted video data item is same as the generation location of the plurality of first video data items belonging to the first group, classifying the extracted video data item into the first group.

### Claim 4 (depends on 1)

The slide show generation method according to claim 1, wherein
the selecting and the generating includes:
sequentially arranging, in chronological order, a plurality of video data items in the first group, starting from a video data item with an earliest generation date and time;
dividing, into N periods, a total period from a generation date and time of a leading video data item until a generation date and time of a last video data item in the plurality of video data items arranged, where N is an integer of 2 or greater;
generating a plurality of small sets into which the plurality of video data items arranged are classified for each of the N periods in the total period; and
selecting one or more video data items for each of the plurality of small sets generated.

### Claim 5 (depends on 1)

The slide show generation method according to claim 1, wherein
the selecting and the generating includes:
sequentially arranging, in chronological order, a plurality of video data items in the first group, starting from a video data item with an earliest generation date and time;
generating a plurality of small sets into which the plurality of video data items arranged are classified for every M video data items in order of the arrangement, where M is an integer of 2 or greater; and
selecting one or more video data items for each of the plurality of small sets generated.

### Claim 6 (depends on 1)

The slide show generation method according to claim 1, wherein
in the selecting and the generating, when a plurality of video data items belonging to the first group include an image data item and a moving image data item, the moving image data item is selected with priority over the image data item.

### Claim 7 (depends on 1)

The slide show generation method according to claim 1, further comprising:
performing image analysis on each of the plurality of video data items to estimate an event type of the video data item, wherein
in the selecting and the generating, a video data item is selected with priority, the video data item being a video data item with an event type to which a largest number of video data items belong among event types of a plurality of video data items belonging to the first group.

### Claim 8 (depends on 1)

The slide show generation method according to claim 1, further comprising:
performing image analysis on each of the video data items to estimate an event type of the video data item, wherein
in the selecting and the generating, when selecting a predetermined number of video data items from a plurality of video data items belonging to the first group:
a half of the predetermined number of video data items are sequentially selected in descending order starting from a video data item with an event type to which a largest number of video data items belong among event types of the plurality of video data items belonging to the first group; and
a remaining half of the predetermined number of video data items are selected as video data items whose event types have not been selected as event types of the half of the predetermined number of video data items among the event types of the plurality of video data items belonging to the first group.

### Claim 9 (depends on 8)

The slide show generation method according to claim 8, wherein
in the selecting and the generating, the remaining half of the predetermined number of video data items are sequentially selected in ascending order starting from a video data item with an event type to which a smallest number of video data items belong among event types of the plurality of video data items belonging to the first group.

### Claim 10 (depends on 1)

A computer-readable non-transitory recording medium having recorded thereon a program for causing a computer to execute the slide show generation method according to claim 1.

### Claim 11

A slide show generation device comprising:
an obtainer that obtains a plurality of video data items;
a first classifier that classifies, into a first group, a first video data item among the plurality of video data items obtained by the obtainer, a plurality of first video data items being generated at a generation location that is same among the plurality of first video data items on a generation date that is same among the plurality of first video data items, each of the plurality of first video data items being the first video data item;
a second classifier that classifies, into the first group, a second video data item among the plurality of video data items obtained by the obtainer, the second video data item being a video data item that does not include location information and was generated between generation dates and times, in chronological order, of any two first video data items among the plurality of first video data items belonging to the first group, the location information indicating a generation location of the video data item;
a generator that selects one or more video data items from among a plurality of video data items each of which is the first video data item or the second video data item, and generates slide show data; and
a player that sequentially plays playing back the one or more video data items selected, wherein:
the first classifier:
calculates a distance between a predetermined first location and a generation location of each of the plurality of first video data items among the plurality of video data items obtained by the obtainer;
classifies a near-distance first video data item and a far-distance first video data item into different groups, the near-distance first video data item being the first video data item whose calculated distance is less than a predetermined first distance, the far-distance first video data item being the first video data item whose calculated distance is at least the predetermined first distance; and
classifies, into a second group, a third video data item among the plurality of video data items obtained by the obtainer, the third video data item having a generation date and a generation location at least one of which is different from the generation date and the generation location of the plurality of first video data items belonging to the first group, and
the second classifier:
when a generation date and time of the second video data item is, in chronological order, between a generation date and time of any one of the plurality of first video data items belonging to the first group and a generation date and time of any one of a plurality of third video data items which belong to the second group and each of which is the third video data item, classifies the second video data item into a group to which a video data item belongs, the video data item being a video data item with a generation date and time closest to the generation date and time of the second video data item among a plurality of video data items each of which is classified into either the first group or the second group.

### Claim 12

A slide show generation method comprising:
obtaining a plurality of video data items;
performing image analysis on each of the plurality of video data items to estimate an event type of the video data item;
classifying, into a first group, a first video data item among the plurality of video data items obtained in the obtaining, a plurality of first video data items being generated at a generation location that is same among the plurality of first video data items on a generation date that is same among the plurality of first video data items, each of the plurality of first video data items being the first video data item;
classifying, into the first group, a second video data item among the plurality of video data items obtained in the obtaining, the second video data item being a video data item that does not include location information and was generated between generation dates and times, in chronological order, of any two first video data items among the plurality of first video data items belonging to the first group, the location information indicating a generation location of the video data item;
selecting one or more video data items from among a plurality of video data items each of which is the first video data item or the second video data item, and generating slide show data; and
sequentially playing back the one or more video data items selected, wherein:
the classifying of the first video data item includes:
calculating a distance between a predetermined first location and a generation location of each of the plurality of first video data items among the plurality of video data items obtained in the obtaining;
classifying a near-distance first video data item and a far-distance first video data item into different groups, the near-distance first video data item being the first video data item whose calculated distance is less than a predetermined first distance, the far-distance first video data item being the first video data item whose calculated distance is at least the predetermined first distance; and
classifying, into a second group, a third video data item among the plurality of video data items obtained in the obtaining, the third video data item having a generation date and a generation location at least one of which is different from the generation date and the generation location of the plurality of first video data items belonging to the first group, and
the classifying of the second video data item includes:
when a generation date and time of the second video data item is, in chronological order, between a generation date and time of any one of the plurality of first video data items and a generation date and time of any one of a plurality of third video data items which belong to the second group and each of which is the third video data item, classifying the second video data item into a group to which a video data item belongs, the video data item being a video data item with an event type that matches an event type of the second video data item at a highest concordance rate among a plurality of video data items each of which is classified into either the first group or the second group.

### Claim 13 (depends on 12)

A computer-readable non-transitory recording medium having recorded thereon a program for causing a computer to execute the slide show generation method according to claim 12.

### Claim 14

A slide show generation device comprising:
an obtainer that obtains a plurality of video data items;
an estimator that performs image analysis on each of the plurality of video data items to estimate an event type of the video data item;
a first classifier that classifies, into a first group, a first video data item among the plurality of video data items obtained by the obtainer, a plurality of first video data items being generated at a generation location that is same among the plurality of first video data items on a generation date that is same among the plurality of first video data items, each of the plurality of first video data items being the first video data item;
a second classifier that classifies, into the first group, a second video data item among the plurality of video data items obtained by the obtainer, the second video data item being a video data item that does not include location information and was generated between generation dates and times, in chronological order, of any two first video data items among the plurality of first video data items belonging to the first group, the location information indicating a generation location of the video data item;
a generator that selects one or more video data items from among a plurality of video data items each of which is the first video data item or the second video data item, and generates slide show data; and
a player that sequentially plays back the one or more video data items selected, wherein:
the first classifier:
calculates a distance between a predetermined first location and a generation location of each of the plurality of first video data items among the plurality of video data items obtained by the obtainer;
classifies a near-distance first video data item and a far-distance first video data item into different groups, the near-distance first video data item being the first video data item whose calculated distance is less than a predetermined first distance, the far-distance first video data item being the first video data item whose calculated distance is at least the predetermined first distance; and
classifies, into a second group, a third video data item among the plurality of video data items obtained by the obtainer, the third video data item having a generation date and a generation location at least one of which is different from the generation date and the generation location of the plurality of first video data items belonging to the first group, and
the second classifier:
when a generation date and time of the second video data item is, in chronological order, between a generation date and time of any one of the plurality of first video data items and a generation date and time of any one of a plurality of third video data items which belong to the second group and each of which is the third video data item, classifies the second video data item into a group to which a video data item belongs, the video data item being a video data item with an event type that matches an event type of the second video data item at a highest concordance rate among a plurality of video data items each of which is classified into either the first group or the second group.