# US 2017/0256289 A1 · Systems and methods for automating identification and display of video data sets

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0256289 A1
- Document ID: US20170256289A1
- Status: Published application
- Kind: A1
- Application number: 15/061,739
- Filed: 2016-03-04
- Published: 2017-09-07
- Earliest claimed: 2016-03-04
- Assignees: Disney Enterprises, Inc.
- Applicants: Disney Enterprises, Inc.
- Inventors: TONY R. SMITH
- Web page: https://patentgrep.com/patent/US20170256289A1

## CPC

- G06K 7/10297: {arrangements for handling protocols designed for non-contact record carriers such as RFIDs NFCs, e.g. ISO/IEC 14443 and 18092 (cryptographic protocols H04L9/00; network security protocols H04L63/00; real-time communication protocols in data switching networks H04L65/00; network protocols for data switching network services H04L67/00)}
- G11B 27/031: Electronic editing of digitised analogue information signals, e.g. audio or video signals
- G11B 27/11: by using information not detectable on the record carrier
- H04N 21/233: Processing of audio elementary streams {(monitoring, identification or recognition of audio in broadcast systems H04H60/58)}
- H04N 21/23418: {involving operations for analysing video streams, e.g. detecting features or characteristics (television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/2353: {specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata}
- H04N 21/47205: {for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally}
- H04N 21/8153: {comprising still images, e.g. texture, background image}
- H04N 21/854: Content authoring
- H04N 21/8547: involving timestamps for synchronizing content
- H04N 21/858: Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
- G06K: GRAPHICAL DATA READING (image or video recognition or understanding G06V); PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A system for identifying, tagging, and displaying one or more assets within an audio visual (AV) file includes an asset tagging server, an asset tag acquisition device, and a database, wherein the asset tag acquisition device includes an asset identification engine configured to receive an asset identification data set and generate an asset tag data file that includes an asset tag corresponding to each asset. The asset tagging server is configured to receive, from an AV capture device, an AV file that includes an AV representation of each asset and corresponding timestamp data, and store, in the database, an AV asset tag data file comprising the beginning timestamp, the ending time stamp, and the set of asset tags. The system further includes a scene generation server configured to receive, from an editing display system, a set of asset parameters, search the database to identify one or more AV asset tag data files that correspond to the set of asset parameter, and display, on a user interface, the identified AV asset tag data files together with corresponding thumbnail images.

## Claims

### Claim 1

A system for identifying and tagging one or more assets within an audio visual (AV) file comprising:
an asset tagging server, an asset tag acquisition device, and a database;
wherein the asset tag acquisition device comprises an asset identification engine, the asset identification engine is configured to receive an asset identification data set and generate an asset tag data file comprising an asset tag corresponding to each asset; and
the asset tagging server comprises a processor and a computer readable media with a software program embedded thereon, the software program configured to:
receive, from an AV capture device, an AV file comprising an AV representation of each asset, a beginning timestamp, and an ending timestamp;
receive, from the asset identification engine, the asset tag data file corresponding to the AV file;
store, in the database, an AV asset tag data file comprising the beginning timestamp, the ending time stamp, and the set of asset tags.

### Claim 2 (depends on 1)

The system of claim 1, wherein the asset tag acquisition device further comprises a user interface, and the asset identification engine is configured to receive the asset identification data set from the user interface.

### Claim 3 (depends on 1)

The system of claim 1, wherein the asset tag acquisition device further comprises an asset sensor, and the asset identification engine is configured to receive the asset identification data set from the asset sensor.

### Claim 4 (depends on 3)

The system of claim 3, wherein the asset sensor is a Radio Frequency Identification (RFID) receiver and an RFID is disposed on each asset.

### Claim 5 (depends on 3)

The system of claim 3, wherein the asset sensor is the AV capture device and the asset identification engine is further configured to identify each asset using pattern recognition or sound recognition.

### Claim 6 (depends on 3)

The system of claim 3, wherein the asset sensor is a video device configured to identify each asset using a pattern recognition algorithm.

### Claim 7

A method for identifying and tagging assets within an AV file comprising:
receiving, from an AV capture device, an AV file comprising AV content including AV representations of one or more assets, a beginning timestamp, and an ending timestamp;
identifying, with an asset tag acquisition device, the one or more assets;
generating, for each asset, a corresponding asset tag;
generating an AV asset tag data file comprising the beginning timestamp, the ending timestamp, and the corresponding asset tags; and
storing the AV asset tag data file in a database.

### Claim 8 (depends on 7)

The method of claim 7, wherein each asset is selected from the group consisting of human assets, physical assets, environmental assets, auditory assets, and human emotion assets.

### Claim 9 (depends on 7)

The method of claim 7, wherein the identifying the one or more assets comprises receiving an RFID signal from an RFID tag disposed on each asset.

### Claim 10 (depends on 7)

The method of claim 7, wherein the identifying the one or more assets comprises executing a pattern or voice recognition algorithm on the AV file.

### Claim 11 (depends on 7)

The method of claim 7, wherein the identifying the one or more assets comprises receiving an asset identification data set from a user interface.

### Claim 12

A system for displaying AV data sets, comprising:
a scene generation server and a database, the database comprising a set of AV asset tag data files;
wherein the scene generation server comprises a processor and a computer readable media with a software program embedded thereon, the software program configured to:
receive, from an editing display system, a set of asset parameters;
search the database to identify one or more AV asset tag data files that correspond to the set of asset parameter.

### Claim 13 (depends on 12)

The system of claim 12, wherein the editing display system is configured to receive a list of relevant AV asset tag data files from the scene generation server and display the relevant AV asset tag data files in a user interface.

### Claim 14 (depends on 12)

The system of claim 12, wherein the editing display system is configured to receive the set of asset parameters from a user interface.

### Claim 15 (depends on 12)

The system of claim 12, wherein the set of asset parameters comprises human asset parameters, environmental asset parameters, physical asset parameters, or auditory asset parameters.

### Claim 16 (depends on 13)

The system of claim 13, wherein the set of asset parameters further comprises one or more pre-defined asset parameters corresponding to a user profile.

### Claim 17

A method for displaying AV data sets comprising:
receiving, from an editing display system, a set of asset parameters;
generating an asset tag query based on the set of asset parameters;
generating a list of relevant AV asset tag data files based on the asset tag query; and
displaying, on a user interface, one or more AV asset tag data files selected from the list of relevant AV tag data files.

### Claim 18 (depends on 17)

The method of claim 17, wherein the displaying one or more AV asset tag data files further comprises displaying a thumbnail image corresponding to each AV tag data file.

### Claim 19 (depends on 17)

The method of claim 17, further comprising:
receiving, from the user interface, one or more AV asset tag data file selections;
generating, for each AV asset tag data file selection, a scene tagged AV file, wherein the scene tagged AV file comprises an asset tag data file and an AV file corresponding to the asset tag data file; and
replaying, on the user interface, at least one of the AV files.

### Claim 20 (depends on 18)

The method of claim 18, wherein the displaying one or more AV asset tag data files further comprises:
selecting a group of AV asset tag data files that correspond to at least one of the asset parameters;
arranging one or more graphic windows in a grid pattern within the user interface; and
displaying a thumbnail image corresponding to an AV asset tag data file from the group inside each graphic windows.