# US 2020/0394560 A1 · System and Method for Generating Training Materials for a Video Classifier

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0394560 A1
- Document ID: US20200394560A1
- Status: Published application
- Kind: A1
- Application number: 16/766,682
- Filed: 2018-09-05
- Published: 2020-12-17
- Earliest claimed: 2017-09-06
- Assignees: Osr Enterprises AG
- Applicants: Osr Enterprises AG
- Inventors: Yosef BEN-EZRA; Samuel HAZAK; Yaniv BEN-HAIM; Yoni SCHIFF; Shai NISSIM; Orit SHIFMAN
- Web page: https://patentgrep.com/patent/US20200394560A1

## CPC

- G06F 16/483: using metadata automatically derived from the content
- G06F 16/583: using metadata automatically derived from the content
- G06N 5/04: Inference or reasoning models
- G06N 20/00: Machine learning
- G06V 10/774: Generating sets of training patterns; Bootstrap methods, e.g. bagging or boosting
- G06V 20/41: {Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items (segmenting video sequences G06V20/49)}
- G09B 9/02: for teaching control of vehicles or other craft
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)

## Abstract

A method, system and computer program product for generating content for training a classifier, the method comprising: receiving two or more parts of a description; for each part, retrieving from an extracted feature collection library one or more extracted feature collections derived from one or more video frames, the extracted feature collections or the video frames labeled with a label associated with the part, thus obtaining a multiplicity of extracted feature collections; and combining the multiplicity of extracted feature collections to obtain a combined feature collection associated with the description, the combined feature collection to be used for training a classifier.

## Claims

### Claim 1

A method of generating content for training a classifier, comprising:
receiving at least two parts of a description;
for each part of the at least two parts, retrieving from an extracted feature collection library at least one extracted feature collection derived from at least one video frame, the at least one extracted feature collection or the at least one video frame labeled with a label associated with the part, thus obtaining a multiplicity of extracted feature collections; and
combining the multiplicity of extracted feature collections to obtain a combined feature collection associated with the description, the combined feature collection to be used for training a classifier.

### Claim 2 (depends on 1)

The method of claim 1, further comprising training a video classifier on a corpus including the combined feature collection as labeled with the description.

### Claim 3 (depends on 1)

The method of claim 1, wherein the at least one extracted feature collection is a two dimensional Fast Fourier Transform (FFT) of at least one video frame.

### Claim 4 (depends on 1)

The method of claim 1, wherein the at least one extracted feature collection is a wavelet transformation of at least one video frame.

### Claim 5 (depends on 1)

The method of claim 1, wherein the at least one extracted feature collection comprises at least one element selected from the group consisting of: geometrical parameters, color parameters; texture parameters; location parameters, and size parameters.

### Claim 6 (depends on 1)

The method of claim 1, further comprising extracting the at least one extracted feature collection from the at least one video frame.

### Claim 7 (depends on 1)

The method of claim 1, wherein the at least one video frame is captured by a capturing device selected from the group consisting of: a video camera; an Infra-Red video camera; an imaging Radar and an imaging Lidar.

### Claim 8 (depends on 1)

The method of claim 1, further comprising reconstructing at least one synthetic video frame from the combined feature collection, the at least one synthetic video frame viewable by a human user.

### Claim 9

An apparatus for generating content for training a classifier the apparatus comprising:
a processor adapted to perform the steps of:
receiving at least two parts of a description;
for each part of the at least two parts, retrieving from an extracted feature collection library at least one extracted feature collection derived from at least one video frame, the at least one extracted feature collection or the at least one video frame labeled with a label associated with the part, thus obtaining a multiplicity of extracted feature collections; and
combining the multiplicity of extracted feature collections to obtain a combined feature collection associated with the description, the combined feature collection to be used for training a classifier.

### Claim 10 (depends on 9)

The apparatus of claim 9, wherein the processor is further adapted to train a video classifier on a corpus including the combined feature collection as labeled with the description.

### Claim 11 (depends on 9)

The apparatus of claim 9, wherein the at least one extracted feature collection is a two dimensional Fast Fourier Transform (FFT) of at least one video frame.

### Claim 12 (depends on 9)

The apparatus of claim 9, wherein the at least one extracted feature collection is a wavelet transformation of at least one video frame.

### Claim 13 (depends on 9)

The apparatus of claim 9, wherein the at least one extracted feature collection comprises at least one element selected from the group consisting of: geometrical parameters, color parameters; texture parameters; location parameters, and size parameters.

### Claim 14 (depends on 9)

The apparatus of claim 9, wherein the processor is further adapted to extract the at least one extracted feature collection from the at least one video frame.

### Claim 15 (depends on 9)

The apparatus of claim 9, wherein the at least one video frame is captured by a capturing device selected from the group consisting of: a video camera; an Infra-Red video camera; an imaging Radar and an imaging Lidar.

### Claim 16 (depends on 9)

The apparatus of claim 9, wherein the processor is further adapted to reconstruct at least one synthetic video frame from the combined feature collection, the at least one synthetic video frame viewable by a human user.

### Claim 17

A computer program product comprising a non-transitory computer readable storage medium retaining program instructions configured to cause a processor to perform actions, which program instructions implement:
receiving at least two parts of a description;
for each part of the at least two parts, retrieving from an extracted feature collection library at least one extracted feature collection derived from at least one video frame, the at least one extracted feature collection or the at least one video frame labeled with a label associated with the part, thus obtaining a multiplicity of extracted feature collections; and
combining the multiplicity of extracted feature collections to obtain a combined feature collection associated with the description, the combined feature collection to be used for training a classifier.
