Back to results
US 11,457,140 B2Granted
Automatic camera angle switching in response to low noise audio to create combined audiovisual file
AssigneeOn Time Staffing Inc.
InventorRoman Olshansky
Life of this patent
Estimating the term…
Abstract
A system and method are provided for automatically concatenating two or more audiovisual clips containing video input from multiple cameras, and producing a combined audiovisual file containing video that switches between the two video inputs. In some examples, two video inputs and an audio input are recorded synchronously and are synchronized. The audio input can be sampled to locate low-noise audio events. The audiovisual file contains video that switches between two or more camera angles at the low-noise audio events. In one aspect, pauses are automatically removed from the audiovisual files. In another aspect, the system detects switch-initiating events, and switches between camera angles in response to detecting a switch-initiating event.
Claims20
A system comprising:
- a first video input from a first video camera and a second video input from a second video camera, wherein the first video camera and the second video camera are directed towards a common area, such that the video cameras are configured to obtain video data of a common subject in the common area from different angles;
- an audio input;
- a time counter providing a timeline associated with the first video input, the second video input, and the audio input, wherein the timeline enables a time synchronization of the first video input, the second video input, and the audio input;
- a non-transitory computer memory and a computer processor;
- and
- computer instructions stored on the memory for instructing the processor to perform the steps of:
- sampling the audio input to identify a first low noise audio segment in which a decibel level is below a threshold level for a predetermined period of time;
- sampling the audio input to identify a beginning of the first low noise audio segment and an end of the first low noise audio segment;
- sampling the audio input to identify a second low noise audio segment in which a decibel level is below a threshold level for a predetermined period of time;
- sampling the audio input to identify a beginning of the second low noise audio segment and an end of the second low noise audio segment;
- in response to identifying the first low noise audio segment, automatically assembling a combined audiovisual file by performing the steps of:
- retaining a first audiovisual clip comprising a portion of the audio input and first video input occurring before the first low noise audio segment,
- retaining a second audiovisual clip comprising a portion of the audio input and second video input occurring after the first low noise audio segment, and
- concatenating the first audiovisual clip and the second audiovisual clip to create a combined audiovisual file;
- wherein (1) the first audiovisual clip ends at the beginning of the first low noise audio segment and the second audiovisual clip begins at the beginning of the first low noise audio segment, (2) the first audiovisual clip ends after the beginning of the first low noise audio segment and before the end of the first low noise audio segment and the second audiovisual clip begins after the beginning of the first low noise audio segment and before the end of the first low noise audio segment, or (3) the first audiovisual clip ends at the end of the first low noise audio segment and the second audiovisual clip begins at the end of the first low noise audio segment;
- in response to identifying the second low noise audio segment, automatically assembling the combined audiovisual file by further performing the steps of:
- retaining the second audiovisual clip comprising a portion of the audio input and second video input occurring after the first low noise audio segment and before the second low noise audio segment,
- retaining a third audiovisual clip comprising a portion of the audio input and the first video input occurring after the second low noise audio segment, and
- concatenating the second audiovisual clip and the third audiovisual clip for the combined audiovisual file if the time between the first low noise audio segment and the second low noise audio segment is greater than a switch delay time period, or maintaining the second audiovisual clip throughout the second low noise audio segment in the combined audiovisual file if the time between the first low noise audio segment and the second low noise audio segment is less than the switch delay time period;
- wherein the combined audiovisual file includes the first low noise audio segment from the audio input.
17 more elements
A computer-implemented method comprising:
- receiving first video input of an individual from a first camera,
- receiving second video input of the individual from a second camera, wherein the first video camera and the second video camera are directed towards a common area, such that the video cameras are configured to obtain video data of a common subject in the common area from different angles,
- receiving audio input of the individual from a microphone,
- wherein the first video input, the second video input, and the audio input are recorded synchronously, and the first video input, the second video input, and the audio input are all of a first length;
- sampling the audio input to identify multiple low noise audio segments, wherein the sampled audio input to identify the low noise audio segment has a decibel level that is below a threshold level for at least four seconds;
- automatically assembling a combined audiovisual file by performing the steps of:
- retaining multiple audiovisual clips, each clip comprising a portion of the first video input or the second video input occurring before or after the low noise audio segments;
- removing a portion of the audio input, the first video input, and second video input that falls between a beginning and an ending of each of the low noise audio segments;
- and
- concatenating the multiple audiovisual clips to create a combined audiovisual file containing video of the individual from two camera angles;
- wherein each of the multiple audiovisual clips (1) ends at the beginning of a low noise audio segment, (2) ends after the beginning of the low noise audio segment and before the end of the low noise audio segment, or (3) ends at the end of the low noise audio segment;
- wherein the combined audiovisual file includes at least a portion of a low noise audio segment from the audio input,
- wherein the combined audiovisual file comprises audiovisual clips alternating between the first video input and the second video input.
10 more elements
A system comprising:
- a first video input and a second video input;
- an audio input;
- a time counter providing a timeline associated with the first video input, the second video input, and the audio input, wherein the timeline enables a time synchronization of the first video input, the second video input, and the audio input;
- wherein the first video input, the second video input, and the audio input are recorded synchronously and the first video input, the second video input, and the audio input are all of a first length;
- a non-transitory computer memory and a computer processor;
- and
- computer instructions stored on the memory for instructing the processor to perform the steps of:
- sampling the audio input to identify a low noise audio segment in which a decibel level is below a threshold level for a predetermined period of time;
- sampling the audio input to identify a beginning of the low noise audio segment and an end of the low noise audio segment;
- removing a portion of the audio input, the first video input, and the second video input that falls between the beginning and the end of the low noise audio segment;
- and
- automatically assembling a combined audiovisual file by performing the steps of:
- retaining a first audiovisual clip comprising a portion of the audio input and first video input occurring before the low noise audio segment,
- retaining a second audiovisual clip comprising a portion of the audio input and second video input occurring after the low noise audio segment, and
- concatenating the first audiovisual clip and the second audiovisual clip to create a combined audiovisual file of a second length, wherein the first length is longer than the second length.
12 more elements
A video editing system, comprising:
- a plurality of video cameras, wherein each video camera is configured to provide video input, wherein each video camera is directed towards a common area, such that each of the video cameras are configured to obtain video data of a common subject in the common area from different angles;
- an audio input;
- a time counter providing a timeline associated with the first video input, the second video input, and the audio input, wherein the timeline enables a time synchronization of the first video input, the second video input, and the audio input;
- a non-transitory computer memory and a computer processor;
- and
- computer instructions stored on the memory for instructing the processor to perform the steps of:
- preparing a first audiovisual clip, wherein the first audiovisual clip comprises video input from a first video camera of the plurality of video cameras and audio input;
- monitoring the audio input for a first low noise audio segment in which a decibel level is below a threshold level for a predetermined period of time and identifying a beginning of the first low noise audio segment;
- in response to identifying the first low noise audio segment, preparing a second audiovisual clip, wherein the second audio visual clip comprises video input from a second video camera of the plurality of video cameras and audio input after the beginning of the low noise audio segment;
- monitoring the audio input for a second low noise audio segment in which a decibel level is below the threshold level for a period of time and identifying a beginning of the second low noise audio segment,
- if the second low noise audio segment is identified within a switch delay time period from the beginning of the second audiovisual clip, the second audiovisual clip comprises the second low noise audio segment, if the second low noise audio segment is identified after the switch delay period from the start of the second audiovisual clip, preparing a third audiovisual clip, wherein the third audiovisual clip comprises video input from one of the plurality of video cameras other than the second video camera and audio input after the beginning of the second low noise audio segment;
- preparing a combined audiovisual file, the combined audiovisual file comprises the first audiovisual file and the second audiovisual file if the second low noise audio segment is within the switch delay time period or preparing the combined audiovisual file, the combined audiovisual file comprises the first audiovisual file, the second audiovisual file, and the third audiovisual file if the second low noise audio segment is after the switch delay time period.
9 more elements
Dependencies are inferred from the claim text.