# US 10,373,461 B2 · System and method for video preview

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,373,461 B2
- Document ID: US10373461B2
- Status: Granted
- Kind: B2
- Application number: 15/092,544
- Filed: 2016-04-06
- Published: 2017-07-20
- Granted: 2019-08-06
- Earliest claimed: 2016-01-15
- Assignees: Shanghai Xiaoyi Technology Co., Ltd.
- Applicants: Shanghai Xiaoyi Technology Co., Ltd.
- Inventors: Feng Li; Lili Zhao
- Web page: https://patentgrep.com/patent/US10373461B2

## CPC

- G08B 13/19691: {Signalling events for better perception by user, e.g. indicating alarms by making display brighter, adding text, creating a sound}
- G06V 20/46: {Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames}
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G08B 13/1672: {using sonic detecting means, e.g. a microphone operating in the audio frequency range}
- G08B 13/19602: {Image analysis to detect motion of the intruder, e.g. by frame subtraction}
- G08B 13/1961: {Movement detection not involving frame subtraction, e.g. motion detection on the basis of luminance changes in the image}
- G08B 13/19613: {Recognition of a predetermined image pattern or behaviour pattern indicating theft or intrusion}
- G08B 13/19682: {Graphic User Interface [GUI] presenting system data to the user, e.g. information on a screen helping a user interacting with an alarm system}
- G08B 29/188: {Data fusion; cooperative systems, e.g. voting among different detectors}
- G11B 27/031: Electronic editing of digitised analogue information signals, e.g. audio or video signals
- G11B 27/06: Cutting and rejoining; Notching, or perforating record carriers otherwise than by recording styli (record carriers with provision for splicing G11B23/20)
- G11B 27/28: by using information signals recorded by the same method as the main recording {(G11B27/22 takes precedence)}
- H04N 7/18: Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- G06V 20/44: {Event detection}
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method for presenting a preview of a video includes receiving a plurality of video preview frames and information relating to a special event detected in the video. The plurality of video preview frames are extracted from the video. The special event is identified from an analysis of the video, and includes at least one of an object, a moving object, or a sound detected in the video. The method further includes displaying at least one of the received plurality of video preview frames, and displaying an indicator indicating the special event.

## Claims

### Claim 1

A device for presenting a preview of a video, the device comprising:
a memory device configured to store instructions; and
one or more processors configured to execute the instructions to:
receive a plurality of video preview frames and information relating to a special event detected in the video, wherein
an identified feature is identified by determining whether a difference between a video frame and a preceding or subsequent video frame is equal to or exceeds a threshold, wherein the difference is a difference of pixel values or a difference of sound levels,
the special event is identified from an analysis of the video by comparing the identified feature with one or more object, motion, or sound models, and includes at least one of an object, a moving object, or a sound detected in the video, and
the plurality of video preview frames are extracted from the video, wherein a rate of extracting video frames increases upon identification of the special event;
wherein the one or more processors are further configured to skip a time period before extracting the plurality of video preview frames and after extracting the plurality of video preview frames based on whether the special event is detected in a previous time period, wherein the skipped time period before extracting the plurality of video preview frames is different from the skipped time period after extracting the plurality of video preview frames; and
a display in communication with the one or more processors configured to:
display at least one of the plurality of video preview frames, which were received, and
display an indicator indicating the special event.

### Claim 2 (depends on 1)

The device of claim 1, wherein the received information relating to the special event includes a category or alert level associated with the special event.

### Claim 3 (depends on 2)

The device of claim 2, wherein:
the indicator is color coded, and
a color of the indicator represents the category or alert level associated with the special event.

### Claim 4 (depends on 1)

The device of claim 1, wherein:
the information relating to the special event includes a time stamp associated with the special event;
the one or more processors are further configured to execute the instructions to receive, from a server or a camera, the video; and
the display is further configured to:
receive, from a user, one or more inputs; and
play, in response to the one or more inputs, a portion of the video around the time stamp associated with the special event.

### Claim 5 (depends on 1)

The device of claim 1, wherein the display is further configured to display two or more video preview frames, the two or more video preview frames appearing at different time points in the video.

### Claim 6 (depends on 1)

The device of claim 1, wherein the indicator has a length, the length representing a duration of the special event appearing in the video.

### Claim 7 (depends on 1)

The device of claim 1, wherein the one or more object, motion, or sound models includes at least one of: properties or characteristics of a portion of an image, properties or characteristics of a portion of a sound, a type of the object, a type of the motion, a type of the sound, an alert level associated with the object, motion, or sound, or a category associated with the object, motion, or sound.

### Claim 8

A system for generating a plurality of video preview frames for a video, the system comprising:
a memory device that stores instructions; and
one or more processors that are configured to execute the instructions to:
generate or access one or more object, motion, or sound models;
receive a video;
analyze the video;
identify an identified feature by determining whether a difference between a video frame and a preceding or subsequent video frame is equal to or exceeds a threshold, wherein the difference is a difference of pixel values or a difference of sound levels;
identify a special event from an analysis of the video by comparing the identified feature with the one or more object, motion, or sound models, the special event including at least one of an object, a moving object, or a sound detected in the video;
obtain at least one video frame representing the special event, wherein a rate of obtaining video frames increases upon identification of the special event;
wherein the one or more processors are further configured to skip a time period before obtaining the plurality of video preview frames and after obtaining the plurality of video preview frames based on whether the special event is detected in a previous time period, wherein the skipped time period before obtaining the plurality of video preview frames is different from the skipped time period after obtaining the plurality of video preview frames; and
transmit, to a user, the at least one video frame representing the special event and information relating to the special event.

### Claim 9 (depends on 8)

The system of claim 8, wherein the one or more processors are further configured to:
obtain one or more video frames from the video;
detect an object from the one or more video frames; and
identify a first special event corresponding to the detected object.

### Claim 10 (depends on 9)

The system of claim 9, wherein the one or more processors are further configured to:
extract an audio signal from the video;
detect a sound included in the audio signal;
identify a second special event corresponding to the detected sound; and
associate the first and second special events if the first and second special events appear in the video around a same time.

### Claim 11 (depends on 9)

The system of claim 9, wherein the one or more processors are further configured to:
extract an audio signal from the video;
detect a sound included in the audio signal;
identify a special event corresponding to the detected sound.

### Claim 12 (depends on 8)

The system of claim 8, wherein the one or more object, motion, or sound models includes at least one of: properties or characteristics of a portion of an image, properties or characteristics of a portion of a sound, a type of the object, a type of the motion, a type of the sound, an alert level associated with the object, motion, or sound, or a category associated with the object, motion, or sound.

### Claim 13

A method for presenting a preview of a video, the method comprising:
receiving a plurality of video preview frames and information relating to a special event detected in the video, wherein
an identified feature is identified by determining whether a difference between a video frame and a preceding or subsequent video frame is equal to or exceeds a threshold, wherein the difference is a difference of pixel values or a difference of sound levels,
the special event is identified from an analysis of the video by comparing an identified feature with one or more object, motion, or sound models, and includes at least one of an object, a moving object, or a sound detected in the video, and
the plurality of video preview frames are extracted from the video, wherein a rate of extracting video frames increases upon identification of the special event;
a time period is skipped before extracting the plurality of video preview frames and after extracting the plurality of video preview frames based on whether the special event is detected in a previous time period, wherein the skipped time period before extracting the plurality of video preview frames is different from the skipped time period after extracting the plurality of video preview frames;
displaying at least one of the plurality of video preview frames, which were received; and
displaying an indicator indicating the special event.

### Claim 14 (depends on 13)

The method of claim 13, wherein the received information relating to the special event includes a category or alert level associated with the special event.

### Claim 15 (depends on 14)

The method of claim 14, wherein:
the indicator is color coded, and
a color of the indicator represents the category or alert level associated with the special event.

### Claim 16 (depends on 13)

The method of claim 13, further comprising:
receiving, from a server or a camera, the video;
receiving, from a user, one or more inputs; and
playing, in response to the one or more inputs, a portion of the video around a time stamp associated with the special event.

### Claim 17 (depends on 13)

The method of claim 13, further comprising displaying two or more video preview frames, the two or more video preview frames appearing at different time points in the video.

### Claim 18 (depends on 13)

The method of claim 13, wherein the indicator has a length, the length representing a duration of the special event appearing in the video.

### Claim 19 (depends on 13)

The method of claim 13, wherein the one or more object, motion, or sound models includes at least one of: properties or characteristics of a portion of an image, properties or characteristics of a portion of a sound, a type of the object, a type of the motion, a type of the sound, an alert level associated with the object, motion, or sound, or a category associated with the object, motion, or sound.

### Claim 20

A method for generating a plurality of video preview frames for a video, comprising:
generating or accessing one or more object, motion, or sound models;
receiving a video;
analyzing the video;
identifying an identified feature by determining whether a difference between a video frame and a preceding or subsequent video frame is equal to or exceeds a threshold, wherein the difference is a difference of pixel values or a difference of sound levels;
identifying a special event from an analysis of the video by comparing the identified feature with the one or more object, motion, or sound models, the special event including at least one of an object, a moving object, or a sound detected in the video;
obtaining at least one video frame representing the special event, wherein a rate of obtaining video frames increases upon identification of the special event;
skipping a time period before obtaining the plurality of video preview frames and after obtaining the plurality of video preview frames based on whether the special event is detected in a previous time period, wherein the skipped time period before obtaining the plurality of video preview frames is different from the skipped time period after obtaining the plurality of video preview frames; and
transmitting, to a user, the at least one video frame representing the special event and information relating to the special event.

### Claim 21 (depends on 20)

The method of claim 20, further comprising:
obtaining one or more video frames from the video;
detecting an object from the one or more video frames; and
identifying a first special event corresponding to the detected object.

### Claim 22 (depends on 21)

The method of claim 21, further comprising:
extracting an audio signal from the video;
detecting a sound included in the audio signal;
identifying a second special event corresponding to the detected sound; and
associating the first and second special events if the first and second special events appear in the video around a same time.

### Claim 23 (depends on 20)

The method of claim 20, wherein the one or more object, motion, or sound models includes at least one of: properties or characteristics of a portion of an image, properties or characteristics of a portion of a sound, a type of the object, a type of the motion, a type of the sound, an alert level associated with the object, motion, or sound, or a category associated with the object, motion, or sound.

### Claim 24

A non-transitory computer readable medium embodying a computer program product, the computer program product comprising instructions configured to cause a computing device to:
receive a plurality of video preview frames and information relating to a special event detected in the video, wherein
an identified feature is identified by determining whether a difference between a video frame and a preceding or subsequent video frame is equal to or exceeds a threshold, wherein the difference is a difference of pixel values or a difference of sound levels,
the special event is identified from an analysis of the video by comparing the identified feature with one or more object, motion, or sound models, and includes at least one of an object, a moving object, or a sound detected in the video,
the plurality of video preview frames are extracted from the video, wherein a rate of extracting video frames increases upon identification of the special event,
wherein time period is skipped before extracting the plurality of video preview frames and after extracting the plurality of video preview frames based on whether the special event is detected in a previous time period, wherein the skipped time period before extracting the plurality of video preview frames is different from the skipped time period after extracting the plurality of video preview frames;
display at least one of the plurality of video preview frames, which were received; and
display an indicator indicating the special event.

### Claim 25 (depends on 24)

The non-transitory computer readable medium of claim 24, wherein the one or more object, motion, or sound models includes at least one of: properties or characteristics of a portion of an image, properties or characteristics of a portion of a sound, a type of the object, a type of the motion, a type of the sound, an alert level associated with the object, motion, or sound, or a category associated with the object, motion, or sound.