# US 2021/0176410 A1 · Displaying a video stream

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0176410 A1
- Document ID: US20210176410A1
- Status: Published application
- Kind: A1
- Application number: 16/952,095
- Filed: 2020-11-19
- Published: 2021-06-10
- Earliest claimed: 2019-12-09
- Assignees: Axis AB
- Applicants: Axis AB
- Inventors: Markus ANDERSSON; Stefan TRAN
- Web page: https://patentgrep.com/patent/US20210176410A1

## CPC

- H04N 5/272: Means for inserting a foreground image in a background image, i.e. inlay, outlay
- H04N 7/18: Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- G06V 20/41: {Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items (segmenting video sequences G06V20/49)}
- H04N 7/183: {for receiving images from a single remote source}
- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- G06V 20/44: {Event detection}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

There is provided a computer implemented method for displaying a video stream of a scene (100) captured by a video capture device on a display of a client device. The method comprising: detecting a new event (112) in the scene, determining a new event area (114) in the scene within which the new event is detected, checking whether a prior event has been detected within the new event area during a predetermined time period preceding the new event, upon no prior event being detected during the predetermined time period, adding a visual indicator (116) to an image frame (103) temporally corresponding to the detection of the new event and to a number of subsequent image frames (103) of the video stream, wherein the visual indicator coincides with the new event area, and wherein the step of adding the visual indicator comprises gradually changing an appearance of the visual indicator throughout the number of subsequent image frames, and displaying the video stream with the added visual indicator on the display of the client device. There is also provided a related client device and a non-transitory computer-readable storage medium.

## Claims

### Claim 1

A computer implemented method for displaying a video stream of a scene captured by a video capture device on a display of a client device, the method comprising:
detecting a new event in the scene,
determining a new event area in the scene within which the new event is detected,
checking whether a prior event has been detected within the new event area during a predetermined time period preceding the new event,
upon no prior event being detected during the predetermined time period, adding a visual indicator to an image frame temporally corresponding to the detection of the new event and to a number of subsequent image frames of the video stream, wherein the visual indicator coincides with the new event area, and wherein the step of adding the visual indicator comprises gradually changing an appearance of the visual indicator throughout the number of subsequent image frames, and
displaying the video stream with the added visual indicator on the display of the client device.

### Claim 2 (depends on 1)

The computer implemented method according to claim 1, further comprising determining a duration since a last prior event in the new event area, wherein the number of subsequent image frames and/or the appearance of the visual indicator is based on the duration.

### Claim 3 (depends on 1)

The computer implemented method according to claim 1, further comprising:
detecting a separate event ongoing in the scene simultaneously with the new event, and
upon the separate event being detected, determining a separate event area in the scene within which the separate event is detected,
determining a distance between the new event area and the separate event area,
wherein the step of adding the visual indicator is performed upon determining that the distance between the new event area and the separate event area is greater than a predetermined threshold.

### Claim 4 (depends on 3)

The computer implemented method according to claim 3, wherein the number of subsequent image frames and/or the appearance of the visual indicator is based on the distance between the new event area and the separate event area.

### Claim 5 (depends on 1)

The computer implemented method according to claim 1, comprising determining a level of motion of the new event, wherein the step of adding the visual indicator is performed upon determining that the level of motion is greater than a predetermined threshold.

### Claim 6 (depends on 1)

The computer implemented method according to claim 1 comprising determining a level of motion of the new event, wherein the number of subsequent image frames and/or the appearance of the visual indicator is based on the level of motion.

### Claim 7 (depends on 1)

The computer implemented method according to claim 1, further comprising determining an object class pertaining to an object associated with the new event, wherein the step of adding the visual indicator is performed based on either the determined object class.

### Claim 8 (depends on 1)

The computer implemented method according to claim 1, further comprising determining a size of the object associated with the new event, wherein the step of adding the visual indicator is performed based on the determined size of the object.

### Claim 9 (depends on 1)

The computer implemented method according to claim 1, wherein the visual indicator is configured to follow a movement of the new event across subsequent image frames of the video stream.

### Claim 10 (depends on 1)

The computer implemented method according to claim 1, wherein the step of gradually changing the appearance of the visual indicator comprises one or more of gradually expanding, gradually fading out, gradually changing form, gradually rotating, and gradually changing a color of the visual indicator throughout the number of subsequent image frames.

### Claim 11 (depends on 1)

The computer implemented method according to claim 1, further comprising determining a viewed point of at least one eye of an operator viewing the display,
wherein the step of adding the visual indicator is performed upon determining that the viewed point is outside of the display or upon determining that the viewed point is located a distance from the new event area that is greater than a predetermined threshold.

### Claim 12 (depends on 1)

A non-transitory computer-readable storage medium having stored thereon instructions for implementing the computer implemented method according to claim 1, when executed on a device having processing capabilities.

### Claim 13

A client device for displaying a video stream of a scene, the client device comprising control circuitry configured to execute:
an event detection function configured to detect a new event in the scene,
an event localization function configured to determine a new event area in the scene, corresponding to the area in the scene, within which the new event is detected,
an event comparison function configured to check whether a prior event has been detected within the new event area during a predetermined time period preceding the new event,
an indicator adding function configured to, upon no prior event being detected during the predetermined time period, add a visual indicator to an image frame and to a number of subsequent image frames of the video stream, wherein the visual indicator coincides with the new event area, and wherein the indicator adding function is further configured to gradually change an appearance of the visual indicator throughout the number of subsequent image frames, and
a display function configured to display the video stream with the added visual indicator on a display of the client device.

### Claim 14 (depends on 13)

A system comprising:
a client device according to claim 13, and
a video capture device.

### Claim 15 (depends on 14)

The system according to claim 14, wherein the video capture device is a monitoring camera for wide-angle imaging, panoramic imaging, or 360-degree imaging.
