# US 2020/0394411 A1 · Method of highlighting an object of interest in an image or video

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0394411 A1
- Document ID: US20200394411A1
- Status: Published application
- Kind: A1
- Application number: 16/899,002
- Filed: 2020-06-11
- Published: 2020-12-17
- Earliest claimed: 2019-06-14
- Assignees: Axis AB
- Applicants: Axis AB
- Inventors: Simon Dahlberg; Anders Kruger
- Web page: https://patentgrep.com/patent/US20200394411A1

## CPC

- G06V 20/41: {Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items (segmenting video sequences G06V20/49)}
- H04N 19/132: Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
- G06T 11/00: Two-dimensional [2D] image generation
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G06V 20/62: Text, e.g. of license plates, overlay texts or captions on TV images
- G06V 40/10: Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V 40/172: {Classification, e.g. identification}
- H04N 19/167: Position within a video image, e.g. region of interest [ROI]
- H04N 19/172: the region being a picture, frame or field
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A method of highlighting an object of interest comprises providing a digital image, determining a region of interest in the digital image covering an object of interest in the digital image having a person identifier, masking all image data in the digital image in a surrounding area to the region of interest, within the detected region of interest, determining a region of exclusion covering an object of exclusion in the digital image having another person identifier, and forming an output image comprising image data from the digital image of the region of interest, wherein the region of exclusion thereof is masked, and comprising the masked image data of the surrounding area. A device for performing the method is also disclosed. The method may be performed on an image sequence, for example in the form of a surveillance video.

## Claims

### Claim 1

A method of highlighting an object of interest in an image, the method comprising
providing a digital image,
determining a region of interest inside the digital image covering an object of interest having a person identifier, wherein the person identifier is a feature, characteristic or object from which a person identity can be uniquely identified,
masking all image data in the digital image in a surrounding area to the region of interest,
within the detected region of interest, determining a region of exclusion covering an object of exclusion in the digital image having another person identifier, and
forming an output image comprising image data from the digital image of the region of interest, wherein the region of exclusion thereof is masked, and comprising the masked image data of the surrounding area.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the surrounding area corresponds to the rest of the digital image.

### Claim 3 (depends on 1)

The method according to claim 1, wherein the image data is masked by manipulation of image data from the digital image.

### Claim 4 (depends on 1)

The method according to claim 1, wherein the object of interest is a human.

### Claim 5 (depends on 4)

The method according to claim 4, further comprising receiving an identity of a human, and wherein the act of determining the region of interest is performed based on the received identity.

### Claim 6 (depends on 1)

The method according to claim 1, wherein the act of determining a region of interest or determining a region of exclusion comprises executing an object detection algorithm on the digital image.

### Claim 7 (depends on 1)

The method according to claim 1, wherein the person identifier comprises a face, a license plate, or an id tag.

### Claim 8 (depends on 1)

A method of highlighting an object of interest in a video sequence, the method comprising:
providing a video sequence comprising digital images, for each image of a selection of digital images from the video sequence, applying the method according to claim 1, and forming an output video sequence comprising the output images.

### Claim 9 (depends on 1)

A method of highlighting an object of interest in a video sequence, the method comprising:
providing a video sequence comprising digital images,
for each image of a selection of digital images from the video sequence, applying the method according to claim 1, and
for temporally intermediate images located between a first selected image and a second selected image in the video sequence,
determining regions of interest by interpolation between a determined first region of interest in the first selected image and a determined second region of interest in the second selected image, and for each temporally intermediate image,
masking all image data in the temporally intermediate image in a surrounding area to the region of interest,
within the detected region of interest, determining a region of exclusion covering an object of exclusion in the digital image having another person identifier, and
forming an output image comprising image data from the temporally intermediate image of the region of interest, wherein the region of exclusion thereof is masked, and comprising the masked image data of the surrounding area, and forming an output video sequence comprising the output images.

### Claim 10 (depends on 1)

A computer program product comprising a computer-readable storage medium with instructions adapted to carry out the method of claim 1 when executed by a device having processing capability.

### Claim 11

A device arranged to highlight a region of interest in an image, the device comprising
a detector arranged to determine a region of interest inside the digital image covering an object of interest having a person identifier, wherein the person identifier is a feature, characteristic or object from which a person identity can be uniquely identified, and to, within the detected region of interest, determining a region of exclusion covering an object of exclusion in the digital image having another person identifier, and
a processor arranged to mask all image data in the digital image in a surrounding area to the region of interest, and to form an output image comprising image data from the digital image of the region of interest, wherein the region of exclusion thereof is masked, and comprising the masked image data of the surrounding area.

### Claim 12 (depends on 11)

The device according to claim 11, arranged in a video card of a video management system.
