# US 2026/0127713 A1 · Updates of background layers during encoding

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0127713 A1
- Document ID: US20260127713A1
- Status: Published application
- Kind: A1
- Application number: 19/360,453
- Filed: 2025-10-16
- Published: 2026-05-07
- Earliest claimed: 2024-11-04
- Assignees: Axis AB
- Applicants: Axis AB
- Inventors: Johan STENING; Song YUAN
- Web page: https://patentgrep.com/patent/US20260127713A1

## CPC

- G06T 5/50: using two or more images, e.g. averaging or subtraction
- H04N 19/23: with coding of regions that are present throughout a whole video segment, e.g. sprites, background or mosaic
- G06T 7/194: involving foreground-background segmentation
- G06V 10/764: using classification, e.g. of video objects
- H04N 19/17: the unit being an image region, e.g. an object
- H04N 19/20: using video object coding
- H04N 19/30: using hierarchical techniques, e.g. scalability (H04N19/63 takes precedence)
- H04N 19/597: specially adapted for multi-view video sequence encoding
- G06T 2207/20221: Image fusion; Image merging
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Techniques update background layers during encoding of scene, performed by an image processing device. The scene is encoded based on classifying objects depicted in the scene as either foreground or background. The background is divided into ordered background layers where each background layer is associated with a respective depth model. The method comprises detecting) a change in an image portion of one background layer. The method comprises calculating a difference between the image portion and a corresponding image portion of a background layer ordered behind the one background layer. The method comprises selecting, when the difference is smaller than a threshold, the background layer ordered behind the one background layer to represent the image portion.

## Claims

### Claim 1

A method for updating background layers during encoding of a scene, performed by an image processing device, wherein the scene is encoded based on classifying objects depicted in the scene as either foreground or background, wherein the background is divided into ordered background layers where each background layer is associated with a respective depth model (dm), and the method comprising:
detecting a change in an image portion of one background layer;
calculating a difference between the image portion and a corresponding image portion of a background layer ordered behind the one background layer;
selecting, when the difference is smaller than a threshold, the background layer ordered behind the one background layer to represent the image portion; and
creating, when the difference is not smaller than the threshold, a new background layer to represent the image portion.

### Claim 2 (depends on 1)

The method according to claim 1, further comprising:
merging the new background layer with the background layer ordered behind the new background layer upon expiration of a merge time (mt) associated with the background layer ordered behind the new background layer.

### Claim 3 (depends on 1)

The method according to claim 1, wherein each background layer is associated with a respective merge time (mt).

### Claim 4 (depends on 3)

The method according to claim 3, wherein representation of an object in the scene is merged into a given background layer when the object remains stationary in the scene longer than the merge time (mt) of the given background layer.

### Claim 5 (depends on 2)

The method according to claim 2, wherein each background layer is associated with a respective merge time (mt), and wherein a given background layer is merged into the background layer ordered behind it after having existed longer than the merge time (mt) of the background layer ordered behind it.

### Claim 6 (depends on 1)

The method according to claim 1, wherein the background layers are ordered by merge time (mt), with the background layer with shortest merge time (mt) closest to the foreground.

### Claim 7 (depends on 1)

The method according to claim 1, wherein the image portion has depth values as given by the depth model (dm) of the background layer that represents the image portion.

### Claim 8 (depends on 1)

The method according to claim 1, further comprising:
encoding the foreground and the background layers into an encoded video stream of the scene.

### Claim 9

An image processing device for updating background layers during encoding of scene, wherein the scene is encoded based on classifying objects depicted in the scene as either foreground or background, wherein the background is divided into ordered background layers where each background layer is associated with a respective depth model (dm), the image processing device comprising processing circuitry, the processing circuitry being configured to cause the image processing device to:
detect a change in an image portion of one background layer;
calculate a difference between the image portion and a corresponding image portion of a background layer ordered behind the one background layer;
select, when the difference is smaller than a threshold, the background layer ordered behind the one background layer to represent the image portion; and
create, when the difference is not smaller than the threshold, a new background layer to represent the image portion.

### Claim 10 (depends on 9)

The image processing device according to claim 9, further being configured to merge the new background layer with the background layer ordered behind the new background layer upon expiration of a merge time (mt) associated with the background layer ordered behind the new background layer.

### Claim 11

A computer program for updating background layers during encoding of scene, wherein the scene is encoded based on classifying objects depicted in the scene as either foreground or background, wherein the background is divided into ordered background layers where each background layer is associated with a respective depth model (dm), the computer program comprising computer code which, when run on processing circuitry of an image processing device, causes the image processing device to:
detect a change in an image portion of one background layer;
calculate a difference between the image portion and a corresponding image portion of a background layer ordered behind the one background layer;
select, when the difference is smaller than a threshold, the background layer ordered behind the one background layer to represent the image portion; and
create, when the difference is not smaller than the threshold, a new background layer to represent the image portion.

### Claim 12 (depends on 11)

A computer program product comprising a computer program according to claim 11, and a computer readable storage medium on which the computer program is stored.

### Claim 13 (depends on 9)

The image processing device according to claim 9, wherein each background layer is associated with a respective merge time (mt).

### Claim 14 (depends on 13)

The image processing device according to claim 13, wherein representation of an object in the scene is merged into a given background layer when the object remains stationary in the scene longer than the merge time (mt) of the given background layer.

### Claim 15 (depends on 10)

The image processing device according to claim 10, wherein each background layer is associated with a respective merge time (mt), and wherein a given background layer is merged into the background layer ordered behind it after having existed longer than the merge time (mt) of the background layer ordered behind it.

### Claim 16 (depends on 9)

The image processing device according to claim 9, wherein the background layers are ordered by merge time (mt), with the background layer with shortest merge time (mt) closest to the foreground.

### Claim 17 (depends on 9)

The image processing device according to claim 9, wherein the image portion has depth values as given by the depth model (dm) of the background layer that represents the image portion.

### Claim 18 (depends on 9)

The image processing device according to claim 9, wherein the foreground and the background layers are encoded into an encoded video stream of the scene.
