# US 2026/0229039 A1 · Abnormality detection device, abnormality detection method, and program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0229039 A1
- Document ID: US20260229039A1
- Status: Published application
- Kind: A1
- Application number: 19/149,924
- Filed: 2023-12-26
- Published: 2026-08-06
- Earliest claimed: 2023-01-25
- Assignees: NEC Corporation
- Applicants: NEC Corporation
- Inventors: Tetsuo INOSHITA; Yuichi NAKATANI
- Web page: https://patentgrep.com/patent/US20260229039A1

## CPC

- G06V 20/54: of traffic, e.g. cars on the road, trains or boats
- G06T 7/00: Image analysis
- G06T 11/00: Two-dimensional [2D] image generation
- G06V 10/273: {removing elements interfering with the pattern to be recognised}
- G06V 10/7747: {Organisation of the process, e.g. bagging or boosting}
- G06V 10/776: Validation; Performance evaluation
- H04N 7/18: Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An abnormality detection device according to the present invention generates a plurality of altered images by altering each of a plurality of captured images that are in a time sequence. Alteration of the captured images includes masking processing of masking one or more partial regions included in the captured images, and restoration processing of restoring the masked partial regions using data from other than the partial regions. For each of the plurality of captured images, the abnormality detection device calculates difference data representing difference between the captured image and the altered image generated from the captured image, and determines whether or not the captured images represent an abnormal state on the basis of a plurality of pieces of the calculated difference data.

## Claims

### Claim 1

An abnormality detection device comprising:
at least one memory that is configured to store instructions; and
at least one processor that is configured to execute the instructions to:
generate a plurality of processed images, by processing each of a plurality of time-series captured images;
calculate difference data representing a difference between the captured image and the processed image generated from the captured image, for each of the plurality of captured images; and
determine whether the captured image represents an abnormal state, based on a plurality of pieces of the calculated difference data,
wherein the processing executed on the captured image includes mask processing for masking one or more partial regions included in the captured image and restoration processing for restoring the masked partial region by using data other than the partial region.

### Claim 2 (depends on 1)

The abnormality detection device according to claim 1,
wherein the calculation of the difference data includes:
detecting, from the captured image, an image region representing a predetermined type of object that is not abnormal to be present in the captured image; and
calculating the difference data by calculating a difference between the captured image and the processed image generated from the captured image, for an image region excluding the detected image region.

### Claim 3 (depends on 1)

The abnormality detection device according to claim 1, wherein the calculation of the difference data includes detecting an image region representing a predetermined type of object from the captured image and excluding the detected image region from a target of the masking.

### Claim 4 (depends on 1)

The abnormality detection device according to claim 1,
wherein the at least one memory further stores a restoration model that has been trained to output, in response to an input of an image including a masked image region, an image in which the masked image region is restored,
wherein the calculation of the difference data includes executing the restoration processing by inputting the captured image in which the partial region is masked by the mask processing, into the restoration model, and
wherein, in a training of the restoration model, the image region representing the predetermined type of the object that is not abnormal to be present in the captured image is not included in a target of loss calculation.

### Claim 5 (depends on 1)

The abnormality detection device according to claim 1,
wherein the determination of whether the captured image represents an abnormal state includes:
calculating, for each of reference time points, a situation change degree representing a ratio of a statistical value of the difference data calculated for each of the plurality of captured images generated in a period after the reference time point, with respect to a statistical value of the difference data calculated for each of the plurality of captured images generated in a period before the reference time point; and
determining, in a case where the situation change degree calculated for the reference time point is equal to or more than a threshold, that the captured image generated at the reference time point represents an abnormal state.

### Claim 6 (depends on 5)

The abnormality detection device according to claim 5,
wherein the at least one processor is configured further to output a screen including the captured image,
wherein the output of the screen includes attenuating the situation change degree over time after it is determined that the situation change degree calculated for the reference time point is equal to or more than the threshold, and including, in the screen, a display indicating that the captured image represents the abnormal state, while the attenuated situation change degree is equal to or more than the situation change degree calculated for the newly acquired captured image.

### Claim 7

An abnormality detection method executed by a computer comprising:
generating a plurality of processed images, by processing each of a plurality of time-series captured images;
calculating difference data representing a difference between the captured image and the processed image generated from the captured image, for each of the plurality of captured images; and
determining whether the captured image represents an abnormal state, based on a plurality of pieces of the calculated difference data,
wherein the processing executed on the captured image includes mask processing for masking one or more partial regions included in the captured image and restoration processing for restoring the masked partial region by using data other than the partial region.

### Claim 8 (depends on 7)

The abnormality detection device according to claim 7,
wherein the calculation of the difference data includes:
detecting, from the captured image, an image region representing a predetermined type of object that is not abnormal to be present in the captured image; and
calculating the difference data by calculating a difference between the captured image and the processed image generated from the captured image, for an image region excluding the detected image region.

### Claim 9 (depends on 7)

The abnormality detection method according to claim 7, wherein the calculation of the difference data includes detecting an image region representing a predetermined type of object from the captured image, and excluding the detected image region from a target of the masking.

### Claim 10 (depends on 7)

The abnormality detection method according to claim 7,
wherein the computer includes a restoration model that has been trained to output, in response to an input of an image including a masked image region, an image in which the masked image region is restored,
wherein the calculation of the difference data includes executing the restoration processing by inputting the captured image in which the partial region is masked by the mask processing, into the restoration model, and
wherein, in a training of the restoration model, the image region representing the predetermined type of the object that is not abnormal to be present in the captured image is not included in a target of loss calculation.

### Claim 11 (depends on 7)

The abnormality detection method according to claim 7,
wherein the determination of whether the captured image represents an abnormal state includes:
calculating, for each of reference time points, a situation change degree representing a ratio of a statistical value of the difference data calculated for each of the plurality of captured images generated in a period after the reference time point, with respect to a statistical value of the difference data calculated for each of the plurality of captured images generated in a period before the reference time point; and
determining, in a case where the situation change degree calculated for the reference time point is equal to or more than a threshold, that the captured image generated at the reference time point represents an abnormal state.

### Claim 12 (depends on 11)

The abnormality detection method according to claim 11, further comprising outputting a screen including the captured image,
wherein the output of the screen includes attenuating the situation change degree over time after it is determined that the situation change degree calculated for the reference time point is equal to or more than the threshold, and including, in the scree, a display indicating that the captured image represents the abnormal state, while the attenuated situation change degree is equal to or more than the situation change degree calculated for the newly acquired captured image.

### Claim 13

A non-transitory computer-readable medium storing a program for causing a computer to execute processing comprising:
generating a plurality of processed images, by processing each of a plurality of time-series captured images;
calculating difference data representing a difference between the captured image and the processed image generated from the captured image, for each of the plurality of captured images; and
determining whether the captured image represents an abnormal state, based on a plurality of pieces of the calculated difference data,
wherein the processing executed on the captured image includes mask processing for masking one or more partial regions included in the captured image and restoration processing for restoring the masked partial region by using data other than the partial region.

### Claim 14 (depends on 13)

The medium according to claim 13,
wherein the calculation of the difference data includes:
detecting, from the captured image, an image region representing a predetermined type of object that is not abnormal to be present in the captured image; and
calculating the difference data by calculating a difference between the captured image and the processed image generated from the captured image, for an image region excluding the detected image region.

### Claim 15 (depends on 13)

The medium according to claim 13, wherein the calculation of the difference data includes detecting an image region representing a predetermined type of an object from the captured image, and the detected image region is excluded from a mask target.

### Claim 16 (depends on 13)

The medium according to claim 13,
wherein the program further comprises a restoration model that has been trained to output, in response to an input of an image including a masked image region, an image in which the masked image region is restored,
wherein the calculation of the difference data includes executing the restoration processing by inputting the captured image in which the partial region is masked by the mask processing, into the restoration model, and
wherein, in a training of the restoration model, the image region representing the predetermined type of the object that is not abnormal to be present in the captured image is not included in a target of loss calculation.

### Claim 17 (depends on 13)

The medium according to claim 13,
wherein the determination of whether the captured image represents an abnormal state includes:
calculating, for each of reference time points, a situation change degree representing a ratio of a statistical value of the difference data calculated for each of the plurality of captured images generated in a period after the reference time point, with respect to a statistical value of the difference data calculated for each of the plurality of captured images generated in a period before the reference time point; and
determining, in a case where the situation change degree calculated for the reference time point is equal to or more than a threshold, that the captured image generated at the reference time point represents an abnormal state.

### Claim 18 (depends on 17)

The medium according to claim 17,
wherein the program further causes the computer to execute outputting a screen including the captured image,
wherein the output of the screen includes attenuating the situation change degree over time after it is determined that the situation change degree calculated for the reference time point is equal to or more than the threshold, and including, in the screen, a display indicating that the captured image represents the abnormal state, while the attenuated situation change degree is equal to or more than the situation change degree calculated for the newly acquired captured image.
