# US 11,122,237 B2 · Systems and methods for redaction of screens

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,122,237 B2
- Document ID: US11122237B2
- Status: Granted
- Kind: B2
- Application number: 16/432,804
- Filed: 2019-06-05
- Published: 2019-12-05
- Granted: 2021-09-14
- Earliest claimed: 2018-06-05
- Assignees: Axon Enterprise, Inc.
- Applicants: Axon Enterprise, Inc.
- Inventors: Anh Tuan Nguyen; Noah Spitzer-Williams; Jacob Hershfield
- Web page: https://patentgrep.com/patent/US11122237B2

## CPC

- H04N 5/77: between a recording apparatus and a television camera
- H04N 5/91: Television signal processing therefor
- G06F 1/163: {Wearable computers, e.g. on a belt}
- G06F 1/1686: {the I/O peripheral being an integrated camera}
- G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour
- G06T 5/20: using local operators
- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G06V 20/59: inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
- H04N 5/272: Means for inserting a foreground image in a background image, i.e. inlay, outlay
- H04N 9/8205: {involving the multiplexing of an additional signal and the colour video signal}
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06T 5/70: Denoising; Smoothing
- G06T 2207/10016: Video; Image sequence
- G06T 2207/20024: Filtering details
- G06T 2207/30232: Surveillance
- G06V 2201/02: Recognising information on displays, dials, clocks
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Systems, devices, and methods redact one or more light-emitting screens in data recorded on a recording device. The redaction may include receiving recorded data comprising a plurality of pixel values. The redaction may include detecting one or more light-emitting screens in the received image. The redaction may include redacting a subset of the pixel values from the recorded associated with the one or more detected light-emitting screens. The redaction may be commonly applied to multiple frames of recorded data through the use of a unique identifier assigned to a same detected light-emitting screen. A same light-emitting screen may be tracked across multiple non-sequential or sequential frames and assigned a same unique identifier.

## Claims

### Claim 1

A system for redacting one or more light-emitting screens recorded in video data at an incident, the system comprising:
a body-worn camera configured to be worn by a law enforcement officer, the camera comprising:
an image sensor configured to capture one or more images;
a first memory configured to store instructions for recording the video data; and
a first processing circuit configured to execute the instructions for recording the video data, wherein execution of the instructions for recording causes the first processing circuit to:
record the one or more images in the video data; and
upload the video data; and
a redaction computing device configured to receive the video data, the redaction computing device comprising:
at least one second memory configured to store the video data uploaded from the camera and instructions for redaction; and
a second processing circuit configured to execute the instructions for redaction, wherein execution of the instructions for redaction causes the second processing circuit to perform operations comprising:
detecting a light-emitting screen in each image of the one or more images in the video data, wherein:
the detected light-emitting screen is a light-emitting screen of a display of one of a mobile data terminal mounted in a vehicle or a mobile communications device;
the display further comprises a non-light-emitting bezel adjacent the detected light-emitting screen; and
detecting the light-emitting screen in each image of the one or more images comprises generating a mask associated with the detected light-emitting screen, wherein a shape of the mask is selected to match the detected light-emitting screen and exclude the non-light-emitting bezel;
redacting a subset of pixel values in each image of the one or more images in accordance with the detected light-emitting screen in each image of the one or more images in the video data, wherein the redacting comprises applying a redaction filter to the subset of pixels in each image in accordance with the mask; and
providing the one or more redacted images for display.

### Claim 2 (depends on 1)

The system of claim 1, wherein detecting the light-emitting screen in each image of the one or more images comprises identifying the subset of pixels in each image, wherein the subset of pixels in each image is associated with the light-emitting screen.

### Claim 3 (depends on 2)

The system of claim 2, wherein detecting the light-emitting screen in each image of the one or more images comprises concurrently:
providing an indication of the identified subset of pixels in a first image of the one or more images for display; and
identifying the subset of pixels in a second image of the one or more images.

### Claim 4 (depends on 2)

The system of claim 2, wherein detecting the light-emitting screen in each image of the one or more images comprises providing the mask for display.

### Claim 5 (depends on 4)

The system of claim 4, wherein an area of the mask for each image is greater than an area of the identified subset of pixels in each image.

### Claim 6 (depends on 1)

The system of claim 1, wherein detecting the light-emitting screen in each image of the one or more images comprises applying the video data to a neural network previously trained on separate images each comprising one or more annotated light-emitting screens.

### Claim 7 (depends on 1)

The system of claim 1, wherein at least one of the one or more detected light-emitting screens is the screen of the mobile data terminal mounted in the vehicle.

### Claim 8 (depends on 1)

The system of claim 1, wherein detecting the light-emitting screen in each image of the one or more images comprises detecting two or more light-emitting screens in a same image of the one or more images.

### Claim 9 (depends on 6)

The system of claim 6, wherein detecting the light-emitting screen comprises tracking a same light-emitting screen between a first image of the one or more images and a second image of the one or more images.

### Claim 10 (depends on 1)

The system of claim 1, wherein redacting each image of the one or more images includes receiving a selection associated with each detected light-emitting screen and redacting each image in accordance with the selection.

### Claim 11 (depends on 10)

The system of claim 10, wherein the selection includes a mask edit and redacting each image includes redacting each image in accordance with the mask edit.

### Claim 12 (depends on 10)

The system of claim 10, wherein the selection includes a default selection provided by the redaction computing device.

### Claim 13 (depends on 10)

The system of claim 10, wherein the one or more images include a plurality of images and the selection includes a selection of a mask segment associated with a same light emitting screen across the plurality of images.

### Claim 14

A redaction computing device for redacting light-emitting screens captured in one or more images recorded at an incident, the device comprising:
at least one memory configured to store instructions for redaction; and
at least one processing circuit configured to execute the instructions, wherein execution of the instructions by the at least one processing circuit causes the at least one processing circuit to perform operations comprising:
receiving the one or more images, wherein the one or more images include at least one image captured by a body-worn camera of a law enforcement officer;
detecting a light-emitting screen in a first image of the one or more images, wherein the detected light-emitting screen is a screen of a mobile data terminal mounted in a vehicle;
redacting the first image of the one or more images in accordance with the detected light-emitting screen in the first image of the one or more images; and
storing the redacted first image in the at least one memory, wherein:
detecting the light-emitting screen in the first image comprises:
generating a mask associated with the detected light-emitting screen, wherein a shape of the mask is equal or greater than a shape of the detected light-emitting screen and less than a shape of a bezel of a display of the mobile data terminal mounted in the vehicle that includes the detected light-emitting screen; and
transmitting the mask to a remote computing device; and
redacting the first image comprises:
receiving a selection associated with the transmitted mask from the remote computing device; and
applying a redaction filter to the first image in accordance with the received selection.

### Claim 15 (depends on 14)

The device of claim 14, wherein the one or more images include at least one image captured in a pre-event buffer prior to recording of the one or more images in video data.

### Claim 16

A computer-implemented method for redacting video data recorded at an incident, the method comprising:
receiving an image, the image comprising a plurality of pixel values;
detecting a light-emitting screen in the received image; and
redacting a subset of the pixel values associated with the detected light-emitting screen, wherein:
the detected light-emitting screen is a light-emitting screen of a display of one of a mobile data terminal mounted in a vehicle or a mobile communications device;
the display further comprises a non-light-emitting bezel adjacent the detected light-emitting screen; and
redacting the subset of the pixel values associated with the detected light-emitting screen comprises:
generating a mask associated with the detected light-emitting screen; and
applying a redaction filter to the subset of the pixel values in accordance with the mask, wherein a shape of the mask is selected to match the detected light-emitting screen and exclude the non-light-emitting bezel.

### Claim 17 (depends on 16)

The method of claim 16, wherein the received image is captured inside the vehicle.

### Claim 18 (depends on 16)

The method of claim 16, wherein detecting the light-emitting screen in the received image comprises concurrently:
providing an indication of the subset of the pixel values of the received image for display; and
identifying a subset of the pixel values associated with the light-emitting screen in a second image of the video data, wherein the received image is different from the second image.

### Claim 19 (depends on 16)

The method of claim 16, wherein the received image is recorded by a body-worn camera attached to a user to record the received image during the incident.
