# US 10,118,097 B2 · Systems and methods for automated image processing for images with similar luminosities

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,118,097 B2
- Document ID: US10118097B2
- Status: Granted
- Kind: B2
- Application number: 15/283,071
- Filed: 2016-09-30
- Published: 2018-02-15
- Granted: 2018-11-06
- Earliest claimed: 2016-08-09
- Assignees: Electronic Arts Inc.
- Applicants: Electronic Arts Inc.
- Inventors: Karen Elaine Stevens
- Web page: https://patentgrep.com/patent/US10118097B2

## CPC

- A63F 13/52: involving aspects of the displayed game scene
- A63F 13/79: involving player-related data, e.g. identities, accounts, preferences or play histories
- G06T 11/10: Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77)
- G06T 11/60: Creating or editing images; Combining images with text
- A63F 13/25: Output arrangements for video game devices
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Embodiments of systems and methods for automated image processing to improve visibility of similar luminosities in a digital media application are disclosed. The systems and methods can determine a Daltonization value based on the color palette of a frame in the digital media and modify a local contrast parameter and a local brightness parameter of the frame by applying an enhanced Daltonization process to the frame. The enhanced Daltonization technique can create a color shift in the frame. In some embodiments, after the frame is optimally Daltonized, the local brightness and contrast parameters are rebalanced to shift colors back to light hues to compensate for the initial shift to darker colors. The systems and methods can return the optimized frame to a colorblind person for view.

## Claims

### Claim 1

A method for automated image processing to improve visibility of colors having similar luminosities in a digital media application, the method comprising:
under control of a computing device comprising a hardware processor configured to execute software instructions:
identifying an image frame of a virtual environment in a digital media application;
identifying an initial value of a contrast and an initial value of a brightness of the image frame;
determining a Daltonization strength, a local contrast parameter, and a local brightness parameter of the image frame;
adjusting the contrast and the brightness of at least a portion of the image frame based on the local contrast parameter and the local brightness parameter;
applying a modified Daltonization process using, at least, the Daltonization strength to modify color values of the image frame, wherein the Daltonization process creates a modified image frame;
adjusting the contrast and the brightness of at least a portion of the modified image frame to create an enhanced image frame; and
generating instructions for rendering the enhanced image frame in the digital media application.

### Claim 2 (depends on 1)

The method of claim 1, wherein the digital media application is a video game.

### Claim 3 (depends on 1)

The method of claim 1, wherein the Daltonization strength is determined based, at least in part, on a color palette of the virtual environment.

### Claim 4 (depends on 1)

The method of claim 1, wherein determining the Daltonization strength, the local contrast parameter, and the local brightness parameter of the image frame comprises:
identifying a type of colorblindness associated with a user of the digital media application; and
accessing predetermined default values for the Daltonization strength, the local contrast parameter, and the local brightness parameter associated with the type of colorblindness.

### Claim 5 (depends on 1)

The method of claim 1, wherein adjusting the contrast and the brightness of the image frame based on the local contrast parameter and the local brightness parameter comprises increasing the contrast and the brightness of the image frame.

### Claim 6 (depends on 1)

The method of claim 1, wherein adjusting the contrast and the brightness of the modified image frame comprises adjusting the colors of the modified image frame to a lighter hue.

### Claim 7 (depends on 1)

The method of claim 1, wherein adjusting the contrast and the brightness of the modified image frame comprises restoring the contrast to the initial value of the contrast and restoring the brightness to the initial value of the brightness.

### Claim 8

A system for automated image processing to improve visibility of colors having similar luminosities in a digital media application, the system comprising:
a hardware processor configured to execute software instructions configured to:
identify an image frame of a virtual environment in a digital media application;
identify an initial value of a contrast and an initial value of a brightness of the image frame;
access a Daltonization strength, a local contrast parameter, and a local brightness parameter of the image frame;
adjust the contrast and the brightness of at least a portion of the image frame based, at least in part, on the local contrast parameter and the local brightness parameter;
apply a modified Daltonization process using, at least, the Daltonization strength to modify color values of the image frame, wherein the Daltonization process creates a modified image frame;
adjust the contrast and the brightness of at least a portion of the modified image frame to create an enhanced image frame; and
render the enhanced image frame within the digital media application; and
generate instructions for display of the enhanced image frame within a graphical user interface of the digital media application.

### Claim 9 (depends on 8)

The system of claim 8, wherein the graphical user interface is further configured to display the enhanced image frame of the virtual environment in the digital media application.

### Claim 10 (depends on 8)

The system of claim 8, wherein the Daltonization strength is determined based at least in part on a color palette of the virtual environment.

### Claim 11 (depends on 8)

The system of claim 8, wherein to access the Daltonization strength, the local contrast parameter, and the local brightness parameter of the image frame, the hardware processor is further configured to:
identify a type of colorblindness associated with a user of the digital media application; and
access default values for the Daltonization strength, the local contrast parameter, and the local brightness parameter associated with the type of colorblindness.

### Claim 12 (depends on 8)

The system of claim 8, wherein to modify the contrast and the brightness of the image frame based on the local contrast parameter and the local brightness parameter, the hardware processor is further configured to increase the contrast and the brightness of the image frame.

### Claim 13 (depends on 12)

The system of claim 12, wherein to adjust the contrast and the brightness of the color shifted representation of the image frame, the hardware processor is further configured to adjust the colors of the modified image frame to a lighter hue.

### Claim 14 (depends on 8)

The system of claim 8, wherein the hardware processor is a graphics processing unit.

### Claim 15

A non-transitory computer-readable medium having stored thereon a computer program, the computer program including executable instructions which configure a hardware processor to:
identify an image frame of a virtual environment in a digital media application;
identify an initial value of a contrast and an initial value of a brightness of the image frame;
access a Daltonization strength, a local contrast parameter, and a local brightness parameter of the image frame;
adjust the contrast and the brightness of at least a portion of the image frame based, at least in part, on the local contrast parameter and the local brightness parameter;
apply a modified Daltonization process using, at least, the Daltonization strength to modify color values of the image frame, wherein the Daltonization process creates a modified image frame;
adjust the contrast and the brightness of at least a portion of the modified image frame to create an enhanced image frame; and
render the enhanced image frame within the digital media application; and
generate instructions for display of the enhanced image frame within a graphical user interface of the digital media application.

### Claim 16 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the Daltonization strength is determined based at least in part on a color palette of the virtual environment.

### Claim 17 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein to access the Daltonization strength, the local contrast parameter, and the local brightness parameter of the image frame, the executable instructions further cause the hardware processor to:
identify a type of colorblindness associated with a user of the digital media application; and
access default values for the Daltonization strength, the local contrast parameter, and the local brightness parameter associated with the type of colorblindness.

### Claim 18 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein to modify the contrast and the brightness of the image frame based on the local contrast parameter and the local brightness parameter, the executable instructions further cause the hardware processor to increase the contrast and the brightness of the image frame.

### Claim 19 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein to adjust the contrast and the brightness of at least a portion of the modified image frame, the executable instructions further cause the hardware processor to adjust the color values of the modified image frame to a lighter hue.

### Claim 20 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein to adjust the contrast and the brightness of the modified image frame, the executable instructions further cause the hardware processor to restore the contrast to the initial value of the contrast and restoring the brightness to the initial value of the brightness.
