# US 12,008,736 B2 · Methods, systems, and program products for generating altered images based on ON-OFF visual pathway information

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,008,736 B2
- Document ID: US12008736B2
- Status: Granted
- Kind: B2
- Application number: 17/556,921
- Filed: 2021-12-20
- Published: 2022-06-23
- Granted: 2024-06-11
- Earliest claimed: 2020-12-18
- Assignees: The Research Foundation for The State University of New York
- Applicants: The Research Foundation for the State University of New York
- Inventors: Hamed Rahimi Nasrabadi; José-Manuel Alonso
- Web page: https://patentgrep.com/patent/US12008736B2

## CPC

- G06T 5/50: using two or more images, e.g. averaging or subtraction
- G06T 5/90: Dynamic range modification of images or parts thereof
- G06T 7/90: Determination of colour characteristics
- G06V 10/56: relating to colour
- G06V 10/60: relating to illumination properties, e.g. using a reflectance or lighting model
- G06T 2207/10024: Color image
- G06T 2207/10081: Computed x-ray tomography [CT]
- G06T 2207/10088: Magnetic resonance imaging [MRI]
- G06T 2207/10116: X-ray image
- G06T 2207/10132: Ultrasound image
- G06T 2207/20212: Image combination
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Images may be altered based on ON-OFF visual pathway information processing. A process for generating altered images may include separating an original image into distinct images based on luminance values for each pixel of the pixels that form the original image. The distinct images may include a first and a second separated image, where each separated image includes distinct pixels. Additionally, the process may include determining a first luminance range for the first separated image based on the luminance value for each pixel forming the first separated image, and determining a second luminance range for the second separated image based on the luminance value for each pixel forming the second separated image. The process may also include adjusting visual parameters of the first and second separated images, and combining the adjusted, first and second separated images to generate the altered image.

## Claims

### Claim 1

A method for generating an altered image, the method comprising:
separating an original image into distinct images based on a luminance value for each pixel of a plurality of pixels forming the original image, the distinct images including:
a first separated image formed from a first group of pixels of the original image, and
a second separated image formed from a second group of pixels of the original image, the second group of pixels distinct form the first group of pixels;
determining a first luminance range for the first separated image, the first luminance range based on the luminance value for each pixel of the first group of pixels of the first separated image;
determining a second luminance range for the second separated image, the second luminance range based on the luminance value for each pixel of the second group of pixels,
wherein the second luminance range is distinct from the first luminance range;
adjusting visual parameters of the first separated image formed from the first group of pixels based on a first luminance function;
adjusting visual parameters of the second separated image formed from the second group of pixels based on a second luminance function; and
combining the adjusted, first separated image and the adjusted, second separated image to generate the altered image.

### Claim 2 (depends on 1)

The method of claim 1, further comprises:
calculating a mean luminance value for the original image based on the luminance value for each pixel of the plurality of pixels forming the original image.

### Claim 3 (depends on 2)

The method of claim 2, wherein the separating of the original image into the two distinct images further comprises:
comparing the luminance value for each pixel of the plurality of pixels to the calculated mean luminance value for the original image;
associating a pixel of the plurality pixels with the first group of pixels included in the first separated image in response to determining the luminance value of the pixel is less than or equal to the mean luminance value; and
associating the pixel of the plurality pixels with the second group of pixels included in the second separated image in response to determining the luminance value of the pixel is greater than the mean luminance value.

### Claim 4 (depends on 1)

The method of claim 1, wherein the first separated image corresponds to an OFF image, and the second separated image corresponds to an ON image.

### Claim 5 (depends on 1)

The method of claim 1, wherein the generated, altered image includes a single image formed from the combined adjusted, first separated image and the adjusted, second separated image.

### Claim 6 (depends on 1)

The method of claim 1, wherein the separating of the original image into the distinct images further including:
separating the original image into a plurality of single-color images;
separating each single-color image of the plurality of single-color image into the distinct images, each of the distinct images including:
the first separated image formed from the first group of pixels of the single-color image, and
the second separated image formed from the second group of pixels of the single-color image, the second group of pixels distinct form the first group of pixels.

### Claim 7 (depends on 6)

The method of claim 6, wherein the plurality of single-color images include:
a red color image;
a green color image; and
a blue color image.

### Claim 8

A system comprising:
an image capture device; and
at least one computing device operably connected to the image capture device, the at least one computing device generating an altered image from an original image captured by the image capture device by performing processes including:
separating an original image into distinct images based on a luminance value for each pixel of a plurality of pixels forming the original image, the distinct images including:
a first separated image formed from a first group of pixels of the original image, and
a second separated image formed from a second group of pixels of the original image, the second group of pixels distinct form the first group of pixels;
determining a first luminance range for the first separated image, the first luminance range based on the luminance value for each pixel of the first group of pixels of the first separated image;
determining a second luminance range for the second separated image, the second luminance range based on the luminance value for each pixel of the second group of pixels,
wherein the second luminance range is distinct from the first luminance range;
adjusting visual parameters of the first separated image formed from the first group of pixels based on a first luminance function;
adjusting visual parameters of the second separated image formed from the second group of pixels based on a second luminance function; and
combining the adjusted, first separated image and the adjusted, second separated image to generate the altered image.

### Claim 9 (depends on 8)

The system of claim 8, wherein the at least one computing device performing further processes including:
calculating a mean luminance value for the original image based on the luminance value for each pixel of the plurality of pixels forming the original image.

### Claim 10 (depends on 9)

The system of claim 9, wherein the separating of the original image into the two distinct images further comprises:
comparing the luminance value for each pixel of the plurality of pixels to the calculated mean luminance value for the original image;
associating a pixel of the plurality pixels with the first group of pixels included in the first separated image in response to determining the luminance value of the pixel is less than or equal to the mean luminance value; and
associating the pixel of the plurality pixels with the second group of pixels included in the second separated image in response to determining the luminance value of the pixel is greater than the mean luminance value.

### Claim 11 (depends on 8)

The system of claim 8, wherein the first separated image corresponds to an OFF image, and the second separated image corresponds to an ON image.

### Claim 12 (depends on 8)

The system of claim 8, wherein the generated, altered image includes a single image formed from the combined adjusted, first separated image and the adjusted, second separated image.

### Claim 13 (depends on 8)

The system of claim 8, wherein the separating of the original image into the distinct images further including:
separating the original image into a plurality of single-color images;
separating each single-color image of the plurality of single-color image into the distinct images, each of the distinct images including:
the first separated image formed from the first group of pixels of the single-color image, and
the second separated image formed from the second group of pixels of the single-color image, the second group of pixels distinct form the first group of pixels.

### Claim 14 (depends on 13)

The system of claim 13, wherein the plurality of single-color images include:
a red color image;
a green color image; and
a blue color image.

### Claim 15 (depends on 8)

The system of claim 8, wherein the image capture device includes at least one of:
a photography camera,
a video camera,
a scanner,
an x-ray imaging device,
a computed tomography (CT) device,
an ultrasound device, or
a magnetic resonance imagining (MM) device.

### Claim 16

A computer program product stored on a non-transitory computer-readable storage medium, which when executed by a computing system, generates an altered image based on an original image captured by an image capture device, the computer program product comprising:
program code that separates an original image into distinct images based on a luminance value for each pixel of a plurality of pixels forming the original image, the distinct images including:
a first separated image formed from a first group of pixels of the original image, and
a second separated image formed from a second group of pixels of the original image, the second group of pixels distinct form the first group of pixels;
program code that determines a first luminance range for the first separated image, the first luminance range based on the luminance value for each pixel of the first group of pixels of the first separated image;
program code that determines a second luminance range for the second separated image, the second luminance range based on the luminance value for each pixel of the second group of pixels,
wherein the second luminance range is distinct from the first luminance range;
program code that adjusts visual parameters of the first separated image formed from the first group of pixels based on a first luminance function;
program code that adjusts visual parameters of the second separated image formed from the second group of pixels based on a second luminance function; and
program code that combines the adjusted, first separated image and the adjusted, second separated image to generate the altered image.

### Claim 17 (depends on 16)

The program product of claim 16, further comprises:
program code that calculates a mean luminance value for the original image based on the luminance value for each pixel of the plurality of pixels forming the original image.

### Claim 18 (depends on 17)

The program product of claim 17, wherein the program code that separates the original image into the two distinct images further comprises:
program code that compares the luminance value for each pixel of the plurality of pixels to the calculated mean luminance value for the original image;
program code that associates a pixel of the plurality pixels with the first group of pixels included in the first separated image in response to determining the luminance value of the pixel is less than or equal to the mean luminance value; and
program code that associates the pixel of the plurality pixels with the second group of pixels included in the second separated image in response to determining the luminance value of the pixel is greater than the mean luminance value.

### Claim 19 (depends on 16)

The program product of claim 16, wherein the first separated image corresponds to an OFF image, and the second separated image corresponds to an ON image.

### Claim 20 (depends on 16)

The program product of claim 16, wherein the program code that separates the original image into the distinct images further including:
program code that separates the original image into a plurality of single-color images, the plurality of single-color images including:
a red color image;
a green color image; and
a blue color image;
program code that separates each single-color image of the plurality of single-color image into the distinct images, each of the distinct images including:
the first separated image formed from the first group of pixels of the single-color image, or
the second separated image formed from the second group of pixels of the single-color image, the second group of pixels distinct form the first group of pixels.