# US 2025/0148569 A1 · Image data alignment for mobile system sensors

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0148569 A1
- Document ID: US20250148569A1
- Status: Published application
- Kind: A1
- Application number: 18/500,278
- Filed: 2023-11-02
- Published: 2025-05-08
- Earliest claimed: 2023-11-02
- Assignees: Ford Global Technologies, LLC
- Applicants: Ford Global Technologies, LLC
- Inventors: David Michael Herman; Larry Dean Sanders; Akshay Vaidya
- Web page: https://patentgrep.com/patent/US20250148569A1

## CPC

- G06T 5/50: using two or more images, e.g. averaging or subtraction
- B60W 10/04: including control of propulsion units
- B60W 10/20: including control of steering systems
- B60W 50/0097: {Predicting future conditions}
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06T 7/90: Determination of colour characteristics
- G06V 10/56: relating to colour
- G06V 10/82: using neural networks
- G06V 20/58: Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- H04N 23/84: for processing colour signals
- B60W 60/001: {Planning or execution of driving tasks}
- B60W 2420/403: Image sensing, e.g. optical camera
- G06T 2207/10024: Color image
- G06T 2207/10152: Varying illumination
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/30256: Lane; Road marking
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A computer that includes a processor and a memory, the memory including instructions executable by the processor to determine a first prediction with a machine learning system based on receiving a first image from a first camera and determine a second prediction with a machine learning system based on receiving a second image from a second camera. When the first prediction does not equal the second prediction within a user determined tolerance, determine color consistency based on comparing pixel values from the first image with a threshold determined based on previously determined pixel values, determine color correction parameters by determining pixel statistics based on pixel values from the first image to include in an image signal processing system and apply the color correction parameters to a third image from the first camera by receiving the third image at the image signal processing system.

## Claims

### Claim 1

A system, comprising:
a computer that includes a processor and a memory, the memory including instructions executable by the processor to:
determine a first prediction with a machine learning system based on receiving a first image from a first camera;
determine a second prediction with the machine learning system based on receiving a second image from a second camera;
when the first prediction does not equal the second prediction within a user determined tolerance:
determine color consistency based on comparing pixel values from the first image with a threshold determined based on previously determined pixel values;
determine color consistency parameters by determining pixel statistics based on pixel values from the first image and the second image to include in an image signal processing system; and
apply the color consistency parameters to the second image from the second camera with the image signal processing system.

### Claim 2 (depends on 1)

The system of claim 1, the instructions including further instructions to determine the threshold by varying pixel values in a training dataset image input to a machine learning system to determine when a prediction output changes based on the pixel values.

### Claim 3 (depends on 1)

The system of claim 1, wherein the pixel statistics include a pixel mean and a pixel standard deviation.

### Claim 4 (depends on 1)

The system of claim 1, wherein the color consistency parameters include one or more of lens shading, white balance, defect pixel, denoise, color interpolation, edge enhancement, color correction matrix, brightness/contrast, and gamma.

### Claim 5 (depends on 1)

The system of claim 1, wherein the color consistency is based on determining one or more of camera color consistency, spatial color consistency, and temporal color consistency on the images.

### Claim 6 (depends on 5)

The system of claim 5, wherein camera color consistency is determined by comparing images acquired by different cameras viewing the same scene with the same illumination.

### Claim 7 (depends on 5)

The system of claim 5, wherein spatial color consistency is determined by comparing overlapping images acquired by different cameras viewing portions of the same scene with differing illumination.

### Claim 8 (depends on 5)

The system of claim 5, wherein temporal color consistency is determined by comparing images acquired by the camera viewing the same scene at different times.

### Claim 9 (depends on 1)

The system of claim 1, wherein the first prediction and the second prediction include one or more of object identity and object location.

### Claim 10 (depends on 9)

The system of claim 9, wherein the object identity includes one or more of a roadway and a vehicle.

### Claim 11 (depends on 1)

The system of claim 1, wherein the machine learning system includes a convolutional neural network that includes convolutional layers and fully connected layers.

### Claim 12 (depends on 1)

The system of claim 1, the instruction including further instructions to convert a red, green, blue (RGB) color space image to a luma, red projection, blue projection (YUV) image and outputting the image.

### Claim 13 (depends on 1)

The system of claim 1, wherein the machine learning system is included in a mobile machine.

### Claim 14 (depends on 13)

The system of claim 13, wherein the mobile machine is operated based on the one or more predictions.

### Claim 15 (depends on 14)

The system of claim 14, wherein the mobile machine is a vehicle and the vehicle is operated by controlling one or more of vehicle propulsion and vehicle steering.

### Claim 16

A method, comprising:
determining a first prediction with a machine learning system based on receiving a first image from a first camera;
determining a second prediction with the machine learning system based on receiving a second image from a second camera;
when the first prediction does not equal the second prediction within a user determined tolerance:
determining color consistency based on comparing pixel values from the first image with a threshold determined based on previously determined pixel values;
determining color consistency parameters by determining pixel statistics based on pixel values from the first image to include in an image signal processing system; and
applying the color consistency parameters to a third image from the first camera by receiving the third image at the image signal processing system.

### Claim 17 (depends on 16)

The method of claim 16, further comprising determining the threshold by varying pixel values in a training dataset image input to a machine learning system to determine when a prediction output changes based on the pixel values.

### Claim 18 (depends on 16)

The method of claim 16, wherein the pixel statistics include a pixel mean and a pixel standard deviation.

### Claim 19 (depends on 16)

The method of claim 16, wherein the color consistency parameters include one or more of lens shading, white balance, defect pixel, denoise, color interpolation, edge enhancement, color correction matrix, brightness/contrast, and gamma.

### Claim 20 (depends on 16)

The method of claim 16, wherein the color consistency is based on determining one or more of camera color consistency, spatial color consistency, and temporal color consistency on the images.
