# US 2019/0313570 A1 · System and method for determining crop residue fraction using blind source separation of color images

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0313570 A1
- Document ID: US20190313570A1
- Status: Published application
- Kind: A1
- Application number: 16/298,002
- Filed: 2019-03-11
- Published: 2019-10-17
- Earliest claimed: 2018-04-17
- Assignees: HRL Laboratories, LLC
- Applicants: HRL Laboratories, LLC
- Inventors: Yuri Owechko
- Web page: https://patentgrep.com/patent/US20190313570A1

## CPC

- G06T 7/11: Region-based segmentation
- A01B 79/005: {Precision agriculture}
- G06F 18/2134: based on separation criteria, e.g. independent component analysis
- G06T 7/136: involving thresholding
- G06T 7/62: of area, perimeter, diameter or volume
- G06T 7/90: Determination of colour characteristics
- G06V 20/10: Terrestrial scenes (scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59)
- A01D 41/127: Control or measuring arrangements specially adapted for combines
- G06T 2207/10016: Video; Image sequence
- G06T 2207/10024: Color image
- G06T 2207/30188: Vegetation; Agriculture
- G06T 2207/30252: Vehicle exterior; Vicinity of vehicle
- G06V 10/56: relating to colour
- G09G 2340/06: Colour space transformation
- H04N 1/54: Conversion of colour picture signals to a plurality of signals some of which represent particular mixed colours, e.g. for textile printing
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- A01B: SOIL WORKING IN AGRICULTURE OR FORESTRY; PARTS, DETAILS, OR ACCESSORIES OF AGRICULTURAL MACHINES OR IMPLEMENTS, IN GENERAL (making or covering furrows or holes for sowing, planting or manuring A01C5/00; mowers convertible to soil working apparatus or capable of soil working A01D42/04; mowers combined with soil working implements A01D43/12; soil working for engineering purposes E01, E02, E21)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- A01D: HARVESTING; MOWING
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Described is a system for determining crop residue fraction. The system includes a color video camera mounted on a mobile platform for generating a two-dimensional (2D) color video image of a scene in front or behind the mobile platform. In operation, the system separates the 2D color video image into three separate one-dimensional (1D) mixture signals for red, green, and blue channels. The three 1D mixture signals are then separated into pure 1D component signals using blind source separation. The 1D component signals are thresholded and converted to 2D binary, pixel-level abundance maps, which can then be integrated to allow the system to determine a total component fractional abundance of crop in the scene. Finally, the system can control a mobile platform, such as a harvesting machine, based on the total component fractional abundance of crop in the scene.

## Claims

### Claim 1

A system for determining crop residue fraction, the system comprising:
a color video camera mounted on a mobile platform for generating a two-dimensional (2D) color video image of a scene in front or behind the mobile platform;
one or more processors and a memory, the memory being a non-transitory computer-readable medium having executable instructions encoded thereon, such that upon execution of the instructions, the one or more processors perform operations of:
separating the 2D color video image into three separate one-dimensional (1D) mixture signals for red, green, and blue channels;
separating the three 1D mixture signals into pure 1D component signals using blind source separation;
thresholding and converting the 1D component signals to 2D binary, pixel-level abundance maps; and
determining a total component fractional abundance of crop in the scene by integrating the abundance maps.

### Claim 2 (depends on 1)

The system as set forth in claim 1, further comprising an operation of controlling the mobile platform based on the total component fractional abundance of crop in the scene.

### Claim 3 (depends on 1)

The system as set forth in claim 1, wherein the blind source separation is independent component analysis.

### Claim 4 (depends on 1)

The system as set forth in claim 1, wherein the abundance maps represent relative abundance levels of plant, plant residue, and soil in the scene in front of or behind the mobile platform.

### Claim 5

A computer program product for determining crop residue fraction, the computer program product comprising:
a non-transitory computer-readable medium having executable instructions encoded thereon, such that upon execution of the instructions by one or more processors, the one or more processors perform operations of:
receiving a two-dimensional (2D) color image of a scene in front or behind a mobile platform;
separating the 2D color video image into three separate one-dimensional (1D) mixture signals for red, green, and blue channels;
separating the three 1D mixture signals into pure 1D component signals using blind source separation;
thresholding and converting the 1D component signals to 2D binary, pixel-level abundance maps; and
determining a total component fractional abundance of crop in the scene by integrating the abundance maps.

### Claim 6 (depends on 5)

The computer program product as set forth in claim 5, further comprising an operation of controlling the mobile platform based on the total component fractional abundance of crop in the scene.

### Claim 7 (depends on 5)

The computer program product as set forth in claim 5, wherein the blind source separation is independent component analysis.

### Claim 8 (depends on 5)

The computer program product as set forth in claim 5, wherein the abundance maps represent relative abundance levels of plant, plant residue, and soil in the scene in front of or behind the mobile platform.

### Claim 9

A computer implemented method for determining crop residue fraction, the method comprising an act of:
causing one or more processers to execute instructions encoded on a non-transitory computer-readable medium, such that upon execution, the one or more processors perform operations of:
receiving a two-dimensional (2D) color image of a scene in front or behind a mobile platform;
separating the 2D color video image into three separate one-dimensional (1D) mixture signals for red, green, and blue channels;
separating the three 1D mixture signals into pure 1D component signals using blind source separation;
thresholding and converting the 1D component signals to 2D binary, pixel-level abundance maps; and
determining a total component fractional abundance of crop in the scene by integrating the abundance maps.

### Claim 10 (depends on 9)

The method as set forth in claim 9, further comprising an operation of controlling the mobile platform based on the total component fractional abundance of crop in the scene.

### Claim 11 (depends on 9)

The method as set forth in claim 9, wherein the blind source separation is independent component analysis.

### Claim 12 (depends on 9)

The method as set forth in claim 9, wherein the abundance maps represent relative abundance levels of plant, plant residue, and soil in the scene in front of or behind the mobile platform.
