# US 2016/0253793 A1 · Detecting Object Presence on a Target Surface

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0253793 A1
- Document ID: US20160253793A1
- Status: Published application
- Kind: A1
- Application number: 14/634,717
- Filed: 2015-02-27
- Published: 2016-09-01
- Earliest claimed: 2015-02-27
- Assignees: Cognex Corporation
- Applicants: Cognex Corporation
- Inventors: Cyril C. Marrion; Nickolas James Mullan
- Web page: https://patentgrep.com/patent/US20160253793A1

## CPC

- G06T 7/0008: {checking presence/absence}
- G06T 7/85: {Stereo camera calibration}
- G06T 2207/10012: Stereo images
- G06T 2207/10028: Range image; Depth image; 3D point clouds
- G06T 2207/30208: Marker matrix
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Described are methods, systems, apparatus, and computer program products for determining the presence of an object on a target surface. A machine vision system includes a first image capture device configured to image a first portion of a target surface from a first viewpoint and a second image capture device configured to image a second portion of the target surface from a second viewpoint. The machine vision system is configured to acquire a first image from the first image capture device, a second image from the second image capture device, rectify the first image and second image, retrieve a disparity field, generate difference data by comparing, based on the mappings of the disparity field, image elements in the first rectified image and a second image elements in the second rectified image; and determine whether the difference data is indicative of an object on the target surface.

## Claims

### Claim 1

A machine vision system comprising:
a first image capture device configured to image a first portion of a target surface from a first viewpoint;
a second image capture device configured to image a second portion of the target surface from a second viewpoint, wherein the first portion of the target surface at least partially overlaps the second portion of the target surface;
a machine vision processor connected to the first image capture device and the second image capture device, the machine vision processor configured to:
acquire a first image of the target surface from the first image capture device;
acquire a second image of the target surface from the second image capture device;
rectify the first image to form a first rectified image and rectify the second image to form a second rectified image;
retrieve a disparity field that provides mappings from a first plurality of coordinates in the first rectified image to a second plurality of coordinates in the second rectified image;
generate difference data by comparing, based on the mappings of the disparity field, a first plurality of image elements in the first rectified image to a second plurality of image elements in the second rectified image; and
determine whether the difference data is indicative of an object on the target surface.

### Claim 2 (depends on 1)

The machine vision system of claim 1, wherein the first image capture device and the second image capture device are a camera and, wherein the camera is configured to image the first portion of the target surface from the first viewpoint and image the second portion of the target surface from the second viewpoint approximately simultaneously.

### Claim 3 (depends on 1)

The machine vision system of claim 1, wherein the first image capture device is a first camera and the second image capture device is a second camera.

### Claim 4 (depends on 1)

The machine vision system of claim 1, wherein the machine vision processor is configured to acquire the first image and the second image substantially simultaneously.

### Claim 5 (depends on 1)

The machine vision system of claim 1, wherein the first plurality of image elements is a first plurality of pixel values.

### Claim 6 (depends on 5)

The machine vision system of claim 5, wherein the plurality of pixel values are at least one of grey scale values, hue values, gradient values, and reflectance values.

### Claim 7 (depends on 1)

The machine vision system of claim 1, wherein the target surface is one of a conveyor belt, tray and a receptacle.

### Claim 8 (depends on 1)

The machine vision system of claim 1, wherein the difference data comprises a plurality of difference values, and wherein the machine vision processor is configured to form the difference data by, for each image element of the first plurality of image elements:
generating a difference value by applying one or more difference functions to the element and a corresponding element of the second plurality of image elements, wherein a correspondence between the element and the corresponding element is based on the disparity field.

### Claim 9 (depends on 1)

The machine vision system of claim 1, wherein the machine vision processor is configured to apply at least one of a filtering algorithm and a shape-finding algorithm to the difference data to determine whether the difference data is indicative of the object on the target surface.

### Claim 10

A method executed by a machine vision system comprising:
acquiring, by the machine vision system, a first image of the target surface from a first viewpoint;
acquiring, by the machine vision system, a second image of the target surface from a second viewpoint, wherein the first image and the second image are captured from distinct viewpoints;
rectifying, by the machine vision system, the first image to form a first rectified image and the second image to form a second rectified image;
retrieving, by the machine vision system, a disparity field that provides mappings from a first plurality of coordinates in the first rectified image to a second plurality of coordinates in the second rectified image;
generating, by the machine vision system, difference data by comparing, based on the mappings of the disparity field, a first plurality of image elements in the first rectified image to a second plurality of image elements in the second rectified image; and
determining, by the machine vision system, whether the difference data is indicative of an object on the target surface.

### Claim 11 (depends on 10)

The method of claim 10, wherein the first image and the second image are captured by a camera and, wherein the camera is configured to image the target surface from the first viewpoint and image the target surface from the second viewpoint approximately simultaneously.

### Claim 12 (depends on 10)

The method of claim 10, wherein the first image is captured by a first camera and the second image is captured by a second camera.

### Claim 13 (depends on 10)

The method of claim 10, further comprising acquiring the first image and the second image substantially simultaneously.

### Claim 14 (depends on 10)

The method of claim 10, wherein the first plurality of image elements is a first plurality of pixel values.

### Claim 15 (depends on 14)

The method of claim 14, wherein the plurality of pixel values are at least one of grey scale values, hue values, gradient values, and reflectance values.

### Claim 16 (depends on 10)

The method of claim 10, wherein the target surface is one of a conveyor belt, tray and a receptacle.

### Claim 17 (depends on 10)

The method of claim 10, wherein the difference data comprises a plurality of difference values, and wherein the method further comprises forming the difference data by, for each image element of the first plurality of image elements:
generating a difference value by applying one or more difference functions to the element and a corresponding element of the second plurality of image elements, wherein a correspondence between the element and the corresponding element is based on the disparity field.

### Claim 18 (depends on 10)

The method of claim 10, further comprising applying, by the machine vision system, at least one of a filtering algorithm and a shape-finding algorithm to the difference data to determine whether the difference data is indicative of the object on the target surface.
