# US 2012/0250978 A1 · Scene analysis using image and range data

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0250978 A1
- Document ID: US20120250978A1
- Status: Published application
- Kind: A1
- Application number: 13/309,558
- Filed: 2011-12-01
- Published: 2012-10-04
- Earliest claimed: 2010-12-01
- Assignees: The Trustees of the University of Pennsylvania
- Inventors: Camillo Jose Taylor
- Web page: https://patentgrep.com/patent/US20120250978A1

## CPC

- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G06T 7/11: Region-based segmentation
- G06T 7/292: Multi-camera tracking
- G06T 2207/30241: Trajectory
- H04N 7/181: {for receiving images from a plurality of remote sources}
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Image and range data associated with an image can be processed to estimate planes within the 3D environment in the image. By utilizing image segmentation techniques, image data can identify regions of visible pixels having common features. These regions can be used to candidate regions for fitting planes to the range data based on a RANSAC technique.

## Claims

### Claim 1

A method for identifying a feature in an image comprising steps of:
receiving an image having color image data and depth information;
identifying a first set of segments, including a first segment, in the image using an image segmenting technique;
identifying a first set of 3D points associated with the first segment in the depth information; and
estimating a plane that describes the 3D points associated with the first segment.

### Claim 2 (depends on 1)

The method of claim 1, wherein the step of estimating a plane comprises using a RANdom SAmple Consensus to estimate a best fitting plane.

### Claim 3 (depends on 1)

The method of claim 1, wherein the steps of identifying a first set of 3D points and estimating a plane that describes the 3D points are repeated for each segment in the first set of segments.

### Claim 4 (depends on 1)

The method of claim 1, further comprising the step of determining a first subset of the first set of segments based on the size of each segment, wherein the steps of identifying a first set of 3D points and estimating a plane that describes the 3D points are repeated for each segment in the first subset of segments.
