# US 2019/0172220 A1 · Method for Determining the Pose of a Camera and for Recognizing an Object of a Real Environment

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0172220 A1
- Document ID: US20190172220A1
- Status: Published application
- Kind: A1
- Application number: 16/258,110
- Filed: 2019-01-25
- Published: 2019-06-06
- Earliest claimed: 2009-10-19
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Peter Meier
- Web page: https://patentgrep.com/patent/US20190172220A1

## CPC

- G06T 7/73: using feature-based methods
- G06T 7/246: using feature-based methods, e.g. the tracking of corners or segments
- G06T 7/30: Determination of transform parameters for the alignment of images, i.e. image registration
- G06T 7/33: using feature-based methods
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06T 7/75: {involving models}
- G06V 10/245: {by locating a pattern; Special marks for positioning}
- G06V 10/768: {using context analysis, e.g. recognition aided by known co-occurring patterns}
- G06V 20/20: in augmented reality scenes
- G06T 2207/10012: Stereo images
- G06T 2207/30232: Surveillance
- G06T 2207/30244: Camera pose
- G06V 20/64: Three-dimensional [3D] objects
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A method for determining the pose of a camera relative to a real environment includes the following steps: taking at least one image of a real environment by means of a camera, the image containing at least part of a real object, performing a tracking method that evaluates information with respect to correspondences between features associated with the real object and corresponding features of the real object as it is contained in the image of the real environment, so as to obtain conclusions about the pose of the camera, determining at least one parameter of an environmental situation, and performing the tracking method in accordance with the at least one parameter. Analogously, the method can also be utilized in a method for recognizing an object of a real environment in an image taken by a camera.

## Claims

### Claim 1

A non-transitory computer readable medium comprising computer readable code which, when executed by one or more processors, causes the one or more processors to:
obtain an image captured by a camera, the image comprising a real environment including a real object;
determine a parameter value corresponding to an environmental parameter of the real environment;
select a data model based on the parameter value; and
detect the real object in the image based on the data model.

### Claim 2 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the computer readable code is further executable by the one or more processors to determine an uncertainty value associated with detection of the real object in the image based on a distance between the parameter value and a model parameter value of the environmental parameter associated with the data model.

### Claim 3 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the environmental parameter corresponds to a weather condition, a traffic condition, a time of day, an altitude, or a time of year.

### Claim 4 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the computer readable code is further executable by the one or more processors to select an object recognition algorithm based on the parameter value.

### Claim 5 (depends on 4)

The non-transitory computer readable medium of claim 4, wherein selecting the object recognition algorithm includes selecting between an edge feature detection algorithm and a corner feature detection algorithm.

### Claim 6 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the computer readable code is further executable by the one or more processors to obtain position data from a position sensor and determine the parameter value based on the position data and environmental report data.

### Claim 7 (depends on 6)

The non-transitory computer readable medium of claim 6, wherein the computer readable code is further executable by the one or more processors to obtain the environmental report data from a weather database.

### Claim 8 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein detecting the real object in the image based on the data model includes comparing features extracted from the image to the data model.

### Claim 9 (depends on 8)

The non-transitory computer readable medium of claim 8, wherein the computer readable code is further executable by the one or more processors to weight comparisons of the features to the data model based on the parameter value.

### Claim 10 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the computer readable code is further executable by the one or more processors to select the data model based on a distance between the parameter value and a model parameter value of the environmental parameter associated with the data model.

### Claim 11

A method comprising:
obtaining an image captured by a camera, the image comprising a real environment including a real object;
determining a parameter value corresponding to an environmental parameter of the real environment;
selecting a data model based on the parameter value; and
detecting the real object in the image based on the data model.

### Claim 12 (depends on 11)

The method of claim 11, further comprising determining an uncertainty value associated with detection of the real object in the image based on a distance between the parameter value and a model parameter value of the environmental parameter associated with the data model.

### Claim 13 (depends on 11)

The method of claim 11, wherein the environmental parameter corresponds to a weather condition, a traffic condition, a time of day, an altitude, or a time of year.

### Claim 14 (depends on 11)

The method of claim 11, further comprising selecting an object recognition algorithm based on the parameter value.

### Claim 15 (depends on 14)

The method of claim 14, wherein selecting the object recognition algorithm includes selecting between an edge feature detection algorithm and a corner feature detection algorithm.

### Claim 16 (depends on 11)

The method of claim 11, further comprising obtaining position data from a position sensor and determine the parameter value based on the position data and environmental report data.

### Claim 17 (depends on 16)

The method of claim 16, further comprising obtaining the environmental report data from a weather database.

### Claim 18

An apparatus comprising:
one or more processors; and
one or more memory devices storing instructions executable by the one or more processors to:
obtain an image captured by a camera, the image comprising a real environment including a real object;
determine a parameter value corresponding to an environmental parameter of the real environment;
select a data model based on the parameter value; and
detect the real object in the image based on the data model.

### Claim 19 (depends on 18)

The apparatus of claim 18, wherein the instructions are further executable by the one or more processors to determine an uncertainty value associated with detection of the real object in the image based on a distance between the parameter value and a model parameter value of the environmental parameter associated with the data model.

### Claim 20 (depends on 18)

The apparatus of claim 18, wherein the instructions are further executable by the one or more processors to select the data model based on a distance between the parameter value and a model parameter value of the environmental parameter associated with the data model.
