# US 2023/0410461 A1 · Efficient multi-scale orb without image resizing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0410461 A1
- Document ID: US20230410461A1
- Status: Published application
- Kind: A1
- Application number: 18/335,828
- Filed: 2023-06-15
- Published: 2023-12-21
- Earliest claimed: 2022-06-17
- Inventors: Nithin Gollahalli Ananda; Thomas Muttenthaler; Edward James Rosten; Daniel Wolf
- Web page: https://patentgrep.com/patent/US20230410461A1

## CPC

- G06V 10/443: {by matching or filtering}
- G06T 11/00: Two-dimensional [2D] image generation
- G06V 10/462: {Salient features, e.g. scale invariant feature transforms [SIFT]}
- G06V 10/751: {Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching}
- G06V 20/20: in augmented reality scenes
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A method for detecting a marker in a camera image is described. In one aspect, a method includes accessing a camera image generated by an optical sensor of an augmented reality (AR) device, accessing a query image from a storage of the AR device, and identifying, using a feature detector program, the query image in the camera image without scaling the camera image.

## Claims

### Claim 1

A method comprising:
accessing a camera image generated by an optical sensor of an augmented reality (AR) device;
accessing a query image from a storage of the AR device; and
identifying, using a feature detector program, the query image in the camera image without scaling the camera image.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
scaling a detector window of the feature detector program; and
extracting features from the camera image by scanning the unscaled camera image with the scaled detector.

### Claim 3 (depends on 2)

The method of claim 2, further comprising:
extracting features from the query image by scanning the query image with an unscaled detector.

### Claim 4 (depends on 3)

The method of claim 3, further comprising:
comparing descriptors based on the extracted features from the camera image with descriptors based on the extracted features from the query image.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
accessing a virtual content item corresponding to the query image; and
displaying the virtual content item in a display of the AR device.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
generating the camera image using a wide-angle lens coupled to the optical sensor.

### Claim 7 (depends on 1)

The method of claim 1, wherein the camera image includes a low resolution image.

### Claim 8 (depends on 1)

The method of claim 1, wherein the feature detector program includes ORB (Oriented FAST and Rotated BRIEF) local feature detector.

### Claim 9 (depends on 1)

The method of claim 1, wherein the feature detector program is configured to compare descriptors based on extracted features from the camera image using a scaled detector with descriptors based on extracted features from the query image using an unscaled detector.

### Claim 10 (depends on 1)

The method of claim 1, wherein the query image includes marker data that indicate a pre-defined visual code.

### Claim 11

A computing apparatus comprising:
a processor; and
a memory storing instructions that, when executed by the processor, configure the apparatus to:
access a camera image generated by an optical sensor of an augmented reality (AR) device;
access a query image from a storage of the AR device; and
identify, using a feature detector program, the query image in the camera image without scaling the camera image.

### Claim 12 (depends on 11)

The computing apparatus of claim 11, wherein the instructions further configure the apparatus to:
scale a detector window of the feature detector program; and
extract features from the camera image by scanning the unscaled camera image with the scaled detector.

### Claim 13 (depends on 12)

The computing apparatus of claim 12, wherein the instructions further configure the apparatus to:
extract features from the query image by scanning the query image with an unscaled detector.

### Claim 14 (depends on 13)

The computing apparatus of claim 13, wherein the instructions further configure the apparatus to:
compare descriptors based on the extracted features from the camera image with descriptors based on the extracted features from the query image.

### Claim 15 (depends on 11)

The computing apparatus of claim 11, wherein the instructions further configure the apparatus to:
access a virtual content item corresponding to the query image; and
display the virtual content item in a display of the AR device.

### Claim 16 (depends on 11)

The computing apparatus of claim 11, wherein the instructions further configure the apparatus to:
generate the camera image using a wide-angle lens coupled to the optical sensor.

### Claim 17 (depends on 11)

The computing apparatus of claim 11, wherein the camera image includes a low resolution image.

### Claim 18 (depends on 11)

The computing apparatus of claim 11, wherein the feature detector program includes ORB (Oriented FAST and Rotated BRIEF) local feature detector.

### Claim 19 (depends on 11)

The computing apparatus of claim 11, wherein the feature detector program is configured to compare descriptors based on extracted features from the camera image using a scaled detector with descriptors based on extracted features from the query image using an unscaled detector.

### Claim 20

A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computer, cause the computer to:
access a camera image generated by an optical sensor of an augmented reality (AR) device;
access a query image from a storage of the AR device; and
identify, using a feature detector program, the query image in the camera image without scaling the camera image.
