# US 2026/0073553 A1 · Tag survey using visual markers

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0073553 A1
- Document ID: US20260073553A1
- Status: Published application
- Kind: A1
- Application number: 18/883,724
- Filed: 2024-09-12
- Published: 2026-03-12
- Earliest claimed: 2024-09-12
- Assignees: QUALCOMM Incorporated
- Applicants: QUALCOMM Incorporated
- Inventors: Thomas ALLAN; Abhishek PRASAD; Tingting LIU; Joe THOMAS
- Web page: https://patentgrep.com/patent/US20260073553A1

## CPC

- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06T 7/74: {involving reference images or patches}
- G06T 2207/10016: Video; Image sequence
- G06T 2207/30204: Marker
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Systems and techniques are described for surveying devices. For example, an apparatus can obtain, from at least one camera sensor while the at least one camera sensor is traveling along a path, a plurality of images comprising a plurality of devices. Each image is obtained from a respective position of the at least one camera sensor along the path. Each device of the plurality of devices includes a respective visual marker. The apparatus can detect visual markers of the plurality of devices in the plurality of images and can determine an arrangement of the visual markers detected in the plurality of images. The apparatus can pair, based on aligning the arrangement of the visual markers with a first map comprising a corresponding arrangement of a plurality of objects, a respective object of the plurality of objects to each device of the plurality of devices.

## Claims

### Claim 1

An apparatus for surveying devices, the apparatus comprising:
at least one memory; and
at least one processor coupled to the at least one memory and configured to:
obtain, from at least one camera sensor while the at least one camera sensor is traveling along a path, a plurality of images comprising a plurality of devices, wherein each image of the plurality of images is obtained from a respective position of the at least one camera sensor along the path, and wherein each device of the plurality of devices comprises a respective visual marker;
detect visual markers of the plurality of devices in the plurality of images;
determine an arrangement of the visual markers detected in the plurality of images; and
pair, based on aligning the arrangement of the visual markers with a first map comprising a corresponding arrangement of a plurality of objects, a respective object of the plurality of objects to each device of the plurality of devices.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the arrangement of the visual markers comprises a respective height of each of the visual markers, and an order of the visual markers for each of the respective heights.

### Claim 3 (depends on 2)

The apparatus of claim 2, wherein the respective height for each of the visual markers corresponds to a respective shelf of a shelving unit associated with the first map.

### Claim 4 (depends on 1)

The apparatus of claim 1, wherein the first map is a planogram for the plurality of objects.

### Claim 5 (depends on 1)

The apparatus of claim 1, wherein the at least one processor is configured to determine, based on mapping the first map to a second map comprising known locations on the path, a respective location of each device of the plurality of devices.

### Claim 6 (depends on 5)

The apparatus of claim 5, wherein the at least one processor is configured to determine the respective location of each device of the plurality of devices is further based on performing triangulation using lines of sight from the known locations on the path to the visual markers in the plurality of images.

### Claim 7 (depends on 5)

The apparatus of claim 5, wherein the respective location of each device of the plurality of devices comprises coordinates in a real-world space.

### Claim 8 (depends on 5)

The apparatus of claim 5, wherein the second map is a building layout.

### Claim 9 (depends on 1)

The apparatus of claim 1, wherein each visual marker of the visual markers is a fiducial marker.

### Claim 10 (depends on 1)

The apparatus of claim 1, wherein two or more devices of the plurality of devices are mounted on a device rail.

### Claim 11 (depends on 1)

The apparatus of claim 1, wherein each device of the plurality of devices is an electronic tag or an electronic shelf label.

### Claim 12

A method for surveying devices, the method comprising:
obtaining, from at least one camera sensor while the at least one camera sensor is traveling along a path, a plurality of images comprising a plurality of devices, wherein each image of the plurality of images is obtained from a respective position of the at least one camera sensor along the path, and wherein each device of the plurality of devices comprises a respective visual marker;
detecting visual markers of the plurality of devices in the plurality of images;
determining an arrangement of the visual markers detected in the plurality of images; and
pairing, based on aligning the arrangement of the visual markers with a first map comprising a corresponding arrangement of a plurality of objects, a respective object of the plurality of objects to each device of the plurality of devices.

### Claim 13 (depends on 12)

The method of claim 12, wherein the arrangement of the visual markers comprises a respective height of each of the visual markers, and an order of the visual markers for each of the respective heights.

### Claim 14 (depends on 13)

The method of claim 13, wherein the respective height for each of the visual markers corresponds to a respective shelf of a shelving unit associated with the first map.

### Claim 15 (depends on 12)

The method of claim 12, wherein the first map is a planogram for the plurality of objects.

### Claim 16 (depends on 12)

The method of claim 12, further comprising determining, based on mapping the first map to a second map comprising known locations on the path, a respective location of each device of the plurality of devices.

### Claim 17 (depends on 16)

The method of claim 16, wherein determining the respective location of each device of the plurality of devices is further based on performing triangulation using lines of sight from the known locations on the path to the visual markers in the plurality of images.

### Claim 18 (depends on 16)

The method of claim 16, wherein the respective location of each device of the plurality of devices comprises coordinates in a real-world space.

### Claim 19 (depends on 12)

The method of claim 12, wherein each visual marker of the visual markers is a fiducial marker.

### Claim 20 (depends on 12)

The method of claim 12, wherein two or more devices of the plurality of devices are mounted on a device rail.
