# US 12,114,082 B2 · Shelf-mountable imaging system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,114,082 B2
- Document ID: US12114082B2
- Status: Granted
- Kind: B2
- Application number: 17/681,378
- Filed: 2022-02-25
- Published: 2022-10-06
- Granted: 2024-10-08
- Earliest claimed: 2022-02-25
- Assignees: Target Brands, Inc.
- Applicants: Target Brands, Inc.
- Inventors: Anup Jayapal Rao; Sunay Narkar; Sanjay Bhokse; Sandeep Tammana; Karthik Raju; Abby P Joby; Hithyshi M; Kurmanadharao Valla; Shanavas M S; Wasim Salih Thari
- Web page: https://patentgrep.com/patent/US12114082B2

## CPC

- A47F 10/02: for self-service type systems, e.g. supermarkets (A47F10/06 takes precedence; hand-carts B62B; baskets B65D)
- G06F 1/3246: by software initiated power-off
- G06F 1/325: {Power saving in peripheral device}
- G06K 17/0022: {arrangements or provisions for transferring data to distant stations, e.g. from a sensing device ("transfer between computer elements G06F13/00 "; data-transmission H04L)}
- G06Q 10/08726: {for replenishment processing, procedures, or recommendations using forecasting or optimisation}
- G06Q 10/0874: {Inventory fulfillment (shipping G06Q10/083)}
- G06Q 20/203: {Inventory monitoring}
- G06Q 20/208: {Input by product or record sensing, e.g. weighing or scanner processing}
- H04N 23/54: Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
- H04N 23/61: based on recognised objects
- H04N 23/617: Upgrading or updating of programs or applications for camera control
- H04N 23/65: Control of camera operation in relation to power supply
- H04N 23/661: Transmitting camera control signals through networks, e.g. control via the Internet
- H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
- A47F 2010/025: {using stock management systems}
- G06Q 10/087: Inventory or stock management, e.g. order filling, procurement or balancing against orders
- H04N 23/57: Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
- A47F: SPECIAL FURNITURE, FITTINGS, OR ACCESSORIES FOR SHOPS, STOREHOUSES, BARS, RESTAURANTS OR THE LIKE; PAYING COUNTERS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06K: GRAPHICAL DATA READING (image or video recognition or understanding G06V); PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An imaging system capture images of products on shelves in a minimally invasive way. The images can be processed to assess restocking needs and other information. The imaging system includes multiple shelf-mountable imaging devices that can be positioned throughout one or more retail locations. Certain types of imaging devices may be self-contained units having replaceable or rechargeable internal power sources and/or wireless communication interfaces. Certain types of imaging device are configured to take images only when the field of view is not blocked by traffic (e.g., consumers, employees, etc.). Certain types of imaging devices are low-profile and/or are camouflageable to enhance the user experience.

## Claims

### Claim 1

An imaging system for use in capture of images of shelf stock at a retail location, the retail location including a plurality of retail product shelves arranged in a plurality of aisles, each of the retail product shelves having opposite top and bottom sides extending along a length and along a depth of the retail product shelf, the length of each retail product shelf extending along the respective aisle, the depth of each retail product shelf extending between a rear and a front edge of the retail product shelf, the imaging system comprising:
a plurality of self-contained imaging devices each mounted to the bottom side of one of the retail product shelves, each of the imaging devices comprising:
a housing mounted to the bottom side of the respective retail product shelf so that a viewing portion extends forwardly of the front edge of the retail product shelf while a majority of the housing remains flush or recessed from the front edge of the respective retail product shelf;
an image sensor disposed at the viewing portion of the housing and oriented toward an opposed retail product shelf on an opposite side of the aisle from the respective retail product shelf;
a main processor circuit disposed within the housing, the main processor circuit being configured to manage the image sensor;
a wireless communication interface disposed at the housing, the wireless communication interface being managed by the main processor circuit to communicate images obtained from the image sensor to a remote aggregation device; and
a replaceable internal power source disposed within the housing, the internal power source being configured to supply power to the image sensor, the main processor circuit, and the wireless communication interface.

### Claim 2 (depends on 1)

The imaging system of claim 1, wherein the image sensor of each of the imaging devices is a first image sensor; and wherein each of the imaging devices also includes a second image sensor disposed at the viewing portion of the housing and oriented towards the opposed retail product shelf, wherein the first image sensor faces partially in a first direction along the length of the retail product shelf and the second image sensor faces partially in an opposite second direction along the length of the retail product shelf.

### Claim 3 (depends on 2)

The imaging system of claim 2, wherein the first and second image sensors have at least partially overlapping fields of view.

### Claim 4 (depends on 1)

The imaging system of claim 1, wherein each of the imaging devices further comprises:
a companion circuit communicatively connected to the main processor circuit, the companion circuit including a wireless communication interface, the companion circuit being configured to:
determine that an update to operational instructions should be performed;
temporarily disable a sleep mode of the main processor circuit and the companion circuit;
initiate wireless communication with a remote server storing updated operational instructions;
obtain the updated operational instructions from the remote server via the wireless communication;
store the updated operational instructions in a memory reserved for instructions executed by the main processor circuit; and
initiate a reboot of the main processor circuit.

### Claim 5 (depends on 1)

The imaging system of claim 1, wherein each of the imaging devices has a sleep mode, a wake-up mode, an image capture mode, an internal transfer mode, and an external transfer mode, wherein the main processor circuit obtains a motion sensor reading when the imaging device is transitioned to the wake-up mode, wherein the imaging device transfers image data from the image sensors to a companion circuit memory during the internal transfer mode, and wherein the imaging device transfers the image data from the companion circuit memory to the remote aggregation device during the external transfer mode.

### Claim 6 (depends on 2)

The imaging system of claim 2, wherein each of the imaging devices includes a motion sensor disposed at the housing and managed by the main processor circuit, wherein the main processor circuit only instructs the image sensor to obtain an image when the motion sensor does not detect motion.

### Claim 7 (depends on 1)

The imaging system of claim 1, wherein the retail product shelf to which a first of the imaging devices is mounted includes a flat main portion and an angled front edge; and wherein the housing is configured to conform to the flat main portion and to the angled front edge, and wherein the majority of the housing is disposed behind the angled front edge.

### Claim 8 (depends on 1)

The imaging system of claim 1, wherein the replaceable internal power source includes at least one battery mounted within a removable carriage, wherein the carriage is removable without removing the housing from the respective retail product shelf.

### Claim 9 (depends on 1)

The imaging system of claim 1, wherein the housing is configured to provide access to the internal power source for replacement while the viewing portion remains stationary relative to the respective retail product shelf.

### Claim 10 (depends on 1)

The imaging system of claim 1, wherein a film is disposed at the viewing portion of the housing to extend over the image sensor.

### Claim 11 (depends on 1)

The imaging system of claim 1, wherein multiple ones of the imaging devices are disposed along a common one of the retail product shelves, the imaging devices being spaced apart along the length of the common one of the retail product shelves sufficient so that an entirety of the opposed retail product shelf is within a combined field of view of the multiple ones of the imaging devices.

### Claim 12 (depends on 1)

The imaging system of claim 1, further comprising the remote aggregation device configured to receive images from the imaging devices via the wireless communication interface, the remote aggregation device including an image processing server.

### Claim 13

An imaging system for use in capture of images of shelf stock at a retail location, the retail location including a plurality of retail product shelves arranged in a plurality of aisles, each of the retail product shelves having opposite top and bottom sides extending along a length and along a depth of the retail product shelf, the length of each retail product shelf extending along the respective aisle, the depth of each retail product shelf extending between a rear and a front edge of the retail product shelf, and each retail product shelf having an angled extension extending downwardly from the retail product shelf, the imaging system comprising:
a plurality of self-contained imaging devices each mounted to the bottom side of one of the retail product shelves so that a main portion of each imaging device is disposed behind the angled extension of the respective retail product shelf, the main portion of each imaging device defining an access aperture, each of the imaging devices comprising:
a plurality of image sensors disposed at a viewing portion of the housing that extends beneath the angled extension;
a wireless communication interface disposed within the main portion of the housing, the wireless communication interface being configured to communicate images obtained from the image sensors to a remote aggregation device;
a network communication controller and wireless network interface disposed within the main portion of the housing; and
a replaceable internal power source disposed within the main portion of the housing, the internal power source being configured to supply power to the image sensors, the wireless communication interface, and the network communication controller, the replaceable internal power source being removable from the main portion of the housing through the access aperture without removing the main portion of the housing from the respective retail product shelf.

### Claim 14 (depends on 13)

The imaging system of claim 13, wherein the main portion of the housing of a first of the imaging devices defines the access aperture at one side of the main portion of the housing; and wherein the housing of the first imaging device also includes a door slidably mounted over the access aperture to selectively cover and expose the access aperture.

### Claim 15 (depends on 14)

The imaging device of claim 14, wherein the internal power source of the first imaging device includes a plurality of batteries mounted to a carriage that is removably mounted within the main portion of the housing, the carriage aligning with the access aperture, and the carriage being spring biased towards the access aperture.

### Claim 16 (depends on 14)

The imaging device of claim 14, wherein the main portion of the housing of the first imaging device includes a recessed reset button disposed at an opposite side of the main portion of the housing from the access aperture.

### Claim 17 (depends on 14)

The imaging device of claim 14, wherein the door is configured to remain coupled to the main portion of the housing even when the access aperture is exposed.

### Claim 18 (depends on 13)

The imaging system of claim 13, wherein each of imaging devices includes a motion sensor arrangement mounted to the viewing portion of the housing.

### Claim 19 (depends on 13)

The imaging system of claim 13, wherein the plurality of image sensors of one of the imaging devices have overlapping fields of view.

### Claim 20 (depends on 13)

The imaging device of claim 13, further comprising a plurality of mounting plates, wherein the main portion of each housing is configured to mount to the bottom side of the respective retail product shelf and a respective one of the mounting plates is configured to mount to the top side of the respective retail product shelf so that fasteners extend through the retail product shelf between the housing and the mounting plate.