# US 2020/0401987 A1 · Goods information obtaining device, shelf, shelf managing system and method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0401987 A1
- Document ID: US20200401987A1
- Status: Published application
- Kind: A1
- Application number: 16/491,312
- Filed: 2019-03-15
- Published: 2020-12-24
- Earliest claimed: 2018-06-25
- Assignees: Boe Technology Group Co., Ltd.
- Applicants: Boe Technology Group Co., Ltd.
- Inventors: Wei DENG; Hongyan PEI; Xin LI; Tianyue ZHAO
- Web page: https://patentgrep.com/patent/US20200401987A1

## CPC

- B65G 1/1371: {with data records}
- G06Q 10/087: Inventory or stock management, e.g. order filling, procurement or balancing against orders
- B65G 1/02: Storage devices (furniture A47B; shop fittings A47F)
- G02B 7/182: for mirrors
- G06Q 10/08724: {by shelf level inventory management, e.g. planograms}
- G06T 3/4038: Image mosaicing, e.g. composing plane images from plane sub-images
- G06T 7/0002: {Inspection of images, e.g. flaw detection}
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- H04N 23/695: Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
- H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
- A47F 2010/025: {using stock management systems}
- B65G 2203/041: Camera
- B65G: TRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS (packaging B65B; handling thin or filamentary materials, e.g. paper sheets or thread, B65H; cranes B66C; portable mobile or lifting or hauling appliances, e.g. hoists, B66D; devices for lifting or lowering goods for loading or unloading purposes, e.g. fork-lift trucks, B66F9/00; emptying bottles, jars, casks, barrels or similar containers, not otherwise provided for, B67C9/00; delivering or transferring liquids B67D; filling or discharging vessels for liquefied, solidified or compressed gases F17C; pipe-line systems for fluids F17D)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- A47F: SPECIAL FURNITURE, FITTINGS, OR ACCESSORIES FOR SHOPS, STOREHOUSES, BARS, RESTAURANTS OR THE LIKE; PAYING COUNTERS

## Abstract

The present disclosure relates to a goods information obtaining device, a shelf, a shelf managing system and a method. A goods information obtaining device for obtaining goods information within a shelf unit, includes: at least one reflector; and at least one image sensor for sensing a reflection image of goods within the shelf unit that are reflected one or more times by the at least one reflector.

## Claims

### Claim 1

A goods information obtaining device for obtaining goods information within a shelf unit, comprising:
at least one reflector; and
at least one image sensor for sensing a reflection image of goods within the shelf unit that are reflected one or more times by the at least one reflector.

### Claim 2 (depends on 1)

The goods information obtaining device according to claim 1, wherein each of the at least one reflector comprises a plane mirror or a convex mirror.

### Claim 3 (depends on 1)

The goods information obtaining device according to claim 1, wherein the at least one image sensor comprises a plurality of image sensors, and viewing angles of lenses of the plurality of image sensors adjoin or partially coincide respectively each other at a coverage area of the at least one reflector.

### Claim 4 (depends on 1)

The goods information obtaining device according to claim 1, further comprising a driver for driving the at least one image sensor or the at least one reflector to move, such that a viewing angle of a lens of each of the at least one image sensor covers reflection images of different portions of the goods on the at least one reflector at different moments.

### Claim 5 (depends on 1)

A shelf, comprising:
a shelf unit for containing goods; and
the goods information obtaining device according to claim 1.

### Claim 6 (depends on 5)

The shelf according to claim 5, wherein the at least one reflector is located on one side of a top of the shelf unit close to the goods, and each of the at least one image sensor comprises a lens, wherein the lens has a viewing angle covering at least a portion of the at least one reflector.

### Claim 7 (depends on 6)

The shelf according to claim 6, wherein the lens has a height no higher than a height of the goods.

### Claim 8 (depends on 7)

The shelf according to claim 7, wherein the height of lens is configured to be flush with a bottom plane of the shelf unit.

### Claim 9 (depends on 5)

The shelf according to claim 5, wherein the shelf unit has an open end for accessing the goods, and the at least one image sensor is located within the shelf unit and on one side of the shelf unit away from the open end.

### Claim 10 (depends on 9)

The shelf according to claim 9, wherein the shelf unit further has a closed end, where the at least one image sensor is located.

### Claim 11 (depends on 8)

The shelf according to claim 8, wherein a minimum distance d between the lens and the goods satisfies:
d
=
H

(
2

D
′
-
H
)
W
;
where W is a maximum distance between the goods and the lens, H is a height of the goods, and D′ is a minimum spatial height of the shelf unit.

### Claim 12 (depends on 5)

The shelf according to claim 5, wherein the at least one reflector comprises:
a first reflector, located on one side of a top of the shelf unit close to the goods; and
a second reflector, located on one side opposite to the first reflector;
wherein each of the at least one image sensor comprises a lens having an orientation configured such that a viewing angle of the lens covers at least a portion of the second reflector.

### Claim 13 (depends on 5)

The shelf according to claim 5, wherein the at least one reflector is located external to the shelf unit.

### Claim 14 (depends on 1)

A shelf managing system, comprising:
the goods information obtaining device according to claim 1; and
a processor for processing the reflection image.

### Claim 15 (depends on 14)

The shelf managing system according to claim 14, wherein the processor is configured to perform at least one of the following operations:
analyzing the reflection image to obtain goods information related to placement within the shelf unit;
stitching reflection images to form a complete reflection image of the goods within the shelf unit; or
detecting whether the goods placed within the shelf unit are out of stock or are wrong goods according to the reflection image.

### Claim 16 (depends on 5)

A shelf managing system, comprising:
the shelf according to claim 5; and
a processor for processing the reflection images.

### Claim 17 (depends on 16)

The shelf managing system according to claim 16, wherein the processor is configured to perform at least one of the following operations:
analyzing the reflection image to obtain goods information related to placement within the shelf unit;
stitching reflection images to form a complete reflection image of the goods within the shelf unit; or
detecting whether the goods placed within the shelf unit are out of stock or are wrong goods according to the reflection image.

### Claim 18

A shelf managing method, comprising:
sensing by an image sensor a reflection image of goods within a shelf unit that are reflected one or more times by at least one reflector;
analyzing the reflection image to obtain goods information related to placement within the shelf unit.

### Claim 19 (depends on 18)

The shelf managing method according to claim 18, further comprising:
judging whether the goods placed within the shelf unit are out of stock or are wrong goods according to the goods information related to placement.

### Claim 20 (depends on 18)

The shelf managing method according to claim 18, further comprising:
stitching reflection images to form a complete reflection image of the goods within the shelf unit.