US 10,122,915 B2Granted

Method and device for panoramic image processing

AssigneeTrax Technology Solutions Pte Ltd.

InventorsHilit Maayan, Daniel Shimon Cohen, Jacob Greenshpan

Life of this patent

Estimating the term…

Loading patent…

Abstract

The present disclosure provides a method for providing an indication about a distance between a retail unit and an electronic device, comprising: acquiring from an image sensor in a retail establishment, at least one image of a product on a store shelf; accessing in a memory that stores a plurality of templates associated with a plurality of differing products, a template associated with the product on the store shelf in the at least one acquired image; comparing at least one dimension associated with the product in the at least one acquired image with at least one dimension associated with the accessed template; based on the comparison, determining whether a distance between the image sensor and the product on the store shelf is within an acceptable range for additional image processing; and providing a notification to a user of the electronic device to adjust the distance between the image sensor and the product on the shelf when the product is outside of the acceptable range.

Claims20

Dependent claims

A non-transitory computer readable medium including instructions that when executed by a processor cause the processor to perform a method for scanning a retail unit including a plurality of store shelves using an electronic device, the method comprising:

acquiring from an image sensor in a retail store environment, a plurality of images of at least one product on a store shelf of the retail unit by moving the electronic device along a scanning direction parallel to a horizontal plane associated with the store shelf;
accessing a memory that stores a plurality of templates associated with a plurality of differing products, wherein each of the plurality of templates is a visual representation of a product;
identifying in the memory a template with a visual representation of a product that matches the at least one product on the store shelf in the plurality of acquired images;
comparing dimensions of the at least one product in the plurality of acquired images with dimensions of the visual representation of the product in the identified template;
based on the dimensions comparison between the at least one product in the plurality of acquired images and the visual representation of the product in the identified template, determining whether a distance between the image sensor and the at least one product on the store shelf is within an acceptable range for additional image processing;
displaying on a display screen configured to display in real time the plurality of images being acquired a notification to adjust the distance between the image sensor and the at least one product on the shelf when the at least one product is outside of the acceptable range;
determining a vertical drift of the electronic device during the acquiring of the plurality of images, wherein the vertical drift is a change in an actual scanning direction relative to a predetermined scanning direction and the change is in a direction perpendicular to the predetermined scanning direction;
and
displaying on the display screen a visual indicator indicative of the determined vertical drift.

6 more elements

A handheld electronic device, comprising:

an image sensor for acquiring, in a retail store environment establishment, a plurality of images of at least one product on a store shelf by moving the electronic device along a scanning direction parallel to a horizontal plane associated with the store shelf;
a display screen configured to display in real time the plurality of images being acquired;
a processor configured to:
access a memory that stores a plurality of templates associated with a plurality of differing products, wherein each of the plurality of templates is a visual representation of a product;
identify in the memory a template that matches the at least one product on the store shelf in the plurality of acquired images;
compare dimensions of the at least one product in the plurality of acquired images with dimensions of the visual representation of the product in the identified template;
based on the dimensions comparison between the at least one product in the plurality of acquired images and the visual representation of the product in the identified template, determine whether a distance between the image sensor and the at least one product on the store shelf is within an acceptable range for additional image processing;
display on the display screen a notification to adjust the distance between the image sensor and the at least one product on the shelf when the at least one product is outside of the acceptable range;
determine a vertical drift of the electronic device during acquiring of the plurality of images, wherein the vertical drift is a change in an actual scanning direction relative to a predetermined scanning direction and the change is in a direction perpendicular to the predetermined scanning direction;
and
display on the display screen a visual indicator indicative of the determined vertical drift.

8 more elements

Dependencies are inferred from the claim text.

Facts

Application: 15/187,276Filed 20 Jun 2016 · continuation
Priority: 9 Jan 2014
Published: US 2016/0309082 A120 Oct 2016
Granted: 6 Nov 2018
Term ends: Not estimatedThe source records don’t support an estimate.

Classification7 codes

H04N 23/64
Control of cameras or camera modules: computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality,…
G06T 3/20
Geometric image transformations in the plane of the image: linear translation of whole images or parts thereof, e.g. panning
G06T 3/40
Geometric image transformations in the plane of the image: scaling of whole images or parts thereof, e.g. expanding or contracting
H04N 5/265
Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the…: mixing

Family

Application14/151,011Parent of this continuation · filed 9 Jan 2014
US 2016/0309082 A1Pre-grant publication · published 20 Oct 2016
US 2015/0193909 A1Published application
US 10,122,915 B2This patent

From the US filing history. Foreign family members aren’t listed.

Timeline

Citations

Open elsewhere

Building an agent or pulling many patents? Use the API or MCP server instead of scraping pages. Get an API key