Method, computer program product, and system for producing combined image information to provide extended vision
AssigneeToshiba Global Commerce Solutions Holdings Corporation
InventorsMonsak Jason Chirakansakcharoen, Dean Frederick Herring, Ankit Singh, David John Steiner
Life of this patent
Estimating the term…
Abstract
Method, computer program product, and system to provide an extended vision within an environment having a plurality of items, where the extended vision is based on a field of view of a person determined using a first visual sensor, and is further based on at least a second visual sensor disposed within the environment. Image information from the first and second visual sensors is associated to produce combined image information. Selected portions of the combined image information are displayed based on input provided through a user interface.
Claims20
A computer-implemented method to provide an extended vision within an environment having a plurality of items available for selection by a person, the method comprising:
- analyzing first image information acquired using a first visual sensor within the environment to determine a field of view of the person, wherein the first visual sensor is coupled with a first computing device that is body-worn or carried by the person;
- analyzing second image information acquired using a plurality of second visual sensors disposed within the environment, wherein the plurality of second visual sensors are coupled with a second computing device;
- determining that an arrangement of the plurality of second visual sensors results in at least a first deadspace area within the environment, the first deadspace area representing a first portion of the environment that is not represented in the second image information acquired using any of the plurality of second visual sensors;
- determining, using stored location data describing a planned arrangement for placement of the plurality of items within the environment, one or more items of the plurality of items that are within or adjacent to the first deadspace area;
- transmitting, to the first computing device, a prompt suggesting that the person should acquire image information corresponding to the first deadspace area, wherein the prompt comprises a suggestion for the one or more items;
- upon determining that the field of view of the person includes the one or more items, storing at least a portion of the first image information in a memory of the second computing device;
- and
- generating a combined image information using at least (i) the stored portion of the first image information, and (ii) a portion of the second image information.
A computer program product to provide an extended vision within an environment having a plurality of items available for selection by a person, the computer program product comprising:
- a computer-readable storage medium having computer-readable program code embodied therewith, the computer-readable program code executable by one or more computer processors to perform an operation that includes:
- analyzing first image information acquired using a first visual sensor within the environment to determine a field of view of the person, wherein the first visual sensor is coupled with a first computing device that is body-worn or carried by the person;
- analyzing second image information acquired using a plurality of second visual sensors disposed within the environment, wherein the plurality of second visual sensors are coupled with a second computing device;
- determining that an arrangement of the plurality of second visual sensors results in at least a first deadspace area within the environment, the first deadspace area representing a first portion of the environment that is not represented in the second image information acquired using any of the plurality of second visual sensors;
- determining, using stored location data describing a planned arrangement for placement of the plurality of items within the environment, one or more items of the plurality of items that are within or adjacent to the first deadspace area;
- transmitting, to the first computing device, a prompt suggesting that the person should acquire image information corresponding to the first deadspace area, wherein the prompt comprises a suggestion for the one or more items;
- upon determining that the field of view of the person includes the one or more items, storing at least a portion of the first image information in a memory of the second computing device;
- and
- generating a combined image information using at least (i) the stored portion of the first image information, and (ii) a portion of the second image information.
A system to provide an extended vision within an environment having a plurality of items available for selection by a person, the system comprising:
- a plurality of computer processors, at least one processor included in a first computing device associated with the person, and at least one other processor included in at least one second computing device associated with the environment and communicatively coupled with the first computing device;
- a first visual sensor communicatively coupled with the first computing device, the first visual sensor disposed within the environment and configured to acquire first image information;
- and
- a plurality of second visual sensors that are communicatively coupled with the at least one second computing device, the plurality of second visual sensors disposed within the environment and configured to acquire second image information,
- wherein the plurality of computer processors are configured to perform an operation that includes:
- determining that an arrangement of the plurality of second visual sensors results in at least a first deadspace area within the environment, the first deadspace area representing a first portion of the environment that is not represented in the second image information acquired using any of the plurality of second visual sensors;
- determining, using stored location data describing a planned arrangement for placement of the plurality of items within the environment, one or more items of the plurality of items that are within or adjacent to the first deadspace area;
- transmitting, to the first computing device, a prompt suggesting that the person should acquire image information corresponding to the first deadspace area, wherein the prompt comprises a suggestion for the one or more items;
- upon determining that the field of view of the person includes the one or more items, storing at least a portion of the first image information in a memory of the second computing device;
- and
- generating a combined image information using at least (i) the stored portion of the first image information, and (ii) a portion of the second image information.
Dependencies are inferred from the claim text.