# US 2019/0057257 A1 · Method and system to provide the details about the product item that the user is looking for and providing the navigation map for the selected item presented in the store

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0057257 A1
- Document ID: US20190057257A1
- Status: Published application
- Kind: A1
- Application number: 15/681,378
- Filed: 2017-08-19
- Published: 2019-02-21
- Earliest claimed: 2017-08-19
- Assignees: Johnson Manuel-Devadoss
- Inventors: Johnson Manuel-Devadoss
- Web page: https://patentgrep.com/patent/US20190057257A1

## CPC

- G06Q 30/0639: {Locating goods or services, e.g. based on physical position of the goods or services within a shopping facility}
- G01C 21/3476: {using point of interest [POI] information, e.g. a route passing visible POIs}
- G06V 10/255: {Detecting or recognising potential candidate objects based on visual cues, e.g. shapes}
- G06V 20/20: in augmented reality scenes
- G01C 21/206: {specially adapted for indoor navigation}
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Disclosed is a method and system to provide the details about an item and in-store navigation to the item. A user may leverage the present invention to capture an image using camera device to analyze and determine more details about it. The present invention may leverage the deep learning techniques to analyze the given image to determine a plurality of items presented in the image. In one embodiment, the present invention highlights a plurality of items from the image to allow user to select an item. Once user chosen an item from the highlighted objected from the image, the present invention provides more detailed information about the item along with related items to the chosen item and provides a list of stores that may have the item. In another embodiment, the present invention provides the in-store navigation to the chosen item presented in the chosen store.

## Claims

### Claim 1

A method, comprising:
analyzing a mobile computing captured image to identify a plurality of objects presented;
highlighting a plurality of identified objects from mobile computing captured image for user to choose a particular object;
retrieving a plurality of information for user chosen object from highlighted plurality of objects;
providing a plurality of stores for user chosen object from highlighted plurality of objects;
providing an in-store navigation map to a chosen object from a plurality of identified objects.

### Claim 2 (depends on 1)

The method of claim 1, wherein identified a plurality of objects is plurality of object detection using deep learning technique from provided captured image by user.

### Claim 3 (depends on 1)

The method of claim 1, wherein chosen object is an object selected by user from a highlighted plurality of objects in captured image to determine object features and where to buy.

### Claim 4 (depends on 1)

The method of claim 1, wherein in-store navigation map is providing a navigational route to a chosen object that is presented in chosen store.

### Claim 5

A system, comprising:
a processor; and
a memory coupled with the processor, wherein the memory is configured to provide the processor with instructions which when executed cause the processor to:
analyzing a mobile computing captured image to identify a plurality of objects presented;
highlighting a plurality of identified objects from mobile computing captured image for user to choose a particular object;
retrieving a plurality of information for user chosen object from highlighted plurality of objects;
providing a plurality of stores for user chosen object from highlighted plurality of objects;
providing an in-store navigation map to a chosen object from a plurality of identified objects.

### Claim 6 (depends on 5)

The system of claim 5, wherein identified a plurality of objects is plurality of object detection using deep learning technique from provided captured image by user.

### Claim 7 (depends on 5)

The system of claim 5, wherein chosen object is an object selected by user from a highlighted plurality of objects in captured image to determine object features and where to buy.

### Claim 8 (depends on 5)

The system of claim 5, wherein in-store navigation map is providing a navigational route to a chosen object that is presented in chosen store.

### Claim 9

A computer program product, the computer program product being embodied in a tangible non-transitory computer readable storage medium and comprising computer instructions for:
analyzing a mobile computing captured image to identify a plurality of objects presented;
highlighting a plurality of identified objects from mobile computing captured image for user to choose a particular object;
retrieving a plurality of information for user chosen object from highlighted plurality of objects;
providing a plurality of stores for user chosen object from highlighted plurality of objects;
providing an in-store navigation map to a chosen object from a plurality of identified objects.

### Claim 10 (depends on 9)

The computer program product of claim 9, wherein identified a plurality of objects is plurality of object detection using deep learning technique from provided captured image by user.

### Claim 11 (depends on 9)

The computer program product of claim 9, wherein chosen object is an object selected by user from a highlighted plurality of objects in captured image to determine object features and where to buy.

### Claim 12 (depends on 9)

The computer program product of claim 9, wherein in-store navigation map is providing a navigational route to a chosen object that is presented in chosen store.
