# US 12,008,620 B2 · Artificial intelligence method for image analysis and item selection

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,008,620 B2
- Document ID: US12008620B2
- Status: Granted
- Kind: B2
- Application number: 17/527,591
- Filed: 2021-11-16
- Published: 2022-03-10
- Granted: 2024-06-11
- Earliest claimed: 2019-04-30
- Applicants: David Sazan
- Inventors: David Sazan
- Web page: https://patentgrep.com/patent/US12008620B2

## CPC

- G06Q 30/0625: {by formulating product or service queries, e.g. using keywords or predefined options}
- G06F 3/0484: for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F 18/2413: based on distances to training or reference patterns
- G06Q 30/0631: {Recommending goods or services}
- G06T 7/13: Edge detection
- G06T 7/73: using feature-based methods
- G06V 10/44: Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
- G06V 10/764: using classification, e.g. of video objects
- G06V 10/82: using neural networks
- G06V 20/20: in augmented reality scenes
- G06V 40/10: Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06T 2207/10016: Video; Image sequence
- G06T 2207/30196: Human being; Person
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A computer implemented method of image analysis is disclosed. The method comprises receiving, from a first computing device associated with a first human user, a communication indicating that the first human user has selected one or more items for purchase and has purchased the items; receiving, from the first computing device, identifying information of the items; identifying one or more merchants offering the items for sale; receiving one or more images depicting the first human user using the items; after receipt of the images, automatically determining, based on visual characteristics of the images, that the items are depicted in the images; and transmitting, for display to the second human user, an automatically generated augmented graphical user interface comprising the images and hyperlinks that convey the second human user to a merchant website allowing the second human user to purchase the items from the merchants.

## Claims

### Claim 1

A computer implemented method of image analysis, comprising:
receiving, from a first computing device associated with a first human user, a communication indicating that the first human user has selected one or more items for purchase and has purchased the one or more items;
receiving, from the first computing device, identifying information of the one or more items and corresponding identifiers of one or more merchants offering the one or more items for sale;
transmitting, from a second computing device, a request by a second human user associated with one or more images stored by either the second computing device or a third computing device, the one or more images depicting the first human user using the one or more items:
receiving the one or more images from the second computing device or the third computing device;
automatically determining, based on visual characteristics of the one or more images, that the one or more items are depicted in the one or more images, wherein the determining comprises determining a necessary color correction to an image based on a difference between a color of a region depicted in the one or more images and a known color of that region and applying the necessary color correction to the image before analysis to identify the one or more items;
transmitting, to the second computing device or a fourth computing device, for display by the second computing device or the fourth computing device, an automatically generated augmented graphical user interface comprising the one or more images and hyperlinks,
displaying by the second computing device or the fourth computing device, the augmented graphical user interface to the second human user;
determining that one of the hyperlinks has been activated by the second human user; and
conveying the second human user to a merchant website allowing the second human user to purchase the one or more items from the one or more merchants.

### Claim 2 (depends on 1)

The method of claim 1, wherein the one or more images comprise a video clip.

### Claim 3 (depends on 1)

The method of claim 1, wherein automatically determining that the one or more items are depicted in the one or more images comprises dividing the one or more images into regions based on edges detected within the one or more images.

### Claim 4 (depends on 1)

The method of claim 1, wherein automatically determining that the one or more items are depicted in the one or more images comprises identifying the first human user as being present in the one or more images using facial recognition.

### Claim 5 (depends on 1)

The method of claim 1, wherein automatically determining that the one or more items are depicted in the one or more images comprises identifying a text, logo, or design present in the one or more images which matches a corresponding text, logo, or design of the one or more items.

### Claim 6 (depends on 1)

The method of claim 1, wherein the first computing device is a mobile phone comprising a camera and a screen that displays an item entry interface.

### Claim 7 (depends on 1)

The method of claim 1, wherein the second computing device comprises memory storing non-transitory instructions that when executed by a processor of the second computing device, further cause the second computing device to:
automatically determine, based on visual characteristics of the one or more images, one or more items that visually correspond to items depicted in the one or more images but are not among the one or more items purchased by the first human user; and
wherein the automatically generated augmented graphical user interface also comprises hyperlinks that, when followed by the second user, will allow the second user to purchase the one or more items depicted in the one or more images that visually correspond to items depicted in the one or more images but are not among the one or more items purchased by the first human user.

### Claim 8 (depends on 1)

The method of claim 1, further comprising:
receiving an image depicting a person using an unidentified item that is not one of the one or more items;
automatically determining identities of one or more commercially available items which visually correspond to the unidentified item and are potential identifications of the unidentified item; and
automatically generating an augmented graphical user interface that comprises the one or more images, a visual highlighting of the unidentified item, an informational region that displays the one or more commercially available items, and a link within the informational region to an online store of a merchant from which one of the one or more commercially available items may be purchased.

### Claim 9 (depends on 1)

The method of claim 1, further comprising:
receiving access to a website shopping cart or online shopping history to obtain the identifying information of the one or more items purchased by the first human user.

### Claim 10 (depends on 1)

The method of claim 1, wherein the identifying information of the one or more items comprises a photograph of a bar code.

### Claim 11 (depends on 1)

The method of claim 1, wherein the identifying information of the one or more items comprises a photograph of a sales receipt.

### Claim 12 (depends on 1)

The method of claim 1, wherein the identifying information of the one or more items is accompanied by one or more reference photographs of the one or more items while in use by the first human user.

### Claim 13 (depends on 1)

The method of claim 1, wherein the automatically determining, based on visual characteristics of the one or more images, that the one or more items are depicted in the one or more images comprises identification of an event attended by the first human user during which the one or more images were captured.

### Claim 14 (depends on 1)

The method of claim 1, wherein a database for storing identifying information regarding items purchased by users and corresponding identifiers of merchants is updated in real time to include the one or more items and the corresponding identifiers of one or more merchants offering the one or more items for sale in response to the first human user purchasing the one or more items.