# US 2019/0171975 A1 · Dynamic Progress Recognition and Recommendations Based on Machine Learning

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0171975 A1
- Document ID: US20190171975A1
- Status: Published application
- Kind: A1
- Application number: 15/830,175
- Filed: 2017-12-04
- Published: 2019-06-06
- Earliest claimed: 2017-12-04
- Assignees: Bank of America Corporation
- Applicants: Bank of America Corporation
- Inventors: Manu Kurian; Matthew E. Carroll
- Web page: https://patentgrep.com/patent/US20190171975A1

## CPC

- G06N 20/00: Machine learning
- G02B 27/0172: {characterised by optical features}
- G06Q 30/00: Commerce
- G06Q 30/0251: Targeted advertisements
- G06Q 30/0281: {Customer communication at a business location, e.g. providing product or service information, consulting}
- G06Q 30/0282: Rating or review of business operators or products
- G06Q 30/0631: {Recommending goods or services}
- G06V 20/20: in augmented reality scenes
- G02B 27/017: {Head mounted}
- G02B 2027/014: {comprising information/image processing systems}
- G02B 2027/0141: {characterised by the informative content of the display}
- G06N 5/046: Forward inferencing; Production systems
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Systems for dynamically recognizing progress and generating recommendations are provided. In some examples, a system may image data from an augmented reality device. The image data may include video images, still images, images of machine-readable code, and the like. The received image data may be analyzed in real-time to identify an object within the data. In some examples, machine learning may be used to identify one or more characteristics of the object. The identified characteristics may be compared to one or more pre-defined goals or limits and a notification may be generated based on the comparison. The notification may be transmitted to the augmented reality device and displayed on the augmented reality device. In some examples, based on the comparison, machine learning may be used to generate one or more recommendations and a notification may be generated including the recommendations and may be transmitted to the augmented reality device for display.

## Claims

### Claim 1

A system, comprising:
an augmented reality device of a user; and
a dynamic progress recognition and recommendation computing platform in communication with the augmented reality device, the dynamic progress recognition and recommendation computing platform, comprising:
at least one processor;
a communication interface communicatively coupled to the at least one processor; and
memory storing computer-readable instructions that, when executed by the at least one processor, cause the dynamic progress recognition and recommendation computing platform to:
receive, from the augmented reality device of the user, image data;
analyze, in real-time, the image data using at least one of: object recognition and optical character recognition to identify an object within the image;
determine, using one or more machine learning datasets, at least one characteristic of the identified object;
compare the determined at least one characteristic of the identified object to a pre-defined goal of the user;
generate a notification based on the comparing; and
transmit the generated notification to the augmented reality device of the user.

### Claim 2 (depends on 1)

The system of claim 1, wherein generating the notification based on the comparing further includes instructions that, when executed, cause the dynamic progress recognition and recommendation computing platform to:
identify, based on the comparison and the one or more machine learning datasets, a recommended alternative object; and
generate the notification including the recommended alternative object.

### Claim 3 (depends on 1)

The system of claim 1, further including instructions that, when executed, cause the dynamic progress recognition and recommendation computing platform to:
cause the generated notification to be displayed on the augmented reality device of the user.

### Claim 4 (depends on 1)

The system of claim 1, wherein the image data is at least one of: video images and still images.

### Claim 5 (depends on 1)

The system of claim 1, wherein the image data includes an image of a machine-readable code arranged on the object.

### Claim 6 (depends on 1)

The system of claim 1, wherein the augmented reality device is a wearable device.

### Claim 7 (depends on 6)

The system of claim 6, wherein the augmented reality device includes augmented reality glasses.

### Claim 8 (depends on 1)

The system of claim 1, wherein the at least one characteristic is at least one of: price and nutritional value.

### Claim 9 (depends on 1)

The system of claim 1, wherein the pre-defined goal of the user is a budget associated with a category of goods.

### Claim 10

A method, comprising:
at a computing platform comprising at least one processor, memory, and a communication interface:
receiving, by the at least one processor and from an augmented reality device of a user via the communication interface, image data;
analyzing, in real-time and by the at least one processor, the image data using at least one of: object recognition and optical character recognition to identify an object within the image;
determining, by the at least one processor and using one or more machine learning datasets, at least one characteristic of the identified object;
comparing, by the at least one processor, the determined at least one characteristic of the identified object to a pre-defined goal of the user;
generating, by the at least one processor, a notification based on the comparing; and
transmitting, by the at least one processor, the generated notification to the augmented reality device of the user.

### Claim 11 (depends on 10)

The method of claim 10, wherein generating the notification based on the comparing further includes:
identifying, by the at least one processor and based on the comparison and the one or more machine learning datasets, a recommended alternative object; and
generating, by the at least one processor, the notification including the recommended alternative object.

### Claim 12 (depends on 10)

The method of claim 10, further including:
causing, by the at least one processor, the generated notification to be displayed on the augmented reality device of the user.

### Claim 13 (depends on 10)

The method of claim 10, wherein the image data includes at least one of: video images and still images.

### Claim 14 (depends on 10)

The method of claim 10, wherein the image data includes an image of a machine-readable code arranged on the object.

### Claim 15 (depends on 10)

The method of claim 10, wherein the augmented reality device is a wearable device.

### Claim 16 (depends on 15)

The method of claim 15, wherein the augmented reality device includes augmented reality glasses.

### Claim 17 (depends on 10)

The method of claim 10, wherein the at least one characteristic is at least one of: price and nutritional value.

### Claim 18 (depends on 10)

The method of claim 10, wherein the pre-defined goal of the user is a budget associated with a category of goods.

### Claim 19

One or more non-transitory computer-readable media storing instructions that, when executed by a computing platform comprising at least one processor, memory, and a communication interface, cause the computing platform to:
receive, from an augmented reality device of a user, image data;
analyze, in real-time, the image data using at least one of: object recognition and optical character recognition to identify an object within the image;
determine, using one or more machine learning datasets, at least one characteristic of the identified object;
compare the determined at least one characteristic of the identified object to a pre-defined goal of the user;
generate a notification based on the comparing; and
transmit the generated notification to the augmented reality device of the user.

### Claim 20 (depends on 19)

The one or more non-transitory computer-readable media of claim 19, wherein generating the notification based on the comparing further includes instructions that, when executed, cause the computing platform to:
identify, based on the comparison and the one or more machine learning datasets, a recommended alternative object; and
generate the notification including the recommended alternative object.

### Claim 21 (depends on 19)

The one or more non-transitory computer-readable media of claim 19, further including instructions that, when executed, cause the computing platform to:
cause the generated notification to be displayed on the augmented reality device of the user.

### Claim 22 (depends on 19)

The one or more non-transitory computer-readable media of claim 19, wherein the image data includes at least one of: video images, still images and an image of a machine-readable code.

### Claim 23 (depends on 19)

The one or more non-transitory computer-readable media of claim 19, wherein the augmented reality device is a wearable device.

### Claim 24 (depends on 23)

The one or more non-transitory computer-readable media of claim 23, wherein the augmented reality device includes augmented reality glasses.

### Claim 25 (depends on 19)

The one or more non-transitory computer-readable media of claim 19, wherein the at least one characteristic is at least one of: price and nutritional value.

### Claim 26 (depends on 19)

The one or more non-transitory computer-readable media of claim 19, wherein the pre-defined goal of the user is a budget associated with a category of goods.
