# US 9,519,924 B2 · Method for collective network of augmented reality users

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 9,519,924 B2
- Document ID: US9519924B2
- Status: Granted
- Kind: B2
- Application number: 15/045,185
- Filed: 2016-02-16
- Published: 2016-06-09
- Granted: 2016-12-13
- Earliest claimed: 2011-03-08
- Assignees: Bank of America Corporation
- Applicants: Bank of America Corporation
- Inventors: Matthew A. Calman; Erik Stephen Ross; Alfred Hamilton
- Web page: https://patentgrep.com/patent/US9519924B2

## CPC

- G06Q 30/0605: {Pooling transaction partners, e.g. group buying or group selling}
- G06Q 10/42: Determination of affinities or common interests between users
- G06Q 30/02: Marketing; Price estimation or determination; Fundraising
- G06Q 30/0613: {using intermediate agents}
- G06Q 30/0623: {by investigating goods or services}
- G06Q 30/0635: {replenishment orders; recurring orders}
- G06Q 30/0641: {utilising user interfaces specially adapted for shopping}
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G09G 5/003: {Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto (specific for a CRT G09G1/165; for a flat panel G09G3/2092)}
- H04L 65/403: Arrangements for multi-party communication, e.g. for conferences (data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15)
- H04L 65/60: Network streaming of media packets
- G09G 2370/022: Centralised management of display operation, e.g. in a server instead of locally
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

Embodiments of the invention provide for using video analysis, such as augmented reality or the like to assist a group of users to utilize mobile devices for creating a collective network environment of users that identifies objects in which one or more users in a group of users may be interested, and notifies the one or more users of information associated with the object. A collective network comprises a group of users that each have a mobile device that contains or is otherwise operatively coupled to a data capture device. For example, the mobile device may be a mobile phone that is capable of taking video with a camera device. A user in the collective network may capture video on his mobile device, and an application can identify the object in the video and provide interested users in the collective network with information about the object.

## Claims

### Claim 1

A method for utilizing one or more collective networks of users with image capture devices to identify objects captured using the image capture devices and provide offers to users within the one or more collective networks of users, the method comprising:
receiving, by one or more processing devices, a real-time video stream, wherein the video stream is captured through the use of a first data capture device in communication with a first mobile device of a first user in the one or more collective networks of users;
identifying, by the one or more processing devices, a first object from the video stream;
retrieving, by the one or more processing devices, data about the first object;
presenting, by the one or more processing devices, the data about the first object to the first mobile device, wherein presenting the data about the first object comprises superimposing the data about the first object over the video stream on the first mobile device of the first user;
determining, by the one or more processing devices, a notification preference associated with the first object, wherein the notification preference comprises at least a notification type, one or more objects, and one or more users;
determining, by the one or more processing devices, that a second user within the one or more collective networks of users is interested in a second object based on the data about the first object and the notification preference, wherein each user within the one or more collective networks of users has a mobile device with an image capture device associated with the mobile device, wherein each image capture device is configured to capture images of the one or more objects, wherein each mobile device is configured to receive data about the one or more objects;
presenting, by the one or more processing devices, a notification about the second object to a second mobile device of the second user based on at least the notification preference, wherein the notification is presented when it is determined that the second user is interested in the second object, wherein the notification is presented as a video link of the video stream on the second mobile device of the second user, and wherein the video stream comprises data about the second object superimposed on the video stream;
receiving, by the one or more processing devices, a response from the second user, wherein the response further comprises one or more actions the second user wishes to take in response to receiving the notification, wherein the one or more actions comprises at least an indication to purchase the second object;
transmitting, by the one or more processing devices, a request received from the second user to the first user to purchase the second object, wherein the request comprises providing the first user with access to funds associated with a financial institution account of the second user by providing information associated with the financial institution account of the second user to the first user, and wherein the second user is virtually present via the one or more collective networks of users; and
receiving, by the one or more processing device, an indication that the first user placed an order for the purchase of the second object for the second user using the funds accessed from the financial institution account of the second user.

### Claim 2 (depends on 1)

The method of claim 1, wherein determining if the second user within the one or more collective networks of users is interested in the second object further comprises determining the first user from which the data about the first object was received.

### Claim 3 (depends on 1)

The method of claim 1, wherein determining if the second user within the one or more collective networks of users is interested in the second object further comprises determining the one or more collective networks of users to which the first user belongs.

### Claim 4 (depends on 1)

The method of claim 1, wherein determining if the second user within the one or more collective networks of users is interested in the second object further comprises determining the one or more users that belong to the one or more collective networks of users.

### Claim 5 (depends on 1)

The method of claim 1, wherein determining if the second user within the one or more collective networks of users is interested in the second object further comprises comparing the data received about the first object to a group of one or more objects associated with the one or more users that belong to the one or more collective networks of users.

### Claim 6 (depends on 5)

The method of claim 5, wherein the group of one or more objects associated with the one or more users is a wish list, shopping list, or object transaction history associated with the one or more users.

### Claim 7 (depends on 1)

The method of claim 1, wherein the first object and the second object are the same.

### Claim 8 (depends on 1)

The method of claim 1, wherein the second object is similar to or related to the first object.

### Claim 9 (depends on 1)

The method of claim 1, further comprising receiving a request from the first user or the second user to create the one or more collective networks of users.

### Claim 10 (depends on 1)

The method of claim 1, further comprising receiving a request from the first user or the second user to create a first user profile or a second user profile for the one or more collective networks of users.

### Claim 11 (depends on 1)

The method of claim 1, further comprising receiving a request to link and authenticate a first user profile or a second user profile to an account of the first user or the second user at a financial institution.

### Claim 12 (depends on 1)

The method of claim 1, further comprising receiving a request to link one or more objects to a first user profile or a second user profile.

### Claim 13 (depends on 1)

The method of claim 1, further comprising receiving a request to invite the one or more users to join the one or more collective networks of users.

### Claim 14 (depends on 1)

The method of claim 1, further comprising receiving a request to allow the one or more users to join the one or more collective networks of users.

### Claim 15 (depends on 1)

The method of claim 1, further comprising:
posting and settling the accounts of the first user, the second user, a financial institution, or a merchant after the second user makes a purchase of the first object or the second object.

### Claim 16 (depends on 1)

The method of claim 1, wherein the method further comprises receiving an indication from the second user to place the second object on hold for a predetermined period of time.

### Claim 17

A computer program product for utilizing one or more collective networks of users with image capture devices to identify objects captured using the image capture devices and provide offers to users within the one or more collective networks of users, the computer program product comprising at least one non-transitory computer-readable medium having computer-readable program code portions embodied therein, the computer-readable program code portions comprising:
an executable portion configured for receiving a real-time video stream, wherein the video stream is captured through the use of a first data capture device in communication with a first mobile device of a first user in the one or more collective networks of users;
an executable portion configured for identifying a first object from the video stream;
an executable portion configured for retrieving data about the first object;
an executable portion configured for presenting the data about the first object to the first mobile device, wherein presenting the data about the first object comprises superimposing the data about the first object over the video stream on the first mobile device of the first user;
an executable portion configured for determining a notification preference associated with the first object, wherein the notification preference comprises at least a notification type, one or more objects, and one or more users;
an executable portion configured for determining that a second user within the one or more collective networks of users is interested in a second object based on the data about the first object and the notification preference, wherein each user within the one or more collective networks of users has a mobile device with an image capture device associated with the mobile device, wherein each image capture device is configured to capture images of the one or more objects, wherein each mobile device is configured to receive data about the one or more objects;
an executable portion configured for presenting a notification about the second object to a second mobile device of the second user based on at least the notification preference, wherein the notification is presented when it is determined that the second user is interested in the second object, wherein the notification is presented as a video link of the video stream on the second mobile device of the second user, and wherein the video stream comprises data about the second object superimposed on the video stream;
an executable portion configured for receiving a response from the second user, wherein the response further comprises one or more actions the second user wishes to take in response to receiving the notification, wherein the one or more actions comprises at least an indication to purchase the second object;
an executable portion configured for transmitting a request received from the second user to the first user to purchase the second object, wherein the request comprises providing the first user with access to funds associated with a financial institution account of the second user by providing information associated with the financial institution account of the second user to the first user, and wherein the second user is virtually present via the one or more collective networks of users; and
an executable portion configured for receiving an indication that the first user placed an order for the purchase of the second object for the second user using the funds accessed from the financial institution account of the second user.

### Claim 18 (depends on 17)

The computer program product of claim 17, wherein the executable portion configured for determining if the second user within the one or more collective networks of users is interested in the second object further comprises determining the first user from which the data about the first object was received.

### Claim 19 (depends on 17)

The computer program product of claim 17, wherein the executable portion configured for determining if the second user within the one or more collective networks of users is interested in the second object further comprises determining the one or more collective networks of users to which the first user belongs.

### Claim 20 (depends on 17)

The computer program product of claim 17, wherein the executable portion configured for determining if the second user within the one or more collective networks of users is interested in the second object further comprises determining the one or more users that belong to the one or more collective networks of users.

### Claim 21 (depends on 17)

The computer program product of claim 17, wherein the executable portion configured for determining if the second user within the one or more collective networks of users is interested in the second object further comprises comparing the data received about the first object to a group of one or more objects associated with the one or more users that belong to the one or more collective networks of users.

### Claim 22 (depends on 21)

The computer program product of claim 21, wherein the group of one or more objects associated with the one or more users is a wish list, shopping list, or object transaction history associated with the one or more users.

### Claim 23 (depends on 17)

The computer program product of claim 17, wherein the first object and the second object are the same.

### Claim 24 (depends on 17)

The computer program product of claim 17, wherein the second object is similar to or related to the first object.

### Claim 25 (depends on 17)

The computer program product of claim 17, further comprising an executable portion configured for receiving a request from the first user or the second user to create the one or more collective networks of users.

### Claim 26 (depends on 17)

The computer program product of claim 17, further comprising an executable portion configured for receiving a request from the first user or the second user to create a first user profile or a second user profile for the one or more collective networks of users.

### Claim 27 (depends on 17)

The computer program product of claim 17, further comprising an executable portion configured for receiving a request to link and authenticate a first user profile or a second user profile to an account of the first user or the second user at a financial institution.

### Claim 28 (depends on 17)

The computer program product of claim 17, further comprising an executable portion configured for receiving a request to link one or more objects to a first user profile or a second user profile.

### Claim 29 (depends on 17)

The computer program product of claim 17, further comprising an executable portion configured for receiving a request to invite the one or more users to join the one or more collective networks of users.

### Claim 30 (depends on 17)

The computer program product of claim 17, further comprising an executable portion configured for receiving a request to allow the one or more users to join the one or more collective networks of users.

### Claim 31 (depends on 17)

The computer program product of claim 17, further comprising an executable portion configured for posting and settling the accounts of the first user, the second user, a financial institution, or a merchant after the second user makes a purchase of the first object or the second object.

### Claim 32 (depends on 17)

The computer program product of claim 17, further comprising an executable portion configured for receiving an indication from the second user to place the second object on hold for a predetermined period of time.