# US 2012/0232954 A1 · Providing social impact information associated with identified products or businesses

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0232954 A1
- Document ID: US20120232954A1
- Status: Published application
- Kind: A1
- Application number: 13/342,055
- Filed: 2012-01-01
- Published: 2012-09-13
- Earliest claimed: 2011-03-08
- Assignees: Bank of America Corporation
- Inventors: Matthew A. Calman; Erik Stephen Ross; Alfred Hamilton
- Web page: https://patentgrep.com/patent/US20120232954A1

## CPC

- G06Q 30/0203: Market surveys; Market polls
- G06F 16/951: Indexing; Web crawling techniques
- G06Q 10/00: Administration; Management
- G06Q 30/02: Marketing; Price estimation or determination; Fundraising
- G06Q 30/0201: Market modelling; Market analysis; Collecting market data
- G06Q 30/0625: {by formulating product or service queries, e.g. using keywords or predefined options}
- G06Q 30/0631: {Recommending goods or services}
- G06Q 30/0643: {graphically representing goods, e.g. 3D product representation}
- H04L 67/306: User profiles
- H04W 4/02: Services making use of location information
- H04W 4/029: Location-based management or tracking services
- G06Q 10/40: Business processes related to social networking or social networking services
- H04N 23/661: Transmitting camera control signals through networks, e.g. control via the Internet
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Embodiments of the invention are directed to methods and apparatuses for capturing a real-time video stream using a mobile computing device, determining, using a computing device processor, which images from the real-time video stream are associated with goods and businesses consistent with a predetermined social impact, and presenting on a display of the real-time video stream, one or more indicators, each indicator being associated with an image determined to be consistent with a predetermined social impact.

## Claims

### Claim 1

A method of providing social impact information of goods and services providers, the method comprising:
identifying, via a processor, one or more goods or service providers proximate in location to a mobile device;
determining, via the processor, which goods or service providers proximate in location to the mobile device are consistent with a predetermined social impact; and
presenting, via a display, one or more indicators, each indicator associated with a good or service provider proximate in location to the mobile device determined to be consistent with the predetermined social impact.

### Claim 2 (depends on 1)

The method of claim 1, wherein identifying one or more goods or service providers further comprises capturing, via the mobile device, a real-time video stream, wherein the real-time video stream includes at least one image of a good or service provider.

### Claim 3 (depends on 2)

The method of claim 2, wherein capturing a real-time video stream further comprises implementing, via the processor, object recognition processing to identify the goods or service providers within the real-time video stream.

### Claim 4 (depends on 1)

The method of claim 1, wherein identifying one or more goods or service providers further comprises capturing a code located on or proximate to one or more of the products or service providers, wherein the code identifies the product or service provider.

### Claim 5 (depends on 1)

The method of claim 1, wherein identifying one or more goods or service providers further comprises receiving, via the mobile device, wireless communication from a product identifying tag or a service provider identifying tag associated with the goods or service provider.

### Claim 6 (depends on 1)

The method of claim 1, wherein identifying one or more goods or service providers further comprises determining, via the processor, a location of the mobile device and determining, via the processor, the one or more goods or service providers based on the determined location.

### Claim 7 (depends on 1)

The method of claim 1, wherein the mobile device is a mobile phone.

### Claim 8 (depends on 2)

The method of claim 2, wherein the real-time video stream is captured by the same mobile device that presents the one or more indicators.

### Claim 9 (depends on 1)

The method of claim 1, wherein determining which goods or service providers proximate in location to the mobile device are consistent with a predetermined social impact further comprises:
collecting data concerning the social values of importance to a user; and
generating a social impact profile for the user.

### Claim 10 (depends on 2)

The method of claim 2, wherein determining which images from the real-time video stream are associated with goods or service providers consistent with a predetermined social impact further comprises:
identifying the goods and service providers captured in the real-time video stream;
correlating the goods and service providers identified in the video stream to information regarding the social impact of the goods or service providers;
comparing the information regarding the social impact of the goods and service providers to the social impact profile of the user.

### Claim 11 (depends on 9)

The method of claim 9 wherein collecting the data concerning the social values of importance to the user comprises collecting user defined data concerning the social values of importance to the user

### Claim 12 (depends on 9)

The method of claim 9 wherein collecting the data concerning the social values of importance to the user comprises:
analyzing the purchasing behavior of the user; and
identifying the social values of importance to the user based on the purchasing behavior of the user.

### Claim 13 (depends on 9)

The method of claim 9 wherein collecting the data concerning the social values of importance to the user comprises:
collecting personal data associated with the user; and
identifying the social values of importance to the user based on the personal data of the user.

### Claim 14 (depends on 10)

The method of claim 10 wherein the social impact of the goods or service providers comprises one or more of the following: an environmental impact, nature of production, product attributes, business attributes or charitable activities.

### Claim 15 (depends on 11)

The method of claim 11 wherein the user defined data comprises responses to survey questions.

### Claim 16 (depends on 11)

The method of claim 11 wherein the user defined data comprises search terms inputted by the user and the user's desired correlation between the inputted search terms and the goods or service providers.

### Claim 17 (depends on 12)

The method of claim 12 wherein the purchasing behavior comprises financial records available to a financial institution.

### Claim 18 (depends on 13)

The method of claim 13 wherein the personal data associated with the user comprises data available to a financial institution.

### Claim 19 (depends on 2)

The method of claim 2 wherein presenting, via a display, one or more indicators, each indicator associated with a good or service provider proximate in location to the mobile device determined to be consistent with the predetermined social impact comprises superimposing the indicator over the real-time video stream.

### Claim 20 (depends on 1)

The method of claim 1, wherein the indicators are selectable by a user.

### Claim 21 (depends on 1)

The method of claim 1, wherein the indicators, upon being selected present a user with additional information about the goods or service provider.

### Claim 22 (depends on 1)

The method of claim 1, wherein the indicators, upon being selected present a user with an option to purchase one or more of the goods or a service provided by the service provider via the mobile device.

### Claim 23

An apparatus comprising:
a device for capturing a real-time video stream, wherein the real-time video stream includes at least one image of a good or service provider;
a processor operably connected to the device, configured to determine which images from the real-time video stream are associated with goods or service providers consistent with a predetermined social impact profile; and
a display, operably connected to the processor, for presenting the real-time video stream with one or more indicators, each indicator associated with an image of a good or service provider determined to be consistent with the predetermined social impact profile.

### Claim 24 (depends on 19)

The apparatus of claim 19, wherein the device is a mobile device.

### Claim 25 (depends on 19)

The apparatus of claim 19, wherein the device is a mobile phone.

### Claim 26 (depends on 19)

An apparatus as in claim 19, wherein the processor, in determining which images from the real-time video stream are associated with goods or service providers consistent with a predetermined social impact profile, is further configured to:
collect data concerning the social values of importance to a user; generate a social impact profile for the user;
identify goods and service providers captured in the real-time video stream;
correlate the goods or service providers captured in the real-time video stream to information regarding the social impact of the goods or service providers;
assign a social impact profile to the goods or service provider captured in the real-time video stream; and
correlate the social impact profile for the user to the social impact profile of the goods or service provider.

### Claim 27 (depends on 22)

The apparatus of claim 22 wherein the processor in collecting data concerning the social values of importance to the user is configured to collect user defined data concerning the social values of importance to the user.

### Claim 28 (depends on 22)

The apparatus of claim 22 wherein the processor in collecting data concerning the social values of importance to the user is configured to:
analyze the purchasing behavior of the user; and
identify the social values of importance to the user based on the purchasing behavior of the user.

### Claim 29 (depends on 22)

The apparatus of claim 22 wherein the processor in collecting data concerning the social values of importance to the user is configured to:
collect personal data associated with the user; and
identify the social values of importance to the user based on the purchasing behavior of the user.

### Claim 30 (depends on 22)

The apparatus of claim 22 wherein the social impact of the goods or service provider comprise one or more of the following: environmental impact, nature of production, product attributes, business attributes or charitable activities

### Claim 31 (depends on 23)

The apparatus of claim 23 wherein the user defined data comprises responses to survey questions.

### Claim 32 (depends on 23)

The apparatus of claim 23 wherein the user defined data comprises search terms inputted by the user and the user's desired correlation between the inputted search terms and the goods or service providers.

### Claim 33 (depends on 24)

The apparatus of claim 24 wherein the purchasing behavior comprises financial records available to a financial institution.

### Claim 34 (depends on 24)

The apparatus of claim 24 wherein the personal data associated with the user comprises data available to a financial institution.

### Claim 35 (depends on 19)

The apparatus of claim 19 wherein the display in presenting the real-time video stream with one or more indicators is further configured to superimpose the indicator over the image of the goods or service providers determined to be consistent with the predetermined social impact profile.

### Claim 36 (depends on 19)

The method of claim 19, wherein the indicators are selectable by the user.

### Claim 37 (depends on 19)

The method of claim 19, wherein the indicators, upon begin selected present the user with additional information about the goods or service providers.

### Claim 38 (depends on 19)

The method of claim 19, wherein the indicators, upon being selected present the user with an option to purchase one or more of the goods or a service provided by the service provider via the device.

### Claim 39

A computer program product, comprising:
a non-transitory computer-readable medium having computer-executable code stored thereon, the computer executable code comprising:
a first code portion configured to capture, via a mobile device, a real-time video stream,
a second code portion configured to determine which images from the real-time video stream are associated with goods or service providers consistent with a predetermined social impact profile,
a third code portion configured to present on a display the real-time video stream with one or more indicators, each indicator associated with an image determined to be consistent with the predetermined social impact profile.

### Claim 40 (depends on 35)

The computer program product of claim 35, wherein the second code portion is further configured to:
collect data concerning the social values of importance to the user;
generate a social impact profile for the user;
identify the goods and service providers captured in the real-time video stream;
correlate the goods and service providers identified in the video stream to information regarding the social impact of the goods and businesses;
comparing information regarding the social impact of the goods and businesses to the social impact profile of the user.

### Claim 41 (depends on 36)

The computer program product of claim 36, wherein collecting the data concerning the social values of importance to the user comprises collecting user defined data concerning the social values of importance to the user.

### Claim 42 (depends on 36)

The computer program product of claim 36, wherein collecting the data concerning the social values of importance to the user comprises:
analyzing the purchasing behavior of the user; and
identifying the social values of importance to the user based on the purchasing behavior of the user.

### Claim 43 (depends on 36)

The computer program product of claim 36 wherein collecting the data concerning the social values of greatest importance to the user comprises:
collecting personal data associated with the user; and
identifying the social values of importance to the user based on the purchasing behavior of the user.

### Claim 44 (depends on 36)

The computer program product of claim 36 wherein the social impact of the goods or service providers comprise one or more of the following: environmental impact, nature of production, product attributes, business attributes or charitable activities.

### Claim 45 (depends on 37)

The computer program product of claim 37, wherein the user defined data comprises responses to survey questions.

### Claim 46 (depends on 37)

The computer program product of claim 37, wherein the user defined data comprises search terms inputted by the user and the user's desired correlation between the inputted search terms and the goods or service providers.

### Claim 47 (depends on 38)

The computer program product of claim 38, wherein the purchasing behavior comprises financial records available to a financial institution.

### Claim 48 (depends on 39)

The computer program product of claim 39, wherein the personal data associated with the user comprises data available to a financial institution.

### Claim 49 (depends on 35)

The computer program product of claim 35, wherein third code portion is configured to superimpose the indicators over the real-time video stream.

### Claim 50 (depends on 35)

The computer program product of claim 35, wherein the indicators are selectable by the user.

### Claim 51 (depends on 35)

The computer program product of claim 35, wherein the indicators, upon being selected present the user with additional information about the goods or service providers.

### Claim 52 (depends on 35)

The computer program product of claim 35, wherein the indicators, upon being selected present the user with an option to purchase one or more of the products or services provided by the service provider via the mobile device.

### Claim 53 (depends on 35)

The computer program product of claim 35, wherein the mobile device is a mobile phone.
