# US 2010/0306043 A1 · Measuring Impact Of Online Advertising Campaigns

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2010/0306043 A1
- Document ID: US20100306043A1
- Status: Published application
- Kind: A1
- Application number: 12/472,318
- Filed: 2009-05-26
- Published: 2010-12-02
- Earliest claimed: 2009-05-26
- Inventors: Robert Taaffe Lindsay; Thomas Carriero; Yun-Fang Juan
- Web page: https://patentgrep.com/patent/US20100306043A1

## CPC

- G06Q 30/0242: Determining effectiveness of advertisements
- G06Q 30/02: Marketing; Price estimation or determination; Fundraising
- G06Q 30/0245: {Surveys}
- H04L 67/306: User profiles
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

Methods and systems allow measurement of effectiveness of advertising campaigns based on online advertisements targeted towards specific sets of members. A set of members is allowed to see an advertisement whereas another set of members is withheld from seeing the advertisement under conditions similar to the first set. Test sets obtained from the two sets of members are polled with questions evaluating effectiveness of advertisement. The poll questions evaluate effectiveness based on factors including brand awareness, purchase intent, or brand favorability. Statistical analysis is performed to quantitatively measure the effectiveness of the advertisement by measuring the improvement in above factors as a result of showing the advertisement.

## Claims

### Claim 1

A computer implemented method of evaluating effectiveness of an online advertising campaign comprising advertisements, wherein the advertising campaign is presented to a set of members of an online system, the method comprising:
associating each member from the set of members with one or more advertisements that can be displayed to the member;
responsive to detecting a member accessing the online system:
selecting an advertisement associated with the member;
determining whether the member belongs to a sample set of members or a control set of members;
responsive to the member belonging to the control set, withholding the advertisement from presentation to the member;
responsive to the member belonging to the sample set, providing the advertisement for presentation to the member; and
determining a measure of effectiveness of the advertising campaign based on information received from members from the control set and from members from the sample set.

### Claim 2 (depends on 1)

The method of claim 1, wherein determining a measure of effectiveness of the advertising campaign comprises:
providing a question to a member belonging to one of the sample set or the control set of members, while the member is accessing the online system; and
receiving a response from the member including an answer to the question, wherein the answer is indicative of effectiveness of the advertisement.

### Claim 3 (depends on 2)

The method of claim 2, wherein answers to the question are indicative of awareness of the subject of the advertisement.

### Claim 4 (depends on 2)

The method of claim 2, wherein answers to the question are indicative of favorability towards the subject of the advertisement.

### Claim 5 (depends on 1)

The method of claim 1, wherein determining whether the member belongs to a sample set of members or a control set of member comprises computing a hash value based on at least a member ID associated with the member.

### Claim 6 (depends on 1)

The method of claim 1, wherein an advertisement is withheld from a member of the control set a predetermined number of times within a predetermined time interval, and the advertisement is presented to members belonging to one of the sample set or the control set of members the predetermined number of times within the predetermined time interval.

### Claim 7 (depends on 1)

The method of claim 1, wherein the set of members is determined based on attributes of members.

### Claim 8 (depends on 1)

The method of claim 1, wherein the set of members is determined based on demographics of members.

### Claim 9 (depends on 1)

The method of claim 1, wherein the set of members is determined based on interests of members.

### Claim 10 (depends on 1)

The method of claim 1, wherein the set of members is determined based upon affiliations of the members.

### Claim 11 (depends on 1)

The method of claim 1, wherein the set of members is determined based upon activities of the members within the online system.

### Claim 12 (depends on 1)

The method of claim 1, wherein determining a measure of effectiveness of the advertising campaign comprises computing a lift in favorability of members towards the subject of the advertisement.

### Claim 13 (depends on 1)

The method of claim 1, wherein a member has an account for which the member has registered, and a profile storing attributes of the member, the attributes including demographic information of the member.

### Claim 14 (depends on 1)

The method of claim 1, wherein a member is associated with a profile storing the attributes of the member, the attributes including historical information of the member's activities within the online system.

### Claim 15

A computer-implemented system for evaluating effectiveness of an online advertising campaign comprising advertisements, wherein the advertising campaign is presented to a set of members of an online system, the system comprising:
a computer processor; and
a computer-readable storage medium storing computer program modules configured to execute on the computer processor, the computer program modules comprising:
an advertisement selector module configured to:
associate each member from the set of members with a one or more advertisements that can be displayed to the member;
an advertisement server module configured to:
select an advertisement associated with the member;
determine whether the member belongs to a sample set of members or a control set of members;
withhold the advertisement from presentation to the member, responsive to the member belonging to the control set;
provide the advertisement for presentation to the member, responsive to the member belonging to the sample set; and
a poll analyzer module configured to:
determine a measure of effectiveness of the advertising campaign based on information received from members from the control set and from members from the sample set.

### Claim 16 (depends on 15)

The system of claim 15, wherein determining a measure of effectiveness of the advertising campaign comprises:
providing a question to a member belonging to one of the sample set or the control set of members, while the member is accessing the online system; and
receiving a response from the member including an answer to the question, wherein the answer is indicative of effectiveness of the advertisement.

### Claim 17 (depends on 16)

The system of claim 16, wherein answers to the question are indicative of awareness of the subject of the advertisement.

### Claim 18 (depends on 16)

The system of claim 16, wherein answers to the question are indicative of favorability towards the subject of the advertisement.

### Claim 19 (depends on 15)

The system of claim 15, wherein determining whether the member belongs to a sample set of members or a control set of member comprises computing a hash value based on at least a member ID associated with the member.

### Claim 20 (depends on 15)

The system of claim 15, wherein the set of members is determined based on demographics of members.

### Claim 21 (depends on 15)

The system of claim 15, wherein the set of members is determined based on attributes of members.

### Claim 22 (depends on 15)

The system of claim 15, wherein the set of members is determined based on interests of members.

### Claim 23 (depends on 15)

The system of claim 15, wherein the set of members is determined based upon affiliations of the members.

### Claim 24 (depends on 15)

The system of claim 15, wherein the set of members is determined based upon activities of the members within the online system.

### Claim 25 (depends on 15)

The system of claim 15, wherein determining a measure of effectiveness of the advertising campaign comprises computing a lift in favorability of members towards the subject of the advertisement.

### Claim 26 (depends on 15)

The system of claim 15, wherein a member has an account for which the member has registered, and a profile storing attributes of the member, the attributes including demographic information of the member.

### Claim 27 (depends on 15)

The system of claim 15, wherein a member is associated with a profile storing the attributes of the member, the attributes including historical information of the member's activities within the online system.

### Claim 28

A computer implemented method of evaluating effectiveness of an online advertising campaign comprising advertisements, wherein the advertising campaign is presented to a set of members of a website, the method comprising:
associating each member from the set of members with one or more advertisements that can be displayed to the member;
receiving a request for determining an advertisement to be presented to a member interacting with the website;
selecting an advertisement associated with the member;
determining whether the member belongs to a sample set of members or a control set of members;
responsive to the member belonging to the control set, withholding the advertisement from presentation to the member;
responsive to the member belonging to the sample set, responding to the request with the advertisement; and
determining a measure of effectiveness of the advertising campaign based on information received from members from the control set and from members from the sample set.

### Claim 29

A computer implemented method of evaluating effectiveness of an online advertising campaign comprising advertisements, wherein the advertising campaign is presented to a set of members of an online system, the method comprising:
determining a first set of advertisements belonging to the advertising campaign and a second set of advertisements belonging to the advertising campaign;
associating each member from the set of members with one or more advertisements belonging to the advertising campaign that can be displayed to the member;
responsive to detecting a member accessing the online system:
selecting an advertisement associated with the member;
determining whether the member belongs to one of a first experimental set of members, a second experimental set of members, or a control set of members;
responsive to the member belonging to the first experimental set of members, presenting an advertisement from the first set of advertisements to the member;
responsive to the member belonging to the second experimental set of members, presenting an advertisement from the second set of advertisements to the member;
responsive to the member belonging to the control set, withholding the advertisement from presentation to the member; and
determining a measure of effectiveness of the advertising campaign based on information received from members belonging to the first experimental set of members, the second experimental set of members, and/or the control set of members.

### Claim 30

A computer implemented method of evaluating effectiveness of an online advertising campaign comprising advertisements, wherein the advertising campaign is presented to a set of members of an online system, the method comprising:
determining a parameter associated with presentation of an advertisement of the advertising campaign and a first parameter value and a second parameter value of the parameter;
associating each member from the set of members with one or more advertisements that can be displayed to the member;
responsive to detecting a member account accessing the online system:
selecting an advertisement associated with the member;
determining whether the member belongs to one of a first experimental set of members, a second experimental set of members, or a control set of members;
responsive to the member belonging to the first experimental set of members, presenting the advertisement to the member based on the first parameter value;
responsive to the member belonging to the second experimental set of members, presenting the advertisement to the member based on the second parameter value;
responsive to the member belonging to the control set, withholding the advertisement from presentation to the member; and
determining a measure of effectiveness of the advertisement campaign based on information received from members belonging to the first experimental set of members, the second experimental set of members, and/or the control set of members.

### Claim 31 (depends on 30)

The method of claim 30, wherein a parameter determines the time duration during which the advertisement is shown to members.

### Claim 32 (depends on 30)

The method of claim 30, wherein a parameter determines an order in which different advertisements are presented to the member.

### Claim 33 (depends on 30)

The method of claim 30, wherein a parameter determines the location of the advertisement in a user interface used for showing the advertisement.

### Claim 34 (depends on 30)

The method of claim 30, wherein a parameter determines whether comments provided by members for the advertisement are presented with the advertisement.

### Claim 35 (depends on 30)

The method of claim 30, wherein a parameter determines whether content generated by members related to the advertisement is presented with the advertisement.

### Claim 36 (depends on 30)

The method of claim 30, wherein determining a measure of effectiveness of the advertising campaign comprises:
providing a question to a member belonging to one of the sample set or the control set of members, while the member is accessing the online system; and
receiving a response from the member including an answer to the question, wherein the answer is indicative of effectiveness of the advertisement.

### Claim 37 (depends on 36)

The method of claim 36, wherein answers to the question are indicative of awareness of the subject of the advertisement.

### Claim 38 (depends on 36)

The method of claim 36, wherein answers to the question are indicative of favorability towards the subject of the advertisement.

### Claim 39 (depends on 30)

The method of claim 30, wherein determining whether the member belongs to one of a first experimental set of members, a second experimental set of members, or a control set of members comprises computing a hash value based on at least a member ID associated with the member.

### Claim 40 (depends on 30)

The method of claim 30, wherein the set of members is determined based on attributes of members.

### Claim 41 (depends on 30)

The method of claim 30, wherein the set of members is determined based on demographics of members.

### Claim 42 (depends on 30)

The method of claim 30, wherein the set of members is determined based on interests of members.

### Claim 43 (depends on 30)

The method of claim 30, wherein determining a measure of effectiveness of the advertising campaign comprises computing a lift in favorability of members towards the subject of the advertisement.

### Claim 44 (depends on 30)

The method of claim 30, wherein the set of members is determined based upon affiliations of the members.

### Claim 45 (depends on 30)

The method of claim 30, wherein the set of members is determined based upon activities of the members within the online system.

### Claim 46 (depends on 30)

The method of claim 30, wherein determining a measure of effectiveness of the advertising campaign comprises computing a lift in favorability of members towards the subject of the advertisement.

### Claim 47 (depends on 30)

The method of claim 30, wherein a member has an account for which the member has registered, and a profile storing attributes of the member, the attributes including demographic information of the member.

### Claim 48 (depends on 30)

The method of claim 30, wherein a member is associated with a profile storing the attributes of the member, the attributes including historical information of the member's activities within the online system.
