# US 2014/0156385 A1 · Measuring recollection of an advertisement by groups of users > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2014/0156385 A1 - Document ID: US20140156385A1 - Status: Published application - Kind: A1 - Application number: 13/705,625 - Filed: 2012-12-05 - Published: 2014-06-05 - Earliest claimed: 2012-12-05 - Assignees: Facebook, Inc. - Applicants: Facebook, Inc. - Inventors: Brad Hopkins Smallwood; Sean Bruich - Web page: https://patentgrep.com/patent/US20140156385A1 ## CPC - G06Q 30/0245: {Surveys} - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR ## Abstract An ad publishing system measures the effectiveness of an advertisement by determining whether recipients of the advertisement recall receiving it. This measurement is accomplished by polling a subset of the recipients of the advertisement as to whether they recall receiving, viewing, or otherwise being exposed to the advertisement. The market segment characteristics of the recipients and the subset of recipients are accounted for to improve the relevance of the polling responses. Market segment characteristics are determined using information describing recipients such as demographic information, psychographic information, or other information identifying likes, dislikes, interests, consuming habits, personal connections, group affiliations, internet browsing history, and other similar information. The responses to the recall poll can be used to calculate an effectiveness score of the advertisement as a function of market segment, advertisement publisher platform, or other variables. ## Claims ### Claim 1 A method comprising: determining identities of a plurality of recipients of an advertisement, each of the identities associated with a recipient profile including market segment information; determining a first market segment profile of the plurality of recipients using market segment information in the recipient profiles; selecting a subset of recipients from the plurality of recipients, the subset having a second market segment profile and selected based on a comparison of the first market segment profile with the second market segment profile; providing each of the recipients in the subset with a recall question inquiring whether each of the recipients in the subset recalls the advertisement; and receiving a response to the recall question from at least one of the recipients in the subset. ### Claim 2 (depends on 1) The method of claim 1, wherein the recall question is provided within 24 hours after the plurality of recipients has been provided with the advertisement. ### Claim 3 (depends on 1) The method of claim 1, further comprising determining an effectiveness score for the advertisement, the effectiveness score based on a number of recipients in the subset recalling the advertisement. ### Claim 4 (depends on 3) The method of claim 3, wherein the effectiveness score is calculated for each of at least two market segments of the plurality of recipients provided with the advertisement. ### Claim 5 (depends on 4) The method of claim 4, further comprising comparing a first effectiveness score of the advertisement for a first market segment to a second effectiveness score of the advertisement for a second market segment. ### Claim 6 (depends on 3) The method of claim 3, further comprising: calculating an effectiveness score of the advertisement for each of at least two third-party websites providing the advertisement to recipients; and comparing the effectiveness scores of the two third-party websites. ### Claim 7 (depends on 6) The method of claim 6, further comprising reallocating a distribution of advertising impressions served from a first third-party website having a first effectiveness score to a second third-party website having a second effectiveness score higher than the first effectiveness score. ### Claim 8 (depends on 3) The method of claim 3, wherein the effectiveness score is calculated by multiplying a total number of impressions of the advertisement served by a response rate of the subset to the recall question. ### Claim 9 (depends on 1) The method of claim 1, further comprising: receiving the advertisement and a target audience of a defined demographic for the advertisement from an advertiser; and using an effectiveness score for the defined demographic to further refine the target audience received from the advertiser. ### Claim 10 (depends on 1) The method of claim 1, further comprising using a social networking system to provide the advertisement for display. ### Claim 11 (depends on 1) The method of claim 1, wherein the market segment information comprises demographic information. ### Claim 12 (depends on 1) The method of claim 1, wherein the market segment information comprises psychographic information. ### Claim 13 (depends on 1) The method of claim 1, wherein the market segment information is based at least in part on whether the user has established one or more social connections with another object in the social networking system. ### Claim 14 A method comprising: determining identities of a plurality of recipients of an advertisement, each of the identities associated with a recipient profile including market segment information; determining a first market segment profile of the plurality of recipients using market segment information in the recipient profiles; selecting a first subset of recipients from the plurality of recipients; providing each of the recipients of the first subset with a recall question inquiring whether each of the recipients in the subset recalls the advertisement; receiving responses to the recall question from a plurality of the recipients of the first subset; and selecting responses to the recall question comprising a second subset of recipients, the second subset having a second market segment profile that is approximately the same as the first market segment profile. ### Claim 15 (depends on 14) The method of claim 14, further comprising determining an effectiveness score for the advertisement, the effectiveness score based on a number of recipients in the subset recalling the advertisement. ### Claim 16 (depends on 14) The method of claim 14, wherein the recall question is provided within 24 hours after the plurality of recipients has been provided with the advertisement. ### Claim 17 (depends on 14) The method of claim 14, further comprising determining an effectiveness score for the advertisement, the effectiveness score based on a number of recipients in the subset recalling the advertisement. ### Claim 18 (depends on 17) The method of claim 17, further comprising: calculating at least two effectiveness scores for each of at least two market segments of the plurality of recipients; and comparing a first effectiveness score of the advertisement for a first market segment to a second effectiveness score of the advertisement for a second market segment. ### Claim 19 (depends on 18) The method of claim 18, further comprising reallocating a distribution of advertising impressions served from a first market segment having a first effectiveness score to a second market segment having a second effectiveness score higher than the first effectiveness score. ### Claim 20 (depends on 18) The method of claim 18, further comprising comparing a first effectiveness score of the advertisement for a first third party website to a second effectiveness score of the advertisement for a second third party website. ### Claim 21 (depends on 18) The method of claim 18, wherein the effectiveness score is calculated for at least one third party website providing the advertisement to the plurality of recipients, the effectiveness score measuring recall of the advertisement for each of the at least one third party websites. ### Claim 22 (depends on 18) The method of claim 18, wherein the effectiveness score is calculated by multiplying a total number of impressions of the advertisement served by a response rate of the first subset to the recall question. ### Claim 23 (depends on 14) The method of claim 14, further comprising: receiving the advertisement and a target audience of a defined demographic for the advertisement from an advertiser; and using an effectiveness score for the defined demographic to further refine the target audience received from the advertiser. ### Claim 24 (depends on 14) The method of claim 14, wherein the market segment information comprises demographic information. ### Claim 25 (depends on 14) The method of claim 14, wherein the market segment information comprises psychographic information. ### Claim 26 (depends on 14) The method of claim 14, wherein the market segment information comprises social object information stored in a social networking system.