# US 2019/0377572 A1 · Monitoring of Media Displayed by Third-Party Components

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0377572 A1
- Document ID: US20190377572A1
- Status: Published application
- Kind: A1
- Application number: 16/077,584
- Filed: 2018-03-26
- Published: 2019-12-12
- Earliest claimed: 2017-04-02
- Assignees: Safedk Mobile Ltd
- Applicants: SafeDK Mobile LTD.
- Inventors: Maya Mograbi-Lapiner; Ori Lentzitzky; Ariel Cattan; Idan Mandil; Eldad Moneta; Orly Shoavi; Ronnie Sternberg
- Web page: https://patentgrep.com/patent/US20190377572A1

## CPC

- G06F 8/77: Software metrics
- G06Q 30/02: Marketing; Price estimation or determination; Fundraising
- G06F 11/302: {where the computing system component is a software system}
- G06F 11/3409: {for performance assessment}
- G06F 11/3612: {by runtime analysis (performance monitoring G06F11/3466)}
- G06F 11/3636: {by tracing the execution of the program}
- G06F 21/10: Protecting distributed programs or content, e.g. vending or licensing of copyrighted material (protection in video systems or pay television H04N7/16) {; Digital rights management [DRM]}
- G06Q 30/0241: Advertisements
- G06Q 30/0242: Determining effectiveness of advertisements
- G06Q 30/0276: {Advertisement creation}
- G06F 16/00: Information retrieval; Database structures therefor; File system structures therefor
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR

## Abstract

System, method and products for monitoring media displayed by third-party components. A runtime component monitors execution of a program on the user device. The runtime component identifies an attempt by a third-party component that is integrated with the program to display media. The runtime component obtains obtain data associated with the media, determines a fingerprint of the media and transmits to a server the data and the fingerprint. In response to a request received from the server or lack thereof, the runtime component determines whether to drop the media or transmit the media to the server. The server is provided with aggregated data about different medias displayed by third-party components by different instances of the program executed by different user devices.

## Claims

### Claim 1

A computer program product comprising:
a non-transitory computer readable medium retaining program instructions of a runtime component;
wherein a developer of a program integrated the runtime component with the program, whereby the runtime component is operatively coupled with the program;
wherein the program instructions, when executed by a user device, cause the user device to:
monitor execution of the program on the user device;
identify an attempt by a component of the program to display media to a user of the user device, wherein the component is a third-party component developed by a different developer than the developer and integrated with the program by the developer;
obtain data associated with the media;
determine a fingerprint of the media;
transmit to a server the data and the fingerprint, whereby transmitting lightweight data to the server;
in response to a request received from the server or lack thereof, determine whether to drop the media or transmit the media to the server;
whereby providing the server with aggregated data about different medias displayed by third-party components by different instances of the program executed by different user devices.

### Claim 2 (depends on 1)

The computer program product of claim 1, wherein the third-party component is a Software Development Kit (SDK) that is compiled into the program by the developer.

### Claim 3 (depends on 2)

The computer program product of claim 2, wherein the SDK is an advertisement SDK configured to serve advertisements to users of the program, wherein the media is an advertisement.

### Claim 4 (depends on 3)

The computer program product of claim 3, wherein the advertisement is selected from a group consisting of: a static image, a dynamic image, a video, and an interactive advertisement.

### Claim 5 (depends on 1)

The computer program product of claim 1, wherein the runtime component is configured to heuristically verify that the media is an advertisement based on the media being displayed by an Software Development Kits (SDK) and not by the program.

### Claim 6 (depends on 1)

The computer program product of claim 1, wherein the runtime component is configured to heuristically verify that the media is an advertisement based on the media being displayed by an Advertisement Software Development Kit (SDK) and not by the program or by other SDKs.

### Claim 7 (depends on 1)

The computer program product of claim 1, wherein the determination of the fingerprint comprises computing a perceptual hashing of the media.

### Claim 8 (depends on 7)

The computer program product of claim 7, wherein the program instructions, when executed, are configured to cause the user device to compute the perceptual hashing a multiplicity of times to obtain multiple hashing values; and to compare the multiple hashing values to determine whether the media is static or dynamic.

### Claim 9 (depends on 1)

The computer program product of claim 1, wherein the determination of the fingerprint comprises obtaining a Uniform Resource Locator (URL) from which the media is played, wherein the fingerprint is the URL.

### Claim 10 (depends on 1)

The computer program product of claim 1 wherein the program instructions, when executed, are configured to cause the user device to verify that the media is an advertisement, wherein the verification comprises comparing aspect ratio of the media with a set of aspect ratios used by advertisements for a device having a displayed aspect ratio as of the user device.

### Claim 11 (depends on 10)

The computer program product of claim 10, wherein in response to the verification, the runtime component is configured to notify the server that the component is potentially an Advertisement Software Development Kit (SDK), whereby automatically identifying Advertisement SDKs.

### Claim 12 (depends on 1)

The computer program product of claim 1, wherein the runtime component is configured, in response to a second request received from the server, temporarily retaining the media on the user device until the request is received.

### Claim 13 (depends on 1)

The computer program product of claim 1, wherein the monitoring of execution comprises: scanning, periodically, visual objects of the program during runtime to identify visual objects associated with an Advertisement Software Development Kit (SDK).

### Claim 14 (depends on 1)

The computer program product of claim 1, wherein said monitoring of execution comprises:
scanning visual objects of the program during runtime;
for each visual object, determining a component responsible for the visual object, wherein said determining comprises performing stack trace analysis to identify the component; and
comparing the component with predetermined set of Software Development Kits (SDKs).

### Claim 15 (depends on 1)

The computer program product of claim 1, wherein in response to identification of the attempt to display the media, the runtime component is configured to render the media in a resolution lower than a resolution in which the media is to be displayed by the program, whereby down-sampling the media to obtain a lightweight representation thereof

### Claim 16 (depends on 1)

The computer program product of claim 1,
wherein the component is an Advertisement Software Development Kit (SDK), wherein the media is an advertisement,
wherein the runtime component is configured to determine, based on blocking rules, whether to allow the advertisement to be displayed, wherein the blocking rules are determined by the developer;
whereby the developer selectively blocking a portion of advertisements served by the Advertisement SDK, thereby potentially reducing generated revenue for the developer from the program.

### Claim 17 (depends on 1)

The computer program product of claim 1, wherein the developer integrated the runtime component with the program by compiling the runtime component with the program, by statically linking the runtime component with the program, or by causing the program to dynamically link to the runtime component during execution.

### Claim 18 (depends on 1)

The computer program product of claim 1, wherein the runtime component is a Software Development Kit (SDK) provided by a provider different than the third-party and the developer, wherein the developer included the SDK in the program.

### Claim 19

A system comprising:
a server coupled with a media database, wherein the media database retaining for each media, a fingerprint of the media, a visual representation of the media received from a user device, and values of one or more performance-related metrics;
a plurality of user devices, wherein the user devices retaining a program developed by a developer,
wherein the program is operatively coupled with a runtime component and a media display component,
wherein the runtime component is configured to monitor execution of the program to identify attempts by the media display component to display a media to a user, wherein the runtime component is configured to determine a fingerprint of the media and obtain data relating to the one or more performance-related metrics, wherein the runtime component is configured to transmit the fingerprint and the data to the server; and
wherein the server is configured to identify multiple transmissions regarding a same media from multiple user devices and to instruct one device to transmit the media to the server and to instruct other devices to avoid transmitting the media to the server.

### Claim 20 (depends on 19)

The system of claim 19, wherein the server is configured to update a record regarding the media in the media database based on the data of all the multiple transmissions.

### Claim 21 (depends on 19)

The system of claim 19, wherein the server is configured to select the one device based on at least one of the following: a connectivity status of the one device, a battery level of the one device, and a number of past requests from the one device to transmit medias to the server.

### Claim 22 (depends on 19)

The system of claim 19, wherein said server is configured to:
in response to receiving a first transmission from a first device regarding the one media, determining, using the fingerprint, whether a copy of the media is retained in the media database;
in response to a determination that the copy is not retained in the media database, notifying the first device to temporarily retain the media;
in response to receiving a second transmission from a second device regarding the one media, determining which of the first and second device is to upload the media to the server; and
based on the selection, transmit a first request to one of the first and second devices to upload the media to the server and transmit a second request to another of the first and second devices to locally delete a retained copy of the media.

### Claim 23 (depends on 19)

The system of claim 19, wherein the server is configured to identify copies of a same media based on the fingerprint values of the copies being identical or having a distance lower than a predetermined threshold distance.

### Claim 24 (depends on 19)

The system of claim 19, wherein the server comprising a dashboard component configured to display to the developer media displayed by different instances of the program and performance related values regarding thereto.

### Claim 25 (depends on 24)

The system of claim 24, wherein a plurality of different media display components are integrated into the program, wherein the plurality of different media display components are Advertisement Software Development Kits (SDKs), wherein the dashboard component is further configured to enable the user to view performance related values of the advertisement when being served by one of the Advertisement SDKs and performance related values of the advertisement being served by any of the Advertisement SDKs.

### Claim 26 (depends on 19)

The system of claim 19 further comprising a dashboard component configured to enable the developer to provide selective blocking rules for selectively blocking medias based on past performance or content policy, whereby the developer blocking medias regardless of an identity of a media display component displaying the medias, wherein the runtime component is configured to implement the selective blocking of the medias.

### Claim 27 (depends on 19)

The system of claim 19, wherein a plurality of different media display components are integrated into the program, wherein the plurality of different media display components are Advertisement Software Development Kits (SDKs), wherein the system comprising a dashboard component that is configured to enable the developer to define selective blocking rules for blocking an advertisement when served by one Advertisement SDK and for not blocking the advertisement when served by another Advertisement SDK.
