# US 2015/0148929 A1 · System and method for engaging a person in the presence of ambient audio

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0148929 A1
- Document ID: US20150148929A1
- Status: Published application
- Kind: A1
- Application number: 14/611,811
- Filed: 2015-02-02
- Published: 2015-05-28
- Earliest claimed: 2010-09-05
- Assignees: Mobile Research Labs, Ltd.
- Applicants: Mobile Research Labs, Ltd.
- Inventors: Aron WEISS; Omri HALEVI; Hezi MANUS; Dave SPRINGER
- Web page: https://patentgrep.com/patent/US20150148929A1

## CPC

- H04N 21/4722: for requesting additional data associated with the content
- G06F 16/433: {using audio data}
- G06F 16/632: Query formulation
- G06F 16/634: {Query by example, e.g. query by humming}
- G06F 16/683: using metadata automatically derived from the content
- G06Q 30/02: Marketing; Price estimation or determination; Fundraising
- H04H 60/58: of audio {(determination or detection of speech characteristics in general G10L25/00; speech recognition in general G10L15/00)}
- H04H 60/64: for providing detail information
- H04H 60/65: for using the result on users' side
- G10L 19/018: Audio watermarking, i.e. embedding inaudible data in the audio signal
- H04H 60/40: for identifying broadcast time
- H04H 2201/90: characterised by the use of signatures
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- H04H: BROADCAST COMMUNICATION (multiplex communication H04J; pictorial communication aspects of broadcast systems H04N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

A computerized method for engaging a user of a mobile computer system, The mobile computer system may be connectable to a server over a wide area network. An audio signal of ambient audio is autonomously sampled in the vicinity of the mobile computer system to capture one or more audio samples of the audio signal. The multiple samples of the audio signal are autonomously sampled without requiring any interaction from the user, thus avoiding an input from the user to capture each of the samples. The audio sample may be processed to extract an audio signature of the audio sample. The audio signature may be compared with multiple previously stored reference audio signatures. Upon matching the audio signature with at least one reference audio signature a matched reference audio signature may be produced.

## Claims

### Claim at position 1

1-24. (canceled)

### Claim 25

A computer-implemented method, comprising:
obtaining, using at least one processor, first audio data associated with a first device, the first audio data including a first time stamp and at least one of (i) a sample of a first audio signal captured by the first device at the first time stamp or (ii) a first audio signature representative of the first audio signal sample;
determining, using the at least one processor, whether the first audio signature corresponds to a second audio signature, the second audio signature being representative of a sample of a second audio signal captured by a second device at a second time stamp; and
when the first audio signature is determined to correspond to the second audio signature, providing, using the at least one processor, and to the second device, first information advising at least a user of a second device of the determined correspondence between the first and second audio signatures.

### Claim 26 (depends on 25)

The method of claim 25, further comprising, when the first audio signature is determined to correspond to the second audio signature, providing the first information to a plurality of second devices, the first information advising users of the second devices of the determined correspondence between the first and second audio signatures.

### Claim 27 (depends on 26)

The method of claim 26, wherein at least one social network links the user of the first device and a subset of the users of the second devices.

### Claim 28 (depends on 25)

The method of claim 25, further comprising providing the first information to the first device when the first audio signature is determined to correspond to the second audio signature, the information advising a user of the first device of the determined correspondence between the first and second audio signatures.

### Claim 29 (depends on 25)

The method of claim 25, wherein the at least one of the first or second devices corresponds to a mobile device.

### Claim 30 (depends on 25)

The method of claim 25, further comprising:
determining whether the first and second audio signatures correspond to a reference audio signature, the reference audio signature being associated with reference audio content; and
when the first and second audio signatures correspond to the common reference audio signature, providing, to at least one of the first or second devices, second information indicative of an exposure of the first and second devices to the reference audio content.

### Claim 31 (depends on 30)

The method of claim 30, further comprising
determining whether the first time stamp falls within a predetermined time period of the second time stamp; and
when the first and second audio signatures are determined to correspond to the common reference audio signature, and when the first time stamp is determined to be fall within the predetermined time period of the second time stamp, the providing, to at least one of the first or second devices, third information indicative of an exposure of the first and second devices to the reference audio content within the predetermined time period.

### Claim 32 (depends on 30)

The method of claim 30, wherein:
the reference audio content is associated with a corresponding reference time stamp, the reference time stamp corresponding to a broadcast time of the reference audio content; and
the method further comprises:
determining whether the first and second time stamps fall within a predetermined time period of the reference time stamp; and
when the first and second audio signatures are determined to correspond to the common reference audio signature, and when the first and second time stamps are determined to fall within the predetermined time period of the reference time stamp, providing, to at least one of the first or second devices, third information indicative of an exposure of the first and second devices to the reference audio content within the predetermined time period.

### Claim 33 (depends on 25)

The method of claim 25, wherein:
a first application executed by the first device causes the first device to generate the first audio signal; and
a second application executed by the second device causes the second device to generate the second audio signal.

### Claim 34 (depends on 33)

The method of claim 33, further comprising:
when the first audio signature is determined to correspond to the second audio signature, establishing that the first and second applications correspond to a common application executed by the first and second devices; and
providing, to at least one of the first or second devices, second information indicative of the execution of the common application by the first and second devices.

### Claim 35 (depends on 25)

The method of claim 25, wherein:
the first audio signal corresponds to first streaming content presented the first device; and
the second audio signal corresponds to second streaming content presented by the second device.

### Claim 36 (depends on 35)

The method of claim 35, further comprising:
when the first audio signature is determined to correspond to the second audio signature, establishing that the first and second streaming content correspond to common streaming content presented by the first and second devices; and
providing, to at least one of the first or second devices, second information indicative of the presentation of the common streaming content by the first and second devices.

### Claim 37 (depends on 35)

The method of claim 35, wherein:
the common streaming content is associated with at least one of a common URL or a common web site, the at least one common URL or web site being accessible to the first and second devices; and
the second information identifies the common URL or web site.

### Claim 38 (depends on 25)

The method of claim 25, further comprising obtaining second audio data associated with the second device, the second audio data comprising second time stamp and at least one of (i) the first audio signal sample captured by the second device at the second time stamp or (ii) the second audio signature.

### Claim 39 (depends on 38)

The method of claim 38, wherein:
the first audio data identifies a first application executed by the first device;
the second audio data identifies a second application executed by the second device; and
the method further comprises:
determining whether the first and second applications correspond to a common application executed by the first and second devices; and
when the first and second applications are determined to correspond to the common application, providing, to at least one of the first or second devices, second information indicative of the execution of the common application by the first and second devices.

### Claim 40 (depends on 38)

The method of claim 38, wherein:
the first audio data identifies first streaming content presented by the first device;
the second audio data identifies second streaming content presented by the first device; and
the method further comprises:
determining whether the first and second streaming content correspond to common streaming content presented by the first and second devices; and
when the first and second streaming content correspond to the common streaming content, providing, to at least one of the first or second devices, second information indicative of the presentation of the common streaming content by the first and second devices.

### Claim 41 (depends on 38)

The method of claim 38, wherein:
the first audio data identifies first URL or web site accessed by the first device;
the second audio data identifies a second URL or web site accessed by the second device; and
the method further comprises:
determining whether the first and second URLs or web sites correspond to a common URL or web site accessed by the first and second devices; and
when the first and second URL or web site correspond to the common URL or web site, providing, to at least one of the first or second devices, second information identifying the common URL or web site accessed by the first and second devices.

### Claim 42

An apparatus, comprising:
a storage device that stores a set of instructions; and
at least one processor coupled to the storage device, the at least one processor being operative with the set of instructions in order to:
obtain first audio data associated with a first device, the first audio data including a first time stamp and at least one of (i) a sample of a first audio signal captured by the first device at the first time stamp or (ii) a first audio signature representative of the first audio signal sample;
determine whether the first audio signature corresponds to a second audio signature, the second audio signature being representative of a sample of a second audio signal captured by a second device at a second time stamp; and
when the first audio signature is determined to correspond to the second audio signature, provide, to the second device, first information advising at least a user of a second device of the determined correspondence between the first and second audio signatures.

### Claim 43

A computer-implemented method, comprising:
using at least one processor, autonomously sampling a first audio signal of ambient audio in a vicinity of a first mobile device, the sampling including capturing a sample of the first audio signal without input from a user of the first mobile device, and the audio signal sample being associated with a first time stamp;
determining, using the at least one processor, whether a first audio signature representative of the first audio signal sample; corresponds to a second audio signature, the second audio signature being representative of a sample of a second audio signal captured by a second device at a second time stamp; and
when the first audio signature is determined to correspond to the second audio signature, providing, using the at least one processor, and to the second device, first information advising at least a user of second device of the determined correspondence between the first and second audio signatures.

### Claim 44 (depends on 43)

The method of claim 43, further comprising obtaining, from at least one of the second device or a server, second audio data associated with the second device, the second audio data including the second time stamp and at least one of (i) the first audio signal sample captured by the second device at the second time stamp or (ii) the second audio signature.

### Claim 45

A computer-implemented method, comprising:
using at least one processor, autonomously sampling a first audio signal of ambient audio in a vicinity of a first mobile device, the sampling including capturing a sample of the first audio signal without input from a user of the first mobile device, and the first audio signal sample being associated with a first time stamp;
receiving, using at least one processor, and from a server, second audio data associated with a trigger event and a second time stamp associated with the trigger event, the second audio data being sampled by a second device;
determining, using the at least one processor, whether the first time stamp falls within a predetermined time interval that includes the second time stamp;
when the first time stamp falls within the predetermined time interval, comparing, using the at least one processor, a first audio signature representative of the first audio signal sample with a second audio signature corresponding to the received second audio data; and
transmitting, using the at least one processor, first information indicative of the determined correspondence between the first and second audio signatures to the server.

### Claim 46 (depends on 45)

The method of claim 45, further comprising receiving, from the server in response to the transmitted first information, second information indicative of an exposure of the first and second devices to reference audio content within the predetermined time period.

### Claim 47 (depends on 45)

The method of claim 45, further comprising receiving, from the server in response to the transmitted first information, second information indicative of at least one of (i) an execution of the common application by the first and second devices, (ii) a presentation of the common streaming content by the first and second services, or (ii) a common URL or web site accessed by the first and second devices.

### Claim 48 (depends on 45)

The method of claim 45, further comprising transmitting the first information indicative of the determined correspondence between the first and second audio signatures to a plurality of second devices, wherein at least one social network links a subset of the users of the second devices to a user of the first device.
