# US 10,375,370 B2 · Audio capture on mobile client devices

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,375,370 B2
- Document ID: US10375370B2
- Status: Granted
- Kind: B2
- Application number: 15/600,999
- Filed: 2017-05-22
- Published: 2017-09-07
- Granted: 2019-08-06
- Earliest claimed: 2015-06-02
- Assignees: Adobe Inc.
- Applicants: Adobe Inc.
- Inventors: Steven G. Warner
- Web page: https://patentgrep.com/patent/US10375370B2

## CPC

- H04N 9/802: involving processing of the sound signal (H04N9/806, H04N9/835 take precedence)
- G11B 27/031: Electronic editing of digitised analogue information signals, e.g. audio or video signals
- G11B 27/034: on discs (G11B27/036, G11B27/038 take precedence)
- G11B 27/10: Indexing; Addressing; Timing or synchronising; Measuring tape travel
- G11B 27/11: by using information not detectable on the record carrier
- H04N 5/76: Television signal recording
- H04N 9/8205: {involving the multiplexing of an additional signal and the colour video signal}
- H04W 4/00: Services specially adapted for wireless communication networks; Facilities therefor
- H04W 88/02: Terminal devices
- H04L 65/00: Network arrangements, protocols or services for supporting real-time applications in data packet communication (real-time or near real-time messaging, e.g. instant messaging [IM] H04L51/04; selective video distribution H04N21/00)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

Audio capture techniques on mobile client devices are described. Video data is obtained by one or more computing devices from a first client device associated with a first user, the video data captured by the first client device of a video scene. Audio data is obtained by the one or more computing devices from a second client device associated with a second user, the second user included in the video data of the video scene. The one or more computing devices ascertain that the audio data is associated with the video data. The association is exposed by the one or more computing device of the audio data to the video data as indicating availability of at least a portion of the audio data as a replacement to audio data captured by the first client device as part of the video data.

## Claims

### Claim 1

A method of leveraging availability of audio data captured by another device, the method comprising:
capturing, by a first client device, video data and first audio data of a video scene;
determining, by the first client device, that second audio data is associated with the video data, the second audio data captured by a second client device;
gaining access, by the first client device, to the second audio data;
receiving, by the first client device, one or more inputs to replace at least a portion of the first audio data with a corresponding portion of the second audio data; and
generating a file configured for playback that includes the corresponding portion of the second audio data configured for output along with the video data.

### Claim 2 (depends on 1)

A method as described in claim 1, wherein the determining that the second audio data is associated with the video data is based in part on a time and location of capturing the second audio data.

### Claim 3 (depends on 2)

A method as described in claim 2, wherein the time and location of capturing the second audio data is determined based on metadata associated with the second audio data.

### Claim 4 (depends on 3)

A method as described in claim 3, wherein the metadata specifies a particular event via manual input from a user of the second client device.

### Claim 5 (depends on 3)

A method as described in claim 3, wherein the metadata specifies a particular event included automatically by the second client device.

### Claim 6 (depends on 3)

A method as described in claim 3, wherein the determining includes a comparison of the metadata with a table of events occurring at specified times and locations.

### Claim 7 (depends on 1)

A method as described in claim 1, wherein the determining includes receiving, from a service provider, an indication of an association of the second audio data with the first video data.

### Claim 8 (depends on 1)

A method as described in claim 1, wherein gaining access includes accessing the second audio data via a service provider storing the second audio data.

### Claim 9 (depends on 1)

A method as described in claim 1, wherein the one or more inputs are received via a user interface of the first client device, the user interface including a representation of the video data, the first audio data, and the second audio data.

### Claim 10 (depends on 1)

A method as described in claim 1, wherein the generated file includes the corresponding portion of the second audio data, another portion of the first audio data, and the video data.

### Claim 11

A computing device comprising:
a processing system; and
a computer-readable storage medium having stored thereon instructions that implement a platform of the computing device that, responsive to execution by the processing system, cause the processor to perform operations comprising:
capturing video data and first audio data of a video scene;
ascertaining, via a service provider, that second audio data is associated with the video data, the second audio data captured by another computing device;
gaining access, via the service provider, to the second audio data;
replacing at least a portion of the first audio data with a corresponding portion of the second audio data; and
generating a file configured for playback that includes the corresponding portion of the second audio data configured for output along with the video data.

### Claim 12 (depends on 11)

A computing device as described in claim 11, wherein the operations further comprise streaming the captured video data to the service provider to match the captured video data to the second audio data.

### Claim 13 (depends on 11)

A computing device as described in claim 11, wherein the operations further comprise uploading, in response to a user input, the captured video data to the service provider for matching the captured video data with the second audio data.

### Claim 14 (depends on 11)

A computing device as described in claim 11, wherein the gaining access comprises requesting, from the service provider, access to the second audio data.

### Claim 15 (depends on 11)

A computing device as described in claim 11, wherein the computing device is one of a mobile phone or a tablet computing device.

### Claim 16 (depends on 11)

A computing device as described in claim 11, wherein the operations further comprise facilitating the ascertaining and the gaining access via a previously downloaded application.

### Claim 17

In a digital medium environment to leverage availability of audio data captured by another device, a system comprising:
means for capturing video data and first audio data of a video scene, the video data including metadata describing one or more of the time or location at which the video data is captured;
means for ascertaining, based in part on the metadata of the video data, that second audio data is associated with the video data, the second audio data captured by the other device and including metadata describing one or more of a time or location at which the second audio data is captured;
means for gaining access to the second audio data;
means for replacing at least a portion of the first audio data with a corresponding portion of the second audio data.

### Claim 18 (depends on 17)

A system as described in claim 17, wherein the other device is closer to the video scene than the first client device.

### Claim 19 (depends on 17)

A system as described in claim 17, wherein the association is ascertained based at least in part on matching the metadata of the video data and the metadata of the audio data.

### Claim 20 (depends on 17)

A system as described in claim 17, wherein one or both of the system and the other device includes a mobile phone.
