US 11,113,092 B2Granted

Global HRTF repository

AssigneeSony Corporation

InventorsJames R. Milne, Gregory Carlsson, Tonni Sandager Larsen

Life of this patent

Estimating the term…

Loading patent…

Abstract

A cloud-based HRTF repository system that can be accessed via a public application program interface (API) on the remote repository server to permit individual users of audio-capable client devices to upload and store personalized HRTFs and basic device data in an open format. The cloud server repository includes a computer readable non-volatile memory which further includes a program memory portion comprising an application program interface (API) module configured for receiving HRTF data from a client device, or from a brand manufacturer, and for sending HRTF data to a client device. A brand manufacturer can upload HRTF data to the cloud-based HRTF repository system either directly from their branded companion app in a client device, or optionally via their own cloud server. One technique includes using a Media Service Provider (MSP) app in the client device with a provided server access library (SAL) thereby enabling retrieval of HRTF data for bath a personalized HRTF for any brand client device, or for retrieval of generalized HRTF data by brand manufacturers having a SAL in their brand server via the remote server repository public API.

Claims16

Dependent claims

A system comprising:

a. a computer readable non-transitory medium, said medium further comprising:
a program memory portion further comprising an application program interface (API) module configured for receiving data items from a client device and for sending data items to a client device,
a first data memory portion comprising client validation data representing at least one of a user-related identifier, a type of device, and
a second data memory portion comprising head related transfer function (HRTF) data sorted according to said client validation data, and
b. a processor in electronic communication with said computer readable non-transitory medium configured to receive request for a client HRTF, the request comprising client validation data, the API to cause the processor to:
compare the client validation data received in the request with the client validation data stored in the first data memory portion, and responsive to validating that the client validation data received in the request matches the client validation data stored in the first memory portion:
send a selection prompt to the client device, wherein API executed by the processor is to cause at least one user interface (UI) to be presented at the client device to generate transfer mode selection data, the UI comprising a perceptible prompt to select at least one of retrieve HRTF data, upload HRTF data, specify a virtual audio mode, or cancel the transaction, and the at least one UI comprising three or more of location cues for identifying the client HRTF, the three or more location cues comprising three of more of center (C), left front (LF), right front (RF), left surround (LS), right surround (RS), center height (CH), left front height (LFH), right front height (RFH), left surround height (LSH), right surround height (RSH), center bottom (CB), right front bottom (RFB), left front bottom (LFB) low frequency effects (LFE) right surround bottom (RSB), and left surround bottom (LSB);
receive the transfer mode selection data and location cues from the client device;
and
responsive to receiving from the client device a request for audio content, cause the API to receive audio content from an audio source, such that the audio content can be convoluted with the client HRTF to provide virtualized audio to the client device in accordance with the selected location cues.

7 more elements

A method, comprising:

executing an application program module in a client device, the application program module configured to upload and download head-related transfer functions (HRTFs) related to the specific client device, at least in part by:
initiating execution of the application program module causing the application program module to send validation data comprising at least one of a user-related identifier and a type of device to an API on a remote server and responsive to a successful validation,
receiving from the remote server a transfer mode selection UI and presenting said transfer mode UI on a display;
animating execution of the transfer mode selection UI received from the remote server API by:
causing the application program module to prompt the client device user to select from one of uploading HRTF data, downloading HRTF data, specify a desired virtualization mode, cancelling the transfer;
causing a virtualization user interface (UI) to be presented on the client device, the virtualization UI comprising three or more of location cues for identifying a HRTF, the three or more location cues comprising three of more of center (C), left front (LF), right front (RF), left surround (LS), right surround (RS), center height (CH), left front height (LFH), right front height (RFH), left surround height (LSH), right surround height (RSH), center bottom (CB), right front bottom (RFB), left front bottom (LFB) low frequency effects (LFE) right surround bottom (RSB), and left surround bottom (LSB);
responsive to selection of the location cues by the client device user, sending by the application program module, at least the location cues to the remote server API;
and
responsive to a request from the client device to receive audio content, causing the application program module to provide virtualized audio received from the remote server API in accordance with the selected HRTF and the selected location cues.

6 more elements

A device comprising:

at least one processor configured with instructions executable to:
provide user validation information comprising at least one of a user identifier and a type of device to a remote server API over a network,
present on at least one client device at least one virtualization user interface (UI), the virtualization UI comprising three or more of location cues for identifying a HRTF, the three or more location cues comprising three of more of center (C), left front (LF), right front (RF), left surround (LS), right surround (RS), center height (CH), left front height (LFH), right front height (RFH), left surround height (LSH), right surround height (RSH), center bottom (CB), right front bottom (RFB), left front bottom (LFB) low frequency effects (LFE) right surround bottom (RSB), and left surround bottom (LSB);
identify at least one head-related transfer function (HRTF) according to selection from the virtualization UI, the at least one HRTF comprising one or more of user-related HRTF data, generalized brand HRTF data;
provide location cues selected from the virtualization UI to the remote server API;
and
play audio on at least one speaker using at least one HRTF, wherein the audio is convoluted using the at least one HRTF and is played in accordance with the location cues data.

4 more elements

Dependencies are inferred from the claim text.

Facts

Application: 16/424,313Filed 28 May 2019 · us provisional application
Priority: 8 Feb 2019
Published: US 2020/0257548 A113 Aug 2020
Granted: 7 Sep 2021
Term ends: Not estimatedThe source records don’t support an estimate.

Classification13 codes

G06F 9/45558
Hypervisors; Virtual machine monitors: hypervisor-specific management and integration aspects
H04S 7/301
Control circuits for electronic adaptation of the sound field: automatic calibration of stereophonic sound system, e.g. with test microphone
G06F 9/542
Interprogram communication: event management; Broadcasting; Multicasting; Notifications
G06F 9/547
Interprogram communication: remote procedure calls [RPC]; Web services

Family

Application62/803,147Us provisional application · filed 8 Feb 2019
US 2020/0257548 A1Pre-grant publication · published 13 Aug 2020
US 11,113,092 B2This patent

From the US filing history. Foreign family members aren’t listed.

Timeline

Citations

Open elsewhere

Building an agent or pulling many patents? Use the API or MCP server instead of scraping pages. Get an API key