# US 11,444,711 B2 · Vehicle-based media system with audio ad and navigation-related action synchronization feature > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,444,711 B2 - Document ID: US11444711B2 - Status: Granted - Kind: B2 - Application number: 16/997,709 - Filed: 2020-08-19 - Published: 2020-12-03 - Granted: 2022-09-13 - Earliest claimed: 2018-08-03 - Assignees: Gracenote, Inc. - Applicants: Gracenote, Inc. - Inventors: Nisarg A. Modi - Web page: https://patentgrep.com/patent/US11444711B2 ## CPC - H04H 20/62: for transportation systems, e.g. in vehicles - G01C 21/3605: {Destination input or retrieval} - G01C 21/3608: {using speech input, e.g. using speech recognition} - G01C 21/3664: {Details of the user input interface, e.g. buttons, knobs or sliders, including those provided on a touch screen; remote controllers; input using gestures} - G01C 21/3667: {Display of a road map (G01C21/3614 takes precedence; guidance using 3D or perspective road maps G01C21/3635)} - G01C 21/3697: {Output of additional, non-guidance related information, e.g. low fuel level (G01C21/3679 takes precedence)} - G06Q 30/0239: {Online discounts or incentives} - G06Q 30/0266: {based on the position of the vehicle} - G06Q 30/0267: {Wireless devices} - G06Q 30/0277: {Online advertisement} - G10L 15/26: Speech to text systems (G10L15/08 takes precedence) - G10L 19/018: Audio watermarking, i.e. embedding inaudible data in the audio signal - H04H 60/375: {Commercial} - H04H 60/58: of audio {(determination or detection of speech characteristics in general G10L25/00; speech recognition in general G10L15/00)} - H04H 60/64: for providing detail information - H04L 65/611: for multicast or broadcast (systems for broadcast or conference H04L12/18; arrangements for broadcast or distribution combined with broadcast H04H20/00; arrangements for broadcast applications with a direct linkage to broadcast information or to broadcast space-time H04H60/00; selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS], H04W4/06) - H04L 65/70: Media network packetisation - H04L 67/125: involving control of end-device applications over a network - H04N 21/4126: {The peripheral being portable, e.g. PDAs or mobile phones} - H04N 21/41422: {located in transportation means, e.g. personal vehicle (arrangements specially adapted for transportation systems in broadcast systems H04H20/62)} - H04N 21/42203: {sound input device, e.g. microphone} - H04N 21/4394: {involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams (arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58)} - H04N 21/4524: {involving the geographical location of the client (retrieval from the Internet by querying based on geographical locations G06F16/9537; systems specially adapted for using geographical information in broadcast systems H04H60/70; protocols in which the network application is adapted for the location of the user terminal in communication control or processing H04L67/52; services making use of the location of users or terminals in wireless networks H04W4/02; locating users or terminals in wireless networks H04W64/00)} - H04N 21/4784: receiving rewards - H04N 21/8106: {involving special audio data, e.g. different tracks for different languages} - H04R 3/12: for distributing signals to two or more loudspeakers {(specially adapted for hearing aids H04R25/407)} - H04W 4/023: {using mutual or relative location information between multiple location based services [LBS] targets or of distance thresholds} - H04W 4/44: for communication between vehicles and infrastructures, e.g. vehicle-to-cloud [V2C] or vehicle-to-home [V2H] - G10L 25/51: for comparison or discrimination - G11B 27/10: Indexing; Addressing; Timing or synchronising; Measuring tape travel - H04H 2201/90: characterised by the use of signatures - H04L 67/12: specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks - H04L 67/52: specially adapted for the location of the user terminal - H04L 67/53: using third party service providers - H04M 1/72412: using two-way short-range wireless interfaces - H04N 21/812: {involving advertisement data (advertising per se G06Q30/02)} - H04R 2499/13: Acoustic transducers and sound field adaptation in vehicles - H04W 4/02: Services making use of location information - H04W 4/23: for mobile advertising - H04W 4/48: for in-vehicle communication - H04H: BROADCAST COMMUNICATION (multiplex communication H04J; pictorial communication aspects of broadcast systems H04N) - G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S) - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K) - H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72) - G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R) - H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08) ## Abstract In one aspect, an example method to be performed by a vehicle-based media system includes (a) receiving audio content; (b) causing one or more speakers to output the received audio content; (c) using a microphone of the vehicle-based media system to capture the output audio content; (d) identifying reference audio content that has at least a threshold extent of similarity with the captured audio content; (e) identifying a geographic location associated with the identified reference audio content; and (f) based at least on the identified geographic location associated with the identified reference audio content, outputting, via the user interface of the vehicle-based media system, a prompt to navigate to the identified geographic location. ## Claims ### Claim 1 A vehicle-based media system comprising: a user interface; one or more processors; and a non-transitory, computer-readable medium storing instructions that, when executed by the one or more processors, cause the vehicle-based media system to perform a set of operations comprising: receiving audio content; causing one or more speakers to output the received audio content; identifying reference audio content that has at least a threshold extent of similarity with the received audio content; identifying a geographic location associated with the identified reference audio content; and based at least on the identified geographic location associated with the identified reference audio content, outputting, via the user interface of the vehicle-based media system, a prompt to navigate to the identified geographic location. ### Claim 2 (depends on 1) The vehicle-based media system of claim 1, wherein the identified geographic location associated with the identified reference audio content is a first geographic location, wherein the set of operations further comprises determining a second geographic location associated with the vehicle-based media system, and wherein outputting the prompt to navigate to the identified geographic location comprises outputting a prompt to navigate to the first geographic location based on the first geographic location being within a threshold proximity of the second geographic location. ### Claim 3 (depends on 2) The vehicle-based media system of claim 2, wherein determining the second geographic location associated with the vehicle-based media system comprises determining (i) a current geographic location of the vehicle-based media system, (ii) a destined geographic location of the vehicle-based media system, or (iii) a geographic location on a route between the current geographic location of the vehicle-based media system and the destined geographic location of the vehicle-based media system. ### Claim 4 (depends on 1) The vehicle-based media system of claim 1, wherein receiving the audio content comprises receiving primary audio content and secondary audio content, wherein causing the one or more speakers to output the received audio content comprises causing the one or more speakers to output the primary audio content and the secondary audio content, wherein the primary audio content comprises entertainment content, and wherein the secondary audio content comprises advertisement content interspersed among the primary content. ### Claim 5 (depends on 4) The vehicle-based media system of claim 4, wherein: identifying reference audio content that has at least the threshold extent of similarity with the received audio content comprises identifying reference audio content that has at least the threshold extent of similarity with the received secondary audio content. ### Claim 6 (depends on 5) The vehicle-based media system of claim 5, wherein identifying the geographic location associated with the identified reference audio content comprises identifying a geographic location related to particular advertisement content of the secondary audio content, and wherein outputting the prompt to navigate to the identified geographic location comprises, while causing the one or more speakers to output the particular advertisement content of the secondary audio content, outputting the prompt to navigate to the geographic location related to the particular advertisement content. ### Claim 7 (depends on 1) The vehicle-based media system of claim 1, wherein the set of operations further comprises: receiving, via the user interface of the vehicle-based media system, a selection of the prompt to navigate to the identified geographic location; and in response to receiving the selection of the prompt, outputting, via the user interface of the vehicle-based media system, directions for navigating to the identified geographic location. ### Claim 8 (depends on 1) The vehicle-based media system of claim 1, wherein identifying the reference audio content that has at least the threshold extent of similarity with the received audio content comprises: generating audio fingerprint data of the received audio content; comparing the generated audio fingerprint data to a plurality of reference audio fingerprint items; and determining that a particular reference audio fingerprint item of the plurality of reference audio fingerprint items has at least the threshold extent of similarity with the generated audio fingerprint data. ### Claim 9 A method to be performed by a vehicle-based media system, the method comprising: receiving audio content; causing one or more speakers to output the received audio content; identifying reference audio content that has at least a threshold extent of similarity with the received audio content; identifying a geographic location associated with the identified reference audio content; and based at least on the identified geographic location associated with the identified reference audio content, outputting, via a user interface of the vehicle-based media system, a prompt to navigate to the identified geographic location. ### Claim 10 (depends on 9) The method of claim 9, wherein the identified geographic location associated with the identified reference audio content is a first geographic location, wherein the method comprises determining a second geographic location associated with the vehicle-based media system, and wherein outputting the prompt to navigate to the identified geographic location comprises outputting a prompt to navigate to the first geographic location based on the first geographic location being within a threshold proximity of the second geographic location. ### Claim 11 (depends on 10) The method of claim 10, wherein determining the second geographic location associated with the vehicle-based media system comprises determining (i) a current geographic location of the vehicle-based media system, (ii) a destined geographic location of the vehicle-based media system, or (iii) a geographic location on a route between the current geographic location of the vehicle-based media system and the destined geographic location of the vehicle-based media system. ### Claim 12 (depends on 9) The method of claim 9, wherein receiving the audio content comprises receiving primary audio content and secondary audio content, wherein causing the one or more speakers to output the received audio content comprises causing the one or more speakers to output the primary audio content and the secondary audio content, wherein the primary audio content comprises entertainment content, and wherein the secondary audio content comprises advertisement content interspersed among the primary content. ### Claim 13 (depends on 12) The method of claim 12, wherein: identifying reference audio content that has at least the threshold extent of similarity with the received audio content comprises identifying reference audio content that has at least the threshold extent of similarity with the received secondary audio content. ### Claim 14 (depends on 13) The method of claim 13, wherein identifying the geographic location associated with the identified reference audio content comprises identifying a geographic location related to particular advertisement content of the secondary audio content, and wherein outputting the prompt to navigate to the identified geographic location comprises, while causing the one or more speakers to output the particular advertisement content of the secondary audio content, outputting the prompt to navigate to the geographic location related to the particular advertisement content. ### Claim 15 (depends on 9) The method of claim 9, wherein the method further comprises: receiving, via the user interface of the vehicle-based media system, a selection of the prompt to navigate to the identified geographic location; and in response to receiving the selection of the prompt, outputting, via the user interface of the vehicle-based media system, directions for navigating to the identified geographic location. ### Claim 16 (depends on 9) The method of claim 9, wherein identifying the reference audio content that has at least the threshold extent of similarity with the received audio content comprises: generating audio fingerprint data of the received audio content; comparing the generated audio fingerprint data to a plurality of reference audio fingerprint items; and determining that a particular reference audio fingerprint item of the plurality of reference audio fingerprint items has at least the threshold extent of similarity with the generated audio fingerprint data. ### Claim 17 A non-transitory, computer-readable medium, having stored thereon program instructions that, upon execution by a vehicle-based media system, cause the vehicle-based media system to perform a set of operations comprising: receiving audio content; causing one or more speakers to output the received audio content; identifying reference audio content that has at least a threshold extent of similarity with the received audio content; identifying a geographic location associated with the identified reference audio content; and based at least on the identified geographic location associated with the identified reference audio content, outputting, via a user interface of the vehicle-based media system, a prompt to navigate to the identified geographic location. ### Claim 18 (depends on 17) The non-transitory, computer-readable medium of claim 17, wherein the identified geographic location associated with the identified reference audio content is a first geographic location, wherein the set of operations further comprises determining a second geographic location associated with the vehicle-based media system, and wherein outputting the prompt to navigate to the identified geographic location comprises outputting a prompt to navigate to the first geographic location based on the first geographic location being within a threshold proximity of the second geographic location. ### Claim 19 (depends on 18) The non-transitory, computer-readable medium of claim 18, wherein determining the second geographic location associated with the vehicle-based media system comprises determining (i) a current geographic location of the vehicle-based media system, (ii) a destined geographic location of the vehicle-based media system, or (iii) a geographic location on a route between the current geographic location of the vehicle-based media system and the destined geographic location of the vehicle-based media system. ### Claim 20 (depends on 17) The non-transitory, computer-readable medium of claim 17, wherein: receiving the audio content comprises receiving primary audio content and secondary audio content, the primary audio content comprising entertainment content, and the secondary audio content comprising advertisement content interspersed among the primary content, causing the one or more speakers to output the received audio content comprises causing the one or more speakers to output the primary audio content and the secondary audio content, identifying reference audio content that has at least the threshold extent of similarity with the received audio content comprises identifying reference audio content that has at least the threshold extent of similarity with the received secondary audio content, identifying the geographic location associated with the identified reference audio content comprises identifying a geographic location related to particular advertisement content of the secondary audio content, and outputting the prompt to navigate to the identified geographic location comprises, while causing the one or more speakers to output the particular advertisement content of the secondary audio content, outputting the prompt to navigate to the geographic location related to the particular advertisement content.