# US 11,907,287 B2 · Source classification using HDMI audio metadata > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,907,287 B2 - Document ID: US11907287B2 - Status: Granted - Kind: B2 - Application number: 17/883,394 - Filed: 2022-08-08 - Published: 2023-03-02 - Granted: 2024-02-20 - Earliest claimed: 2019-06-13 - Assignees: The Nielsen Company (US), LLC - Applicants: The Nielsen Company (US), LLC - Inventors: Robert E. Taylor - Web page: https://patentgrep.com/patent/US11907287B2 ## CPC - G06F 16/683: using metadata automatically derived from the content - G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path} - G06F 18/24: Classification techniques - G10L 19/167: {Audio streaming, i.e. formatting and decoding of an encoded audio signal representation into a data stream for transmission or storage purposes} - G10L 25/30: using neural networks - G10L 25/57: for processing of video signals - G11B 20/00: Signal processing not specific to the method of recording or reproducing; Circuits therefor - H03M 7/30: Compression (speech analysis-synthesis for redundancy reduction G10L19/00; for image communication H04N); Expansion; Suppression of unnecessary data, e.g. redundancy reduction - H03M 7/42: using table look-up for the coding or decoding process, e.g. using read-only memory {(H03M7/4006 takes precedence)} - H04H 60/31: Arrangements for monitoring the use made of the broadcast services - H04N 21/25891: {being end-user preferences (retrieval of video data in a video database based on user preferences G06F16/739; arrangements for recognizing users' preferences H04H60/46; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18)} - H04N 21/43635: {HDMI} - H04N 21/44204: {Monitoring of content usage, e.g. the number of times a movie has been viewed, copied or the amount which has been watched (monitoring of user activities for profile generation for accessing a video database G06F16/739; protecting generic digital content where the protection is independent of the precise nature of the content G06F21/10; arrangements for monitoring the use made of the broadcast services in broadcast systems H04H60/31)} - H04N 21/6582: {Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number (arrangements where receivers interact with the broadcast H04H20/38)} - H04N 21/8405: represented by keywords - G11B 2020/00014: {the compressed signal being an audio signal} - G11B 2020/00028: {Advanced audio coding [AAC]} - H04H 60/58: of audio {(determination or detection of speech characteristics in general G10L25/00; speech recognition in general G10L15/00)} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING - G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R) - H03M: CODING; DECODING; CODE CONVERSION IN GENERAL (using fluidic means F15C4/00; optical analogue/digital converters G02F7/00; coding, decoding or code conversion, specially adapted for particular applications, see the relevant subclasses, e.g. G01D, G01R, G06F, G06T, G09G, G10L, G11B, G11C, H04B, H04L, H04M, H04N; ciphering or deciphering for cryptography or other purposes involving the need for secrecy G09C) - H04H: BROADCAST COMMUNICATION (multiplex communication H04J; pictorial communication aspects of broadcast systems H04N) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Methods, apparatus, systems and articles of manufacture are disclosed for source classification using HDMI audio metadata. An example apparatus includes a metadata extractor to extract values of audio encoding parameters from HDMI metadata obtained from a monitored HDMI port of a media device, the HDMI metadata corresponding to media being output from the monitored HDMI port; map the extracted values of the audio encoding parameters to a first unique encoding class (UEC) in a set of defined UECs, different ones of the set of defined UECs corresponding to different combinations of possible values of the audio encoding parameters capable of being included in the HDMI metadata; and identify a media source corresponding to the media output from the HDMI port based on one or more possible media sources mapped to the first UEC. ## Claims ### Claim 1 An apparatus to perform source classification, the apparatus comprising: at least one memory; instructions; and processor circuitry to execute the instructions to: extract values of audio encoding parameters from high definition multimedia interface (HDMI) metadata obtained from a monitored HDMI port of a media device, the HDMI metadata corresponding to media being output from the monitored HDMI port; map the extracted values of the audio encoding parameters to a first unique encoding class (UEC) in a set of defined UECs, different ones of the set of defined UECs corresponding to different combinations of possible values of the audio encoding parameters capable of being included in the HDMI metadata; and identify a media source corresponding to the media that is output from the monitored HDMI port based on one or more possible media sources mapped to the first UEC. ### Claim 2 (depends on 1) The apparatus of claim 1, wherein the HDMI metadata is extracted prior to being decoded. ### Claim 3 (depends on 1) The apparatus of claim 1, wherein the HDMI metadata is included in an audio stream output from the monitored HDMI port of the media device. ### Claim 4 (depends on 3) The apparatus of claim 3, wherein the audio stream includes transport parameters and licensed encoded audio data. ### Claim 5 (depends on 4) The apparatus of claim 4, wherein the extracted values correspond to the transport parameters. ### Claim 6 (depends on 1) The apparatus of claim 1, wherein the processor circuitry is to determine a disambiguation confidence associated with the map of the extracted values of the audio encoding parameters to the first UEC. ### Claim 7 (depends on 6) The apparatus of claim 6, wherein the processor circuitry is to determine the disambiguation confidence based on a number of values in the first UEC that match a number of values in a defined UEC. ### Claim 8 (depends on 7) The apparatus of claim 7, wherein the processor circuitry is to identify the media source is mapped to the first UEC. ### Claim 9 An apparatus to perform source classification, the apparatus comprising: a media interceptor to intercept high definition multimedia interface (HDMI) data from a media stream output from a monitored HDMI port of a media device; and a metadata extractor to: parse the HDMI data to determine that first media encoding parameters contained in the HDMI data correspond to a first unique encoding class (UEC) of a set of defined UECs, different ones of the set of defined UECs corresponding to different possible combinations of media encoding parameters capable of being included in the HDMI data; and identify a media source corresponding to the media stream output based on one or more possible media sources corresponding to the first UEC. ### Claim 10 (depends on 9) The apparatus of claim 9, further including a metadata converter to convert the HDMI data into a converted metadata format for transmission to a central facility. ### Claim 11 (depends on 9) The apparatus of claim 9, further including a demultiplexer to demultiplex and provide the HDMI data to the metadata extractor. ### Claim 12 (depends on 9) The apparatus of claim 9, wherein the metadata extractor is to determine a disambiguation confidence based on values of the first media encoding parameters associated with the first UEC. ### Claim 13 (depends on 12) The apparatus of claim 12, wherein the metadata extractor is to determine the disambiguation confidence based on a number of values in the first UEC that match a number of values in a defined UEC. ### Claim 14 (depends on 9) The apparatus of claim 9, wherein the media stream is an audio stream, the media stream includes transport parameters and licensed encoded audio data, and the values of the first media encoding parameters correspond to the transport parameters. ### Claim 15 An apparatus to perform source classification, the apparatus comprising: at least one memory; instructions in the apparatus; and processor circuitry to execute the instructions to: intercept high definition multimedia interface (HDMI) data of a media stream output from a monitored HDMI port of a media device; identify HDMI metadata; parse the HDMI metadata; determine that first media encoding parameters contained in the HDMI metadata correspond to a first unique encoding class (UEC) of a set of defined UECs, different ones of the set of defined UECs corresponding to different possible combinations of media encoding parameters capable of being included in the HDMI metadata; and identify a media source corresponding to media that is output based on one or more possible media sources corresponding to the first UEC. ### Claim 16 (depends on 15) The apparatus of claim 15, wherein the processor circuitry is to convert the HDMI metadata into a converted metadata format for transmission to a central facility. ### Claim 17 (depends on 15) The apparatus of claim 15, wherein the processor circuitry is to demultiplex the HDMI metadata. ### Claim 18 (depends on 15) The apparatus of claim 15, wherein the processor circuitry is to determine a disambiguation confidence based on values of the first media encoding parameters associated with the first UEC. ### Claim 19 (depends on 18) The apparatus of claim 18, wherein the processor circuitry is to determine the disambiguation confidence based on a number of values in the first UEC that match a number of values in a defined UEC. ### Claim 20 (depends on 18) The apparatus of claim 18, wherein the media stream is an audio stream, the audio stream includes transport parameters and licensed encoded audio data, and the values of the first media encoding parameters correspond to the transport parameters.