# US 10,504,200 B2 · Metadata acquisition using embedded watermarks > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,504,200 B2 - Document ID: US10504200B2 - Status: Granted - Kind: B2 - Application number: 14/805,303 - Filed: 2015-07-21 - Published: 2015-11-12 - Granted: 2019-12-10 - Earliest claimed: 2014-03-13 - Assignees: Verance Corporation - Applicants: Verance Corporation - Inventors: Joseph M. Winograd; Jian Zhao; Rade Petrovic - Web page: https://patentgrep.com/patent/US10504200B2 ## CPC - G06T 1/0021: {Image watermarking} - G06F 16/48: Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually - G06F 16/9566: {URL specific, e.g. using aliases, detecting broken or misspelled links} - H04L 65/611: for multicast or broadcast (systems for broadcast or conference H04L12/18; arrangements for broadcast or distribution combined with broadcast H04H20/00; arrangements for broadcast applications with a direct linkage to broadcast information or to broadcast space-time H04H60/00; selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS], H04W4/06) - H04L 65/612: for unicast - H04L 65/80: Responding to QoS - H04L 67/561: Adding application-functional data or data for application control, e.g. adding metadata - H04L 67/5683: Storage of data provided by user terminals, i.e. reverse caching - H04N 21/23418: {involving operations for analysing video streams, e.g. detecting features or characteristics (television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)} - H04N 21/6125: {involving transmission via Internet (transmission by internet of broadcast information H04H60/82)} - H04L 61/302: {Administrative registration, e.g. for domain names at internet corporation for assigned names and numbers [ICANN]} - H04L 61/4511: using domain name system [DNS] - H04L 67/02: based on web technology, e.g. hypertext transfer protocol [HTTP] - H04L 67/53: using third party service providers - H04L 2101/35: containing special prefixes - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Methods, devices and computer program products are described that improve acquisition of metadata that is associates with a multimedia content, such an audio or video content. In one exemplary method, the multimedia content is received at a first device that is equipped with a watermark detector and watermark extraction operations are conducted to detect a plurality of watermark messages. Each watermark message includes a server code and an interval code. In this method, a server Internet Protocol (IP) address is obtained that corresponds to a server that stores at least a portion of the metadata associated with the multimedia content. The IP address corresponds to at least one of the server codes detected from the plurality of watermark messages. According to the above method, the metadata is requested from the server having the server IP address, and a response including the metadata associated with the multimedia content is received. ## Claims ### Claim 1 A method for providing metadata associated with a multimedia content, comprising: receiving a query at a metadata server, the query having been initiated by a requesting device coupled to a network, the query including an interval code having been obtained from a watermark message embedded in the multimedia content, the interval code identifying a specific interval of the multimedia content, the metadata server identifiable by an Internet Protocol (IP) address obtained based on a server code of the watermark message embedded in the multimedia content; and transmitting a response to the query based on information in the received query including the server code and the interval code, the response comprising at least a portion of metadata including an Interval Start Time indicative of a starting time of a particular segment of the multimedia content that carries the interval code and at least one of the following: a service identification value indicative of a service associated with at least one watermarked segment of the multimedia content; an activation time value indicative of a starting time at which an application or service associated with the multimedia content is available for activation; a next query time value indicative of an earliest time at which a new query for an event or service is permitted to occur; or a next query slack indicative of a time duration during which a new query is allowed to occur. ### Claim 2 (depends on 1) The method of claim 1, further comprising, in response to the query, providing an interactive content to the requesting device that is based on the received interval code. ### Claim 3 (depends on 1) The method of claim 1, further comprising receiving at least a portion of the metadata from an additional server that is associated with a server registrant device or a content provider device, and storing the at least a portion of the metadata at the metadata server. ### Claim 4 (depends on 3) The method of claim 3, further comprising receiving an interactive content from the additional server that is associated with the content provider device and storing the received interactive content at the metadata server. ### Claim 5 (depends on 1) The method of claim 1, wherein the response further comprises an identification value uniquely identifying a program that at least one watermarked segment of the multimedia content is part of. ### Claim 6 A server device, comprising: at least one processor; a non-transitory data storage device configured to store one or more of metadata or interactive multimedia content; and a memory, comprising processor executable code, the processor executable code when executed by one of the at least one processor configures to server device to: receive a query at a metadata server, the query having been initiated by a requesting device coupled to a network, the query including an interval code having been obtained from a watermark message embedded in the multimedia content, the metadata server identifiable by an Internet Protocol (IP) address obtained based on a server code of the watermark message embedded in the multimedia content; and transmit a response to the query based on information in the received query including the server code and the interval code, the response comprising at least a portion of metadata including an Interval Start Time indicative of a starting time of a particular segment of the multimedia content that carries the interval code and at least one of the following: a service identification value indicative of a service associated with at least one watermarked segment of the multimedia content; an activation time value indicative of a starting time at which an application or service associated with the multimedia content is available for activation; a next query time value indicative of an earliest time at which a new query for an event or service is permitted to occur; or a next query slack indicative of a time duration during which a new query is allowed to occur. ### Claim 7 (depends on 6) The server device of claim 6, the processor executable code when executed by the at least one processor further configures to server device to, in response to the query, provide an interactive content to the requesting device that is based on the received interval code. ### Claim 8 (depends on 6) The server device of claim 6, wherein the processor executable code when executed by the at least one processor further configures to server device to receive at least a portion of the metadata from an additional server that is associated with a server registrant device or a content provider device, and store the at least a portion of the metadata at the metadata server. ### Claim 9 (depends on 8) The server device of claim 8, wherein the processor executable code when executed by the at least one processor further configures to server device to receive an interactive content from the additional server that is associated with the content provider device and store the received interactive content at the metadata server. ### Claim 10 A computer program product, embodied on one or more non-transitory computer readable media, comprising: program code for receiving a query at a metadata server, the query having been initiated by a requesting device coupled to a network, the query including an interval code having been obtained from a watermark message embedded in the multimedia content, the metadata server identifiable by an Internet Protocol (IP) address obtained based on a server code of the watermark message embedded in the multimedia content; and program code for transmitting a response to the query based on information in the received query including the server code and the interval code, the response comprising at least a portion of metadata including an Interval Start Time indicative of a starting time of a particular segment of the multimedia content that carries the interval code and at least one of the following: a service identification value indicative of a service associated with at least one watermarked segment of the multimedia content; an activation time value indicative of a starting time at which an application or service associated with the multimedia content is available for activation; a next query time value indicative of an earliest time at which a new query for an event or service is permitted to occur; or a next query slack indicative of a time duration during which a new query is allowed to occur.