# US 10,121,477 B2 · Video assisted digital audio watermarking > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,121,477 B2 - Document ID: US10121477B2 - Status: Granted - Kind: B2 - Application number: 15/359,931 - Filed: 2016-11-23 - Published: 2018-05-24 - Granted: 2018-11-06 - Earliest claimed: 2016-11-23 - Assignees: ATI Technologies ULC - Applicants: ATI Technologies ULC - Inventors: Tan Peng - Web page: https://patentgrep.com/patent/US10121477B2 ## CPC - G10L 19/018: Audio watermarking, i.e. embedding inaudible data in the audio signal - G11B 27/031: Electronic editing of digitised analogue information signals, e.g. audio or video signals - G11B 27/036: Insert-editing - H04N 5/913: for scrambling {; for copy protection} - H04N 21/233: Processing of audio elementary streams {(monitoring, identification or recognition of audio in broadcast systems H04H60/58)} - H04N 21/23418: {involving operations for analysing video streams, e.g. detecting features or characteristics (television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)} - H04N 21/8358: involving watermark {(protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467)} - H04N 21/8456: {by decomposing the content in the time domain, e.g. in time segments} - G11B 20/00891: {embedded in audio data} - H04N 2005/91335: {the copy protection signal being a watermark} - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING - G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A system and method for embedding digital audio watermarks in audio source information based at least upon identified video content are described. An audio/video processing system receives audiovisual data. A video content analyzer within the system analyzes video source information of the audiovisual data, determines video content depicted by data in the video source information, and generates an indication of the video content. An audio watermark embedder of the system receives the indication, and based at least in part on the indication, adjusts watermark embedding parameters used for embedding the audio watermark in the audio source information. ## Claims ### Claim 1 An audio watermarking embedder comprising: an interface configured to receive an identification of video content represented by data in a video frame; and control logic configured to: select a watermark embedding parameter used for embedding an audio watermark in an audio frame based at least in part on the identification of video content; embed the audio watermark in an audio frame corresponding to the video frame based at least in part on the selected watermark embedding parameter; embed a first amount of data of the audio watermark in the audio frame based at least in part on detecting the identification of video content represents a first scene; and embed a second amount of data different from the first amount of data of the audio watermark in the audio frame based at least in part on detecting the indication of video content represents a second scene different from the first scene. ### Claim 2 (depends on 1) The audio watermarking embedder as recited in claim 1, wherein the control logic is further configured to: embed the audio watermark in the audio frame with a first energy level based at least in part on detecting the identification of video content represents a first scene; and embed the audio watermark in the audio frame with a second energy level different from the first energy level based at least in part on detecting the identification of video content represents a second scene different from the first scene. ### Claim 3 (depends on 1) The audio watermarking embedder as recited in claim 1, wherein the control logic is further configured to: embed the audio watermark in the audio frame at a first audio frequency based at least in part on detecting the identification of video content represents a first scene; and embed the audio watermark in the audio frame at a second audio frequency different from the first audio frequency based at least in part on detecting the identification of video content represents a second scene different from the first scene. ### Claim 4 (depends on 1) The audio watermarking embedder as recited in claim 1, wherein identifying the video content comprises: analyzing the data in the video frame; and determining the data depicts one or more video objects. ### Claim 5 (depends on 4) The audio watermarking embedder as recited in claim 4, wherein identifying the video content further comprises associating each of the one or more video objects with a corresponding category of a plurality of categories. ### Claim 6 (depends on 1) The audio watermarking embedder as recited in claim 1, wherein the control logic is further configured to combine the identification of video content with one or more audio decision parameters prior to embedding the audio watermark in the audio frame. ### Claim 7 (depends on 6) The audio watermarking embedder as recited in claim 6, wherein the audio decision parameters comprise one or more of a frequency of a subband and an energy level of a subband. ### Claim 8 A method comprising: receiving an indication identifying video content depicted by data in a video frame; selecting a watermark embedding parameter used for embedding an audio watermark in an audio frame based at least in part on the identification of video content; embedding the audio watermark in an audio frame corresponding to the video frame based at least in part on the selected watermark embedding parameter; embedding a first amount of data of the audio watermark in the audio frame based at least in part on detecting the identification of video content represents a first scene; and embedding a second amount of data different from the first amount of data of the audio watermark in the audio frame based at least in part on detecting the indication of video content represents a second scene different from the first scene. ### Claim 9 (depends on 8) The method as recited in claim 8, further comprising: embedding the audio watermark in the audio frame with a first energy level based at least in part on detecting the identification of video content represents a first scene; and embedding the audio watermark in the audio frame with a second energy level different from the first energy level based at least in part on detecting the indication represents a second scene different from the first scene. ### Claim 10 (depends on 8) The method as recited in claim 8, further comprising: embedding the audio watermark in the audio frame at a first audio frequency based at least in part on detecting the identification of video content represents a first scene; and embedding the audio watermark in the audio frame at a second audio frequency different from the first audio frequency based at least in part on detecting the identification of video content represents a second scene different from the first scene. ### Claim 11 (depends on 8) The method as recited in claim 8, wherein the identifying the video content comprises: analyzing the data in the video frame; and determining the data depicts one or more video objects. ### Claim 12 (depends on 11) The method as recited in claim 11, wherein identifying the video content further comprises associating each of the one or more video objects with a corresponding category of a plurality of categories. ### Claim 13 (depends on 8) The method as recited in claim 8, wherein the control logic is further configured to combine the identification of video content with one or more audio decision parameters prior to embedding the audio watermark in the audio frame. ### Claim 14 (depends on 13) The method as recited in claim 13, wherein the audio decision parameters comprise one or more of a frequency of a subband and an energy level of a subband. ### Claim 15 An audio/video processing system comprising: a video content analyzer; and an audio watermarking embedder; wherein the video content analyzer is configured to: analyze data in a video frame; identify video content depicted by the data; and generate an indication of the video content; and wherein the audio watermarking embedder is configured to: receive the indication of the video content; select a watermark embedding parameter used for embedding an audio watermark in an audio frame based at least in part on the identification of video content; and embed the audio watermark in an audio frame corresponding to the video frame based at least in part on the selected watermark embedding parameter; embed a first amount of data of the audio watermark in the audio frame based at least in part on detecting the identification of video content represents a first scene; and embed a second amount of data different from the first amount of data of the audio watermark in the audio frame based at least in part on detecting the indication of video content represents a second scene different from the first scene. ### Claim 16 (depends on 15) The audio/video processing system as recited in claim 15, wherein the audio watermarking embedder is further configured to: embed the audio watermark in the audio frame with a first energy level based at least in part on detecting the identification of video content represents a first scene; and embed the audio watermark in the audio frame with a second energy level different from the first energy level based at least in part on detecting the indication represents a second scene different from the first scene. ### Claim 17 (depends on 15) The audio/video processing system as recited in claim 15, wherein the audio watermarking embedder is further configured to: embed the audio watermark in the audio frame at a first audio frequency based at least in part on detecting the identification of video content represents a first scene; and embed the audio watermark in the audio frame at a second audio frequency different from the first audio frequency based at least in part on detecting the identification of video content represents a second scene different from the first scene.