# US 10,121,513 B2 · Dynamic image content overlaying > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,121,513 B2 - Document ID: US10121513B2 - Status: Granted - Kind: B2 - Application number: 15/251,557 - Filed: 2016-08-30 - Published: 2018-03-01 - Granted: 2018-11-06 - Earliest claimed: 2016-08-30 - Assignees: International Business Machines Corporation - Applicants: International Business Machines Corporation - Inventors: Anthony E. Martinez; Vanessa V. Michelini; Vishwa Persaud - Web page: https://patentgrep.com/patent/US10121513B2 ## CPC - G11B 27/036: Insert-editing - G06V 20/46: {Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames} - G11B 27/34: Indicating arrangements {(indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D)} - H04N 21/23424: {involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement} - H04N 21/23439: {for generating different versions} - H04N 21/2668: Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles {(information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063)} - H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)} - H04N 21/812: {involving advertisement data (advertising per se G06Q30/02)} - H04N 21/8146: {involving graphical data, e.g. 3D object, 2D graphics} - G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Systems and methods for dynamic image content overlaying are disclosed. In embodiments, a computer-implemented method comprises analyzing one or more digital image frames for the presence of a placeholder, wherein the placeholder overlays a dynamic image space on a display object and includes a content identifier and a contour mesh; determining the content identifier; retrieving select image content based on the content identifier; determining an orientation of the dynamic image space; transforming the select image content to produce transformed image content that matches the contour mesh and the orientation of the dynamic image space; and replacing the placeholder with the transformed image content to produce a set of one or more embedded image frames. ## Claims ### Claim 1 A computer-implemented method, comprising: analyzing, by a computing device, one or more digital image frames for the presence of a placeholder, wherein the placeholder overlays a dynamic image space on a display object and includes: a content identifier; a contour mesh conveying information regarding the contours and skew of the display object; and at least one corner glyph comprising the content identifier bracketed by a first dimension line and a second dimension line, the first dimension line and second dimension line intersecting at a right angle, a first end cap on the first dimension line, a second end cap on the second dimension line, and one or more scale marks on the first dimension line, wherein the content identifier is a number; determining, by the computing device, the content identifier; retrieving, by the computing device, select image content based on the content identifier; determining, by the computing device, an orientation of the dynamic image space; transforming, by the computing device, the select image content to produce transformed image content that matches the contour mesh and the orientation of the dynamic image space; and replacing, by the computing device, the placeholder with the transformed image content to produce a set of one or more embedded image frames. ### Claim 2 (depends on 1) The method of claim 1, further comprising: mapping the content identifier to the select image content to obtain mapping data; and saving the mapping data in a mapping database. ### Claim 3 (depends on 1) The method of claim 1, further comprising recording, by the computing device, the one or more digital image frames, wherein the analyzing the one or more digital image frames is performed in real time during the recording. ### Claim 4 (depends on 1) The method of claim 1, further comprising visually rendering the set of one or more embedded image frames to a viewer. ### Claim 5 (depends on 1) The method of claim 1, wherein the determining the orientation of the dynamic image space includes determining an orientation of the at least one corner glyph of the placeholder. ### Claim 6 (depends on 5) The method of claim 5, wherein the placeholder includes a plurality of corner glyphs. ### Claim 7 (depends on 5) The method of claim 5, further comprising determining a scale of the dynamic image space based on the first and second dimension lines and the one or more scale marks of the corner glyph. ### Claim 8 (depends on 1) The method of claim 1, further comprising: copying, by the computer device, the one or more digital image frames to produce a second set of digital image frames including a copied placeholder; retrieving, by the computing device, second select image content based on the content identifier; transforming, by the computer device, the second select image content to produce second transformed image content that matches the contour mesh and the orientation of the dynamic image space; and replacing, by the computer device, the copied placeholder with the second transformed image content to produce a second set of one or more embedded image frames, wherein the select image content and the second select image content are different, resulting in differences between the set of one or more embedded image frames and the second set of one or more embedded image frames. ### Claim 9 A computer program product for dynamic image content overlay, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a computing device to cause the computing device to: analyze a digital video stream for the presence of a placeholder, wherein the placeholder overlays a dynamic image space on a display object and includes: a content identifier; a contour mesh conveying information regarding the contours and skew of the display object; and at least one corner glyph comprising the content identifier bracketed by a first dimension line and a second dimension line, the first dimension line and second dimension line intersecting at a right angle, a first end cap on the first dimension line, a second end cap on the second dimension line, and one or more scale marks on the first dimension line, wherein the content identifier is a number; determine the content identifier; retrieve select image content from a content database based on the content identifier; determine an orientation of the dynamic image space; transform the select image content to produce transformed image content that matches the contour mesh and the orientation of the dynamic image space; and replace the placeholder with the transformed image content to produce an embedded digital video stream. ### Claim 10 (depends on 9) The computer program product of claim 9, wherein the program instructions further cause the computing device to: map the content identifier to the select image content to obtain mapping data; and save the mapping data in a mapping database. ### Claim 11 (depends on 9) The computer program product of claim 9, wherein the program instructions further cause the computing device to record the digital video stream, wherein the analyzing the digital video stream is performed in real time during the recording. ### Claim 12 (depends on 9) The computer program product of claim 9, wherein the program instructions further cause the computing device to visually render the embedded digital video stream to a viewer. ### Claim 13 (depends on 9) The computer program product of claim 9, wherein the determining the orientation of the dynamic image space includes determining an orientation of the at least one corner glyph of the placeholder. ### Claim 14 (depends on 13) The computer program product of claim 13, wherein the placeholder includes a plurality of corner glyphs. ### Claim 15 (depends on 9) The computer program product of claim 9, wherein the program instructions further cause the computing device to identify characteristics of the contour mesh by determining a scale of the dynamic image space based on the first and second dimension lines and the one or more scale marks of the placeholder. ### Claim 16 (depends on 9) The computer program product of claim 9, wherein the program instructions further cause the computing device to: copy the digital video stream to produce a second set digital video stream including a copied placeholder; retrieve second select image content based on the content identifier; transform the second select image content to produce second transformed image content that matches the contour mesh and the orientation of the dynamic image space; replace the copied placeholder with the second transformed image content to produce a second embedded digital video stream, wherein the select image content and the second select image content are different, resulting in differences between the embedded digital video stream and the second embedded digital video stream. ### Claim 17 A system for dynamic image content overlay comprising: a CPU, a computer readable memory and a computer readable storage medium associated with a computing device; program instructions to record a digital image stream of a moving display object, the digital image stream comprises frames; program instructions to analyze the digital video stream in real time during the recording for the presence of a placeholder, wherein the placeholder overlays a dynamic image space on the display object and includes a content identifier and a contour mesh; program instructions to determine the content identifier; program instructions to retrieve select image content from a content database based on the content identifier; program instructions to determine an orientation of the dynamic image space for each frame of the digital image stream in which the placeholder is present; program instructions to transform the select image content to produce transformed image content that matches a contour mesh and an orientation of the dynamic image space for each frame of the digital image stream in which the placeholder is present; and program instructions to replace the placeholder with the transformed image content for each frame of the digital image stream in which the placeholder is present to produce an embedded digital video stream; wherein the program instructions are stored on the computer readable storage medium for execution by the CPU via the computer readable memory; and wherein the placeholder further includes at least one corner glyph comprising the content identifier bracketed by a first dimension line and a second dimension line, the first dimension line and second dimension line intersecting at a right angle, a first end cap on the first dimension line, a second end cap on the second dimension line, and one or more scale marks on the first dimension line, wherein the content identifier is a number. ### Claim 18 (depends on 17) The system of claim 17, wherein the program instructions to determine the orientation of the dynamic image space include instructions to determine the orientation of the at least one corner glyph. ### Claim 19 (depends on 17) The system of claim 17, further comprising program instructions to identify characteristics of the contour mesh for each frame of the digital image stream in which the placeholder is present by determining a scale of the dynamic image space based on the first dimension line, the second dimension line, and the one or more scale marks of the at least one corner glyph.