# US 11,907,285 B2 · Surrogate metadata aggregation for dynamic content assembly > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,907,285 B2 - Document ID: US11907285B2 - Status: Granted - Kind: B2 - Application number: 17/502,137 - Filed: 2021-10-15 - Published: 2022-02-03 - Granted: 2024-02-20 - Earliest claimed: 2019-06-18 - Assignees: AT&T Intellect al Property I, L.P. - Applicants: AT&T Intellectual Property I, L.P. - Inventors: Robert Alan Koch; Ari Craine - Web page: https://patentgrep.com/patent/US11907285B2 ## CPC - G06F 16/5866: {using information manually generated, e.g. tags, keywords, comments, manually generated location and time information} - G06F 16/5854: {using shape and object relationship} - G06F 16/587: using geographical or spatial information, e.g. location - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract Concepts and technologies directed to surrogate metadata aggregation for dynamic content assembly are disclosed. Embodiments can include a system that comprises a processor and a memory that stores computer-executable instructions that configure a processor to perform operations. The operations can include obtaining a first visual content from a digital data store, where the first visual content is configured to digitally represent a first scene. The operations can include performing image recognition on the first visual content so as to identify a second visual content that is digitally configured to represent a second scene. The operations can include determining that native original metadata cannot be obtained for the first visual content, where the native original metadata includes information about the first scene digitally represented by the first visual content. The operation can include generating surrogate metadata for the first visual content based on metadata obtained from the second visual content. ## Claims ### Claim 1 A system comprising: a processor; and a memory that stores computer-executable instructions that, in response to execution by the processor, cause the processor to perform operations, the operations comprising: obtaining a first visual content from a digital data store, wherein the first visual content is configured to digitally represent a first scene; performing image recognition on the first visual content so as to identify a second visual content that is digitally configured to represent a second scene, wherein identification of the second visual content is based on the second visual content having an amount of image features that is shared with the first visual content, and wherein the amount of image features exceeds a shared feature threshold; determining that native original metadata cannot be obtained for the first visual content, wherein the native original metadata includes information about the first scene digitally represented by the first visual content; and generating surrogate metadata for the first visual content based on metadata obtained from the second visual content, wherein the generating the surrogate metadata comprises: identifying, for the first visual content, tags within the metadata from the second visual content; determining which of the tags within the metadata are marked as surrogate importable; and assembling the surrogate metadata based on the tags that are marked as surrogate importable. ### Claim 2 (depends on 1) The system of claim 1, wherein the operations further comprise embedding the surrogate metadata within the first visual content, wherein the surrogate metadata is embedded without populating existing metadata fields provided by the first visual content. ### Claim 3 (depends on 1) The system of claim 1, wherein the determining that the native original metadata cannot be obtained from the first visual content comprises: dereferencing the first visual content to detect for the native original metadata; and determining that the dereferencing yields a null pointer exception, wherein the null pointer exception results from the first visual content not having fields to store the native original metadata. ### Claim 4 (depends on 1) The system of claim 1, wherein the operations further comprise: receiving a content transition request associated with the second scene; and identifying the first visual content and the second visual content based on the surrogate metadata. ### Claim 5 (depends on 4) The system of claim 4, wherein the operations further comprise generating a content transition stream that includes the first visual content and the second visual content. ### Claim 6 (depends on 5) The system of claim 5, wherein the operations further comprise providing the content transition stream to a requesting device. ### Claim 7 (depends on 5) The system of claim 5, wherein the content transition stream presents a transition between the first scene and the second scene. ### Claim 8 A method comprising: obtaining, by a network server executing a processor, a first visual content from a digital data store, wherein the first visual content is configured to digitally represent a first scene; performing, by the network server, image recognition on the first visual content so as to identify a second visual content that is digitally configured to represent a second scene, wherein identification of the second visual content is based on the second visual content having an amount of image features that is shared with the first visual content, and wherein the amount of image features exceeds a shared feature threshold; determining, by the network server, that native original metadata cannot be obtained for the first visual content, wherein the native original metadata includes information about the first scene digitally represented by the first visual content; and generating, by the network server, surrogate metadata for the first visual content based on metadata obtained from the second visual content, wherein the generating the surrogate metadata comprises: identifying, by the network server, for the first visual content, tags within the metadata from the second visual content; determining, by the network server, which of the tags within the metadata are marked as surrogate importable; and assembling, by the network server, the surrogate metadata based on the tags that are marked as surrogate importable. ### Claim 9 (depends on 8) The method of claim 8, further comprising embedding, by the network server, the surrogate metadata within the first visual content, wherein the surrogate metadata is embedded without populating existing metadata fields provided by the first visual content. ### Claim 10 (depends on 8) The method of claim 8, wherein the determining that the native original metadata cannot be obtained from the first visual content comprises: dereferencing, by the network server, the first visual content to detect for the native original metadata; and determining, by the network server, that the dereferencing yields a null pointer exception, wherein the null pointer exception results from the first visual content not having fields to store the native original metadata. ### Claim 11 (depends on 8) The method of claim 8, further comprising: receiving, by the network server, a content transition request associated with the second scene; and identifying, by the network server, the first visual content and the second visual content based on the surrogate metadata. ### Claim 12 (depends on 11) The method of claim 11, further comprising generating, by the network server, a content transition stream that includes the first visual content and the second visual content. ### Claim 13 (depends on 12) The method of claim 12, further comprising providing, by the network server, the content transition stream to a requesting device. ### Claim 14 (depends on 12) The method of claim 12, wherein the content transition stream presents a transition between the first scene and the second scene. ### Claim 15 A computer storage medium having computer-executable instructions stored thereon that, in response to execution by a processor, causes the processor to perform operations, the operations comprising: obtaining a first visual content from a digital data store, wherein the first visual content is configured to digitally represent a first scene; performing image recognition on the first visual content so as to identify a second visual content that is digitally configured to represent a second scene, wherein identification of the second visual content is based on the second visual content having an amount of image features that is shared with the first visual content, and wherein the amount of image features exceeds a shared feature threshold; determining that native original metadata cannot be obtained for the first visual content, wherein the native original metadata includes information about the first scene digitally represented by the first visual content; and generating surrogate metadata for the first visual content based on metadata obtained from the second visual content, wherein the generating the surrogate metadata comprises: identifying, for the first visual content, tags within the metadata from the second visual content; determining which of the tags within the metadata are marked as surrogate importable; and assembling the surrogate metadata based on the tags that are marked as surrogate importable. ### Claim 16 (depends on 15) The computer storage medium of claim 15, wherein the operations further comprise embedding the surrogate metadata within the first visual content, wherein the surrogate metadata is embedded without populating existing metadata fields provided by the first visual content. ### Claim 17 (depends on 15) The computer storage medium of claim 15, wherein the determining that the native original metadata cannot be obtained from the first visual content comprises: dereferencing the first visual content to detect for the native original metadata; and determining that the dereferencing yields a null pointer exception, wherein the null pointer exception results from the first visual content not having fields to store the native original metadata. ### Claim 18 (depends on 15) The computer storage medium of claim 15, wherein the operations further comprise: receiving a content transition request associated with the second scene; and identifying the first visual content and the second visual content based on the surrogate metadata. ### Claim 19 (depends on 18) The computer storage medium of claim 18, wherein the operations further comprise: generating a content transition stream that includes the first visual content and the second visual content; and providing the content transition stream to a requesting device. ### Claim 20 (depends on 19) The computer storage medium of claim 19, wherein the content transition stream presents a transition between the first scene and the second scene.