# US 11,442,985 B2 · Apparatus and a method for artificial intelligence > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,442,985 B2 - Document ID: US11442985B2 - Status: Granted - Kind: B2 - Application number: 17/274,361 - Filed: 2019-09-13 - Published: 2021-11-11 - Granted: 2022-09-13 - Earliest claimed: 2018-09-20 - Assignees: Nokia Technologies Oy - Applicants: Nokia Technologies Oy - Inventors: Emre Aksu; Miska Hannuksela; Jonne Juhani Mäkinen; Juha-Pekka Hippeläinen - Web page: https://patentgrep.com/patent/US11442985B2 ## CPC - H04N 21/84: Generation or processing of descriptive data, e.g. content descriptors {(systems specially adapted for using meta-information in broadcast systems H04H60/73)} - G06F 16/14: Details of searching files based on file metadata - G06F 16/164: {File meta data generation} - G06F 16/74: Browsing; Visualisation therefor (end-user interfaces for requesting or interacting with video content, e.g. video on demand interfaces or electronic programme guides, H04N21/472) - G06F 16/75: Clustering; Classification - G06F 16/783: using metadata automatically derived from the content - G06N 3/02: Neural networks - G06N 3/045: Combinations of networks - G06N 3/0464: Convolutional networks [CNN, ConvNet] - H04N 21/23418: {involving operations for analysing video streams, e.g. detecting features or characteristics (television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)} - H04N 21/26603: {for automatically generating descriptors from content, e.g. when it is not made available by its provider, using content analysis techniques} - H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)} - H04N 21/4666: {using neural networks, e.g. processing the feedback provided by the user} - H04N 21/85406: {involving a specific file format, e.g. MP4 format} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS ## Abstract The embodiments relate to a method comprising receiving visual data in a file format compatible with ISO base media file format; processing the visual data to detect one or more content elements; storing the detected one or more content elements and information on the used process as a metadata; and including the metadata to the media file in association with the visual data. The embodiments also relate to a technical equipment for implementing the method. ## Claims ### Claim 1 A method, comprising: receiving a visual data in a container file, wherein the container file is compatible with a container file format; processing the visual data by using a plurality of processes to detect one or more content elements; storing, the detected one or more content elements and information on the plurality of processes used to detect said one or more content elements, as a metadata; indicating dependencies between the plurality of processes by using a first indication and a second indication, wherein the first indication represents an item which requires one or more inputs, and wherein the second indication represents items comprising said one or more inputs; and including the metadata in the container file associated with the visual data. ### Claim 2 (depends on 1) The method according to claim 1, wherein the container file comprises a first box comprising a metadata on a processing algorithm. ### Claim 3 (depends on 1) The method according to claim 1, wherein the container file comprises a second box comprising a metadata on said one or more content elements. ### Claim 4 (depends on 1) The method according to claim 1, wherein the container file comprises a third box comprising a metadata on a process of multiple processing algorithms. ### Claim 5 (depends on 1) The method according to claim 1, wherein the container file comprises an image sequence or a video, and wherein the container file comprises a media sample definition for media tracks containing the metadata. ### Claim 6 (depends on 1) The method according to claim 1, wherein the container file comprises relationship definitions for defining an association between a container and other entities comprising information in the container file. ### Claim 7 (depends on 1) The method according to claim 1, wherein the visual data is processed by one or more neural networks; or one or more non-neural network based algorithms to detect said one or more content elements. ### Claim 8 An apparatus comprising at least one processor; and at least one memory including computer program code; the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to perform: receive visual data in a container file, wherein the container file is compatible with a container file format; process the visual data by means of a plurality of processes to detect one or more content elements; store the detected one or more content elements and information on used processes to detect said one or more content elements as a metadata; indicate dependencies between various processes, a first and second indication, where the first indication represents an item which requires one or more inputs, and where the second indication represents items comprising said one or more inputs; and include the metadata to the container file in association with the visual data. ### Claim 9 (depends on 8) The apparatus according to claim 8, wherein the container file comprises a first box comprising metadata on a processing algorithm. ### Claim 10 (depends on 8) The apparatus according to claim 8, wherein the container file comprises a second box comprising metadata on said one or more content elements. ### Claim 11 (depends on 8) The apparatus according to claim 8, wherein the container file comprises a third box comprising metadata on a process of multiple processing algorithms. ### Claim 12 (depends on 8) The apparatus according to claim 8, wherein the container file is an image sequence or a video, and wherein the container file comprises a media sample definition for media tracks containing the metadata. ### Claim 13 (depends on 8) The apparatus according to claim 8, wherein the container file comprises relationship definitions for defining an association between a container and other entities comprising information in the container file. ### Claim 14 (depends on 8) The apparatus according to claim 8, further comprising one or more neural networks; or one or more non-neural network based algorithms for processing the visual data to detect said one or more content elements. ### Claim 15 (depends on 8) An apparatus according to claim 8, further comprising at least one processor and memory including computer program code. ### Claim 16 A Computer program product comprises at least one non-transitory computer-readable storage medium having computer executable program code instructions stored therein, the computer executable program code instructions comprising program code instructions configured, upon execution, to: receive a visual data in a container file, wherein the container file is compatible with a container file format; process the visual data by using a plurality of processes to detect one or more content elements; store, the detected one or more content elements and information on the plurality of processes used to detect said one or more content elements, as a metadata; indicate dependencies between the plurality of processes by using a first indication and a second indication, wherein the first indication represents an item which requires one or more inputs, and wherein the second indication represents items comprising said one or more inputs; and include the metadata in the container file associated with the visual data. ### Claim 17 (depends on 16) The computer program product according to claim 16, wherein the container file comprises a first box comprising a metadata on a processing algorithm. ### Claim 18 (depends on 16) The computer program product according to claim 16, wherein the container file comprises a second box comprising a metadata on said one or more content elements. ### Claim 19 (depends on 16) The computer program product according to claim 16, wherein the container file comprises a third box comprising a metadata on a process of multiple processing algorithms. ### Claim 20 (depends on 16) The computer program product according to claim 16, wherein the container file comprises an image sequence or a video, and wherein the container file comprises a media sample definition for media tracks containing the metadata.