# US 12,010,320 B2 · Encoding of modified video > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,010,320 B2 - Document ID: US12010320B2 - Status: Granted - Kind: B2 - Application number: 17/552,616 - Filed: 2021-12-16 - Published: 2022-06-23 - Granted: 2024-06-11 - Earliest claimed: 2020-12-23 - Assignees: Axis AB - Applicants: Axis AB - Inventors: Song Yuan; Viktor Edpalm; Lars Branzén - Web page: https://patentgrep.com/patent/US12010320B2 ## CPC - H04N 19/136: Incoming video signal characteristics or properties - H04N 21/2347: involving video stream encryption - G06F 21/1062: {Editing} - G06F 21/64: Protecting data integrity, e.g. using checksums, certificates or signatures - H04L 9/0825: {using asymmetric-key encryption or public key infrastructure [PKI], e.g. key signature or public key certificates} - H04L 9/3236: {using cryptographic hash functions} - H04L 9/3247: {involving digital signatures} - H04L 63/126: {the source of the received data} - H04N 19/172: the region being a picture, frame or field - H04N 21/23424: {involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement} - H04N 21/2351: {involving encryption of additional data (arrangements using cryptography for the use of broadcast information or broadcast-related information H04H60/23)} - H04N 21/2541: {Rights Management (protecting software against unauthorised usage in a vending or licensing environment G06F21/10; security in data switching network management H04L41/28; security management or policies for network security H04L63/20; access security in wireless networks H04W12/08)} - H04N 21/2665: Gathering content from different sources, e.g. Internet and satellite - H04N 21/4353: {involving decryption of additional data (arrangements using cryptography for the use of broadcast information or broadcast-related information H04H60/23)} - H04N 21/44016: {involving splicing one content stream with another content stream, e.g. for substituting a video clip} - H04N 21/4622: {Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet (web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859)} - H04N 21/835: Generation of protective data, e.g. certificates {(protecting software against unauthorised usage in a vending or licensing environment G06F21/10)} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) ## Abstract A method of processing a video stream comprises receiving a first/second set of input image frames comprising image data originating from a first/second source of input image frames; encoding the sets of input image frames into first/second sets of encoded image frames, forming a combined video stream, wherein an encoded image frame of the first set of encoded image frames exclusively references one or more other encoded image frames of the first set of encoded image frames, and an encoded image frame of the second set of encoded image frames references both an encoded image frame of the first set of encoded image frames and another encoded image frame of the second set of encoded image frames; and signing, using a first/second key, a first/second signing group comprising one or more encoded image frames of the first/second set of encoded image frames, wherein each key pertains to the respective source. ## Claims ### Claim 1 A method of processing a video stream comprising: receiving a first set of input image frames comprising image data originating from a first source of input image frames; receiving a second set of input image frames comprising image data originating from a second source of input image frames, wherein the second set of input image frames includes modifications or changes relative to the first set of image frames; encoding the first set of input image frames and the second set of input image frames into, respectively, a first set of encoded image frames and a second set of encoded image frames, forming a combined video stream, wherein an encoded image frame of the first set of encoded image frames exclusively references one or more other encoded image frames of the first set of encoded image frames, and wherein an encoded image frame of the second set of encoded image frames references both an encoded image frame of the first set of encoded image frames and another encoded image frame of the second set of encoded image frames; designating the first set of encoded image frames as image frames not to be displayed or designating the second set of encoded image frames as image frames to be displayed; signing, using a first key, a first signing group comprising one or more encoded image frames of the first set of encoded image frames, wherein the first key pertains to the first source of input image frames; and signing, using a second key, a second signing group comprising one or more encoded image frames of the second set of encoded image frames, wherein the second key pertains to the second source of input image frames. ### Claim 2 (depends on 1) The method according to claim 1, wherein the second signing group further comprises one or more encoded image frames of the first set of encoded image frames referred to by an encoded image frame of the second set of encoded image frames. ### Claim 3 (depends on 1) The method according to claim 1, further comprising: receiving a third set of input image frames comprising image data originating from a third source of input image frames, wherein the encoding further comprises encoding the third set of input image frames into a third set of encoded image frames, forming part of the combined video stream, wherein an encoded image frame of the third set of encoded image frames references both an encoded image frame of the first set of encoded image frames and another encoded image frame of the third set of encoded image frames, said method further comprising: signing, using a third key, a third signing group comprising one or more image frames of the third set of encoded image frames, wherein the third key pertains to the third source of input image frames. ### Claim 4 (depends on 1) The method according to claim 1, wherein the first source of input image frames is an image sensor of a video capture device. ### Claim 5 (depends on 4) The method according to claim 4, wherein the second source of input image frames is another sensor than the image sensor of the video capture device. ### Claim 6 (depends on 1) The method according to claim 1, wherein the second source of input image frames is a video processing unit. ### Claim 7 (depends on 6) The method according to claim 6, wherein the video processing unit comprises a graphical overlay adding function. ### Claim 8 (depends on 1) The method according to claim 1, wherein the first key is a hash function key, and/or wherein the second key is a hash function key. ### Claim 9 (depends on 1) The method according to claim 1, wherein the encoding comprises inter and/or prediction encoding the first set of input image frames and the second set of input image frames into, respectively, the first set of encoded image frames and the second set of encoded image frames. ### Claim 10 (depends on 1) The method according to claim 1, further comprising: associating with the combined video stream at least one of: a signature pertaining to the signing using the first key, and a signature pertaining to the signing using the second key. ### Claim 11 (depends on 1) The method according to claim 1, further comprising: decoding, at a decoder, the combined video stream; checking a signature comprised in said combined video stream; and associating data pertaining to a result of said checking with the decoded video stream. ### Claim 12 (depends on 1) The method according to claim 1, further comprising: decoding, at a decoder, the combined video stream; determining an origin of an image frame of said combined video stream; associating data based on the determining of the said origin with said image frame. ### Claim 13 A non-transitory computer-readable storage medium having stored thereon instructions for implementing a method, when executed on a device having processing capabilities, the method for processing a video stream comprising: receiving a first set of input image frames comprising image data originating from a first source of input image frames; receiving a second set of input image frames comprising image data originating from a second source of input image frames, wherein the second set of input image frames includes modifications or changes relative to the first set of image frames; encoding the first set of input image frames and the second set of input image frames into, respectively, a first set of encoded image frames and a second set of encoded image frames, forming a combined video stream, wherein an encoded image frame of the first set of encoded image frames exclusively references one or more other encoded image frames of the first set of encoded image frames, and wherein an encoded image frame of the second set of encoded image frames references both an encoded image frame of the first set of encoded image frames and another encoded image frame of the second set of encoded image frames; designating the first set of encoded image frames as image frames not to be displayed or designating the second set of encoded image frames as image frames to be displayed; signing, using a first key, a first signing group comprising one or more encoded image frames of the first set of encoded image frames, wherein the first key pertains to the first source of input image frames; and signing, using a second key, a second signing group comprising one or more encoded image frames of the second set of encoded image frames, wherein the second key pertains to the second source of input image frames. ### Claim 14 A video processing system comprising a processor configured to: receive a first set of input image frames, comprising image data originating from a first source of input image frames; receive a second set of input image frames, comprising image data originating from a second source of input image frames, wherein the second set of input image frames includes modifications or changes relative to the first set of image frames; encode the first set of input image frames and the second set of input image frames into, respectively, a first set of encoded image frames and a second set of encoded image frames, forming a combined video stream, wherein an encoded image frame of the first set of encoded image frames exclusively references one or more image frames of the first set of encoded image frames, and wherein an encoded image frame of the second set of encoded image frames references both an encoded image frame of the first set of encoded image frames and another encoded image frame of the second set of encoded image frames; designate the first set of encoded image frames as image frames not to be displayed or designate the second set of encoded image frames as image frames to be displayed; sign, using a first key, a first signing group comprising one or more encoded image frames of the first set of encoded image frames, wherein the first key pertains to the first source of input image frames; sign, using a second key, a second signing group comprising one or more encoded image frames of the second set of encoded image frames, wherein the second key pertains to the second source of input image frames.