# US 2018/0027237 A1 · Framework for embedding data in encoded video > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2018/0027237 A1 - Document ID: US20180027237A1 - Status: Published application - Kind: A1 - Application number: 15/218,127 - Filed: 2016-07-25 - Published: 2018-01-25 - Earliest claimed: 2016-07-25 - Assignees: Cisco Technology, Inc. - Applicants: Cisco Technology, Inc. - Inventors: Harel CAIN; Michal DEVIR; Yaron SELLA - Web page: https://patentgrep.com/patent/US20180027237A1 ## CPC - H04N 19/13: Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC] - H04N 19/11: among a plurality of spatial predictive coding modes - H04N 19/12: Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264 - H04N 19/176: the region being a block, e.g. a macroblock - H04N 19/467: characterised by the embedded information being invisible, e.g. watermarking - H04N 19/96: Tree coding, e.g. quad-tree coding - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract In one embodiment of a method, system, and apparatus described herein, an encoded video is received. At least one set of areas of a spatially distinct region of a video frame to be modified is selected. An entropy layer from the spatially distinct region of a video frame. A state of the removed entropy layer and the location of a first area of the set of areas of the spatially distinct region of the video frame is stored. One area of the set of areas is decoded, the decoding occurring recursively until all areas of the set of areas of the spatially distinct region of the video frame for predicting and decoding the one area are decoded. A modification of the decoded one area is performed. The modified decoded one area is re-encoded according to a re-encoding condition. The stored state of the entropy layer is retrieved, and the entropy layer is re-applied at the first area to the spatially distinct region of the video frame which comprises the set of areas. Related methods, systems and apparatus are also described. ## Claims ### Claim 1 A method comprising: receiving an encoded video stream; selecting a set of areas of a spatially distinct region of a video frame to be modified; removing an entropy layer from the spatially distinct region of a video frame; storing a state of the removed entropy layer and the location of a first area of the set of areas of the spatially distinct region of the video frame; decoding one area of the set of areas of the spatially distinct region of the video frame, the decoding occurring recursively until all areas of the set of areas of the spatially distinct region of the video frame for predicting, and decoding the one area are decoded; performing a modification of the decoded one area; re-encoding the modified decoded one area according to a re-encoding condition; retrieving the stored state of the removed entropy layer; and re-applying the entropy layer at the stored location of the first area to the spatially distinct region of the video frame which comprises the set of areas. ### Claim 2 (depends on 1) The method according to claim 1 wherein the received encoded video stream is encoded according to the H.264 encoding video standard. ### Claim 3 (depends on 2) The method according to claim 2 wherein the spatially distinct regions of the video frame are H.264 compliant slices. ### Claim 4 (depends on 2) The method according to claim 2 wherein the one area of the spatially distinct regions of the video frame is an H.264 compliant macroblock. ### Claim 5 (depends on 1) The method according to claim 1 wherein the received encoded video stream is encoded according to the H.265 encoding standard. ### Claim 6 (depends on 5) The method according to claim 5 wherein the spatially distinct regions of the video frame are H.265 compliant slices areas. ### Claim 7 (depends on 5) The method according to claim 5 wherein the one area of the spatially distinct regions of the video frame is an H.265 compliant coding tree block. ### Claim 8 (depends on 1) The method according to claim 1, wherein the re-encoding condition comprises the modified decoded one area undergoing a change of its visual representation, wherein new YUV values of the modified decoded one area are re-encoded to be Prediction values plus new Residual values. ### Claim 9 (depends on 1) The method according to claim 1, wherein the re-encoding condition comprises the modified decoded one area undergoing re-encoding in order to prevent inter-frame and intra-frame drift due to manipulations of others of the set of areas undergoing a change of their visual representation, wherein YUV values of the modified decoded one area are re-encoded to be new Prediction values plus new Residual values, so that the new Residual values are calculated based on new predicted Prediction values. ### Claim 10 (depends on 1) The method according to claim 1, wherein the re-encoding condition comprises the modified decoded one area being an intra-predicted one area whose set of neighbors are suitable for use for intra-prediction which will change as a result of the modifying, wherein the YUV values of the modified decoded one area are re-encoded to be new Prediction values plus new Residual values, so that the new Residual values are calculated based on new Prediction values from the set of neighbors. ### Claim 11 (depends on 1) The method according to claim 1 wherein the modification of the decoded one area of the spatially distinct region of the video frame comprises modifying at least one pixel in one of a Y, a U, or a V domain. ### Claim 12 (depends on 1) The method according to claim 1 wherein the modification of the decoded one area of the spatially distinct region of the video frame comprises embedding a watermark into the one area. ### Claim 13 (depends on 1) The method according to claim 1 wherein the modification of the decoded one area of the spatially distinct region of the video frame comprises embedding a logo into the one area. ### Claim 14 (depends on 1) The method according to claim 1 wherein the modification of the decoded one area of the spatially distinct region of the video frame comprises blurring a region of the one area. ### Claim 15 (depends on 1) The method according to claim 1 wherein the modification of the decoded one area comprises re-slicing the spatially distinct region of the video frame, the re-sliced spatially distinct region of the video frame comprising the one area of the set of areas of the spatially distinct region of the video frame. ### Claim 16 A system comprising: a receiver operative to receive an encoded video stream; a video modifier operative to select a set of areas of a spatially distinct region of a video frame to be modified; the video modifier further operative to remove an entropy layer from the spatially distinct region of a video frame which comprises the at least one set of areas; the video modifier further operative to store, in a storage unit, a state of the removed entropy layer and the location of a first area of the set of areas of the spatially distinct region of the video frame; a video decoder operative to decode one area of the spatially distinct region of the video frame, the decoding occurring recursively until all areas of the set of areas of the spatially distinct region of the video frame for predicting and decoding the one area are decoded; the video modifier operative to modify the decoded one area; a video encoder operative to re-encode the modified decoded one area according tea a re-encoding condition; the video modifier operative to retrieve the stored state of the removed entropy layer from the storage unit; and the video modifier operative to re-apply the entropy layer at the stored location of the first area to the spatially distinct region of, the video frame which comprises the set of areas. ### Claim 17 (depends on 16) The system according to claim 16 wherein the received encoded video stream is encoded according to the H.264 encoding video standard. ### Claim 18 (depends on 16) The system according to claim 16 wherein the received. encoded video stream is encoded according to the H.265 encoding video standard. ### Claim 19 (depends on 16) The system according to claim 16, wherein the re-coding condition comprises one of: the modified decoded one area undergoing a change of its visual representation, wherein new YUV values of the one area of the spatially distinct region of the video frame are re-encoded to be Prediction values plus new Residual values; the modified decoded one area undergoing re-encoding in order to prevent inter-frame and intra-frame drift due to manipulations of others of the set of areas undergoing a change of their visual representation, wherein YUV values of the one area are re-encoded to be new Prediction values plus new Residual values, so that the new Residual values are calculated based on new predicted Prediction values; or the modified decoded one area being an intra-predicted one area whose set of neighbors are suitable for use for intra-prediction which will change as a result of the modifying, wherein the YUV values of the one area are re-encoded to be new Prediction values plus new Residual values, so that the new Residual values are calculated based on new Prediction values from the set of neighbors. ### Claim 20 (depends on 16) The system according to claim 16 wherein the modification of the decoded one area comprises at least one of: modifying at least one pixel in one of a Y, a U, or a V domain; embedding a watermark into the one area; embedding a logo into one area; blurring a region of the one area; or re-slicing the spatially distinct region of the video frame, the re-sliced spatially distinct region of the video frame comprising the one area of the set of areas of the spatially distinct region of the video frame.