Framework for embedding data in encoded video

A system comprising:

• a receiver operative to receive an encoded video stream;
• a video modifier operative to select a set of areas of a spatially distinct region of a video frame to be modified;
• the video modifier further operative to remove an entropy layer from the spatially distinct region of a video frame which comprises the at least one set of areas;
• the video modifier further operative to store, in a storage unit, a state of the removed entropy layer and the location of a first area of the set of areas of the spatially distinct region of the video frame;
• a video decoder operative to decode one area of the spatially distinct region of the video frame, the decoding occurring recursively until all areas of the set of areas of the spatially distinct region of the video frame for predicting and decoding the one area are decoded;
• the video modifier operative to modify the decoded one area;
• a video encoder operative to re-encode the modified decoded one area according tea a re-encoding condition;
• the video modifier operative to retrieve the stored state of the removed entropy layer from the storage unit;
• and
• the video modifier operative to re-apply the entropy layer at the stored location of the first area to the spatially distinct region of, the video frame which comprises the set of areas.