# US 2021/0344869 A1 · Image encoder, an image sensing device, and an operating method of the image encoder > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2021/0344869 A1 - Document ID: US20210344869A1 - Status: Published application - Kind: A1 - Application number: 17/129,131 - Filed: 2020-12-21 - Published: 2021-11-04 - Earliest claimed: 2020-04-29 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Samsung Electronics Co., Ltd. - Inventors: WON SEOK LEE; SEONG WOOK SONG; YUN SEOK CHOI - Web page: https://patentgrep.com/patent/US20210344869A1 ## CPC - H04N 5/917: for bandwidth reduction - H04N 19/55: Motion estimation with spatial constraints, e.g. at image or region borders - H04N 5/772: {the recording apparatus and the television camera being placed in the same enclosure} - H04N 9/8042: {involving data reduction} - H04N 19/14: Coding unit complexity, e.g. amount of activity or edge presence estimation (H04N19/146 takes precedence) - H04N 19/433: characterised by techniques for memory access - H04N 23/80: Camera processing pipelines; Components thereof - H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract The present disclosure provides an image encoder. The image encoder is configured to encode an original image and reduce compression loss. The image encoder comprises an image signal processor and a compressor. The image signal processor is configured to receive a first frame image and a second frame image and generates a compressed image of the second frame image using a boundary pixel image of the first frame image. The image signal processor may include memory configured to store first reference pixel data which is the first frame image. The compressor is configured to receive the first reference pixel data from the memory and generate a bitstream obtained by encoding the second frame image based on a difference value between the first reference pixel data and the second frame image. The image signal processor generates a compressed image of the second frame image using the bitstream generated by the compressor. ## Claims ### Claim 1 An image sensing device comprising: an image signal processor configured to receive a first frame image and a second frame image that temporally follows the first frame image and generate a compressed image of the second frame image based on a boundary pixel image of the first frame image, the image signal processor comprising: a memory configured to store first reference pixel data which is the boundary pixel image of the first frame image; and a compressor configured to receive the first reference pixel data from the memory and generate a bitstream obtained by encoding the second frame image based on a difference value between the first reference pixel data and original pixel data of the second frame image, wherein the image signal processor generates the compressed image of the second frame image based on the bitstream. ### Claim 2 (depends on 1) The image sensing device of claim 1, further comprising: a reconstructor configured to reconstruct the bitstream to generate second reference pixel data which is a second boundary pixel image of the second frame image, wherein the memory is configured to store the second reference pixel data and provide the second reference pixel data to the compressor. ### Claim 3 (depends on 2) The image sensing device of claim 2, wherein the compressor is configured to generate the bitstream obtained by encoding the second frame image based on a second difference value between the second frame image and the second reference pixel data provided from the memory. ### Claim 4 (depends on 2) The image sensing device of claim 2, wherein the memory includes a reference pixel buffer memory and a reference boundary pixel buffer memory, and the first reference pixel data is stored in the reference boundary pixel buffer memory and the second reference pixel data is stored in the reference pixel buffer memory. ### Claim 5 (depends on 4) The image sensing device of claim 4, wherein the first reference pixel data provided from the reference boundary pixel buffer memory is provided through a latch. ### Claim 6 (depends on 4) The image sensing device of claim 4, wherein the memory is configured to provide the first reference pixel data and the second reference pixel data to the compressor at substantially the same time. ### Claim 7 (depends on 1) The image sensing device of claim 1, wherein the compressor is configured to generate the bitstream based on a second difference value between second reference pixel data and the first reference pixel data provided from the memory, the second reference pixel data which is a second boundary pixel image of the second frame image. ### Claim 8 (depends on 1) The image sensing device of claim 1, wherein the boundary pixel image of the first frame image includes an image included in a first row of the first frame image. ### Claim 9 (depends on 1) The image sensing device of claim 1, wherein the boundary pixel image of the first frame image includes an image included in a first column of the first frame image. ### Claim 10 (depends on 1) The image sensing device of claim 1, wherein the memory is configured to store third reference pixel data which is the boundary pixel image of the first frame image, the third reference pixel data different from the first reference pixel data, and the compressor is configured to generate the bitstream based on a second difference value between the original pixel data of the second frame image and an average value of the first reference pixel data and the third reference pixel data provided from the memory. ### Claim 11 (depends on 1) The image sensing device of claim 1, further comprising: an action detector configured to detect whether an action of the image sensing device is greater than a reference value, wherein the compressor generates the bitstream based on a second difference value between the original pixel data of the second frame image and constant reference pixel data based on the action detector detecting the action of the image sensing device is greater than the reference value. ### Claim 12 (depends on 1) The image sensing device of claim 1, further comprising: an image decoder configured to decode the bitstream. ### Claim 13 An image encoder configured to receive a first frame image and a second frame image that temporally follows the first frame image, the image encoder comprising: a memory configured to store first reference pixel data which is a boundary pixel image of the first frame image; a compressor configured to receive the first reference pixel data from the memory, generate a first bitstream obtained by encoding original pixel data of the second frame image based on a difference value between the first reference pixel data and the original pixel data of the second frame image, and output the first generated bitstream; and a reconstructor configured to reconstruct the first bitstream to generate second reference pixel data which is a second boundary pixel image of the second frame image. ### Claim 14 (depends on 13) The image encoder of claim 13, wherein the memory includes a reference pixel buffer memory and a reference boundary pixel buffer memory, and the first reference pixel data is stored in the reference boundary pixel buffer memory and the second reference pixel data is stored in the reference pixel buffer memory. ### Claim 15 (depends on 14) The image encoder of claim 14, wherein the first reference pixel data provided from the reference boundary pixel buffer memory is provided with a delay. ### Claim 16 (depends on 14) The image encoder of claim 14, wherein the memory is configured to provide the first reference pixel data and the second reference pixel data to the compressor at substantially the same time. ### Claim 17 (depends on 13) The image encoder of claim 13, wherein the memory is configured to store the second reference pixel data, and the compressor is configured to receive the second reference pixel data from the memory and generate a second bitstream obtained by encoding second original pixel data of a third frame image that temporally follows the second frame image based on a second difference value between the second reference pixel data and the second original pixel data of third frame image. ### Claim 18 (depends on 17) The image encoder of claim 17, wherein the reconstructor is configured to reconstruct the second bitstream to generate third reference pixel data which is a third boundary pixel image of the third frame image. ### Claim 19 A method for operating an image encoder, the method comprising: receiving a first frame image and a second frame image, wherein the second frame image is received at a different time than the first frame image is received; storing first reference pixel data which is a first boundary pixel image of the first frame image; generating a bitstream obtained by encoding original pixel data of the second frame image based on a difference value between the stored first reference pixel data and the original pixel data of the second frame image; outputting the generated bitstream; and reconstructing the bitstream to generate second reference pixel data which is a second boundary pixel image of the second frame image. ### Claim 20 (depends on 19) The method for operating an image encoder of claim 19, further comprising: generating the bitstream based on a second difference value between second original pixel data of the second boundary pixel image and the stored first reference pixel data.