# US 12,120,344 B2 · Transmission device, transmission method, reception device and reception method > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,120,344 B2 - Document ID: US12120344B2 - Status: Granted - Kind: B2 - Application number: 17/858,181 - Filed: 2022-07-06 - Published: 2022-10-20 - Granted: 2024-10-15 - Earliest claimed: 2015-08-19 - Assignees: Saturn Licensing LLC - Applicants: Saturn Licensing LLC - Inventors: Ikuo Tsukagoshi - Web page: https://patentgrep.com/patent/US12120344B2 ## CPC - H04N 19/105: Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction - H04N 19/587: involving temporal sub-sampling or interpolation, e.g. decimation or subsequent interpolation of pictures in a video sequence - H04N 7/01: Conversion of standards {, e.g. involving analogue television standards or digital television standards processed at pixel level} - H04N 19/117: Filters, e.g. for pre-processing or post-processing (sub-band filter banks H04N19/635) - H04N 19/132: Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking - H04N 19/137: Motion inside a coding unit, e.g. average field, frame or block difference - H04N 19/176: the region being a block, e.g. a macroblock - H04N 19/182: the unit being a pixel - H04N 19/187: the unit being a scalable video layer - H04N 19/31: in the temporal domain - H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards - H04N 21/23605: {Creation or processing of packetized elementary streams [PES]} - H04N 7/0127: {by changing the field or frame frequency of the incoming video signal, e.g. frame rate converter} - H04N 21/234327: {by decomposing into layers, e.g. base layer and one or more enhancement layers} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract High frame rate moving image data is satisfactorily transmitted. Mixing processing is performed in units of two temporally consecutive pictures in predetermined frame rate image data, and base frame rate image data is obtained. Image data of one picture in units of the two temporally consecutive pictures is extracted, and high frame rate enhanced frame image data is obtained. Prediction encoding processing of base frame rate image data is performed to the base frame rate image data, and a base stream is obtained. Prediction encoding processing with respect to the base frame rate image data is performed to the high frame rate enhanced frame image data, and an enhanced stream is obtained. A predetermined format container is transmitted including the base stream and the enhanced stream. ## Claims ### Claim 1 A transmission device comprising: processing circuitry configured to: perform mixing processing in units of two temporally consecutive pictures in high frame rate image data to obtain base frame rate image data, the base frame rate image data having a number of frames that is half of a number of frames of the high frame rate image data, extract image data of one picture in units of the two temporally consecutive pictures to obtain enhanced frame image data, the enhanced frame image data having a number of frames that is half of the number of frames of the high frame rate image data, perform encoding processing to the base frame rate image data to obtain a base stream, and perform encoding processing to the enhanced frame image data to obtain an enhanced stream; and multiply the base frame rate image data based on a prediction coefficient for reducing a prediction residue when encoding processing with respect to the base frame rate image data is performed to the enhanced frame image data and the enhanced stream is obtained; a transceiver configured to transmit the base stream and the enhanced stream, and a descriptor in which the prediction coefficient is defined. ### Claim 2 (depends on 1) The transmission device according to claim 1, wherein the processing circuitry is further configured to include the prediction coefficient in a layer of the enhanced stream. ### Claim 3 (depends on 1) The transmission device according to claim 1, wherein the processing circuitry is further configured to transmit a container including the base stream and the enhanced stream, wherein the container has a format of MPEG-2 Transport Stream (MPEG-2 TS), MPEG Media Transport (MMT) or ISO Base Media File Format (ISO BMFF). ### Claim 4 A reception device comprising a receiver configured to receive a base stream and an enhanced stream, and receive a descriptor in which a prediction coefficient for reducing a prediction residue is defined; wherein: the base stream includes base frame rate image data, the base frame rate image data obtained by mixing high frame rate image data of two temporally consecutive pictures, the base frame rate image data having a number of frames that is half of a number of frames of the high frame rate image data, and the enhanced stream includes enhanced frame image data, the enhanced frame image data obtained by extracting image data of one picture of the two temporally consecutive pictures in the high frame rate image data, the enhanced frame image data having a number of frames that is half of the number of frames of the high frame rate image data, and processing circuitry configured to perform decoding processing to the base stream to obtain the base frame rate image data; perform decoding processing to the enhanced stream to obtain the enhanced frame image data, and process the base frame rate image data and the enhanced frame image data based on the prediction coefficient, to obtain the high frame rate image data. ### Claim 5 (depends on 4) The reception device according to claim 4, wherein the processing circuitry is further configured to obtain the prediction coefficient that is defined in a layer of the enhanced stream. ### Claim 6 (depends on 4) The reception device according to claim 4, wherein the processing circuitry is further configured to: perform, to the base frame rate image data, inverse processing of the mixing processing using the enhanced frame image data to obtain the high frame rate image data. ### Claim 7 (depends on 4) The reception device according to claim 4, wherein the processing circuitry is further configured to perform interpolation processing to the high frame rate image data to obtain image data having a higher frame rate than the high frame rate image data. ### Claim 8 (depends on 4) The reception device according to claim 4, wherein the base stream and the enhanced stream are included in a container, the container has a format of MPEG-2 Transport Stream (MPEG-2 TS), MPEG Media Transport (MMT) or ISO Base Media File Format (ISO BMFF). ### Claim 9 (depends on 4) The reception device according to claim 4, further comprising: a display to display the high frame rate image data. ### Claim 10 A reception method performed in a reception device, the reception method comprising: receiving, by a receiver of the reception device, a base stream, an enhanced stream, and a descriptor in which a prediction coefficient for reducing a prediction residue is defined, wherein: the base stream includes base frame rate image data, the base frame rate image data obtained by performing mixing processing in units of two temporally consecutive pictures in high frame rate image data, the base frame rate image data having a number of frames that is half of a number of frames of the high frame rate image data, and the enhanced stream includes enhanced frame image data, the enhanced frame image data obtained by extracting image data of one picture in units of the two temporally consecutive pictures in the high frame rate image data, the enhanced frame image data having a number of frames that is half of the number of frames of the high frame rate image data, and processing, by processing circuitry of the reception device, decoding processing to the base stream to obtain the base frame rate image data, decoding processing to the enhanced stream to obtain the enhanced frame image data, and the base frame rate image data and the enhanced frame image data based on the prediction coefficient, to obtain the high frame rate image data. ### Claim 11 (depends on 10) The reception method according to claim 10, further comprising: obtaining, by the processing circuitry of the reception device, the prediction coefficient that is defined in a layer of the enhanced stream. ### Claim 12 (depends on 10) The reception method according to claim 10, further comprising: performing, by the processing circuitry of the reception device, to the base frame rate image data, inverse processing of the mixing processing using the enhanced frame image data to obtain the high frame rate image data. ### Claim 13 (depends on 10) The reception method according to claim 10, further comprising: performing, by the processing circuitry of the reception device, interpolation processing to the high frame rate image data to obtain image data having a higher frame rate than the high frame rate image data. ### Claim 14 (depends on 10) The reception method according to claim 10, wherein the base stream and the enhanced stream are included in a container, the container has a format of MPEG-2 Transport Stream (MPEG-2 TS), MPEG Media Transport (MMT) or ISO Base Media File Format (ISO BMFF).