# US 2021/0344967 A1 · Image processing apparatus, image processing method and image processing program > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2021/0344967 A1 - Document ID: US20210344967A1 - Status: Published application - Kind: A1 - Application number: 17/273,366 - Filed: 2019-09-11 - Published: 2021-11-04 - Earliest claimed: 2018-09-19 - Assignees: Nippon Telegraph and Telephone Corporation - Applicants: Nippon Telegraph and Telephone Corporation - Inventors: Shinobu KUDO; Shota ORIHASHI; Masaki KITAHARA; Atsushi SHIMIZU - Web page: https://patentgrep.com/patent/US20210344967A1 ## CPC - H04N 19/423: characterised by memory arrangements (H04N19/433 takes precedence) - H04N 19/85: using pre-processing or post-processing specially adapted for video compression - H04N 19/80: Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation (H04N19/635, H04N19/86 take precedence) - H04N 19/91: Entropy coding, e.g. variable length coding [VLC] or arithmetic coding - H04N 19/12: Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264 - H04N 19/132: Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking - H04N 19/154: Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion (use of rate-distortion criteria H04N19/147) - H04N 19/177: the unit being a group of pictures [GOP] - H04N 19/428: {Recompression, e.g. by spatial or temporal decimation} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract An image processing apparatus for performing correction for each frame group including a predetermined number of frames into which video data is divided includes a decoding unit configured to obtain a corrected frame group by correcting a second frame group, which is a frame group continuous with a first frame group in time, using a feature quantity of the first frame group. The decoding unit performs the correction so that subjective image quality based on a relationship between the second frame group and a frame group subsequent to the second frame group in time is increased and so that a predetermined classifier classifies that a frame group in which the second frame group is concatenated with the frame group subsequent to the second frame group in time is the same as a frame group in which the corrected frame group is concatenated with a corrected frame group obtained by correcting the frame group subsequent to the second frame group in time. ## Claims ### Claim 1 An image processing apparatus for performing correction for each frame group including a predetermined number of frames into which video data is divided, the image processing apparatus comprising: a processor; and a storage medium having computer program instructions stored thereon, wherein the computer program instructions, when executed by the processor, perform to: obtain a corrected frame group by correcting a second frame group, which is a frame group continuous with a first frame group in time, using a feature quantity of the first frame group, and perform the correction so that subjective image quality based on a relationship between the second frame group and a frame group subsequent to the second frame group in time is increased and so that a predetermined classifier classifies that a frame group in which the second frame group is concatenated with the frame group subsequent to the second frame group in time is the same as a frame group in which the corrected frame group is concatenated with a corrected frame group obtained by correcting the frame group subsequent to the second frame group in time. ### Claim 2 (depends on 1) The image processing apparatus according to claim 1, wherein the computer program instructions further perform to: increase a weight in the correction in proportion to a feature quantity of a frame subsequent to the second frame group in time. ### Claim 3 An image processing apparatus for performing correction for each frame group including a predetermined number of frames into which video data is divided, the image processing apparatus comprising: a processor; and a storage medium having computer program instructions stored thereon, wherein the computer program instructions, when executed by the processor, perform to: obtain a corrected frame group by correcting a second frame group using a feature quantity of a first frame group, which is a frame group previous to the second frame group in time and continuous with the second frame group in time, and a feature quantity of a third frame group, which is a frame group subsequent to the second frame group in time and continuous with the second frame group in time, and perform the correction so that subjective image quality based on a relationship between the corrected frame group and the first frame group and a relationship between the corrected frame group and the third frame group increases. ### Claim 4 (depends on 1) The image processing apparatus according to claim 1, wherein the computer program instructions further perform to: perform the correction on the basis of a parameter value updated in a learning process based on frame groups into which video data different from the video data is divided. ### Claim 5 (depends on 4) The image processing apparatus according to claim 4, wherein the learning process comprising: acquiring sample data including at least three frame groups which are continuous in time; inputting the sample data to a first learning model and obtaining feature quantities of the frame groups; inputting the feature quantities of the frame groups to a second learning model and obtaining corrected frame groups corresponding to the frame groups; calculating a loss value on the basis of the sample data, the feature quantities of the frame groups, the corrected frame groups, and a predetermined loss function; and updating the parameter value using the loss value. ### Claim 6 An image processing apparatus for performing correction for each partial data group including a predetermined number of partial data elements into which data are divided, the image processing apparatus comprising: a processor; and a storage medium having computer program instructions stored thereon, wherein the computer program instructions, when executed by the processor, perform to: obtain a corrected partial data group by correcting a second partial data group, which is a partial data group continuous with a first partial data group in time, using a feature quantity of the first partial data group, and perform the correction so that subjective image quality based on a relationship between the second partial data group and a partial data group subsequent to the second partial data group in time is increased and so that a predetermined classifier classifies that a partial data group in which the second partial data group is concatenated with the partial data group subsequent to the second partial data group in time is the same as a partial data group in which the corrected partial data group is concatenated with a corrected partial data group obtained by correcting the partial data group subsequent to the second partial data group in time. ### Claim 7 An image processing method of performing correction for each frame group including a predetermined number of frames into which video data is divided, the image processing method comprising: obtaining a corrected frame group by correcting a second frame group, which is a frame group continuous with a first frame group in time, using a feature quantity of the first frame group; and performing the correction so that subjective image quality based on a relationship between the second frame group and a frame group subsequent to the second frame group in time is increased and so that a predetermined classifier classifies that a frame group in which the second frame group is concatenated with the frame group subsequent to the second frame group in time is the same as a frame group in which the corrected frame group is concatenated with a corrected frame group obtained by correcting the frame group subsequent to the second frame group in time. ### Claim 8 (depends on 1) An image processing program for causing a computer to function as the image processing apparatus according to claim 1.