# US 5,568,570 A · Method and apparatus for reducing quantization artifacts in a hierarchical image storage and retrieval system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 5,568,570 A
- Document ID: US5568570A
- Status: Granted
- Kind: A
- Application number: 08/315,781
- Filed: 1994-09-30
- Granted: 1996-10-22
- Earliest claimed: 1994-09-30
- Assignees: Eastman Kodak Company
- Inventors: Majid Rabbani
- Web page: https://patentgrep.com/patent/US5568570A

## CPC

- G06T 1/0028: {Adaptive watermarking, e.g. Human Visual System [HVS]-based watermarking}
- H04N 1/32144: {embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp}
- H04N 1/32251: {in multilevel data, e.g. greyscale or continuous tone data}
- H04N 1/32267: {combined with processing of the image}
- H04N 1/40068: {Modification of image resolution, i.e. determining the values of picture elements at new relative positions (H04N1/3935 takes precedence)}
- H04N 21/23892: {involving embedding information at multiplex stream level, e.g. embedding a watermark at packet level}
- H04N 21/8358: involving watermark {(protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467)}
- H04N 2201/3233: of authentication information, e.g. digital signature, watermark
- H04N 2201/3273: Display
- H04N 2201/3274: Storage or retrieval of prestored additional information
- H04N 2201/328: Processing of the additional information
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

The system and method reduces the quantization artifacts in the addition and removal of a digital watermark to and from a selected resolution image of a hierarchical image storage system where the watermark removal record is placed in a higher resolution image component. For those applications where preserving the image quality of a higher resolution image component is more critical than preserving the image quality of a lower resolution image component, the low-resolution image is modified according to the teachings of the present invention to minimize and in many cases eliminate the quantization artifacts at the higher resolution component.

## Claims

### Claim 1

A method for reducing quantization artifacts in a hierarchical image system of the type that decomposes a high resolution image into low resolution image components, including low resolution image pixel values, and residual image pixel values comprising the steps of:
a) forming a predicted higher resolution image by interpolating the pixel values of the low resolution image components;
b) determining the difference values between the pixel values in the low resolution image and the corresponding pixel values in the higher resolution image;
c) comparing each of the difference values against quantizer conversion values to determine if an error would exist for an executed conversion;
d) adjusting the image pixel values within the low resolution image component if an error would exist, to a value that eliminates the error to form an adjusted low resolution image;
e) using the unadjusted image pixel value as part of the adjusted low resolution image component if an error does not exist; and
f) forming a predicted higher resolution image by interpolating the pixel values of the adjusted low resolution image components of steps d) and e);
g) determining the difference values between the interpolated pixel values in the predicted higher resolution image and the corresponding pixel values in the higher resolution image;
h) comparing each of the difference values against quantizer conversion values to determine if an error would exist for an executed conversion;
i) adjusting further the image pixel values within the adjusted low resolution image component if an error would exist, to a value that eliminates the error to form an adjusted low resolution image; and
j) using the unadjusted image pixel value as part of the adjusted low resolution image component if an error does not exist.

### Claim 2

A method for reducing quantization artifacts in a hierarchical image system of the type that decomposes a high resolution image into low resolution image pixel values and residual image pixel values comprising the steps of:
a) forming a predicted higher resolution image by interpolating the pixel values of the low resolution image components;
b) computing a predicted value for the high-resolution pixel value being processed from the to be adjusted low-resolution image using interpolation;
c) determining the difference value between the predicted value from the low-resolution image and the corresponding pixel value in the higher resolution image;
d) comparing the difference value against quantizer conversion values to determine if an error would exist for an executed conversion;
e) adjusting a pixel value in the low-resolution image to a value that eliminates the error to form an adjusted low resolution image if an error exists; and making no adjustment if an error does not exist; and
f) repeating steps b) through e) for all the pixels in the high-resolution image;

### Claim 3

A method for reducing quantization artifacts in a hierarchical image system of the type that decomposes a high resolution image into low resolution image pixel values and residual image pixel values comprising the steps of:
a) sequentially forming a predicted higher resolution image by interpolating the pixel values of a first block of low resolution image pixel values;
b) determining the difference value between the pixel values in the predicted higher resolution image and the corresponding pixel value in the higher resolution image;
c) comparing the difference value against quantizer conversion values to determine if an error would exist for an executed conversion;
d) adjusting the image pixel value within the low resolution image component if an error would exist, to a value that eliminates the error to form an adjusted low resolution image;
e) using the image pixel value as part of the adjusted low resolution image component if an error does not exist; and
f) repeating steps b) through e) for each pixel value in the higher resolution image.

### Claim 4

A method for reducing quantization artifacts in a hierarchical image system of the type that decomposes a high resolution image into low resolution image pixel values and residual image pixel values comprising the steps of:
a) applying pixel values to pixel positions within a low resolution image to form a low resolution image component;
b) sequentially forming a predicted higher resolution image by interpolating the pixel values of a first block of the low resolution image components;
c) determining the difference value between the pixel value in the predicted higher resolution image and the corresponding pixel value in the higher resolution image;
d) comparing the difference values against established conversion values to determine if an error would exist for an executed conversion;
e) adjusting the image pixel value within the low resolution image component if an error would exist, to a value that eliminates the error to form an adjusted low resolution image;
f) using the image pixel value as part of the adjusted low resolution image component if an error does not exist; and
g) repeating steps b) through f) for each pixel value in the higher resolution image.

### Claim 5

Apparatus for reducing quantization artifacts in a hierarchical image system of the type that decomposes a high resolution image into low resolution image pixel values, and residual image pixel values, comprising:
means for applying pixel values to pixel positions within the low resolution image to form a low resolution image component;
means for determining the difference values between the pixel values in the low resolution image component and the corresponding pixel values in the higher resolution image;
means for comparing each of the difference values against quantizer conversion values to determine if an error would exist for an executed conversion;
means for adjusting the image pixel values within the low resolution image component if an error would exist, to a value that eliminates the error to form an adjusted low resolution image component and using the image pixel value as part of the adjusted low resolution image component if an error does not exist; and
means for forming a predicted higher resolution image by interpolating the pixel values of the adjusted low resolution image component;
means for determining the difference values between the interpolated pixel values in the predicted higher resolution image and the corresponding pixel values in the higher resolution image;
means for comparing each of the difference values against quantizer conversion values to determine if an error would exist for an executed conversion;
means for adjusting the image pixel values within the adjusted low resolution image component if an error would exist, to a value that eliminates the error to form a twice adjusted low resolution image component; and
means for using the image pixel value as part of the twice adjusted low resolution image component if an error does not exist.

### Claim 6

Apparatus for reducing quantization artifacts in a hierarchical image system of the type that decomposes a high resolution image into low resolution image components and residual image components comprising:
means for sequentially forming a predicted higher resolution image by interpolating the pixel values of a first block of the low resolution image components;
means for determining the difference value between the pixel value in the predicted higher resolution image and the corresponding pixel value in the higher resolution image;
means for comparing the difference values against established conversion values to determine if an error would exist for an executed conversion;
means for adjusting an image pixel value within the low resolution image component if an error would exist, to a value that eliminates the error to form an adjusted low resolution image;
means for using the image pixel value as part of the adjusted low resolution image component if an error does not exist; and
means for controlling said means for sequentially forming so as to form blocks for all of the pixels of the high resolution image.

### Claim 7

A method for reducing quantization artifacts in a hierarchical image system of the type that decomposes a high resolution image into low resolution image pixel values and residual image pixel values and applies a watermark to the low resolution image pixel values comprising the steps of:
a) applying watermark pixel values to pixel positions within the low resolution image to form a watermarked low resolution image component;
b) determining the difference values between the pixel values in the watermarked low resolution image and the corresponding pixel values in the higher resolution image;
c) comparing each of the difference values against quantizer conversion values to determine if an error would exist for an executed conversion;
d) adjusting the watermark image pixel values within the watermarked low resolution image component if an error would exist, to a value that eliminates the error to form an adjusted watermarked low resolution image; and
e) using the watermark image pixel value as part of the adjusted watermarked low resolution image component if an error does not exist.

### Claim 8

A method for reducing quantization artifacts in a hierarchical image system of the type that decomposes a high resolution image into low resolution image pixel values and residual image pixel values and applies a watermark to the low resolution image pixel values comprising the steps of:
a) applying watermark pixel values to pixel positions within the low resolution image to form a watermarked low resolution image component;
b) determining the difference values between the pixel values in the watermarked low resolution image and the corresponding pixel values in the higher resolution image;
c) comparing each of the difference values against quantizer conversion values to determine if an error would exist for an executed conversion;
d) adjusting the watermark image pixel values within the watermarked low resolution image component if an error would exist, to a value that eliminates the error to form an adjusted watermarked low resolution image;
e) using the watermark image pixel value as part of the adjusted watermarked low resolution image component if an error does not exist; and
f) forming a predicted higher resolution image by interpolating the pixel values of the adjusted watermarked low resolution image components of steps d) and e);
g) determining the difference values between the interpolated pixel values in the predicted higher resolution image and the corresponding pixel values in the higher resolution image;
h) comparing each of the difference values against quantizer conversion values to determine if an error would exist for an executed conversion;
i) adjusting further the watermark image pixel values within the adjusted watermarked low resolution image component if an error would exist, to a value that eliminates the error to form an adjusted watermarked low resolution image; and
j) using the watermark image pixel value as part of the adjusted watermarked low resolution image component if an error does not exist.

### Claim 9

A method for reducing quantization artifacts in a hierarchical image system of the type that decomposes a high resolution image into low resolution image pixel values and residual image pixel values and applies a watermark to the low resolution image pixel values comprising the steps of:
a) applying watermark pixel values to pixel positions within the low resolution image to form a watermarked low resolution image component;
b) computing a predicted value for the high-resolution pixel value being processed from the to be adjusted watermarked low-resolution image using interpolation;
c) determining the difference value between the predicted value from the low-resolution watermarked image and the corresponding pixel value in the higher resolution image;
d) comparing the difference value against quantizer conversion values to determine if an error would exist for an executed conversion;
e) adjusting a pixel value in the low-resolution watermarked image to a value that eliminates the error to form an adjusted watermarked low resolution image if an error exists; and making no adjustment if an error does not exist; and
f) repeating steps b) through e) for all the pixels in the high-resolution image;

### Claim 10

A method for reducing quantization artifacts in a hierarchical image system of the type that decomposes a high resolution image into low resolution image pixel values and residual image pixel values and applies a watermark to the low resolution image pixel values comprising the steps of:
a) applying watermark pixel values to pixel positions within the low resolution image to form a watermarked low resolution image component;
b) sequentially forming a predicted higher resolution image by interpolating the pixel values of a first block of the watermarked low resolution image components;
c) determining the difference value between the pixel value in the predicted higher resolution image and the corresponding pixel value in the higher resolution image;
d) comparing the difference value against quantizer conversion values to determine if an error would exist for an executed conversion;
e) adjusting the watermark image pixel value within the watermarked low resolution image component if an error would exist, to a value that eliminates the error to form an adjusted watermarked low resolution image;
f) using the watermark image pixel value as part of the adjusted watermarked low resolution image component if an error does not exist; and
g) repeating steps b) through f) for each pixel value in the higher resolution image.

### Claim 11

A method for reducing quantization artifacts in a hierarchical image system of the type that decomposes a high resolution image into low resolution image pixel values and residual image pixel values and applies a watermark to the low resolution image pixel values comprising the steps of:
a) applying watermark pixel values to pixel positions within the low resolution image to form a watermarked low resolution image component;
b) sequentially forming a predicted higher resolution image by interpolating the pixel values of a first block of the watermarked low resolution image components;
c) determining the difference value between the pixel value in the predicted higher resolution image and the corresponding pixel value in the higher resolution image;
d) comparing the difference values against established conversion values to determine if an error would exist for an executed conversion;
e) adjusting the watermark image pixel value within the watermarked low resolution image component if an error would exist, to a value that eliminates the error to form an adjusted watermarked low resolution image;
f) using the watermark image pixel value as part of the adjusted watermarked low resolution image component if an error does not exist; and
g) repeating steps b) through f) for each pixel value in the higher resolution image.

### Claim 12

Apparatus for reducing quantization artifacts in a hierarchical image system of the type that decomposes a high resolution image into low resolution image pixel values and residual image pixel values and applies a watermark to the low resolution image pixel values comprising:
means for applying watermark pixel values to pixel positions within the low resolution image to form a watermarked low resolution image component;
means for determining the difference values between the pixel values in the watermarked low resolution image and the corresponding pixel values in the higher resolution image;
means for comparing each of the difference values against quantizer conversion values to determine if an error would exist for an executed conversion; and
means for adjusting the watermark image pixel values within the watermarked low resolution image component if an error would exist, to a value that eliminates the error to form an adjusted watermarked low resolution image component and using the watermark image pixel value as part of the adjusted watermarked low resolution image component if an error does not exist.

### Claim 13

Apparatus for reducing quantization artifacts in a hierarchical image system of the type that decomposes a high resolution image into low resolution image pixel values and residual image pixel values and applies a watermark to the low resolution image pixel values comprising:
means for applying watermark pixel values to pixel positions within the low resolution image to form a watermarked low resolution image component;
means for determining the difference values between the pixel values in the watermarked low resolution image and the corresponding pixel values in the higher resolution image;
means for comparing each of the difference values against quantizer conversion values to determine if an error would exist for an executed conversion;
means for adjusting the watermark image pixel values within the watermarked low resolution image component if an error would exist, to a value that eliminates the error to form an adjusted low resolution image component and using the watermark image pixel value as part of the adjusted watermarked low resolution image component if an error does not exist; and
means for forming a predicted higher resolution image by interpolating the pixel values of the adjusted watermarked low resolution image;
means for determining the difference values between the interpolated pixel values in the predicted higher resolution image and the corresponding pixel values in the higher resolution image;
means for comparing each of the difference values against quantizer conversion values to determine if an error would exist for an executed conversion;
means for adjusting the watermark image pixel values within the adjusted watermarked low resolution image component if an error would exist, to a value that eliminates the error to form a twice adjusted watermarked low resolution image component; and
means for using the watermark image pixel value as part of the twice adjusted watermarked low resolution image component if an error does not exist.

### Claim 14

Apparatus for reducing quantization artifacts in a hierarchical image system of the type that decomposes a high resolution image into low resolution image components and residual image components and applies a watermark to the low resolution image components comprising:
means for applying watermark pixel values to pixel positions within the low resolution image to form a watermarked low resolution image component;
means for sequentially forming a predicted higher resolution image by interpolating the pixel values of a first block of the watermarked low resolution image components;
means for determining the difference value between the pixel value in the predicted higher resolution image and the corresponding pixel value in the higher resolution image;
means for comparing the difference values against established conversion values to determine if an error would exist for an executed conversion;
means for adjusting the watermark image pixel value within the watermarked low resolution image component if an error would exist, to a value that eliminates the error to form an adjusted watermarked low resolution image;
means for using the watermark image pixel value as part of the adjusted watermarked low resolution image component if an error does not exist; and
means for controlling said means for sequentially forming so as to form blocks for all of the pixels of the high resolution image.