Image processing device for processing image data and map data with regard to depth distribution of a subject, image processing system, imaging apparatus, image processing method, and recording medium

An image processing system comprising:

• at least one processor or at least one circuit programmed to function as an encoding device and a decoding device,
• wherein the encoding device comprising:
• a first encoding unit configured to encode image data;
• and
• a second encoding unit configured to encode map data with regard to depth distribution of a subject, and
• wherein the decoding device comprising:
• a first decoding unit configured to decode the image data encoded by the first encoding unit and thereby generate decoded image data;
• a second decoding unit configured to decode the map data encoded by the second encoding unit and thereby generate decoded map data;
• a first shaping unit configured to perform a shaping process to the decoded map data with reference to the decoded image data having higher resolution than that of the decoded map data, wherein the shaping process includes an edge-preserved filtering process using coefficients generated based on the decoded image data;
• and
• a first image processing unit configured to perform image processing to the decoded image data with reference to the decoded map data that has been processed for shaping by the first shaping unit.

An imaging apparatus that includes an image processing device that processes image data and map data with regard to depth distribution of a subject,

• wherein the image processing device comprising at least one processor or at least one circuit programmed to function as:
• a first decoding unit configured to decode the image data that has been encoded and thereby generate decoded image data;
• a second decoding unit configured to decode the map data that has been encoded and thereby generate decoded map data;
• a first shaping unit configured to perform a shaping process to the decoded map data with reference to the decoded image data having higher resolution than that of the decoded map data, wherein the shaping process includes an edge-preserved filtering process using coefficients generated based on the decoded image data;
• and
• a first image processing unit configured to perform image processing to the decoded image data with reference to the decoded map data that has been processed for shaping by the first shaping unit.

An image processing method implemented by an image processing device that processes image data and map data of depth distribution of a subject, comprising:

• first decoding of decoding the image data that has been encoded and thereby generating decoded image data;
• second decoding of decoding the map data that has been encoded and thereby generating decoded map data;
• shaping by performing a shaping process to the decoded map data with reference to the decoded image data, wherein the shaping process includes an edge-preserved filtering process using coefficients generated based on the decoded image data;
• and
• image processing of performing image processing to the decoded image data with reference to the decoded map data that has been processed for shaping in the shaping.

A non-transitory recording medium in which a program for causing a computer of the image processing device to implement each step of an image processing method is recorded, the image processing method comprising:

• first decoding of decoding the image data that has been encoded and thereby generating decoded image data;
• second decoding of decoding the map data that has been encoded and thereby generating decoded map data;
• shaping by performing a shaping process to the decoded map data with reference to the decoded image data, wherein the shaping process includes an edge-preserved filtering process using coefficients generated based on the decoded image data;
• and
• image processing of performing image processing to the decoded image data with reference to the decoded map data that has been processed for shaping in the shaping.