Image processing device and image processing method

An image processing device disposed in a moving body and connected to a display device having a screen at least a part of which is non-planar, the image processing device comprising:

• an eye-point information acquisition unit configured to acquire information on an eye position of an occupant of the moving body;
• an image acquisition unit configured to acquire an outside-world image showing an outside world of the moving body;
• a parameter generation unit configured to generate a parameter for generating a display-target image to be displayed on the display device from the outside-world image in accordance with the information on the eye position;
• an image generation unit configured to generate the display-target image from the outside-world image based on the parameter generated by the parameter generation unit;
• and
• an image output unit configured to output the display-target image generated by the image generation unit to the display device;
• wherein the parameter includes:
• an element of a projective transformation matrix for transforming coordinates on a reference plane set in a real space from a first coordinate system corresponding to the real space to a second coordinate system that is a coordinate system of the outside-world image;
• and
• an element of a projective transformation matrix that transforms coordinates of the screen into coordinates of the outside-world image within an area of the reference plane displayed on the screen, by specifying the coordinate on a reference plane, where the extension line of the line segment connecting the eye position in the first coordinate system and the coordinate on the screen disposed in the first coordinate system based on screen data indicating a shape and a position of the screen intersects with the reference plane set in the first coordinate system;
• and
• wherein the display device is movably installed in the moving body, and the parameter is updated in accordance with motions of the display device.

An image processing method executed by an image processing device disposed in a moving body and connected to a display device having a screen at least a part of which is non-planar, the method comprising the steps of:

• acquiring information on an eye position of an occupant of the moving body;
• acquiring an outside-world image showing an outside world of the moving body;
• generating a parameter for generating a display-target image to be displayed on the display device from the outside-world image in accordance with the information on the eye position;
• generating the display-target image from the outside-world image based on the generated parameter;
• and
• outputting the generated display-target image to the display device,
• wherein the parameter includes:
• an element of a projective transformation matrix for transforming coordinates on a reference plane set in a real space from a first coordinate system corresponding to the real space to a second coordinate system that is a coordinate system of the outside-world image;
• and
• an element of a projective transformation matrix that transforms coordinates on the screen into coordinates on the reference plane corresponding to an area to be displayed on the screen, by specifying an intersection coordinate on the reference plane, where an extension line of the line segment connecting the eye position in the first coordinate system and the coordinate on the screen disposed in the first coordinate system based on screen data indicating a shape and a position of the screen intersecting with the reference plane set in the first coordinate system at the intersection coordinate on the reference plane.