Control method of spectroscopic imaging device, spectroscopic imaging device, computer program, control method of display system, control method of projector, display system, and projector

A spectroscopic imaging device comprising:

• an imaging element;
• a spectral element;
• and
• one or more processors, wherein
• the one or more processors are configured to perform
• causing the spectroscopic imaging device to generate a first measurement spectrum consisting of N1 wavelengths by imaging a target object by making output wavelengths of the spectral element different when the spectroscopic imaging device is in a first mode,
• causing the spectroscopic imaging device to derive a spectrum of the target object based on the first measurement spectrum,
• causing the spectroscopic imaging device to generate a second measurement spectrum consisting of N2 wavelengths by imaging the target object by making the output wavelengths of the spectral element different when the spectroscopic imaging device is in a second mode, wherein N1 is an integer greater than or equal to two, and N2 is a positive integer less than N1, and
• causing the spectroscopic imaging device to derive the spectrum of the target object in the second mode by
• estimating the first measurement spectrum consisting of the N1 wavelengths from the second measurement spectrum consisting of the N2 wavelengths using transformation data, wherein the transformation data is a matrix that approximates the first measurement spectrum consisting of the N1 wavelengths, and
• deriving the spectrum of the target object based on the estimated first measurement spectrum.

A non-transitory computer-readable storage medium storing a program for specifying a target object based on captured data obtained by a spectroscopic imaging device that includes an imaging element and a spectral element, wherein

• the program causes one or more processors to execute
• generating a first measurement spectrum consisting of N1 wavelengths, in which N1 is an integer greater than or equal to two, by imaging the target object by making output wavelengths of the spectral element different by using the imaging element when the spectroscopic imaging device is in a first mode of the spectroscopic imaging device,
• deriving a spectrum of the target object based on the first measurement spectrum,
• generating a second measurement spectrum consisting of N2 wavelengths, in which N2 is a positive integer less than N1, by imaging the target object by making the output wavelengths of the spectral element different by using the imaging element when the spectroscopic imaging device is in a second mode of the spectroscopic imaging device, and
• deriving the spectrum of the target object in the second mode by
• estimating the first measurement spectrum consisting of the N1 wavelengths from the second measurement spectrum consisting of the N2 wavelengths using transformation data, wherein the transformation data is a matrix that approximates the first measurement spectrum consisting of the N1 wavelengths, and
• deriving the spectrum of the target object based on the estimated first measurement spectrum.

A control method of a display system including a spectroscopic imaging device that includes an imaging element and a spectral element, and a projector that projects a projected image based on image data onto a projection surface, the control method comprising:

• causing the spectroscopic imaging device to generate N1 first imaged data obtained by capturing the projected image by making spectral wavelengths of the spectral element different when the display system is in a first mode;
• causing the projector to generate first corrected image data obtained by correcting first image data based on the N1 first imaged data;
• causing the projector to project a first projected image based on the first corrected image data onto the projection surface;
• causing the spectroscopic imaging device to generate N2 second imaged data obtained by capturing the projected image by making the spectral wavelengths of the spectral element different when the display system is in a second mode;
• causing the projector to generate second corrected image data obtained by correcting the first image data based on the N2 second imaged data;
• and
• causing the projector to project a second projected image based on the second corrected image data onto the projection surface, wherein
• N1 is an integer greater than or equal to two, and N2 is a positive integer less than N1.

A control method of a projector that projects a projected image based on image data onto a projection surface, the control method comprising:

• causing a spectroscopic imaging device to acquire N1 first imaged data obtained by capturing the projected image by making spectral wavelengths of a spectral element of the spectroscopic imaging device different when the projector is in a first mode;
• generating first corrected image data obtained by correcting first image data based on the N1 first imaged data;
• projecting a first projected image based on the first corrected image data onto the projection surface;
• causing the spectroscopic imaging device to acquire N2 second imaged data obtained by capturing the projected image by making the spectral wavelengths of the spectral element of the spectroscopic imaging device different when the projector is in a second mode;
• generating second corrected image data obtained by correcting the first image data based on the N2 second imaged data;
• and
• projecting a second projected image based on the second corrected image data onto the projection surface, wherein
• N1 is an integer greater than or equal to two, and N2 is a positive integer less than N1.

A display system comprising:

• a spectroscopic imaging device including an imaging element and a spectral element;
• a projector projecting a projected image based on image data onto a projection surface;
• and
• one or more processors, wherein
• the one or more processors are configured to execute
• causing the spectroscopic imaging device to generate N1 first imaged data obtained by capturing the projected image by making spectral wavelengths of the spectral element different when the display system is in a first mode;
• causing the projector to generate first corrected image data obtained by correcting first image data based on the N1 first imaged data and project a first projected image based on the first corrected image data onto the projection surface;
• causing the spectroscopic imaging device to generate N2 second imaged data obtained by capturing the projected image by making the spectral wavelengths of the spectral element different when the display system is in a second mode;
• and
• causing the projector to generate second corrected image data obtained by correcting the first image data based on the N2 second imaged data and project a second projected image based on the second corrected image data onto the projection surface, wherein
• N1 is an integer greater than or equal to two, and N2 is an integer less than N1.

A projector that projects a projected image based on image data onto a projection surface, the projector comprising:

• one or more processors configured to perform
• causing a spectroscopic imaging device to acquire N1 first imaged data obtained by capturing the projected image by making spectral wavelengths of a spectral element of the spectroscopic imaging device different when the projector is in a first mode;
• generating first corrected image data obtained by correcting first image data based on the N1 first imaged data;
• projecting a first projected image based on the first corrected image data onto the projection surface;
• causing the spectroscopic imaging device to acquire N2 second imaged data obtained by capturing the projected image by making the spectral wavelengths of the spectral element of the spectroscopic imaging device different when the projector is in a second mode;
• generating second corrected image data obtained by correcting the first image data based on the N2 second imaged data;
• and
• projecting a second projected image based on the second corrected image data onto the projection surface, wherein
• N1 is an integer greater than or equal to two, and N2 is a positive integer less than N1.