Display apparatus, image processing apparatus, and control method

An image processing apparatus comprising:

• an acquisition circuit that acquires three-dimensional coordinate data representing a position, in a space, of at least one type of aerosol existing for real in the space;
• and
• a processor, wherein
• wherein the at least one type of aerosol is a particle floating in the space,
• the processor generates a composite image in which a first image acquired by imaging the space by a camera and a second image representing the at least one type of aerosol existing for real in the space of the first image are combined based on the three-dimensional coordinate data,
• a position of the at least one type of aerosol as seen in a depth direction in the first image is reflected in the second image, and
• a density of the at least one type of aerosol is further reflected in the second image, the density of the at least one type of aerosol is obtained by irradiating an incident light to the at least one type of aerosol, and an intensity of a return light from the at least one type of aerosol corresponds to the density of the at least one type of aerosol.

A control method of controlling a system,

• the system comprising
• a sensor that includes a light source emitting irradiation light toward at least one type of object in a space and a photodetector detecting return light returning from the at least one type of object, the sensor outputting data representing a result of detection of the return light by the photodetector, and
• a display apparatus,
• the control method comprising:
• acquiring the data from the sensor:
• generating three-dimensional coordinate data representing a position, in the space, of the at least one type of object based on the data;
• based on the three-dimensional coordinate data, generating a composite image in which a first image and a second image are combined, the first image being obtained by imaging the space by a camera, the second image representing the at least one type of object existing for real in the space of the first image, reflecting a position of the at least one type of object as seen in a depth direction in the first image, wherein the at least one type of object is a particle floating in the space, and reflecting a density of the at least one type of object in the second image, wherein the density of the at least one type of object is obtained by irradiating an incident light to the at least one type of object, and an intensity of a return light from the at least one type of object corresponds to the density of the at least one type of object;
• and
• causing the display apparatus to display the composite image.

A non-transitory computer-readable storage medium storing a program for controlling a system,

• the system comprising
• a sensor that includes a light source emitting irradiation light toward at least one type of object in a space and a photodetector detecting return light returning from the at least one type of object, the sensor outputting data representing a result of detection of the return light by the photodetector, and
• a display apparatus,
• the program, when executed by the computer, performing:
• acquiring the data from the sensor;
• generating three-dimensional coordinate data representing a position, in the space, of the at least one type of object based on the data;
• based on the three-dimensional coordinate data, generating a composite image in which a first image and a second image are combined, the first image being obtained by imaging the space by a camera, the second image representing the at least one type of object existing for real in the space of the first image, reflecting a position of the at least one type of object as seen in a depth direction in the first image, wherein the at least one type of object is a particle floating in the space, and reflecting a density of the at least one type of object in the second image, wherein the density of the at least one type of object is obtained by irradiating an incident light to the at least one type of object, and an intensity of a return light from the at least one type of object corresponds to the density of the at least one type of object, and
• causing the display apparatus to display the composite image.