Observation method, image processing device, and electron microscope

An image processing device comprising:

• an image acquisition unit configured to acquire an optical microscope image of a specimen including, as a mark, a plurality of metal particles in which localized surface plasmon resonance is excited by irradiation with light, and an electron microscope image of the specimen;
• a first image information acquisition unit configured to acquire information of positions of the plurality of metal particles and information of color of scattered light from the plurality of metal particles due to localized surface plasmon resonance in the optical microscope image and estimate particle diameters of the plurality of metal particles from the information of the color of the scattered light from the metal particles due to localized surface plasmon resonance in the optical microscope image;
• a second image information acquisition unit configured to acquire information of positions and particle diameters of the plurality of metal particles in the electron microscope image, wherein the particle diameters of the plurality of metal particles are determined by measuring the particle diameters of the plurality of metal particles in the electron microscope image;
• a computation unit that determines information for associating the optical microscope image and the electron microscope image based on the information of the positions of the plurality of metal particles and the information of the color of the scattered light from the plurality of metal particles due to localized surface plasmon resonance acquired from the optical microscope image and the information of the positions and the particle diameters of the plurality of metal particles acquired from the electron microscope image, wherein the plurality of metal particles observed in the optical microscope image and the plurality of metal particles observed in the electron microscope image are associated based on the estimated particle diameters and the particle diameters measured in the electron microscope image;
• and
• an image forming unit that performs alignment between the optical microscope image and the electron microscope image based on the information for associating the optical microscope image and the electron microscope image, and forms a single image by superimposing the optical microscope image on the electron microscope image.

An observation method comprising:

• preparing a specimen including, as a mark, a plurality of metal particles in which localized surface plasmon resonance is excited by irradiation with light;
• acquiring an optical microscope image by photographing the specimen with an optical microscope;
• acquiring an electron microscope image by photographing the specimen with an electron microscope;
• acquiring information of positions and colors of the plurality of metal particles in the optical microscope image;
• acquiring information of positions and particle diameters of the plurality of metal particles in the electron microscope image;
• and
• determining information for associating the optical microscope image and the electron microscope image based on the information of the positions and the colors of the plurality of metal particles acquired from the optical microscope image and the information of the positions and the particle diameters of the plurality of metal particles acquired from the electron microscope image,
• wherein preparing the specimen includes:
• labelling an observation target with the plurality of metal particles;
• and
• increasing a size of the plurality of metal particles by sensitization.

An image processing device comprising:

• an image acquisition unit configured to acquire an optical microscope image of a specimen including, as a mark, a plurality of metal particles in which localized surface plasmon resonance is excited by irradiation with light, and an electron microscope image of the specimen;
• a first image information acquisition unit configured to acquire information of positions and colors of the plurality of metal particles in the optical microscope image;
• a second image information acquisition unit configured to acquire information of positions and particle diameters of the plurality of metal particles in the electron microscope image;
• and
• a computation unit that determines information for associating the optical microscope image and the electron microscope image based on the information of the positions and the colors of the plurality of metal particles acquired from the optical microscope image and the information of the positions and the particle diameters of the plurality of metal particles acquired from the electron microscope image,
• wherein the specimen is prepared by:
• labelling an observation target with the plurality of metal particles;
• and
• increasing a size of the plurality of metal particles by sensitization.