# US 11,079,365 B2 · Spectrum simulation apparatus and method for contaminated atmosphere > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,079,365 B2 - Document ID: US11079365B2 - Status: Granted - Kind: B2 - Application number: 16/743,346 - Filed: 2020-01-15 - Published: 2021-04-01 - Granted: 2021-08-03 - Earliest claimed: 2019-09-27 - Assignees: Agency for Defense Development - Applicants: Agency for Defense Development - Inventors: Hyunwoo Nam; Jongseon Kim; Hyeonjeong Kim; Youngjin Koh - Web page: https://patentgrep.com/patent/US11079365B2 ## CPC - G01N 33/0062: {concerning the measuring method or the display, e.g. intermittent measurement or digital display} - G01N 21/3504: for analysing gases, e.g. multi-gas analysis - G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80) - G06T 7/90: Determination of colour characteristics - G06T 11/00: Two-dimensional [2D] image generation - G06T 11/10: Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77) - G01N 2021/3531: {without instrumental source, i.e. radiometric} - G06T 2207/10048: Infrared image - G01N: INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES (measuring or testing apparatus or processes other than immunoassay, involving enzymes or microorganisms C12M, C12Q) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract Provided is a simulation spectrum apparatus including: a background image acquisition unit that acquires a background image of a target region and an infrared signal corresponding to each pixel of the background image; a spectrum acquisition unit that acquires a background radiation intensity spectrum from the infrared signal acquired for the each pixel; a simulation spectrum generation unit that generates a model of a linear combination of a radiation intensity spectrum of a contamination cloud and a background radiation intensity spectrum on the basis of a difference in radiation intensity; a controller that generates a simulation spectrum of the contamination cloud by applying the information on the at least one toxic substance and the atmosphere transmittance to the model of the linear combination; and an imaging unit that generates a spectrum image, combines the generated spectrum image and the background image, and thus generates a simulation contamination cloud image. ## Claims ### Claim 1 A spectrum simulation apparatus using virtual information on at least one toxic substance generated by a user comprising: a background image acquisition unit including at least one camera and an infrared sensor configured to acquire a background image of a target region and an infrared signal corresponding to each pixel of the background image; a spectrum acquisition unit configured to acquire a background radiation intensity spectrum from the infrared signal acquired for the each pixel; an input unit configured to input, by a user, the virtual information on at least one toxic substance and atmosphere transmittance that are generated by the user; a simulation spectrum generation unit configured to generate a model of a linear combination of a radiation intensity spectrum of a contamination cloud and a background radiation intensity spectrum on the basis of a difference in radiation intensity, which depends on whether or not the contamination cloud is present; a controller configured to control the simulation spectrum generation unit in such a manner that a simulation spectrum of the contamination cloud contaminated with the at least one toxic substance, which corresponds to the each pixel, is generated by applying the virtual information on the at least one toxic substance and the atmosphere transmittance that are generated by the user to the model of the linear combination; and an imaging unit that, under the control of the controller, configured to generate a spectrum image in accordance with the simulation spectrum corresponding to the each pixel, combines the generated spectrum image and the background image, and thus generates a simulation contamination cloud image. ### Claim 2 (depends on 1) The spectrum simulation apparatus of claim 1, wherein the simulation spectrum generation unit is further configured to make division into three phases, including an atmosphere, a contamination cloud, and a background, and, on the basis of a three layers-based spectrum model that models a spectroscopic signal and the acquired background radiation intensity spectrum, models a first spectrum model for a case where the contamination cloud is present and a second spectrum model for a case where the contamination cloud is not present, and wherein the simulation spectrum generation unit is further configured to linearly combine a result of approximating a contamination cloud function, which results from approximating the atmosphere transmittance of the contamination cloud using a preset approximation method, and a difference between black-body radiation intensity of the contamination cloud and radiation intensity of the background, and the second spectrum model, and thus generates the model of the linear combination. ### Claim 3 (depends on 1) The spectrum simulation apparatus of claim 1, wherein the imaging unit is further configured to calculate a brightness temperature spectrum on the basis of the simulation spectrum corresponding to each pixel, decides a color value for each pixel according to the calculated brightness temperature spectrum, and thus generates the spectrum image. ### Claim 4 (depends on 3) The spectrum simulation apparatus of claim 3, wherein the imaging unit is further configured to calculate a tristimulus value for the brightness temperature spectrum calculated for each pixel according to a tristimulus function, calculates a RGB value for each pixel according to the calculated tristimulus value, and generates the spectrum image in which a color of each pixel is decided according to the calculated RGB value. ### Claim 5 (depends on 4) The spectrum simulation apparatus of claim 4, wherein the imaging unit is further configured to calculate a YCbCR value corresponding to the RGB value calculated for each pixel and generates the spectrum image in which the color of each pixel is decided according to the calculated YCbCR value. ### Claim 6 (depends on 1) The spectrum simulation apparatus of claim 1, further comprising: a memory storing pieces of information on multiple detection algorithms; and an algorithm performance analysis unit configured to perform toxic substance detection for each of the multiple detection algorithms on the generated simulation cloud image under the control of the controller. ### Claim 7 (depends on 6) The spectrum simulation apparatus of claim 6, wherein, when at least one of the multiple detection algorithms is selected, the controller is further configured to control the algorithm performance analysis unit in such a manner that the generated simulation contamination cloud image is input into the selected detection algorithm and that a result of toxic substance detection in accordance with the selected algorithm is derived, and wherein the controller is further configured to control the imaging unit to image the result of the toxic substance detection, perform comparison with the imaged result of the toxic substance detection, and analyze performance of the selected detection algorithm. ### Claim 8 (depends on 6) The spectrum simulation apparatus of claim 6, further comprising: an output unit configured to output the simulation contamination cloud image that results from the imaging in the imaging unit, or an imaged result of the toxic substance detection through the detection algorithm, as visual information. ### Claim 9 (depends on 1) The spectrum simulation apparatus of claim 1, wherein, with respect to the total number of pixels of the simulation contamination cloud image, the controller is further configured to analyze quantified performance of the selected detection algorithm according to the number of pixels in an imaged result of toxic substance detection, which are matched, in terms of the presence or absence of the toxic substance, with pixels of the simulation contamination cloud image. ### Claim 10 (depends on 1) The spectrum simulation apparatus of claim 1, wherein the controller is further configured to analyze performance of the detection algorithm on the basis of an imaged result of toxic substance detection, and a receiver operating characteristic (ROC) analysis technique for the simulation contamination cloud image. ### Claim 11 A spectrum simulation method using virtual information on at least one toxic substance generated by a user comprising: a first step of including at least one camera and an infrared sensor and acquiring a background image of a target region and an infrared signal corresponding to each pixel of the background image; a second step of acquiring a background radiation intensity spectrum from the infrared signal acquired for the each pixel; a third step of generating a model of a linear combination of a radiation intensity spectrum of a contamination cloud and a background radiation intensity spectrum on the basis of a difference in radiation intensity, which depends on whether or not the contamination cloud is present; a fourth step of generating a simulation spectrum of the contamination cloud contaminated with at least one toxic substance, which corresponds to the each pixel, by applying the virtual information on the at least one toxic substance and atmosphere transmittance to the model of the linear combination, when the virtual information on the at least one toxic substance and the atmosphere transmittance that are generated by the user that are desired to be simulated are input by a user; and a fifth step of generating a spectrum image in accordance with the simulation spectrum corresponding to the each pixel, combining the generated spectrum image and the background image, and thus generating a simulation contamination cloud image. ### Claim 12 (depends on 11) The spectrum simulation method of claim 11, wherein the third step includes a (3-1)-th step of making division into three phases, including an atmosphere, a contamination cloud, and a background and modeling a first spectrum model for a case where the contamination cloud is present and a second spectrum model for a case where the contamination cloud is not present, on the basis of a three layers-based spectrum model that models a spectroscopic signal and the acquired background radiation intensity spectrum; and a (3-2)-nd step of linearly combining a result of approximating a contamination cloud function, which results from approximating the atmosphere transmittance of the contamination cloud using a preset approximation method, and a difference between black-body radiation intensity of the contamination cloud and radiation intensity of the background, and the second spectrum model and thus generating the model of the linear combination. ### Claim 13 (depends on 11) The spectrum simulation method of claim 11, wherein, with the spectrum image, a brightness temperature spectrum is calculated on the basis of the simulation spectrum corresponding to each pixel, and a color value for each pixel is decided and generated according to the calculated brightness temperature spectrum. ### Claim 14 (depends on 11) The spectrum simulation method of claim 11, further comprising: an a step of selecting at least one of preset multiple detection algorithms; a b step of inputting the generated simulation contamination cloud image into the selected detection algorithm and deriving a result of toxic substance detection in accordance with the selected algorithm; a c step of imaging the derived result of the toxic substance detection; and a d step of performing a comparison with the imaged result of the toxic substance detection and analyzing performance of the selected detection algorithm. ### Claim 15 (depends on 14) The spectrum simulation method of claim 14, wherein the d step is a step of analyzing quantified performance of the selected detection algorithm according to the number of pixels in the imaged result of toxic substance detection, which are matched, in terms of the presence or absence of the toxic substance, with pixels of the simulation contamination cloud image, with respect to the total number of pixels of the simulation contamination cloud image. ### Claim 16 (depends on 14) The spectrum simulation method of claim 14, wherein the d step is a step of analyzing performance of the selected detection algorithm on the basis of the imaged result of the toxic substance detection, and a receiver operating characteristic (ROC) analysis technique for the simulation contamination cloud image.