# US 2021/0344852 A1 · Apparatuses, systems, and methods for thermal imaging > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2021/0344852 A1 - Document ID: US20210344852A1 - Status: Published application - Kind: A1 - Application number: 17/241,478 - Filed: 2021-04-27 - Published: 2021-11-04 - Earliest claimed: 2020-05-04 - Assignees: Rebellion Photonics, Inc. - Applicants: Rebellion Photonics, Inc. - Inventors: Thomas A. ISBERG; Robert Timothy KESTER; Suresh VENKATARAYALU; Patrick Charles O'DRISCOLL; Steve Patrick GAUTIERI; Gary Timothy NOE, II; Venus J. DANTAS; Carlos A. CLAVERIA; Ronald J. MARTIN; Michael Jon FREEMAN; Ryan Patrick MALLERY - Web page: https://patentgrep.com/patent/US20210344852A1 ## CPC - G01J 5/0205: {Mechanical elements; Supports for optical elements} - G01J 5/53: Reference sources, e.g. standard lamps; Black bodies - A41D 13/11: Protective face masks, e.g. for surgical use, or for use in foul atmospheres (eye-masks A61F9/04 {; hoods affording protection against heat or harmful chemical agents A62B17/04}) - G01J 3/0208: {using focussing or collimating elements, e.g. lenses or mirrors; performing aberration correction} - G01J 3/021: {using plane or convex mirrors, parallel phase plates, or particular reflectors} - G01J 3/0232: {using shutters} - G01J 3/0297: {Constructional arrangements for removing other types of optical noise or for performing calibration} - G01J 3/36: Investigating two or more bands of a spectrum by separate detectors - G01J 5/0025: {Living bodies (ear thermometers G01J5/0011; detecting, measuring or recording for diagnostic purposes A61B5/00)} - G01J 5/0265: {Handheld, portable (ear thermometers G01J5/049)} - G01J 5/80: Calibration (using comparison with reference sources G01J5/52) - G06V 40/165: {using facial parts and geometric relationships} - G06V 40/171: {Local features and components; Facial parts (eye characteristics G06V40/18); Occluding parts, e.g. glasses; Geometrical relationships} - G07C 9/37: using biometric data, e.g. fingerprints, iris scans or voice recognition - G08B 23/00: Alarms responsive to unspecified undesired or abnormal conditions - H04N 23/11: for generating image signals from visible and infrared light wavelengths - E05B 2035/009: {Locks where a characteristic part of the user's body is used as a key} - G01J 2005/0077: {Imaging} - G06T 2207/30201: Face - G08B 21/02: Alarms for ensuring the safety of persons - G08B 21/0469: {Presence detectors to detect unsafe condition, e.g. infrared sensor, microphone (G08B21/0476 takes precedence)} - G08B 21/0476: {Cameras to detect unsafe condition, e.g. video cameras} - G08B 21/245: {Reminder of hygiene compliance policies, e.g. of washing hands} - G01J: MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY (light sources F21, H01J, H01K, H05B; investigating properties of materials by optical means G01N) - A41D: OUTERWEAR; PROTECTIVE GARMENTS; ACCESSORIES - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G07C: TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE - G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - E05B: LOCKS; ACCESSORIES THEREFOR; HANDCUFFS - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract In one embodiment, an infrared (IR) imaging system for determining a concentration of a target species in an object is disclosed. The imaging system can include an optical system including an optical focal plane array (FPA) unit. The optical system can have components defining at least two optical channels thereof, said at least two optical channels being spatially and spectrally different from one another. Each of the at least two optical channels can be positioned to transfer IR radiation incident on the optical system towards the optical FPA. The system can include a processing unit containing a processor that can be configured to acquire multispectral optical data representing said target species from the IR radiation received at the optical FPA. Said optical system and said processing unit can be contained together in a data acquisition and processing module configured to be worn or carried by a person. ## Claims ### Claim 1 A computer-implemented method comprising: accessing at least one of a target modified visible image and a temperature modified IR image; classifying at least one target indicator in the at least one of the target modified visible image and the temperature modified IR image to create personal protective equipment data; determining a presence of personal protective equipment; classifying the personal protective equipment to create compliance data, where the personal protective equipment is classified based on predetermined data related to personal protective equipment; generating a compliance indicator based on the compliance data and the personal protective equipment data; and generating at least one of an alert and an alarm based on the compliance indicator. ### Claim 2 A computer-implemented method comprising: accessing at least one of a target modified visible image and a temperature modified IR image; correlating a user to each target indicator in the temperature modified IR image; determining that the user has a first temperature indication based on the temperature modified IR image; and generating at least one of an alarm or an alert based on the first temperature indication. ### Claim 3 (depends on 2) The computer-implemented method of claim 2 further comprising: tracking the user to generate a real time or semi-real time location; tracing a user's historical location for a predetermined time; and identifying one or more contacts based on at least one of the real time or semi-real time location and the user's historical location. ### Claim 4 (depends on 2) The computer-implemented method of claim 2 further comprising: classifying at least one target indicator in the at least one of the target modified visible image and the temperature modified IR image to create personal protective equipment data; determining a presence of personal protective equipment; classifying the personal protective equipment to create compliance data, where the personal protective equipment is classified based on predetermined data related to personal protective equipment; generating a compliance indicator based on the compliance data and the personal protective equipment data; and generating at least one of the alert and the alarm based on the compliance indicator ### Claim 5 A computer-implemented method comprising: accessing at least one of a target modified visible image and a temperature modified IR image; correlating a user to each target indicator in the temperature modified IR image; updating a network video recorder overlay with the temperature modified IR image; and determining that the user has a temperature indication above a threshold based on the temperature modified IR image. ### Claim 6 (depends on 5) The computer-implemented method of claim 5 further comprising: generating at least one of an alarm or an alert based on the temperature indication. ### Claim 7 (depends on 5) The computer-implemented method of claim 5 further comprising: tracking the user to generate a real time or semi-real time location; tracing a user's historical location for a predetermined time; and identifying one or more contacts based on at least one of the real time or semi-real time location and the user's historical location. ### Claim 8 (depends on 5) The computer-implemented method of claim 5 further comprising: classifying at least one target indicator in the at least one of the target modified visible image and the temperature modified IR image to create personal protective equipment data; determining a presence of personal protective equipment; classifying the personal protective equipment to create compliance data, where the personal protective equipment is classified based on predetermined data related to personal protective equipment; generating a compliance indicator based on the compliance data and the personal protective equipment data; and generating at least one of an alert and an alarm based on the compliance indicator ### Claim 9 (depends on 5) The computer-implemented method of claim 5 further comprising: identifying the user within at least one of a zone, a region, a building, and a floor to generate a user location; and updating a building management interface with the user location and a user's historical location. ### Claim 10 A computer-implemented method comprising: accessing at least one of a target modified visible image and a temperature modified IR image; correlating each target indicator in the temperature modified IR image to a user; determining a user has a first temperature indication based on the temperature modified IR image; and generating at least one of an alarm or an alert based on the first temperature indication. ### Claim 11 A thermal imaging system comprising: a remote video sensor comprising: a visible imager configured to acquire visible image (VIS) data of a field of view of the remote video sensor; and an infrared (IR) imager configured to acquire IR image data of the field of view of the remote video sensor; and video analysis circuitry operably coupled to the remote video sensor, wherein the video analysis circuitry is configured to: receive VIS data from the visible imager; receive IR image data from the IR imager; analyze the VIS data to determine one or more target indicators of the VIS data associated with one or more faces within the field of view of the remote video sensor; map the one or more target indicators on the IR image data to generate a target modified IR image; analyze the target modified IR image to determine a facial temperature associated with each of the one or more faces within the field of view; generate a target and temperature modified IR image that includes the one or more target indicators and the facial temperatures; and generate an access signal based on the one or more target indicators and the facial temperatures. ### Claim 12 (depends on 11) The system according to claim 11, wherein the video analysis circuitry is further configured to, in response to receiving the VIS data and the IR image data, calibrate and correlate the VIS data and the IR image data. ### Claim 13 (depends on 12) The system according to claim 12, wherein the VIS data from the visible imager further comprises VIS time data and the IR image data from the IR imager further comprise IR time data such that the video analysis circuitry correlates the VIS data and the IR image data based upon the VIS time data and the IR time data. ### Claim 14 (depends on 11) The system according to claim 11, wherein the video analysis circuitry is further configured to display the target and temperature modified IR image. ### Claim 15 (depends on 11) The system according to claim 11, wherein determining the one or more target indicators of the VIS data further comprises determining one or more facial attributes of the one or more faces within the field of view of the remote video sensor. ### Claim 16 (depends on 11) The system according to claim 11, wherein the one or more facial attributes comprise at least one of a mouth, nose, eye, or tear duct of the one or more faces within the field of view of the remote video sensor. ### Claim 17 (depends on 51) The system according to claim 51, wherein analyzing the target modified IR image to determine a facial temperature further comprises determining a facial temperature associated with or bounded by the one or more facial attributes. ### Claim 18 A method for thermal imaging, the method comprising: receiving, via a computing device, visible image (VIS) data from a visible imager; receiving, via the computing device, infrared (IR) image data from an IR imager; analyzing, via facial recognition circuitry of the computing device, the VIS data to determine one or more target indicators of the VIS data associated with one or more faces within the field of view of the remote video sensor; mapping, via the image association circuitry of the computing device, the one or more target indicators on the IR image data to generate a target modified IR image; analyzing, via temperature determination circuitry of the computing device, the target modified IR image to determine a facial temperature associated with each of the one or more faces within the field of view; generating, via the temperature determination circuitry of the computing device, a target and temperature modified IR image that includes the one or more target indicators and the facial temperatures; and generate an access signal based on the one or more target indicators and the facial temperatures. ### Claim 19 (depends on 18) The method according to claim 18, further comprising, in response to receiving the VIS data and the IR image data, calibrating and correlating the VIS data and the IR image data. ### Claim 20 (depends on 19) The method according to claim 19, wherein the VIS data from the visible imager further comprises VIS time data and the IR image data from the IR imager further comprise IR time data such that the VIS data and the IR image data are correlated based upon the VIS time data and the IR time data. ### Claim 21 (depends on 20) The method according to claim 20, further comprising displaying the target and temperature modified IR image. ### Claim 22 (depends on 18) The method according to claim 18, wherein determining the one or more target indicators of the VIS data further comprises determining one or more facial attributes of the one or more faces within the field of view of the remote video sensor. ### Claim 23 (depends on 18) The method according to claim 18, wherein the one or more facial attributes comprise at least one of a mouth, nose, eye, or tear duct of the one or more faces within the field of view of the remote video sensor. ### Claim 24 (depends on 18) The method according to claim 18, wherein analyzing the target modified IR image to determine a facial temperature further comprises determining a facial temperature associated with or bounded by the one or more facial attributes. ### Claim 25 A computer-implemented method comprising: accessing at least one of a target modified visible image and a temperature modified IR image; identifying at least one user in the temperature modified IR image and/or target modified visible image; determining a temperature indication based on the temperature modified IR image for the at least one user and an access credential for the at least one user; and generating an access signal for the at least one user based on the temperature indication and/or the access credential. ### Claim 26 (depends on 25) The computer-implemented method of claim 25 further comprising: generating at least one of an alarm or an alert based on the temperature indication and/or the access credential. ### Claim 27 (depends on 25) The computer-implemented method of claim 25 further comprising: tracking the user to generate a real time or semi-real time location; tracing a user's historical location for a predetermined time; and identifying one or more contacts based on at least one of the real time or semi-real time location and the user's historical location. ### Claim 28 A method for access control using thermal imaging, the method comprising: receiving, via a computing device, visible image (VIS) data from a visible imager; receiving, via the computing device, infrared (IR) image data from an IR imager; analyzing, via facial recognition circuitry of the computing device, the VIS data to determine one or more target indicators of the VIS data associated with one or more faces within the field of view of the remote video sensor; identifying a user that is associated with each face of the one or more faces; mapping, via the image association circuitry of the computing device, the one or more target indicators on the IR image data to generate a target modified IR image; analyzing, via temperature determination circuitry of the computing device, the target modified IR image to determine a facial temperature associated with each of the one or more faces within the field of view; mapping a determined facial temperature to the user; and generate an access signal for the user based on the determined facial temperature and in response to a request for access at an access control point. ### Claim 29 (depends on 28) The method according to claim 28, further comprising, in response to receiving the VIS data and the IR image data, calibrating and correlating the VIS data and the IR image data. ### Claim 30 (depends on 29) The method according to claim 29, wherein the VIS data from the visible imager further comprises VIS time data and the IR image data from the IR imager further comprise IR time data such that the VIS data and the IR image data are correlated based upon the VIS time data and the IR time data. ### Claim 31 (depends on 28) The method according to claim 28, wherein the access signal is further based on a determination of a valid access credential. ### Claim 32 (depends on 28) The method according to claim 28, wherein determining the one or more target indicators of the VIS data further comprises determining one or more facial attributes of the one or more faces within the field of view of the remote video sensor. ### Claim 33 (depends on 28) The method according to claim 28, wherein the one or more facial attributes comprise at least one of a mouth, nose, eye, or tear duct of the one or more faces within the field of view of the remote video sensor. ### Claim 34 (depends on 28) The method according to claim 28, wherein analyzing the target modified IR image to determine a facial temperature further comprises determining a facial temperature associated with or bounded by the one or more facial attributes.