# US 12,192,639 B2 · Thermal imaging system having view-shifting capability > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,192,639 B2 - Document ID: US12192639B2 - Status: Granted - Kind: B2 - Application number: 18/265,314 - Filed: 2021-11-22 - Published: 2024-02-15 - Granted: 2025-01-07 - Earliest claimed: 2020-12-10 - Assignees: 3M Innovative Properties Company - Applicants: 3M Innovative Properties Company - Inventors: Darin K. Thompson; Kimberly M. Henry; Longin J. Kloc; David M. Barbarine - Web page: https://patentgrep.com/patent/US12192639B2 ## CPC - G06F 1/163: {Wearable computers, e.g. on a belt} - H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture - A62B 18/02: Masks (gas-masks for animals A62B18/06; masks for welders A61F9/06) - A62B 18/08: Component parts for gas-masks or gas-helmets, e.g. windows, straps, speech transmitters, signal-devices (eye-pieces for protective goggles A61F9/02; composition of materials for the windows or other transparent parts A62D7/00) - G06F 1/1694: {the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer} - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/012: {Head tracking input arrangements} - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - H04N 5/2628: {Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation} - H04N 5/272: Means for inserting a foreground image in a background image, i.e. inlay, outlay - H04N 23/23: from thermal infrared radiation - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - A62B: DEVICES, APPARATUS OR METHODS FOR LIFE-SAVING (valves specially adapted for medical use A61M39/00; life-saving devices, apparatus or methods specially adapted for use in water B63C9/00; divers' equipment B63C11/00; specially adopted for use with aircraft, e.g. parachutes, ejector seats, {B64D17/00, B64D25/10}; rescue devices peculiar to mining E21F11/00) ## Abstract A thermal imaging system for use with a respirator mask comprising an in-mask display unit, and methods of configuring and operating such a system. The system uses a thermal imaging camera to capture a thermal image. The system is configured with the capability to shift from a default view in which an in-mask micro-display of the in-mask display unit shows a primary subimage of the captured thermal image but does not show a secondary subimage of the captured thermal image, to an auxiliary view in which the secondary subimage is now shown in place of at least a portion of the primary subimage. ## Claims ### Claim 1 A thermal imaging system configured for use with a respirator mask, comprising: an in-mask display unit configured to be mounted within an interior volume of a respirator mask and comprising an in-mask micro-display; a wearable thermal imaging camera that is configured to capture a thermal image and to communicate at least a portion of the captured thermal image to the in-mask micro-display; and, a control system for controlling the in-mask micro-display and the wearable thermal imaging camera, wherein the wearable thermal imaging camera comprises a wide field of view so that the captured thermal image comprises at least a primary subimage and a secondary subimage; and, wherein the control system is configured so that the in-mask micro-display presents a default view in which the in-mask micro-display shows the primary subimage of the captured thermal image but does not show the secondary subimage of the captured thermal image; and, wherein upon the control system receiving an input to shift the in-mask micro-display from the default view to an auxiliary view, the control system causes at least a portion of the primary subimage to be directionally displaced on the in-mask micro-display by the secondary subimage so that the secondary subimage is now shown in place of the displaced portion of the primary subimage. ### Claim 2 (depends on 1) The thermal imaging system of claim 1 wherein the wearable thermal imaging camera comprises a vertical field of view of at least 90 degrees and wherein the in-mask display unit is configured so that an ocular eyepiece of the in-mask display unit occupies a vertical field of view, relative to an eye of a user of the respirator mask and the thermal imaging system, of 70 degrees or less. ### Claim 3 (depends on 1) The thermal imaging system of claim 1 wherein the input to shift the in-mask micro-display from the default view to an auxiliary view is derived from accelerometer data that indicates that the respirator mask is in an orientation that indicates that an auxiliary view is desired by the wearer of the respirator mask. ### Claim 4 (depends on 1) The thermal imaging system of claim 1 wherein when the in-mask micro- display is in an auxiliary view with the secondary subimage being shown in place of the at least portion of the primary subimage, a status notification indicia is shown on the micro-display notifying the user that the in-mask micro-display is presenting an auxiliary view and identifying the location of the secondary subimage in the in-mask micro-display. ### Claim 5 (depends on 1) The thermal imaging system of claim 1 wherein the system is configured to detect a hot spot exhibiting a temperature greater than a pre-determined threshold temperature in the secondary subimage when the in-mask micro-display is in the default view with the secondary subimage not being shown in the in-mask micro-display; and, wherein the system is configured to notify a user of the presence of the hot spot in the secondary subimage. ### Claim 6 (depends on 1) The thermal imaging system of claim 1 wherein the in-mask display unit comprises a monocular eyepiece inside which the in-mask micro-display is mounted; and, wherein the in-mask display unit further comprises an objective lens and an ocular lens that are mounted in the monocular eyepiece rearward of the in-mask micro-display and that combine with the in-mask micro-display to form an optical pathway to deliver images to a single eye of the user. ### Claim 7 (depends on 1) A respirator mask comprising the thermal imaging system of claim 1, wherein the respirator mask defines an interior volume when fitted to the face of a human user. ### Claim 8 (depends on 7) The respirator mask of claim 7 wherein the wearable thermal imaging camera is configured to be attached to the outside of the respirator mask and is wirelessly connected to the control system. ### Claim 9 (depends on 7) The respirator mask of claim 7, wherein the wearable thermal imaging camera is configured to be attached to a protective helmet or a protective garment that is worn in conjunction with the respirator mask, and wherein the wearable thermal imaging camera is wirelessly connected to the control system. ### Claim 10 A method of providing thermal images to a wearer of a respirator mask, the method comprising: capturing a wide-angle thermal image that comprises at least a primary subimage and a secondary subimage; showing the primary subimage on an in-mask micro-display, as a default view that continues until an input to shift the in-mask micro-display from the default view to an auxiliary view is received; upon receiving an input to shift the in-mask micro-display from the default view to the auxiliary view, directing the in-mask micro-display to directionally displace at least a portion of the primary subimage with the secondary subimage so that the secondary subimage is now shown in place of the displaced portion of the primary subimage. ### Claim 11 (depends on 10) The method of claim 10 wherein the input to shift the in-mask micro-display from the default view to the auxiliary view is derived from accelerometer data that indicates that the respirator mask is in an orientation that indicates that an auxiliary view is desired by the wearer of the respirator mask. ### Claim 12 (depends on 10) The method of claim 10 wherein the input to shift the in-mask micro-display from the default view to the auxiliary view results from a voice command from the wearer of the respirator mask, via an internal microphone of the respirator mask, that indicates that an auxiliary view is desired by the wearer of the respirator mask. ### Claim 13 (depends on 10) The method of claim 10 wherein the input to shift the in-mask micro-display from the default view to the auxiliary view results from detection, in the secondary subimage, of at least one hot spot with an estimated temperature that is greater than a pre-determined threshold temperature. ### Claim 14 (depends on 10) The method of claim 10 wherein in the wide-angle thermal image, the secondary subimage is located beyond an upper, lower, left or right boundary of the primary subimage and wherein upon the directional displacing of at least the portion of the primary subimage by the secondary subimage in the in-mask micro-display, the secondary subimage is shown on at least a section of the in-mask micro-display that previously showed the to-be-displaced portion of the primary subimage and that is located proximate to the boundary beyond which the secondary subimage was located in the wide-angle thermal image. ### Claim 15 (depends on 10) The method of claim 10 wherein in the wide-angle thermal image, the secondary subimage is located above an upper boundary of the primary subimage and wherein upon the directional displacing of at least the portion of the primary subimage by the secondary subimage, the secondary subimage is shown on at least an upper section of the in-mask micro-display, that previously showed the to-be-displaced portion of the primary subimage. ### Claim 16 (depends on 15) The method of claim 15 wherein upon the directional displacing of at least the portion of the primary subimage by the secondary subimage, the primary subimage is compressed at least along the vertical direction so that the entirety of the primary subimage is shown on a lower section of the in-mask micro-display. ### Claim 17 (depends on 15) The method of claim 15 wherein upon the directional displacing of at least the portion of the primary subimage by the secondary subimage, the portion of the primary subimage that was previously shown on the upper section of the in-mask micro-display is no longer shown on any section of the in-mask micro-display. ### Claim 18 (depends on 14) The method of claim 14 wherein upon the directional displacing of at least the portion of the primary subimage by the secondary subimage, the primary subimage is entirely replaced by the secondary subimage so that the secondary subimage occupies the entirety of the in-mask micro-display for a pre-chosen period of time. ### Claim 19 (depends on 10) The method of claim 10 wherein when the in-mask micro-display is in auxiliary view with the secondary subimage being shown in place of the at least portion of the primary subimage, a status notification indicia is shown on the in-mask micro-display notifying the user that the in-mask micro-display is in auxiliary view and identifying the location of the secondary subimage in the in-mask micro-display. ### Claim 20 (depends on 10) The method of claim 10 wherein in the wide-angle thermal image, the secondary subimage is located beyond an upper, lower, left or right boundary of the primary subimage and wherein upon the directional displacing of at least the portion of the primary subimage by the secondary subimage in the in-mask micro-display, the secondary subimage is shown on the micro-display as a floating subimage that is positioned on the primary subimage in a location that avoids at least one hot spot of the primary subimage; and, wherein a directional indicia is shown on the in-mask micro-display indicating the direction that the secondary subimage was located relative to the primary subimage in the wide-angle thermal image.