# US 11,122,257 B2 · HDR image capture and display system for enhanced real-time welding visualization and assistance > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,122,257 B2 - Document ID: US11122257B2 - Status: Granted - Kind: B2 - Application number: 16/421,022 - Filed: 2019-05-23 - Published: 2020-11-26 - Granted: 2021-09-14 - Earliest claimed: 2019-05-23 - Assignees: SRI International - Applicants: SRI International; Kawada Technologies, Inc. - Inventors: David Berends; Naohiko Fuse; Atsushi Homma; Noriyuki Kanehira; Tadahisa Tsuyama; Michael Piacentino; Gooitzen van der Wal; Chiharu Yamaoka; David Zhang - Web page: https://patentgrep.com/patent/US11122257B2 ## CPC - H04N 13/361: Reproducing mixed stereoscopic images; Reproducing mixed monoscopic and stereoscopic images, e.g. a stereoscopic image overlay window on a monoscopic image background - B23K 9/095: Monitoring or automatic control of welding parameters - B23K 9/0953: {using computing means} - B23K 9/0956: {using sensing means, e.g. optical} - B23K 9/32: Accessories - B23K 9/322: {Head protecting means} - G02B 27/0172: {characterised by optical features} - G09B 5/02: with visual presentation of the material to be studied, e.g. using film strip - G09B 19/24: Use of tools - H04N 13/156: Mixing image signals - H04N 13/239: using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance (H04N13/243 takes precedence) - H04N 13/296: Synchronisation thereof; Control thereof - H04N 13/344: with head-mounted left-right displays - H04N 13/398: Synchronisation thereof; Control thereof - H04N 23/73: by influencing the exposure time - G02B 2027/0138: {comprising image capture systems, e.g. camera} - G02B 2027/014: {comprising information/image processing systems} - G02B 2027/0141: {characterised by the informative content of the display} - H04N 2213/001: Constructional or mechanical details - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - B23K: SOLDERING OR UNSOLDERING; WELDING; CLADDING OR PLATING BY SOLDERING OR WELDING; CUTTING BY APPLYING HEAT LOCALLY, e.g. FLAME CUTTING; WORKING BY LASER BEAM - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B) ## Abstract A method, apparatus and system for enhanced welding visualization include splitting incoming light from the welding environment into at least a first optical path and a second optical path having different light levels using at least one beam splitter. Images of the split light having different light levels are captured using a respective imaging sensor. The images from the respective imaging sensors are fused to create a left-eye fused image and a right-eye fused image. The left-eye fused image is displayed on a display at a location of a left eye of a user and the right-eye fused image is displayed on a display at a location of a right eye of the user to provide a parallax-free, high dynamic range, representation of the welding environment. ## Claims ### Claim 1 An apparatus for enhanced real-time welding visualization in a welding environment, comprising: a beam splitter splitting incoming light from the welding environment into at least a first optical path and a second optical path each comprising a respective imaging sensor capturing images in each of the at least first and second optical paths with at least two different exposure times at a rate at least twice as fast as a display rate of a display assembly; a control unit receiving and fusing the images from each of the respective imaging sensors in the at least first optical path and second optical path to create a fused image having a higher dynamic range than the individually captured images; and the display assembly displaying the fused images. ### Claim 2 (depends on 1) The apparatus of claim 1, wherein the beam splitter, the at least first and second optical paths, and the respective imaging sensors comprise a left eye imaging assembly and a right eye imaging assembly comprises; at least one respective beam splitter splitting incoming light from the welding environment into at least a third optical path and a fourth optical path each comprising a respective imaging sensor capturing images from the at least third and fourth optical paths with at least two different exposure times at a rate at least twice as fast as the display rate of the display assembly; and wherein images captured by the respective imaging sensors of the at least first and second optical paths in the left eye imaging assembly are fused by the control unit and displayed by the display assembly at a location of a left eye of a user of the apparatus and images captured by the respective imaging sensors of the at least third and fourth optical paths in the right eye imaging assembly are fused by the control unit and displayed by the display assembly at a location of a right eye of the user of the apparatus to provide a three dimensional representation of the welding environment. ### Claim 3 (depends on 2) The apparatus of claim 2, wherein the control unit selects for display images captured by at least one of the respective imaging sensors based on at least measured light levels in the welding environment determined from images captured by at least one of the respective imaging sensors. ### Claim 4 (depends on 1) The apparatus of claim 1, further comprising at least one temperature sensor for sensing temperatures in the welding environment. ### Claim 5 (depends on 4) The apparatus of claim 4, wherein the control unit causes a display, on the display assembly, of a message indicative of a sensed temperature in the welding environment in response to a signal communicated from the at least one temperature sensor indicative of a sensed temperature in the welding environment. ### Claim 6 (depends on 1) The apparatus of claim 1, wherein the displaying of the images of the welding environment comprises a simultaneous display of images of an arc of a weld in progress, a welding wire a welding torch, a puddle of molten metal just welded, a glowing bead of a weld that just solidified, the bead of the weld as the bead cools down and no longer glows, a region of a sample to be welded, and a background region surrounding the weld area, wherein the simultaneous display includes all of the details of an individual display of images of the arc of a weld in progress, the welding wire, the tip of the welding torch, the puddle of molten metal just welded, the glowing bead of the weld that just solidified, the bead of the weld as the bead cools down and no longer glows, the region of the sample to be welded, and the background region surrounding the weld area. ### Claim 7 (depends on 1) The apparatus of claim 1, wherein the control unit causes a display, on the display assembly, of information to assist in the performance of a weld. ### Claim 8 (depends on 7) The apparatus of claim 7, wherein the information to assist in the performance of a weld comprises at least one of an image generated by the control unit and welding parameters of the welding environment. ### Claim 9 (depends on 1) The apparatus of claim 1, wherein the control unit comprises a memory for recording welding processes in the welding environment. ### Claim 10 (depends on 1) The apparatus of claim 1, further comprising at least one near infrared imaging sensor for enabling imaging of the welding environment in the presence of smoke. ### Claim 11 (depends on 1) The apparatus of claim 1, wherein the imaging sensors comprise printed circuit board cameras. ### Claim 12 (depends on 1) The apparatus of claim 1, further comprising at least one of a neutral density filter and a camera lens in at least one of the at least first and second optical paths for differentiating a light level between the at least first and second optical paths. ### Claim 13 A method for enhancing real-time welding visualization in a welding environment, the method comprising: in a wearable welding apparatus, splitting incident light from the welding environment into at least a first optical path and a second optical path using at least one beam splitter; in each of the at least first optical path and second optical path, capturing images of the split light using a respective imaging sensor with at least two different exposure times at a rate at least twice as fast as a display rate; fusing the images from the respective imaging sensors of the at least first optical path and second optical path to create a fused image having a higher dynamic range than the individually captured images; and displaying the fused images. ### Claim 14 (depends on 13) The method of claim 13, wherein the method is repeated for each of a left eye imaging assembly and a right eye imaging assembly. ### Claim 15 (depends on 13) The method of claim 13, further comprising displaying at least one of information and images to assist a user of the wearable welding apparatus in the performance of a weld in the welding environment, wherein the information comprises at least one of welding parameters of the welding environment including at least one of at least one temperature in the welding environment, a feed speed of a weld wire, a position of a weld wire, a position of a weld torch, a current or voltage of a power supply associated with the weld torch, and a dwell time and the images comprise augmented reality images including at least one of a thermal image overlaid on an image of the welding environment and a path overlaid on an image of the welding environment along which to perform a weld. ### Claim 16 (depends on 13) The method of claim 13, further comprising removing sparks from at least one image of the welding environment. ### Claim 17 (depends on 13) The method of claim 13, further comprising communicating with a welding station for determining at least operating parameters of the welding environment. ### Claim 18 (depends on 13) The method of claim 13, further comprising evaluating images of a welding process captured by the imaging sensors and providing feedback to a user regarding weld quality. ### Claim 19 (depends on 13) The method of claim 13, further comprising configuring the imaging sensors to capture images of the welding environment at different frame rates to create images of the welding environment having different exposures.