# US 2026/0017827 A1 · Pinpointing object features in 3d space

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0017827 A1
- Document ID: US20260017827A1
- Status: Published application
- Kind: A1
- Application number: 19/261,038
- Filed: 2025-07-07
- Published: 2026-01-15
- Earliest claimed: 2024-07-12
- Assignees: Norsk Titanium AS
- Applicants: Norsk Titanium AS
- Inventors: Reza Zamiri; Brede Vigdal; Geir Brunes
- Web page: https://patentgrep.com/patent/US20260017827A1

## CPC

- G06T 7/80: Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
- G06V 10/40: Extraction of image or video features
- B23K 10/027: {Welding for purposes other than joining, e.g. build-up welding}
- B23K 26/34: Laser welding for purposes other than joining
- B23K 31/125: {Weld quality monitoring}
- G06T 2207/10004: Still image; Photographic image
- G06T 2207/10012: Stereo images
- G06T 2207/10048: Infrared image
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/30108: Industrial image inspection
- G06T 2207/30164: Workpiece; Machine component
- G06T 2207/30204: Marker
- G06T 2207/30208: Marker matrix
- H04N 17/002: {for television cameras}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- B23K: SOLDERING OR UNSOLDERING; WELDING; CLADDING OR PLATING BY SOLDERING OR WELDING; CUTTING BY APPLYING HEAT LOCALLY, e.g. FLAME CUTTING; WORKING BY LASER BEAM
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method of calibrating a sensing system for determining a position of a feature of an object includes defining reference positions within a three-dimensional reference system; determining corresponding positions within an image frame of an image sensor and positions within a sensor frame of a further sensor; and generating a mapping linking the reference positions and the positions. A position of the feature of the object may be determined based on the mapping. There is also provided a method for monitoring a workpiece, the method comprising: obtaining shortwave infrared images; determining a corresponding image position of a feature of the workpiece or of an automated welding system using a machine-learned model; and determining a position of the feature.

## Claims

### Claim 1

A computer-implemented method of calibrating a sensing system for determining a position of a feature of an object within a three-dimensional reference system, wherein the sensing system comprises an image sensor having an image frame and a further sensor having a sensor frame, the method comprising:
defining a first reference position and a second reference position within the three-dimensional reference system, the second reference position being different from the first reference position;
determining, within the image frame of the image sensor, an image frame position corresponding to the first reference position and an image frame position corresponding to the second reference position;
determining, within the sensor frame of the further sensor, a sensor frame position corresponding to the first reference position and a sensor frame position corresponding to the second reference position; and
generating a mapping that links the first reference position, the image frame position corresponding to the first reference position, and the sensor frame position corresponding to the first reference position, and that links the second reference position, the image frame position corresponding to the second reference position, and the sensor frame position corresponding to the second reference position.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein the image sensor is a first image sensor and the image frame is a first image frame, and wherein the further sensor comprises a second image sensor and the sensor frame comprises a second image frame, and wherein the first image sensor and the second image sensor have an at least partially overlapping field of view.

### Claim 3 (depends on 2)

The computer-implemented method of claim 2, wherein the image frame positions comprise pixel positions in the first image frame and wherein the sensor frame positions comprise pixel positions in the second image frame.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, wherein the further sensor is associated with a moving element for moving the object for which a position of a feature of the object is to be determined within the reference system, and wherein the sensor frame positions comprise positions of the moving element.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, wherein the mapping comprises a look-up table.

### Claim 6 (depends on 1)

The computer-implemented method of claim 1, wherein the first reference position and the second reference position are indicated by at least one indicator, and wherein determining the image frame positions comprises:
identifying the indicator within the image frame; and
determining a position of the indicator within the image frame.

### Claim 7 (depends on 6)

The computer-implemented method of claim 6, wherein the indicator comprises a predefined shape or pattern on a surface, and wherein identifying the indicator within the image frame comprises identifying the predefined shape or pattern within the image frame.

### Claim 8 (depends on 7)

The computer-implemented method of claim 7, wherein the predefined shape or pattern comprises a checkerboard pattern.

### Claim 9 (depends on 6)

The computer-implemented method of claim 6, wherein the indicator is identified within the image frame using a machine-learned model.

### Claim 10 (depends on 1)

The computer-implemented method of claim 1, further comprising:
defining a plurality of further reference positions within the three-dimensional reference system, the plurality of further reference positions being different from the first reference position and the second reference position; and
for each further reference position of the plurality of further reference positions:
determining an image frame position corresponding to the further reference position within the image frame of the image sensor; and
determining a sensor frame position corresponding to the further reference position within the sensor frame of the further sensor,
wherein the mapping is generated to link the further reference position, the image frame position corresponding to the further reference position, and the sensor frame position corresponding to the further reference position.

### Claim 11 (depends on 1)

The computer-implemented method of claim 1, comprising at least one of:
storing the mapping in a memory of the sensing system; or
generating a machine-learned model configured to output a position within the three-dimensional reference system that corresponds to an input image frame position and the sensor frame position by training a machine-learning model using at least part of the mapping as training data; and
storing the machine-learned model in a memory of the sensing system.

### Claim 12 (depends on 11)

The computer-implemented method of claim 11, further comprising:
determining an image frame position corresponding to the feature of the object within the image frame of the image sensor;
determining a sensor frame position corresponding to the feature of the object within the sensor frame of the further sensor; and
determining, by the sensing system, a position of the feature of the object within the three-dimensional reference system based on the image frame position, the sensor frame position, and the mapping.

### Claim 13 (depends on 12)

The computer-implemented method of claim 12, wherein the mapping is stored in the memory of the sensing system, and wherein the method further comprises:
accessing the mapping stored in the memory of the sensing system; and
determining at least one reference position within the three-dimensional reference system within the mapping that corresponds to the image frame position and the sensor frame position, wherein the position of the feature of the object is determined based on the at least one reference position.

### Claim 14 (depends on 13)

The computer-implemented method of claim 13, wherein either:
the mapping directly maps the image frame position and the sensor frame position to a reference position, and the position of the feature is the reference position; or
the mapping does not directly map at least one of the image frame position or the sensor frame position to a reference position, and wherein:
determining the at least one reference position within the three-dimensional reference system within the mapping comprises determining two or more reference positions between which the position of the feature falls based on the image frame position and the sensor frame position; and
determining the position of the feature comprises interpolating between the two or more reference positions to determine the position of the feature.

### Claim 15 (depends on 12)

The computer-implemented method of claim 12, wherein the machine-learned model is stored in the memory of the sensing system, and wherein determining, by the sensing system, the position of the feature within the three-dimensional reference system based on the mapping comprises:
inputting the image frame position corresponding to the object and the sensor frame position corresponding to the feature into the machine-learned model; and
receiving, from the machine-learned model, the position of the feature.

### Claim 16 (depends on 12)

The computer-implemented method of claim 12, further comprising obtaining an image of at least part of the object that includes the feature from the image sensor, wherein the image frame position of the feature within the image frame is determined by providing the image to a further machine-learned model.

### Claim 17

A computer-implemented method for determining, by a sensing system, a position of a feature of an object within a three-dimensional reference system, the sensing system comprising an image sensor having an image frame and a further sensor having a sensor frame, the method comprising:
determining an image frame position corresponding to the feature within the image frame of the image sensor;
determining a sensor frame position corresponding to the feature within the sensor frame of the further sensor; and
determining a position within the three-dimensional reference system for the feature corresponding to the determined image frame position and the determined sensor frame position based on a mapping that links reference positions within the reference system with corresponding image frame positions within the image frame of the image sensor and corresponding sensor frame positions within the sensor frame of the further sensor.

### Claim 18 (depends on 1)

A system comprising:
a processor; and
a memory storing instructions that, when executed by the processor, cause the processor to carry out the method of claim 1.

### Claim 19 (depends on 1)

A sensing system, the sensing system comprising:
an image sensor having an image frame;
a further sensor having a sensor frame;
a processor; and
a memory storing a mapping generated according the method of claim 1.

### Claim 20 (depends on 1)

A computer-readable medium comprising instructions, that when executed by a computer, cause the computer to carry out the method of claim 1.
