# US 12,599,288 B2 · Endoscopic camera arrangement and method for camera alignment error correction

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,599,288 B2
- Document ID: US12599288B2
- Status: Granted
- Kind: B2
- Application number: 17/971,114
- Filed: 2022-10-21
- Published: 2023-04-27
- Granted: 2026-04-14
- Earliest claimed: 2021-10-25
- Assignees: Erbe Vision GmbH
- Applicants: Erbe Vision GmbH
- Inventors: Shirish Joshi; Faisal Kalim; Subhamoy Mandal
- Web page: https://patentgrep.com/patent/US12599288B2

## CPC

- A61B 1/00096: {Optical elements}
- A61B 1/3132: {for laparoscopy}
- A61B 1/00009: {of image signals during a use of endoscope}
- A61B 1/00057: {provided with means for testing or calibration}
- A61B 1/00163: {Optical arrangements (A61B1/002, A61B1/06 take precedence)}
- A61B 1/05: characterised by the image sensor, e.g. camera, being in the distal end portion
- A61B 2034/2055: {Optical tracking systems}
- G02B 23/2407: {Optical details}
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS

## Abstract

Augmented reality applications require precise camera calibration to reduce the overall target registration errors. The camera calibration determines the mathematical model of the camera in order to determine how the physical world space is mapped to the camera image space and thus is highly dependent on the optics of the camera. The camera calibration algorithm normally assumes that the optics of the camera is rigidly fixed, which in fact is not at least for tilted laparoscopic cameras as illustrated in FIGS. 6 to 8. Furthermore, any mechanical play between elements of the objective and the image converter will render the optics variable. According to the invention markers to will be placed within the field of view of the laparoscopic camera, which allows for determination of rotation of the optical part and mechanical misalignment without the necessity or providing any additional sensor.

## Claims

### Claim 1

A laparoscopic camera arrangement comprising:
a laparoscopic camera comprising an elongated shaft extending along a center axis from a proximal end to a distal end and adapted for being introduced into an animal's or human's body;
a camera system comprising an objective with a light entry window at the distal end of the elongated shaft, the camera system comprising a camera unit with an image converter optically coupled to the objective for receiving an optical image, the objective having an optical path running through the light entry window;
at least one optical marker placed within the optical path at the distal end of the elongated shaft for being depicted on the image converter;
a position indicator rigidly connected to the elongated shaft of the laparoscopic camera, the position indicator being configured to detect a position and orientation of the elongated shaft;
a location system connected to the laparoscopic camera, the location system being configured to locate the laparoscopic camera relative to a position of the animal's or human's body; and
an image processing unit configured to detect a displacement of the at least one optical marker on the image converter due to a misalignment of the objective relative to the image converter, and to correct position data, obtained by the position indicator measuring the position and orientation of the elongated shaft, based on the displacement of the at least one optical marker detected by the image processing unit through a homography projection transformation relating the at least one optical marker to the image converter.

### Claim 2 (depends on 1)

The camera arrangement according to claim 1, wherein the at least one optical marker is placed on the light entry window.

### Claim 3 (depends on 1)

The camera arrangement according to claim 1, wherein the objective is rotationally fastened to the image converter.

### Claim 4 (depends on 1)

The camera arrangement according to claim 1, wherein the objective with the light entry window provided thereon is rotatably mounted relative to the image converter.

### Claim 5 (depends on 1)

The camera arrangement according to claim 1, wherein the light entry window is a prism.

### Claim 6 (depends on 1)

The camera arrangement according to claim 1, wherein the objective comprises an axial optical axis.

### Claim 7 (depends on 1)

The camera arrangement according to claim 1, wherein the objective comprises an optical axis oriented sideways.

### Claim 8 (depends on 1)

The camera arrangement according to claim 1, wherein the light entry window is inclined relative to the elongated shaft.

### Claim 9 (depends on 1)

The camera arrangement according to claim 1, wherein the at least one optical marker is placed in a distance from a center of the optical path in a position to be imaged on the image converter at any grade of magnification of the objective.

### Claim 10 (depends on 1)

The camera arrangement according to claim 1, wherein the at least one optical marker comprises at least two, three, or four optical markers, and wherein the at least two, three, or four optical markers are placed at a periphery of the optical path.

### Claim 11 (depends on 10)

The camera arrangement according to claim 10, wherein any of the at least two, three, or four optical markers comprises a unique pattern.

### Claim 12 (depends on 11)

The camera arrangement according to claim 11, wherein the at least two, three, or four optical markers together form an asymmetric structure.

### Claim 13 (depends on 1)

A method for correcting an image captured by a laparoscopic camera arrangement according to claim 1:
projecting the at least one optical marker placed within the optical path onto the image converter, and
determining a mathematical projection model of the laparoscopic camera arrangement.