# US 2022/0265125 A1 · Wireless swivel camera laparoscopic instrument with a virtual mapping and guidance system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0265125 A1
- Document ID: US20220265125A1
- Status: Published application
- Kind: A1
- Application number: 17/740,575
- Filed: 2022-05-10
- Published: 2022-08-25
- Earliest claimed: 2020-09-15
- Assignees: Raytrx, LLC
- Applicants: Raytrx, LLC
- Inventors: David Street; Michael H. Freeman; Jordan Boss; Mitchael C. Freeman; Steven Yeager; Victoria McArtor; Brian Santee; Montgomery H.F. Freeman
- Web page: https://patentgrep.com/patent/US20220265125A1

## CPC

- A61B 1/00098: {Deflecting means for inserted tools}
- A61B 1/00006: {of control signals}
- A61B 1/000094: {extracting biological structures}
- A61B 1/00018: {using electrical cables}
- A61B 1/00066: {Proximal part of endoscope body, e.g. handles (A61B1/0052 takes precedence)}
- A61B 1/00087: {Tools (A61B17/00234 takes precedence)}
- A61B 1/00096: {Optical elements}
- A61B 1/00147: {Holding or positioning arrangements}
- A61B 1/00183: {for variable viewing angles}
- A61B 1/05: characterised by the image sensor, e.g. camera, being in the distal end portion
- A61B 1/0676: {at distal tip of an endoscope}
- A61B 1/0684: {using light emitting diodes [LED]}
- A61B 1/3132: {for laparoscopy}
- A61B 90/361: {Image-producing devices, e.g. surgical cameras}
- A61B 2017/00203: {with speech control or speech recognition}
- A61B 2017/00207: {with hand gesture control or hand gesture recognition}
- A61B 2017/00216: {with eye tracking or head position tracking control}
- A61B 2034/105: {Modelling of the patient, e.g. for ligaments or bones}
- A61B 2034/2065: {Tracking using image or pattern recognition}
- A61B 2090/309: {using white LEDs}
- A61B 2090/365: {augmented reality, i.e. correlating a live optical image with another image}
- A61B 2090/367: {creating a 3D dataset from 2D images using position information}
- A61B 2090/371: {with simultaneous use of two cameras}
- A61B 2090/372: {Details of monitor hardware}
- A61B 2090/502: {Headgear, e.g. helmet, spectacles}
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)

## Abstract

A lighted swivel laparoscopic imaging apparatus has a shaft having a proximal end opposite a distal end, wherein the proximal end is configured for attachment to an actuator, wherein a longitudinal axis extends through the shaft, between the proximal and distal ends, wherein the distal end is configured for insertion into patient anatomy and for attachment of one or more laparoscopic tools, wherein at least a first laparoscopic tool at the distal end pivots on a first gimbal apparatus that is actable, from the actuator at the proximal end of the shaft, to rotate the at least the first laparoscopic tool about the longitudinal axis of the shaft and, further, to rotate the at least the first laparoscopic tool about at least a second axis, orthogonal to the longitudinal axis. The images from the laparoscopic instrument may be viewed in virtual format with a virtual overlay of where the instruments exist and are moving inside the body from an AR/XR headset or other 3D viewing device.

## Claims

### Claim 1

A real-time virtual mapping and guidance system for use in laparoscopic surgeries comprising:
a plurality of sensors;
a processor wherein the processor receives visual and location data from the plurality of sensors and processes said visual and location data to generate a virtual map of at least a portion of a surgical field; and
at least one display such that the display shows the virtual map generated by the processor.

### Claim 2 (depends on 1)

The real-time virtual mapping and guidance system for use in laparoscopic surgeries of claim 1 wherein the virtual map is a three-dimensional virtual map.

### Claim 3 (depends on 1)

The real-time virtual mapping and guidance system for use in laparoscopic surgeries of claim 1 wherein the plurality of sensors comprises at least one camera, LIDAR sensor, gyroscope, accelerometer, magnetometer, GPS device, RFID device, or ball bearing type rolling sensor.

### Claim 4 (depends on 1)

The real-time virtual mapping and guidance system for use in laparoscopic surgeries of claim 1 wherein the virtual map comprises the location and orientation of one or more laparoscopic tools.

### Claim 5 (depends on 4)

The real-time virtual mapping and guidance system for use in laparoscopic surgeries of claim 4 wherein the virtual map further comprises the location and orientation of one or more organs inside a patient's body cavity.

### Claim 6 (depends on 1)

The real-time virtual mapping and guidance system for use in laparoscopic surgeries of claim 1 wherein the virtual mapping and guidance system alerts a surgeon of a potential collision between two or more objects on the surgical field.

### Claim 7 (depends on 1)

The real-time virtual mapping and guidance system for use in laparoscopic surgeries of claim 1 further comprising fiducial markers used to identify and locate objects in the surgical field.

### Claim 8 (depends on 1)

The real-time virtual mapping and guidance system for use in laparoscopic surgeries of claim 1 wherein the at least one display comprises at least one augmented reality headset.

### Claim 9 (depends on 1)

The real-time virtual mapping and guidance system for use in laparoscopic surgeries of claim 1 wherein the at least one display shows additional information such as a patient's vital signs.

### Claim 10

A method for mapping and guidance of laparoscopic surgeries in real-time comprising:
collecting visual and location data of at least a portion of the surgical field;
analyzing said visual and location data to generate a virtual map of at least a portion of the surgical field;
displaying said virtual map.

### Claim 11 (depends on 10)

The method for mapping and guidance of laparoscopic surgeries in real-time of claim 10 wherein the virtual map is a three-dimensional virtual map.

### Claim 12 (depends on 10)

The method for mapping and guidance of laparoscopic surgeries in real-time of claim 10 wherein the virtual map comprises the location and orientation of one or more laparoscopic tools.

### Claim 13 (depends on 12)

The method for mapping and guidance of laparoscopic surgeries in real-time of claim 12 wherein the virtual map further comprises the location and orientation of one or more organs inside a patient's body cavity.

### Claim 14 (depends on 10)

The method for mapping and guidance of laparoscopic surgeries in real-time of claim 10 wherein the visual and location data is collected by at least one camera, LIDAR sensor, gyroscope, accelerometer, magnetometer, GPS device, RFID device, or ball bearing type rolling sensor.

### Claim 15 (depends on 10)

The method for mapping and guidance of laparoscopic surgeries in real-time of claim 10 wherein the step of displaying said virtual map comprises displaying said virtual map on at least one augmented reality headset.

### Claim 16 (depends on 10)

The method for mapping and guidance of laparoscopic surgeries in real-time of claim 10 further comprising the step of monitoring said virtual map and alerting a surgeon of a potential collision between two or more objects on the surgical field.

### Claim 17 (depends on 10)

The method for mapping and guidance of laparoscopic surgeries in real-time of claim 10 further comprising the step of displaying a patient's vital sign.
