# US 12,599,457 B1 · Mixed reality endoscopic retrograde cholangiopancreatopgraphy (ERCP) procedure

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,599,457 B1
- Document ID: US12599457B1
- Status: Granted
- Kind: B1
- Application number: 18/773,817
- Filed: 2024-07-16
- Granted: 2026-04-14
- Earliest claimed: 2021-08-11
- Applicants: Navakanth Gorrepati
- Inventors: Navakanth Gorrepati
- Web page: https://patentgrep.com/patent/US12599457B1

## CPC

- A61B 1/00009: {of image signals during a use of endoscope}
- A61B 90/37: {Surgical systems with images on a monitor during operation}
- A61B 1/00048: {Constructional features of the display}
- A61B 1/0005: {combining images e.g. side-by-side, superimposed or tiled}
- A61B 1/273: for the upper alimentary canal, e.g. oesophagoscopes or gastroscopes
- A61B 34/25: {User interfaces for surgical systems}
- A61B 1/00098: {Deflecting means for inserted tools}
- A61B 2034/105: {Modelling of the patient, e.g. for ligaments or bones}
- A61B 2090/365: {augmented reality, i.e. correlating a live optical image with another image}
- A61B 2090/372: {Details of monitor hardware}
- A61B 2090/374: {NMR or MRI}
- A61B 2090/376: {using X-rays, e.g. fluoroscopy}
- A61B 2090/502: {Headgear, e.g. helmet, spectacles}
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)

## Abstract

A mixed reality endoscopic surgical procedure method, including the steps of selecting a three-dimensional holographic first image of a body part to be surgically operated on and displaying the three-dimensional holographic first image of the body part. The method can further include positioning an endoscope relative to the body part, wherein the endoscope further includes a guidewire, displaying a three-dimensional second holographic image or video of the endoscope or guidewire relative to the body part, and using the three-dimensional first holographic first image as a visual guide for engaging the body part via the guidewire.

## Claims

### Claim 1

A mixed reality endoscopic surgical procedure method, comprising:
selecting a three-dimensional holographic first image or video representative of a body part to be surgically operated on;
displaying the three-dimensional holographic first image or video of the body part on a display;
positioning an endoscope comprising a camera relative to the body part, wherein the endoscope further comprises a guidewire;
displaying, from the camera of the endoscope, a second video of the guidewire relative to the body part;
overlaying the second video and the three-dimensional first holographic image or video over each other;
displaying one or more graphical markers on or adjacent to the overlaid second video and three-dimensional holographic first image or video, wherein the one or more graphical markers are adapted to visually assist a user to guide the guidewire; and
penetrating the body part via the guidewire.

### Claim 2 (depends on 1)

The mixed reality endoscopic surgical procedure method of claim 1, wherein the first holographic first image is comprised of a duodenum illustrating a major papilla orifice or ampulla.

### Claim 3 (depends on 1)

The mixed reality endoscopic surgical procedure method of claim 1, wherein the body part is comprised of the major papilla orifice or ampulla.

### Claim 4 (depends on 1)

The mixed reality endoscopic surgical procedure method of claim 1, wherein the endoscope is further comprised of a sphincterotome.

### Claim 5 (depends on 4)

The mixed reality endoscopic surgical procedure method of claim 4, further comprising:
orientating the sphincterotome to a desired position relative to the position of the first holographic image of the body part.

### Claim 6 (depends on 4)

The mixed reality endoscopic surgical procedure method of claim 4, further comprising:
orientating the sphincterotome within a range of about 10-degrees to about 80-degrees relative to a horizontal plane and further with respect to the position of the first holographic image of the body part.

### Claim 7 (depends on 1)

The mixed reality endoscopic surgical procedure method of claim 1, further comprising displaying a three-dimensional third holographic image or video relative to the three-dimensional first holographic image and the video.

### Claim 8 (depends on 1)

The mixed reality endoscopic surgical procedure method of claim 1, further comprising displaying one or more holographic information of patient vitals.

### Claim 9 (depends on 1)

The mixed reality endoscopic surgical procedure method of claim 1, wherein the video is further comprised of streaming one or more video or image data from a first source.

### Claim 10 (depends on 1)

The mixed reality endoscopic surgical procedure method of claim 1, further comprising displaying one or more holographic images of one or more users and further communicating with the one or more users via audio or video.

### Claim 11

A mixed reality endoscopic surgical procedure method, comprising:
selecting a three-dimensional holographic first image representative of a body part to be surgically operated on;
displaying the three-dimensional holographic first image of the body part via an augmented reality or virtual reality headset;
positioning an endoscope comprising a camera relative to the body part, wherein the endoscope further comprises a guidewire;
displaying a second video, via a feed from the camera of the endoscope, the body part relative to the guidewire;
overlaying the three-dimensional first holographic image or video and the second video over each other;
displaying one or more visual representations on or adjacent to the overlaid second video and three-dimensional holographic first image or video; and
positioning the guidewire using the one or more visual representations and the overlaid second video and three-dimensional holographic first image or video.

### Claim 12

A mixed reality endoscopic surgical procedure method, comprising:
selecting a first image representative of a body part to be surgically operated on;
displaying the first image of the body part via an augmented reality or virtual reality headset;
positioning an endoscope comprising a camera relative to the body part, wherein the endoscope further comprises a catheter;
displaying a second image or video, retrieved via the camera of the endoscope, the body part relative to the catheter;
overlaying the first image and the second image or video over each other;
displaying one or more visual representations on or adjacent to the overlaid first image and second image or video; and
orienting the catheter using the one or more visual representations and the overlaid first image and second image or video.