# US 2012/0253200 A1 · Low-cost image-guided navigation and intervention systems using cooperative sets of local sensors

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0253200 A1
- Document ID: US20120253200A1
- Status: Published application
- Kind: A1
- Application number: 13/476,838
- Filed: 2012-05-21
- Published: 2012-10-04
- Earliest claimed: 2009-11-19
- Assignees: The Johns Hopkins University
- Inventors: Philipp Jakob STOLKA; Emad Moussa BOCTOR
- Web page: https://patentgrep.com/patent/US20120253200A1

## CPC

- A61B 34/20: Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
- A61B 1/0005: {combining images e.g. side-by-side, superimposed or tiled}
- A61B 1/00158: {using magnetic field}
- A61B 1/041: {Capsule endoscopes for imaging}
- A61B 5/0035: {adapted for acquisition of images from more than one imaging mode, e.g. combining MRI and optical tomography}
- A61B 5/065: {Determining position of the probe employing exclusively positioning means located on or in the probe, e.g. using position sensors arranged on the probe}
- A61B 6/4417: {related to combined acquisition of different diagnostic modalities}
- A61B 6/5247: {combining images from an ionising-radiation diagnostic technique and a non-ionising radiation diagnostic technique, e.g. X-ray and ultrasound}
- A61B 6/547: {involving tracking of position of the device or parts of the device}
- A61B 8/42: {Details of probe positioning or probe attachment to the patient}
- A61B 8/4254: {using sensors mounted on the probe}
- A61B 8/5238: {for combining image data of patient, e.g. merging several images from different acquisition modes into one image}
- A61B 90/13: guided by light, e.g. laser pointers
- A61B 5/7217: {of noise originating from a therapeutic or surgical apparatus, e.g. from a pacemaker}
- A61B 6/4441: {the rigid structure being a C-arm or U-arm}
- A61B 8/00: Diagnosis using ultrasonic, sonic or infrasonic waves
- A61B 8/4472: {Wireless probes}
- A61B 90/361: {Image-producing devices, e.g. surgical cameras}
- A61B 2017/00221: {with wireless transmission of data, e.g. by infrared radiation or radiowaves}
- A61B 2034/105: {Modelling of the patient, e.g. for ligaments or bones}
- A61B 2034/107: {Visualisation of planned trajectories or target regions}
- A61B 2034/2048: {using an accelerometer or inertia sensor}
- A61B 2034/2051: {Electromagnetic tracking systems}
- A61B 2034/2055: {Optical tracking systems}
- A61B 2034/2063: {Acoustic tracking systems, e.g. using ultrasound}
- A61B 2090/0818: {Redundant systems, e.g. using two independent measuring systems and comparing the signals}
- A61B 2090/364: {Correlation of different images or relation of image positions in respect to the body}
- A61B 2090/366: {using projection of images directly onto the body}
- A61B 2090/367: {creating a 3D dataset from 2D images using position information}
- A61B 2090/371: {with simultaneous use of two cameras}
- A61B 2090/372: {Details of monitor hardware}
- A61B 2090/374: {NMR or MRI}
- A61B 2090/376: {using X-rays, e.g. fluoroscopy}
- A61B 2090/3762: {using computed tomography systems [CT]}
- A61B 2090/3764: {with a rotating C-arm having a cone beam emitting source}
- A61B 2090/378: {using ultrasound}
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)

## Abstract

An augmentation device for an imaging system has a bracket structured to be attachable to an imaging component, and a projector attached to the bracket. The projector is arranged and configured to project an image onto a surface in conjunction with imaging by the imaging system. A system for image-guided surgery has an imaging system, and a projector configured to project an image or pattern onto a region of interest during imaging by the imaging system. A capsule imaging device has an imaging system, and a local sensor system. The local sensor system provides information to reconstruct positions of the capsule endoscope free from external monitoring equipment.

## Claims

### Claim 1

An augmentation device for an imaging system, comprising:
a bracket structured to be attachable to an imaging component; and
a projector attached to said bracket,
wherein said projector is arranged and configured to project an image onto a surface in conjunction with imaging by said imaging system.

### Claim 2

(canceled)

### Claim 3 (depends on 1)

An augmentation device according to claim 1, further comprising a camera attached to said bracket.

### Claim 4

(canceled)

### Claim 5 (depends on 3)

An augmentation device according to claim 3, further comprising a second camera attached to said bracket.

### Claim 6 (depends on 5)

An augmentation device according to claim 5, wherein the first-mentioned camera is arranged to observe a region of imaging during operation of said imaging system and said second camera is at least one of arranged to observe said region of imaging to provide stereo viewing or to observe a user during imaging to provide information regarding a viewing position of said user.

### Claim 7 (depends on 1)

An augmentation device according to claim 1, further comprising a local sensor system attached to said bracket, wherein said local sensor system provides at least one of position and orientation information of said imaging component to permit tracking of said imaging component while in use.

### Claim 8 (depends on 3)

An augmentation device according to claim 3, further comprising a local sensor system attached to said bracket, wherein said local sensor system provides at least one of position and orientation information of said imaging component to permit tracking of said imaging component while in use.

### Claim 9 (depends on 7)

An augmentation device according to claim 7, wherein said local sensor system comprises at least one of an optical, inertial or capacitive sensor.

### Claim 10 (depends on 7)

An augmentation device according to claim 7, wherein said local sensor system comprises a three-axis gyro system that provides rotation information about three orthogonal axes of rotation.

### Claim 11

(canceled)

### Claim 12 (depends on 10)

An augmentation device according to claim 10, wherein said local sensor system comprises a system of linear accelerometers that provide acceleration information along at least two orthogonal axes.

### Claim 13

(canceled)

### Claim 14 (depends on 8)

An augmentation device according to claim 8, wherein said local sensor system comprises an optical sensor system arranged to detect motion of said imaging component with respect to a surface.

### Claim 15 (depends on 12)

An augmentation device according to claim 12, wherein said imaging system is a component of an image-guided surgery system.

### Claim 16 (depends on 15)

An augmentation device according to claim 15, wherein said imaging system is an ultrasound imaging system and said imaging component is an ultrasound probe handle, said bracket being structured to be attachable to said ultrasound probe handle.

### Claim 17

(canceled)

### Claim 18 (depends on 3)

An augmentation device according to claim 3, further comprising a second camera attached to said bracket, wherein the first-mentioned and second cameras are arranged and configured to provide stereo viewing of a region of interest during imaging with said imaging system, wherein said projector is configured and arranged to project a pattern on a surface in view of the first-mentioned and said second cameras to facilitate stereo object recognition and tracking of objects in view of said cameras.

### Claim 19

(canceled)

### Claim 20

(canceled)

### Claim 21 (depends on 7)

An augmentation device according to claim 7, further comprising a communication system in communication with at least one of said local sensor system, said camera or said projector.

### Claim 22

(canceled)

### Claim 23

A system for image-guided surgery, comprising:
an imaging system; and
a projector configured to project an image onto a region of interest during imaging by said imaging system.

### Claim 24

(canceled)

### Claim 25

(canceled)

### Claim 26

(canceled)

### Claim 27 (depends on 23)

A system for image-guided surgery according to claim 23, further comprising a camera arranged to capture an image of a second region of interest during imaging by said imaging system.

### Claim 28

(canceled)

### Claim 29

(canceled)

### Claim 30 (depends on 27)

A system for image-guided surgery according to claim 27, further comprising a second camera arranged to capture an image of a third region of interest during imaging by said imaging system.

### Claim 31 (depends on 30)

A system for image-guided surgery according to claim 30, further comprising a sensor system comprising a component attached to at least one of said imaging system, said projector, the first-mention camera, or said second camera, wherein said sensor system provides at least one of position and orientation information of said imaging system, said projector, the first-mention camera, or said second camera to permit tracking while in use.

### Claim 32 (depends on 31)

A system for image-guided surgery according to claim 31, wherein said sensor system is a local sensor system providing tracking free from external reference frames.

### Claim 33 (depends on 32)

A system for image-guided surgery according to claim 32, wherein said local sensor system comprises at least one of an optical, inertial or capacitive sensor.

### Claim 34 (depends on 32)

A system for image-guided surgery according to claim 32, wherein said local sensor system comprises a three-axis gyro system that provides rotation information about three orthogonal axes of rotation.

### Claim 35

(canceled)

### Claim 36 (depends on 32)

A system for image-guided surgery according to claim 32, wherein said local sensor system comprises a system of linear accelerometers that provide acceleration information along at least two orthogonal axes.

### Claim 37

(canceled)

### Claim 38 (depends on 32)

A system for image-guided surgery according to claim 32, wherein said local sensor system comprises an optical sensor system arranged to detect motion of said imaging component with respect to a surface.

### Claim 39 (depends on 32)

A system for image-guided surgery according to claim 32, further comprising a communication system in communication with at least one of said local sensor system, said camera or said projector.

### Claim 40 (depends on 39)

A system for image-guided surgery according to claim 39, wherein said communication system is a wireless communication system.

### Claim 41

A capsule imaging device, comprising:
an imaging system; and
a local sensor system,
wherein said local sensor system provides information to reconstruct positions of said capsule endoscope free from external monitoring equipment.

### Claim 42 (depends on 41)

A capsule imaging device according to claim 41, wherein said imaging system is an optical imaging system.

### Claim 43 (depends on 41)

A capsule imaging device according to claim 41, wherein said imaging system is an ultrasound imaging system.

### Claim 44 (depends on 43)

A capsule imaging device according to claim 43, wherein said ultrasound imaging system comprises a pulsed laser and an ultrasound receiver configured to detect ultrasound signals in response to pulses from said pulsed laser interacting with material in regions of interest.

### Claim 45 (depends on 31)

A system for image-guided surgery according to claim 31, further compromising a projection screen that is adapted to be at least one of a handheld or attached to a component of said system.

### Claim 46

(canceled)
