# US 2024/0189062 A1 · System and method for enhanced data analysis with specialized video enabled software tools for medical environments

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0189062 A1
- Document ID: US20240189062A1
- Status: Published application
- Kind: A1
- Application number: 18/378,071
- Filed: 2023-10-09
- Published: 2024-06-13
- Earliest claimed: 2009-05-29
- Inventors: JACK WADE
- Web page: https://patentgrep.com/patent/US20240189062A1

## CPC

- A61B 90/361: {Image-producing devices, e.g. surgical cameras}
- A61B 1/00009: {of image signals during a use of endoscope}
- A61B 1/000095: {for image enhancement}
- A61B 1/00011: {characterised by signal transmission}
- A61B 1/0005: {combining images e.g. side-by-side, superimposed or tiled}
- A61B 1/3132: {for laparoscopy}
- A61B 5/0084: {for introduction into the body, e.g. by catheters (A61B5/1459 takes precedence)}
- A61B 5/0095: {by applying light and detecting acoustic waves, i.e. photoacoustic measurements}
- A61B 5/1032: {Determining colour of tissue for diagnostic purposes}
- A61B 34/25: {User interfaces for surgical systems}
- G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G16H 10/00: ICT specially adapted for the handling or processing of patient-related medical or healthcare data (for medical reports G16H15/00; for therapies or health-improving plans G16H20/00; for the handling or processing of medical images G16H30/00)
- G16H 10/60: for patient-specific data, e.g. for electronic patient records
- G16H 20/40: relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
- G16H 30/40: for processing medical images, e.g. editing
- G16H 40/63: for local operation
- G16H 40/67: for remote operation
- G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems
- G16H 50/70: for mining of medical data, e.g. analysing previous cases of other patients
- G16H 80/00: ICT specially adapted for facilitating communication between medical practitioners or patients, e.g. for collaborative diagnosis, therapy or health monitoring
- H04N 7/147: {Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q)}
- A61B 5/0075: {by spectroscopy, i.e. measuring spectra, e.g. Raman spectroscopy, infrared absorption spectroscopy (A61B5/0071 takes precedence)}
- A61B 5/024: Measuring pulse rate or heart rate
- A61B 90/30: Devices for illuminating a surgical field, the devices having an interrelation with other surgical devices or with a surgical procedure
- A61B 2017/00203: {with speech control or speech recognition}
- A61B 2090/3612: {with images taken automatically}
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06T 2207/30004: Biomedical image processing
- H04L 67/125: involving control of end-device applications over a network
- H04N 7/183: {for receiving images from a single remote source}
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

Medical software tools platforms utilize a surgical display to provide access to specific medical software tools, such as medically-oriented applications or widgets, that can assist surgeons or surgical team in performing various procedures. In particular, an endoscopic camera may register the momentary rise in the optical signature reflected from a tissue surface and in turn transmit it to a medical image processing system which can also receive patient heart rate data and display relevant anomalies. Changes in various spectral components and the speed at which they change in relation to a source of stimulus (heartbeat, breathing, light source modulation, etc.) may indicate the arrival of blood, contrast agents or oxygen absorption. Combinations of these may indicate various states of differing disease or margins of tumors, and so forth. Also, changes in temperatures, physical dimensions, pressures, photoacoustic pressures and the rate of change may indicate tissue anomalies in comparison to historic values.

## Claims

### Claim 1

A system for medical software tools, comprising:
an image stream interface module configured to receive an image stream from a surgical camera;
a user interface overlay module configured to provide a user interface overlay adapted for presentation over the image stream;
an optical sensor located corresponding with said surgical camera for registering changes in spectral characteristics reflected from a tissue surface under inspection;
a medical software tools module configured to provide a medical software tool through the user interface, the medical software tool being configured to perform an operation with respect to the image stream and provide an output adapted to be presented over the image stream;
a medical image processing system for processing patient medical data and corresponding said patient medical data with said momentary changes in spectral characteristics for generating optical signature data indicative of various patient conditions, wherein the medical software tool measures: a. changes in color intensity and b. rates at which said color intensities change in response to: heartbeat pushed blood, breathing pushed oxygen or light intensity or modulation from a light source;
image markers for delineating an area for inspection by a user and wherein said markers may define an area for a user to zoom in for a closer inspection of a portion of said patient tissue;
annotation data fields provided for said user to input information pertaining to said patient tissue;
enhanced data streams resulting from zoomed in inspection including detection of micro-blushes resulting from said patient's heart rate and an amount of blood transmitted through said portion of patient tissue;
a timer used to facilitate the pace at which a medical procedure is performed by said user and for insuring that various patient health sensitive procedure steps are performed within an allotted time; and
a checklist is both established by and utilized by said user for insuring that medical procedure steps are not missed.