# US 12,602,148 B2 · System and method for diagnosis and analysis of medical images > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,602,148 B2 - Document ID: US12602148B2 - Status: Granted - Kind: B2 - Application number: 18/455,680 - Filed: 2023-08-25 - Published: 2024-03-07 - Granted: 2026-04-14 - Earliest claimed: 2022-09-07 - Assignees: PathForce Technologies, Inc. - Applicants: PathForce Technologies, Inc. - Inventors: Mohit A. Kale; Michael F. Colaco - Web page: https://patentgrep.com/patent/US12602148B2 ## CPC - G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour - G06F 3/012: {Head tracking input arrangements} - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06F 3/0485: Scrolling or panning - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - G06T 7/0012: {Biomedical image inspection} - G16H 30/20: for handling medical images, e.g. DICOM, HL7 or PACS - G16H 30/40: for processing medical images, e.g. editing - G16H 40/63: for local operation - G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems - H04L 63/0815: {providing single-sign-on or federations} - H04L 63/0861: {using biometrical features, e.g. fingerprint, retina-scan (cryptographic mechanisms or cryptographic arrangements for entity authentication using biological data H04L9/3231)} - G06F 3/0482: Interaction with lists of selectable items, e.g. menus - G06F 2203/04806: Zoom, i.e. interaction techniques or interactors for controlling the zooming operation - G06T 2200/24: involving graphical user interfaces [GUIs] - G06T 2207/20092: Interactive image processing based on input by user - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) ## Abstract The present invention provides a method and system for the diagnosis and analysis of medical images. More specifically, the system of the present invention focuses on the usage of wearable devices in the field of Pathology and around creating a workflow for the pathologists that helps them analyse, diagnose, and sign off a case using digital technology and wearable devices. The system of the present invention comprises a wearable device, a cloud-based computing platform, data storage, a plurality of interaction modules, and a processing module. The wearable device extends the field of vision by creating a more immersive experience for better diagnosis of the pathological case. ## Claims ### Claim 1 A method for diagnosis and analysis of medical images, the method comprising steps of: providing a wearable device headset, the wearable device headset comprising computing electronics that is configured to execute a plurality of interaction modules including at least a communications module and a display module; executing the communications module with the computing electronics to access a laboratory information system with the wearable device headset; executing the communications module with the computing electronics to obtain a digitized slide from an image store in the laboratory information system with the wearable device headset; executing the display module with the computing electronics to display a plurality of views in a display of the wearable device headset, a first of the plurality of views comprising a display of the digitized slide and a second of the plurality of views comprising information pertaining to and separate from the digitized slide; executing the communications module with the computing electronics to obtain one or more reference images with the wearable device headset from the image store in the laboratory information system; utilizing the computing electronics to compare the digitized slide to the one or more reference images to render a diagnosis pertaining to the digitized slide based on the comparison; and executing the display module to render the diagnosis in the wearable device headset, and/or executing the communications module to transmit the diagnosis to a remote electronic device. ### Claim 2 (depends on 1) The method as claimed in claim 1 wherein the plurality of interaction modules further includes a user interface module that is configured to receive user commands to the wearable device headset for operation of the communication module and the display module. ### Claim 3 (depends on 2) The method as claimed in claim 2 wherein the interface module is configured to receive the user commands as at least one of voice commands, gesture commands, and head movements. ### Claim 4 (depends on 3) The method as claimed in claim 3, further comprising using a head movement user command to switch a view from among the plurality of views. ### Claim 5 (depends on 1) The method as claimed in claim 1, wherein the step of executing the communications module with the computing electronics to obtain the one or more reference images comprises: reading a required diagnosis associated with the digitized slide from the laboratory information system; searching the image store for images having a diagnosis relevant to the required diagnosis and identifying the one or more reference images as images having a diagnosis relevant to the required diagnosis; and receiving in the wearable device headset the identified one or more reference images. ### Claim 6 (depends on 1) The method as claimed in claim 1, wherein the plurality of views further includes a side-by-side view of the digitized image and at least one of the one or more reference images. ### Claim 7 (depends on 1) The method as claimed in claim 1, wherein the plurality of views further includes a centralized view that displays the digitized slide, a left side view that contains a first portion of the information pertaining to and separate from the digitized slide, and a right side view that contains a second portion of the information pertaining to and separate from the digitized slide. ### Claim 8 (depends on 7) The method as claimed in claim 7, wherein the centralized view, right side view, and left side view are displayed simultaneously. ### Claim 9 (depends on 7) The method as claimed in claim 7, wherein the centralized view, right side view, and left side view are displayed sequentially by selective operation of the computing electronics such that each of the plurality of views is rendered on an entire display of the wearable device headset. ### Claim 10 A wearable device headset for diagnosis and analysis of medical images comprising: a display module including a display for rendering images in the wearable device headset; a communications module for electronic communication between the wearable device headset and an electronic device remote from the wearable device headset; and computing electronics that is configured to execute the communications module and the display module; wherein the computing electronics is configured to: execute the communications module to access a laboratory information system with the wearable device headset, execute the communications module to obtain a digitized slide from an image store in the laboratory information system with the wearable device headset; execute the display module to display a plurality of views in the wearable device headset, a first of the plurality of views comprising a display of the digitized slide and a second of the plurality of views comprising information pertaining to and separate from the digitized slide; execute the communications module with the computing electronics to obtain one or more reference images with the wearable device headset from the image store in the laboratory information system; compare the digitized slide to the one or more reference images to render a diagnosis pertaining to the digitized slide based on the comparison; and execute the display module to render the diagnosis in the wearable device headset, and/or execute the communications module to transmit the diagnosis to a remote electronic device. ### Claim 11 (depends on 10) The wearable device headset as claimed in claim 10, wherein the computing electronics is configured to execute the communications module to obtain the one or more reference images by: reading a required diagnosis associated with the digitized slide from the laboratory information system; searching the image store for images having a diagnosis relevant to the required diagnosis and identifying the one or more reference images as images having a diagnosis relevant to the required diagnosis; and receiving in the wearable device headset the identified one or more reference images. ### Claim 12 (depends on 10) The wearable device headset as claimed in claim 10, further comprising a user interface module that is configured to receive user commands to the wearable device headset for operation of the communications module and the display module. ### Claim 13 (depends on 12) The wearable device headset as claimed in claim 12 wherein the user interface module is configured to receive the user commands as at least one of voice commands, gesture commands, and head movements. ### Claim 14 (depends on 10) The wearable device headset as claimed in claim 10, wherein the plurality of views further includes a centralized view that displays the digitized slide, a left side view that contains a first portion of the information pertaining to and separate from the digitized slide, and a right side view that contains a first portion of the information pertaining to and separate from the digitized slide. ### Claim 15 (depends on 10) The wearable device headset as claimed in claim 10 wherein the wearable device headset is an Augmented Reality or a Virtual Reality goggles. ### Claim 16 A non-transitory computer readable medium for diagnosis and analysis of medical images that stores program code which when executed by an electronic processor performs the steps of: executing a communications module in a wearable device headset to access a laboratory information system with the wearable device headset; executing the communications module to obtain a digitized slide from an image store in the laboratory information system with the wearable device headset; executing a display module in the wearable device headset to display a plurality of views in a display of the wearable device headset, a first of the plurality of views comprising a display of the digitized slide and a second of the plurality of views comprising information pertaining to and separate from the digitized slide; executing the communications module to obtain one or more reference images with the wearable device headset from the image store in the laboratory information system; comparing the digitized slide to the one or more reference images to render a diagnosis pertaining to the digitized slide based on the comparison; and executing the display module to render the diagnosis in the wearable device headset, and/or executing the communications module to transmit the diagnosis to a remote electronic device. ### Claim 17 (depends on 16) The non-transitory computer readable medium as claimed in claim 16, wherein executing the communications module with the computing electronics to obtain the one or more reference images comprises: reading a required diagnosis associated with the digitized slide from the laboratory information system; searching the image store for images having a diagnosis relevant to the required diagnosis and identifying the one or more reference images as images having a diagnosis relevant to the required diagnosis; and receiving in the wearable device headset the identified one or more reference images. ### Claim 18 (depends on 16) The non-transitory computer readable medium as claimed in claim 16, wherein the plurality of views further includes a side-by-side view of the digitized image and at least one of the one or more reference images. ### Claim 19 (depends on 16) The non-transitory computer readable medium as claimed in claim 16, wherein the plurality of views further includes a centralized view that displays the digitized slide, a left side view that contains a first portion of the information pertaining to and separate from the digitized slide, and a right side view that contains a second portion of the information pertaining to and separate from the digitized slide. ### Claim 20 (depends on 19) The non-transitory computer readable medium as claimed in claim 19, wherein the centralized view, right side view, and left side view are displayed simultaneously. ### Claim 21 (depends on 19) The non-transitory computer readable medium as claimed in claim 19, wherein the centralized view, right side view, and left side view are displayed sequentially by selective operation of the computing electronics such that each of the plurality of views is rendered on an entire display of the wearable device headset. ### Claim 22 (depends on 16) The non-transitory computer readable medium as claimed in claim 16, wherein the program code further is executed to implement a user interface module in the wearable device headset that is configured to receive user commands to the wearable device headset for operation of the communication module and the display module. ### Claim 23 (depends on 22) The non-transitory computer readable as claimed in claim 22 wherein the interface module is configured to receive the user commands as at least one of voice commands, gesture commands, and head movements. ### Claim 24 (depends on 23) The non-transitory computer readable as claimed in claim 23, further comprising using a head movement user command to switch a view from among the plurality of views. ### Claim 25 A system for diagnosis and analysis of medical images, the system comprising: a computing platform comprising a laboratory information system that includes an image store and a data store including information pertaining to and separate from the image store, and a wearable device headset for diagnosis and analysis of medical images, the wearable device headset comprising: a display module including a display for rendering images in the wearable device headset; a communications module for electronic communication between the wearable device headset and the computing platform remote from the wearable device headset; and computing electronics that is configured to execute the communications module and the display module; wherein the computing electronics is configured to: execute the communications module to access the laboratory information system with the wearable device headset; execute the communications module to obtain a digitized slide from the image store in the laboratory information system with the wearable device headset; execute the display module to display a plurality of views in the wearable device headset, a first of the plurality of views comprising a display of the digitized slide and a second of the plurality of views comprising information pertaining to and separate from the digitized slide; execute the communications module with the computing electronics to obtain one or more reference images with the wearable device headset from the image store in the laboratory information system; compare the digitized slide to the one or more reference images to render a diagnosis pertaining to the digitized slide based on the comparison; and execute the display module to render the diagnosis in the wearable device headset, and/or execute the communications module to transmit the diagnosis to the computing platform; the wearable device headset being configured to communicatively connect with the computing platform using the communications module of the wearable device headset. ### Claim 26 (depends on 25) The system as claimed in claim 25, wherein the computing platform is cloud based. ### Claim 27 (depends on 25) The system as claimed in claim 25, wherein the wearable device headset is an Augmented reality or Virtual Reality goggles.