# US 10,769,779 B2 · Method for increasing reading efficiency in medical image reading process using gaze information of user and apparatus using the same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,769,779 B2
- Document ID: US10769779B2
- Status: Granted
- Kind: B2
- Application number: 15/760,803
- Filed: 2015-09-24
- Published: 2019-11-07
- Granted: 2020-09-08
- Earliest claimed: 2015-09-24
- Assignees: VUNO Inc.
- Applicants: Vuno, Inc.
- Inventors: Sangki Kim; Hyun-Jun Kim; Kyuhwan Jung; Yeha Lee
- Web page: https://patentgrep.com/patent/US10769779B2

## CPC

- A61B 5/163: {by tracking eye movement, gaze, or pupil change}
- G06T 7/0012: {Biomedical image inspection}
- A61B 3/113: for determining or recording eye movement
- A61B 5/748: {Selection of a region of interest, e.g. using a graphics tablet}
- A61B 6/463: {characterised by displaying multiple images or images and diagnostic data on one display}
- A61B 6/469: {for selecting a region of interest [ROI]}
- A61B 8/00: Diagnosis using ultrasonic, sonic or infrasonic waves
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G16H 30/20: for handling medical images, e.g. DICOM, HL7 or PACS
- G16H 30/40: for processing medical images, e.g. editing
- G16H 40/20: for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
- G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems
- A61B 6/032: {Transmission computed tomography [CT]}
- G06F 3/012: {Head tracking input arrangements}
- G06F 3/048: Interaction techniques based on graphical user interfaces [GUI]
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA

## Abstract

According to one embodiment, a method for increasing the reading efficiency of a medical image is provided. The method of increasing the reading efficiency of a medical image comprises of: receiving the gaze information of a user, acquiring a gaze tracking device, during a medical image reading process; determining a region of interest of the user with respect to the medical image by using the gaze information; determining a type of service corresponding to the region of interest; and providing the determined service.

## Claims

### Claim 1

A method for increasing medical image reading efficiency, comprising:
acquiring gaze information of a user including change of gaze and fixation time of gaze during a reading process of the medical image by the user by using a gaze tracking unit coupled with the medical image reading apparatus;
generating, by the medical image reading apparatus, information on a region of interest (ROI) of the user based on the gaze information wherein the information on the region of interest includes the region of interest which is extracted from regions included in the medical image;
determining, by the medical image reading apparatus, a type of service corresponding to the region of interest, using the gaze information which includes the change of gaze and the fixation time of gaze; and
providing, by the medical image reading apparatus, the determined service, and wherein the type of service is determined to be adapted for reading efficiency of the region of interest, based on characteristics of the region of interest including the dimension of the medical image, the modality of the medical image and the morphology of the medical image, and a department in which the user is specialized,
wherein the providing the type of service includes:
in the event that the region of interest is a tissue or a lesion, providing, by the medical image reading apparatus, a three-dimensional model of the tissue or the lesion,
wherein the three-dimensional model is generated based on reconstructing regions of the tissue or a lesion into a three-dimension.

### Claim 2 (depends on 1)

The method of claim 1, further comprising
analyzing, by the medical image reading apparatus, change of the gaze information of the user; and
inferring, by the medical image reading apparatus, a suspected disease from the change of the gaze information.

### Claim 3 (depends on 2)

The method of claim 2, wherein the providing the determined service further includes:
providing, by the medical image reading apparatus, quantitative information to aid the reading or diagnosis of the suspected disease.

### Claim 4 (depends on 1)

The method of claim 1, wherein the determining the type of service includes:
searching, by the medical image reading apparatus, a brightness level and range which are required for maximizing the readability of the region of interest.

### Claim 5 (depends on 1)

The method of claim 1, wherein the determining the type of service includes:
in the event that the region of interest is a tissue or a lesion, generating, by the medical image reading apparatus, quantitative information on the tissue or the lesion.

### Claim 6 (depends on 1)

The method of claim 1, wherein the determining of the type of service includes:
in the event that a lesion or a disease is observed in the region of interest, generating, by the medical image reading apparatus, information on temporal change of the lesion or the disease.

### Claim 7 (depends on 1)

A non-transitory computer readable medium having stored thereon instructions which, when executed by a computer hardware, causes the computer hardware to perform the method of claim 1 to implement the medical image reading apparatus.

### Claim 8

A medical image reading apparatus, comprising:
a gaze tracking unit tracking a gaze of a user during a medical image reading process;
a service determining unit comprised of executable program instructions stored in a non-transitory computer readable medium for:
generating information on a region of interest (ROI) of the user based on the gaze information which includes change of gaze and fixation time of gaze, the information on the region of interest including the region of interest which is extracted from regions included in the medical image,
determining a type of service corresponding to the region of interest, using the gaze information which includes the change of gaze and the fixation time of gaze, and
a service providing unit providing the determined service,
wherein the type of service is determined to be adapted for increased reading efficiency of the region of interest, based on characteristics of the region of interest including the dimension of the medical image, the modality of the medical image, the morphology of the medical image, and a department in which the user is specialized, and
wherein the type of service includes:
in the event that the region of interest is a tissue or a lesion, providing a three-dimensional model of the tissue or the lesion,
wherein the three-dimensional model is generated based on reconstructing regions of the tissue or a lesion into a three-dimension.

### Claim 9 (depends on 8)

The apparatus of claim 8, wherein the service determining unit analyzes change of gaze of the user and infers a suspected disease from the change of gaze.

### Claim 10 (depends on 9)

The apparatus of claim 9, wherein the service providing unit provides quantitative information to aid reading or diagnosis of the suspected disease.

### Claim 11 (depends on 8)

The apparatus of claim 8, wherein the service determining unit searches a brightness level and range which are required for maximizing a readability of the region of interest.

### Claim 12 (depends on 8)

The apparatus of claim 8, wherein the service determining unit generates quantitative information on a tissue or a lesion, in the event that the region of interest is the tissue or the lesion.

### Claim 13 (depends on 8)

The apparatus of claim 8, wherein the service determining unit generates information on temporal change of a lesion or a disease, in the event that the lesion or the disease is observed in the region of interest.

### Claim 14 (depends on 1)

The method of claim 1, wherein the providing the determined service further includes:
providing, by the medical image reading apparatus, medical image of another subject having similar condition with the region of interest.

### Claim 15 (depends on 2)

The method of claim 2, wherein the providing the determined service further includes: providing, by the medical image reading apparatus, information on how the suspected disease in the region of interest will progress in the future.

### Claim 16 (depends on 8)

The apparatus of claim 8, wherein the type of service further includes:
providing, by the medical image reading apparatus, medical image of another subject having similar condition with the region of interest.

### Claim 17 (depends on 9)

The apparatus of claim 9, wherein the type of service further includes: providing, by the medical image reading apparatus, information on how the suspected disease in the region of interest will progress in the future.
