# US 12,225,173 B2 · Telemedicine system, telemedicine method, information processing device, and program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,225,173 B2
- Document ID: US12225173B2
- Status: Granted
- Kind: B2
- Application number: 17/905,523
- Filed: 2021-02-26
- Published: 2023-04-27
- Granted: 2025-02-11
- Earliest claimed: 2020-03-12
- Assignees: Sony Group Corporation
- Applicants: Sony Group Corporation
- Inventors: Takayoshi Hirai; Yohei Ebihara; Naoto Nakamura; Hironori Suzuki
- Web page: https://patentgrep.com/patent/US12225173B2

## CPC

- H04N 1/6027: {Correction or control of colour gradation or colour contrast (H04N1/6058 takes precedence)}
- H04N 7/147: {Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q)}
- A61B 5/00: Measuring for diagnostic purposes (radiation diagnosis A61B6/00; diagnosis by ultrasonic, sonic or infrasonic waves A61B8/00); Identification of persons
- G16H 30/20: for handling medical images, e.g. DICOM, HL7 or PACS
- G16H 30/40: for processing medical images, e.g. editing
- G16H 40/63: for local operation
- G16H 40/67: for remote operation
- G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems
- G16H 80/00: ICT specially adapted for facilitating communication between medical practitioners or patients, e.g. for collaborative diagnosis, therapy or health monitoring
- H04N 7/142: {Constructional details of the terminal equipment, e.g. arrangements of the camera and the display}
- H04N 13/30: Image reproducers (optical systems for producing stereoscopic or other three-dimensional [3D] effects G02B30/00)
- H04N 23/71: Circuitry for evaluating the brightness variation
- H04N 23/88: for colour balance, e.g. white-balance circuits or colour temperature control
- H04N 1/6086: {by scene illuminant, i.e. conditions at the time of picture capture, e.g. flash, optical filter used, evening, cloud, daylight, artificial lighting, white point measurement, colour temperature}
- H04N 1/6088: {by viewing conditions, i.e. conditions at picture output}
- H04N 9/73: Colour balance circuits, e.g. white balance circuits or colour temperature control (camera processing pipelines for colour balance H04N23/88)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA

## Abstract

The present technique relates to a telemedicine system, a telemedicine method, an information processing device, and a program that allow a medical practitioner to more accurately obtain visual information on a patient in telemedicine. The telemedicine system includes a first imaging unit that images a patient in a first space, an image processing unit that corrects an image of the patient based on imaging conditions in a first space and display conditions in a second space for displaying the image of the patient imaged in the first space, and a display unit that displays the corrected image of the patient in the second space. The present technique can be applied to, for example, a telemedicine system.

## Claims

### Claim 1

A telemedicine system, comprising:
a first camera configured to image a patient in a first space;
an image processing circuitry unit that corrects-configured to:
estimate a difference between first illumination conditions of the first space and second illumination conditions of a second space, wherein the first illumination conditions are included in a plurality of imaging conditions of the first space and the second illumination conditions are included in a plurality of display conditions of the second space; and
correct a first image of the patient based on the estimated difference between the first illumination conditions and the second illumination conditions; and
a display device configured to display the corrected first image of the patient in the second space.

### Claim 2 (depends on 1)

The telemedicine system according to claim 1, wherein the image processing circuitry is further configured to:
estimate a skin color of the patient based on a change in the first illumination conditions of the first space to the second illumination conditions of the second space, and
correct the first image of the patient based on the estimated skin color.

### Claim 3 (depends on 2)

The telemedicine system according to claim 2, wherein the image processing circuitry is further configured to correct the first image of the patient based on an adjustment of a white balance.

### Claim 4 (depends on 1)

The telemedicine system according to claim 1, wherein
the first illumination conditions of the first space include at least one of a color of an illumination light of the first space, a brightness of the illumination light of the first space, and a type of a light source of the first space, and
the second illumination conditions include at least one of a color of an illumination light of the second space, a brightness of the illumination light of the second space, and a type of a light source of the second space.

### Claim 5 (depends on 1)

The telemedicine system according to claim 1, further comprising:
a second camera configured to image a medical practitioner who provides medical care for the patient in the second space; and
a condition identification circuitry configured to:
identify the first illumination conditions of the first space based on the first image of the patient imaged by the first camera, and
identify the second illumination conditions of the second space based on a second image of the medical practitioner imaged by the second camera.

### Claim 6 (depends on 1)

The telemedicine system according to claim 1, wherein
the plurality of imaging conditions include at least one of a first configuration of the first camera and a first setting of the first camera, and
the plurality of display conditions include at least one of a second configuration of the display device and a second setting of the display device.

### Claim 7 (depends on 1)

The telemedicine system according to claim 1, wherein
the image processing circuitry is further configured to change at least one of a presence or an absence of a correction to the first image of the patient based on a user setting, and
the image processing circuitry is further configured to change an intensity of the correction to the first image based on the user setting.

### Claim 8 (depends on 1)

The telemedicine system according to claim 1, wherein at least one of the plurality of imaging conditions or the plurality of display conditions include information on at least one of an attribute of the patient and past medical care information on the patient.

### Claim 9 (depends on 1)

The telemedicine system according to claim 1, wherein
the image processing circuitry is further configured to correct the first image of the patient based on a conversation between the patient and a medical practitioner, wherein
the medical practitioner provides medical care for the patient in the second space.

### Claim 10 (depends on 1)

The telemedicine system according to claim 1, further comprising a three-dimensional information detection circuitry configured to detect three-dimensional information on the patient in the first space,
wherein the display device is further configured to display the three-dimensional information on the patient.

### Claim 11 (depends on 1)

The telemedicine system according to claim 1, further comprising a condition identification circuitry configured to identify the plurality of imaging conditions and the plurality of display conditions.

### Claim 12 (depends on 1)

The telemedicine system according to claim 1, further comprising:
a first information processing device configured to connect with the first camera;
a second information processing device configured to connect with the display device; and
a third information processing device configured to connect with the image processing circuitry,
wherein the third information processing device is further configured to connect to the first information processing device and the second information processing device via a network,
wherein the third information processing device is further configured to receive the first image of the patient from the first information processing device via the network and transmit the corrected first image of the patient to the second information processing device.

### Claim 13 (depends on 1)

The telemedicine system according to claim 1, further comprising:
a first information processing device configured to connect with the first camera; and
a second information processing device configured to connect with the display device and the image processing circuitry,
wherein the second information processing device is further configured to connect to the first information processing device via a network, and
wherein the second information processing device is further configured to receive the first image of the patient from the first information processing device via the network.

### Claim 14

A telemedicine method, comprising:
imaging a patient in a first space;
estimating a difference between first illumination conditions of the first space and second illumination conditions of a second space, wherein the first illumination conditions are included in a plurality of imaging conditions of the first space and the second illumination conditions are included in a plurality of display conditions of the second space;
correcting an image of the patient based on the estimated difference between the first illumination conditions and the second illumination conditions; and
displaying the corrected image of the patient in the second space.

### Claim 15

An information processing device, comprising:
an image processing circuitry configured to:
estimate a difference between first illumination conditions in a first space and second illumination conditions of a second space, wherein the first illumination conditions are included in a plurality of imaging conditions for imaging a patient in the first space and the second illumination conditions are included in a plurality of display conditions of the second space, and wherein the image of the patient is displayed in the second space; and
correct the image of the patient based the estimated difference between the first illumination conditions and the second illumination conditions.

### Claim 16 (depends on 15)

The information processing device according to claim 15, further comprising an output control circuitry configured to display the corrected image of the patient.

### Claim 17

A non-transitory computer-readable medium having stored thereon, computer-executable instructions which, when executed by a computer, cause the computer to execute operations, the operations comprising:
estimating a difference between first illumination conditions in a first space and second illumination conditions of a second space, wherein the first illumination conditions are included in a plurality of imaging conditions for imaging a patient in the first space and the second illumination conditions are included in a plurality of display conditions of the second space, and wherein the image of the patient is displayed in the second space; and
correcting the image of the patient based on the estimated difference between the first illumination conditions and the second illumination conditions.

### Claim 18

A telemedicine system, comprising:
a first camera configured to image a patient in a first space;
an image processing circuitry configured to correct an image of the patient based on a plurality of imaging conditions in the first space and a plurality of display conditions in a second space for displaying the image of the patient imaged in the first space,
wherein at least one of the plurality of imaging conditions or the plurality of display conditions include information on an attribute of the patient and past medical care information on the patient; and
a display device configured to display the corrected image of the patient in the second space.
