# US 2021/0241904 A1 · Techniques for remotely controlling a medical device based on image data

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0241904 A1
- Document ID: US20210241904A1
- Status: Published application
- Kind: A1
- Application number: 17/236,385
- Filed: 2021-04-21
- Published: 2021-08-05
- Earliest claimed: 2017-12-22
- Assignees: Stryker Corporation
- Applicants: Stryker Corporation
- Inventors: Thomas Durlach; Ross Nave; Krishna Sandeep Bhimavarapu
- Web page: https://patentgrep.com/patent/US20210241904A1

## CPC

- G16H 40/67: for remote operation
- A61B 5/0013: {Medical image data (A61B1/00011, A61B6/56, A61B8/56 take precedence)}
- A61B 5/002: {Monitoring the patient using a local or closed circuit, e.g. in a room or building (A61B5/0017 takes precedence)}
- A61B 5/0024: {for multiple sensor units attached to the patient, e.g. using a body or personal area network}
- A61B 5/0077: {Devices for viewing the surface of the body, e.g. camera, magnifying lens}
- A61B 5/6892: {Mats}
- A61B 5/7435: {Displaying user selection data, e.g. icons in a graphical user interface}
- G16H 40/20: for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
- G16H 80/00: ICT specially adapted for facilitating communication between medical practitioners or patients, e.g. for collaborative diagnosis, therapy or health monitoring
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)

## Abstract

A system and a method for remotely controlling a medical device based on image data are disclosed. The system includes a medical device, an image sensor, and a remote caregiver interface. The medical device includes a controller coupled to a communication network. The image sensor is coupled to the communication network and is configured to capture image data. The remote caregiver interface is coupled to the communication network and is configured to display the image data for viewing by a user, receive a selected remote control function from the user, and transmit an input signal corresponding to the selected remote control function to the controller of the medical device to execute the selected remote control function based on the input signal.

## Claims

### Claim 1

A system for remotely controlling a medical device based on image data, the system comprising:
a medical device comprising a patient support apparatus including:
a controller coupled to a communication network,
a support structure with a patient support surface to support a patient, and
an actuatable device coupled to the patient support apparatus and operable to facilitate treatment of the patient
an image sensor coupled to the communication network and being configured to capture image data and to transmit the image data to the controller; and
a remote caregiver interface coupled to the communication network and configured to:
display the image data for viewing by a user of the remote caregiver interface,
receive a selected remote control function from the user corresponding to operation of the actuatable device, and
transmit an input signal corresponding to the selected remote control function to the controller of the medical device;
wherein the controller is configured to:
analyze the image data to determine a patient condition;
alter the selected remote control function based on the patient condition; and
transmit an output signal to the actuatable device to execute the altered remote control function to facilitate treatment of the patient.

### Claim 2 (depends on 1)

The system as set forth in claim 1, wherein the patient condition comprises a patient presence, a comfort indication of the patient, a physiological state of the patient, or combinations thereof.

### Claim 3 (depends on 1)

The system as set forth in claim 1, wherein the remote caregiver interface is further configured to:
analyze the image data from the image sensor to determine a patient condition;
alter the selected remote control function based on the patient condition; and
transmit an input signal corresponding to the altered remote control function to the controller; and
wherein the controller is further configured to:
transmit an output signal to the actuatable device to execute the altered remote control function based on the input signal corresponding to the altered remote control function.

### Claim 4 (depends on 1)

The system as set forth in claim 1, further comprising a patient sensor configured to transmit a sensor input signal in response to sensing a state of the patient;
wherein the controller is further configured to receive the sensor input signal and determine the patient condition based on the sensor input signal; and
wherein the controller is further configured to:
alter the remote control function based on the patient condition, and
transmit an output signal to the actuatable device to execute the altered remote control function.

### Claim 5 (depends on 4)

The system as set forth in claim 4, wherein the patient sensor is coupled to the communication network and wherein the remote caregiver interface is further configured to receive the sensor input signal and determine the patient condition based on the sensor input signal;
wherein the remote caregiver interface is further configured to:
alter the remote control function based on the patient condition, and
transmit an input signal corresponding to the altered remote control function based on the patient condition; and
wherein the controller is further configured to transmit the output signal to the actuatable device to execute the altered remote control function based on the input signal corresponding to the altered remote control function.

### Claim 6 (depends on 1)

The system as set forth in claim 1, wherein the image sensor comprises an infrared image sensor, a visual light image sensor, or a combination thereof.

### Claim 7 (depends on 1)

The system as set forth in claim 1, wherein the communication network is a wireless network.

### Claim 8 (depends on 1)

The system as set forth in claim 1, further comprising a local user interface configured to transmit a selected local control function to the controller.

### Claim 9 (depends on 8)

The system as set forth in claim 8, wherein the local user interface is configured to display a graphical user interface; and
wherein the remote caregiver interface is configured to display a graphical user interface, the graphical user interface on the remote caregiver interface being identical to the graphical user interface on the local user interface.

### Claim 10 (depends on 8)

The system as set forth in claim 8, wherein the local user interface is configured to display a graphical user interface; and
wherein the remote caregiver interface is further configured to replicate at least a portion of the graphical user interface displayed on the local user interface.

### Claim 11 (depends on 1)

The system as set forth in claim 1, wherein the image sensor is coupled to the patient support apparatus.

### Claim 12 (depends on 1)

The system as set forth in claim 1, wherein image sensor is coupled to a support structure near the patient support apparatus.

### Claim 13 (depends on 1)

The system as set forth in claim 1, wherein the remote caregiver interface is a mobile device.

### Claim 14 (depends on 1)

The system as set forth in claim 1, wherein the remote caregiver interface comprises a camera, the camera configured to capture image data of the user of the remote caregiver interface.

### Claim 15 (depends on 14)

The system as set forth in claim 14, further comprising a local user interface coupled to the communication network and being proximate to the patient support apparatus, the local user interface being configured to receive the image data of the user from the remote caregiver interface.

### Claim 16 (depends on 15)

The system as set forth in claim 15, wherein the remote caregiver interface is further configured to initiate a video conference with the local user interface and wherein the local user interface is further configured to initiate the video conference with the remote caregiver interface.

### Claim 17 (depends on 15)

The system as set forth in claim 15, wherein one of the controller and the remote caregiver interface is further configured to:
determine a patient condition; and
initiate a video conference with the local user interface based on the patient condition.

### Claim 18 (depends on 1)

The system as set forth in claim 1, wherein the actuatable device comprises a lighting device, a temperature device, a humidity device, or combinations thereof.

### Claim 19 (depends on 1)

The system as set forth in claim 1, wherein the actuatable device comprises a vibrational therapy device, a percussion therapy device, compression therapy device, a patient warming device, an electrical stimulation device, or combinations thereof.