# US 2021/0278653 A1 · Control device and medical observation system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0278653 A1
- Document ID: US20210278653A1
- Status: Published application
- Kind: A1
- Application number: 17/149,746
- Filed: 2021-01-15
- Published: 2021-09-09
- Earliest claimed: 2020-03-04
- Assignees: Sony Olympus Medical Solutions Inc.
- Applicants: Sony Olympus Medical Solutions Inc.
- Inventors: Kazuhiro YAMAGUCHI
- Web page: https://patentgrep.com/patent/US20210278653A1

## CPC

- G02B 21/365: {Control or image processing arrangements for digital or video microscopes (G02B21/361, G02B21/362 take precedence)}
- A61B 34/25: {User interfaces for surgical systems}
- A61B 90/08: {Accessories or related features not otherwise provided for}
- A61B 90/20: Surgical microscopes characterised by non-optical aspects
- G02B 21/0012: {Surgical microscopes (counterbalanced structures for surgical microscopes G02B7/001)}
- G06F 3/012: {Head tracking input arrangements}
- A61B 2017/00203: {with speech control or speech recognition}
- A61B 2017/00216: {with eye tracking or head position tracking control}
- A61B 2090/0807: {Indication means}
- A61B 2562/0219: Inertial sensors, e.g. accelerometers, gyroscopes, tilt switches
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A control device includes: an acquiring unit configured to acquire a detection value from a sensor that detects a posture of a head of a user who operates an imaging device that images an observation target; and a control unit configured to generate an operation instruction signal for the imaging device using a reference value set by the user viewing initialization information displayed by a display device and the detection value.

## Claims

### Claim 1

A control device comprising:
an acquiring unit configured to acquire a detection value from a sensor that detects a posture of a head of a user who operates an imaging device that images an observation target; and
a control unit configured to generate an operation instruction signal for the imaging device using a reference value set by the user viewing initialization information displayed by a display device and the detection value.

### Claim 2 (depends on 1)

The control device according to claim 1, wherein the control unit is configured to
cause the display device to display the initialization information in a center of a screen of the display device and
associate a display area of the display device and the detection value corresponding to the posture of the head of the user to thereby generate the operation instruction signal.

### Claim 3 (depends on 1)

The control device according to claim 1, wherein the control unit is configured to generate the operation instruction signal based on a difference between the reference value and the detection value.

### Claim 4 (depends on 3)

The control device according to claim 3, wherein an absolute value of the difference at a time when the control unit transitions from a state in which the control unit is generating the operation instruction signal to a state in which the control unit stops the generation of the operation instruction signal is larger than an absolute value of the difference at a time when the control unit transitions from the state in which the control unit stops the generation of the operation instruction signal to a state in which the control unit starts the generation of the operation instruction signal.

### Claim 5 (depends on 1)

The control device according to claim 1, wherein the control unit is configured to calculate a statistical amount indicating statistical fluctuation in a predetermined period of the detection value and, disable the operation instruction signal in a case where the statistical amount does not satisfy a standard with which it may be determined that the fluctuation is small.

### Claim 6 (depends on 1)

The control device according to claim 1, wherein, the control unit is configured to disable the operation instruction signal in a case where the detection value does not satisfy a standard with which it may be determined that the user is viewing the display device.

### Claim 7 (depends on 1)

The control device according to claim 1, wherein the control unit is configured to set a plurality of operation modes for generating the operation instruction signals different from one another.

### Claim 8 (depends on 7)

The control device according to claim 7, wherein
the acquiring unit is configured to acquire a sound signal of the user, an input of which is received by a microphone,
the control device further comprises a sound processing unit configured to recognize content of the sound signal, and
the control unit is configured to change the operation mode according to a recognition result of the sound processing unit.

### Claim 9 (depends on 8)

The control device according to claim 8, wherein
the acquiring unit is configured to acquire an input signal from a footswitch, and
the control unit is configured to enable an input of the sound signal only when the acquiring unit acquires the sound signal from the microphone while the acquiring unit is acquiring the input signal from the footswitch and generates the operation instruction signal only in a case where the acquiring unit acquires the detection value while the acquiring unit is acquiring the input signal from the footswitch.

### Claim 10 (depends on 1)

The control device according to claim 1, wherein
the acquiring unit is configured to acquire an input signal from a footswitch, and
the control unit is configured to generate the operation instruction signal only in a case the acquiring unit acquires the detection value while the acquiring unit is acquiring the input signal from the footswitch.

### Claim 11 (depends on 10)

The control device according to claim 10, wherein the control unit is configured to change an operation mode of the imaging device in a case where the acquiring unit acquires the input signal from the footswitch within a predetermined time after the input signal from the footswitch stops.

### Claim 12 (depends on 1)

The control device according to claim 1, wherein
the sensor includes an acceleration sensor, and
the sensor is configured to detect a posture in which a head of the user is tilted to any direction of a front and a rear and left and right from a reference posture.

### Claim 13 (depends on 12)

The control device according to claim 12, wherein the sensor further includes a gyro sensor and is configured to detect rotation from the reference posture of the head of the user, the rotation being rotation in a horizontal direction in which height of eyes of the user is not changed.

### Claim 14 (depends on 1)

The control device according to claim 1, wherein
the display device is configured to display a three-dimensional image, and
the sensor is attached to eyeglasses worn by the user in order to view the three-dimensional image.

### Claim 15 (depends on 1)

The control device according to claim 1, wherein the operation instruction signal is a signal indicating operation of at least one of visual field movement, zoom, and focus of the imaging device.

### Claim 16

A medical observation system comprising:
an imaging device configured to image a very small part of a body to be observed;
a sensor configured to detect movement of a head of a user who operates the imaging device;
a display device configured to display an image acquired by the imaging device; and
a control device including
an acquiring unit configured to acquire a detection value from the sensor, and
a control unit configured to generate an operation instruction signal for the imaging device using a reference value set by the user viewing initialization information displayed by the display device and the detection value, and output the operation instruction signal to the imaging device.
