# US 2021/0004195 A1 · Remote work-support system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0004195 A1
- Document ID: US20210004195A1
- Status: Published application
- Kind: A1
- Application number: 16/910,746
- Filed: 2020-06-24
- Published: 2021-01-07
- Earliest claimed: 2019-07-01
- Assignees: Hitachi, Ltd.
- Applicants: Hitachi, Ltd.
- Inventors: Chiyo OHNO; Naohito IKEDA; Toshiki ISHII; Satoshi OUCHI; Taku HOSHIZAWA
- Web page: https://patentgrep.com/patent/US20210004195A1

## CPC

- G06F 3/1454: {involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay}
- G06F 3/147: using display panels
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/012: {Head tracking input arrangements}
- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G06F 3/0485: Scrolling or panning
- G06V 20/20: in augmented reality scenes
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16)
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/014: {comprising information/image processing systems}
- G09G 2370/022: Centralised management of display operation, e.g. in a server instead of locally
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

Provided is a remote work-support system including a first display device to be worn on a first user working at a work site, a surrounding imaging device disposed on the work site, and an information processing device provided at a predetermined spot, configured to be communicable with the first display device and the surrounding imaging device, and operated by a second user. The first display device includes a first communication unit transmitting first image data to the information processing device. The surrounding imaging device includes a second communication unit transmitting second image data to the information processing device. The information processing device includes second display devices displaying the first and second image data, an operation unit through which data is input, and a third communication unit transmitting data input by the second user through the operation unit to the first display device.

## Claims

### Claim 1

A remote work-support system comprising:
a first display device to be worn on a first user working at a work site;
a surrounding imaging device disposed on the work site; and
an information processing device provided at a predetermined spot, configured to communicable with the first display device and the surrounding imaging device, and operated by a second user,
the first display device including
a first display unit that displays information to the first user,
a first imaging unit that captures an image in front of the first display device and outputs first image data, and
a first communication unit that transmits the first image data to the information processing device,
the surrounding imaging device including
a second imaging unit that outputs second image data including an imaging range different from an imaging range of the first image data, and
a second communication unit that transmits the second image data to the information processing device, and
the information processing device including
a second display device that displays the first image data and the second image data,
an operation unit through which data is input, and
a third communication unit that transmits data input by the second user through the operation unit to the first display device.

### Claim 2 (depends on 1)

The remote work-support system according to claim 1 further comprising:
a line-of-sight detection sensor that detects a line-of-sight of the second user; and
a line-of-sight correspondence control unit that causes the second display device to enlarge and display a portion corresponding to the line-of-sight in the second image data.

### Claim 3 (depends on 2)

The remote work-support system according to claim 2, further comprising a scroll control unit that scrolls the second image data displayed on the second display device in a right-left direction or an up-down direction, in a case where the line of sight of the second user is in a predetermined state.

### Claim 4 (depends on 2)

The remote work-support system according to claim 2 further comprising:
a posture detection unit that detects a posture of the second user, wherein
the line-of-sight correspondence control unit causes the second display device to enlarge and display the portion corresponding to the line-of-sight in the second image data in a case where the posture detection unit detects a predetermined posture of the second user.

### Claim 5 (depends on 4)

The remote work-support system according to claim 4 further comprising a scroll control unit that scrolls the second image data displayed on the second display device in a right-left direction or an up-down direction, in a case where the posture detection unit detects a predetermined motion state of the second user.

### Claim 6 (depends on 1)

The remote work-support system according to claim 1 further comprising:
a line-of-sight detection sensor that detects a line of sight of the second user;
a visual image determination unit that determines which of the first image data and the second image data the second user is viewing on a basis of the line of sight detected; and
a transmission control unit that controls a data rate of the first image data or the second image data or stops transmission, on the basis of a determination result of the visual image determination unit.

### Claim 7 (depends on 1)

The remote work-support system according to claim 1 further comprising:
a line-of-sight detection sensor that detects a line of sight of the second user;
a visual image determination unit that determines which of the first image data and the second image data the second user is viewing on a basis of the line of sight detected; and
a screen control unit that notifies the first user of a determination result of the visual image determination unit via the first display unit.

### Claim 8 (depends on 1)

The remote work-support system according to claim 1 further comprising:
a line-of-sight detection sensor that detects a line of sight of the second user;
a visual image determination unit that determines which of the first image data and the second image data the second user is viewing on a basis of the line of sight detected, and detects a coordinate position viewed in a case where the second user views the second image data; and
a direction display unit that is mounted on the surrounding imaging device and displays a direction corresponding to the coordinate position.
