# US 2021/0278839 A1 · Work machine, control method of work machine, and storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0278839 A1
- Document ID: US20210278839A1
- Status: Published application
- Kind: A1
- Application number: 17/326,921
- Filed: 2021-05-21
- Published: 2021-09-09
- Earliest claimed: 2018-11-29
- Assignees: Honda Motor Co., Ltd.
- Applicants: Honda Motor Co., Ltd.
- Inventors: Makoto YAMAMURA; Hiroto TAKAHASHI; Takamasa UDAGAWA
- Web page: https://patentgrep.com/patent/US20210278839A1

## CPC

- G05D 1/0077: {using redundant signals or controls}
- G05D 1/0251: {extracting 3D information from a plurality of images taken from different locations, e.g. stereo vision (stereoscopic image analysis H04N13/00; depth recovery from images G06T7/593)}
- G05D 1/0005: {with arrangements to save energy}
- G05D 1/0217: {in accordance with energy consumption, time reduction or distance reduction criteria}
- G05D 1/0246: {using a video camera in combination with image processing means}
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES

## Abstract

A work machine that operates based on an image of a camera, comprising: a plurality of cameras; a detection unit configured to detect a failure or a trouble in one of the plurality of cameras; a distance obtaining unit configured to, if the failure or the trouble is not detected, obtain distance information between the work machine and an object based on images with a parallax which are captured by the plurality of cameras, and if the failure is detected, obtaining the distance information based on an image captured by another camera in which the failure or the trouble is not detected; and a control unit configured to control the work machine based on the distance information obtained by the distance obtaining unit.

## Claims

### Claim 1

A work machine that operates based on an image of a camera, comprising:
a plurality of cameras;
a detection unit configured to detect a failure or a trouble in one of the plurality of cameras;
a distance obtaining unit configured to, if the failure or the trouble is not detected, obtain distance information between the work machine and an object based on images with a parallax which are captured by the plurality of cameras, and if the failure is detected, obtaining the distance information based on an image captured by another camera in which the failure or the trouble is not detected; and
a control unit configured to control the work machine based on the distance information obtained by the distance obtaining unit.

### Claim 2 (depends on 1)

The work machine according to claim 1, further comprising:
an object recognition unit configured to recognize the object based on a first analysis model and an image captured by one of the plurality of cameras,
wherein if the failure or the trouble is not detected, the control unit controls an operation of the work machine based on the distance information obtained based on the images with the parallax by the distance obtaining unit and an object recognition result by the object recognition unit.

### Claim 3 (depends on 2)

The work machine according to claim 2, wherein the first analysis model is a model incapable of obtaining the distance information.

### Claim 4 (depends on 2)

The work machine according to claim 2, further comprising a second object recognition unit configured to recognizing the object based on a second analysis model and an image captured by the other camera in which the failure or the trouble is not detected,
wherein if the failure or the trouble is detected, the control unit controls the operation of the work machine based on the distance information obtained by the distance obtaining unit based on the image captured by the other camera and an object recognition result by the second object recognition unit.

### Claim 5 (depends on 4)

The work machine according to claim 4, wherein the second analysis model is a model capable of obtaining the distance information.

### Claim 6 (depends on 1)

The work machine according to claim 1, wherein if the failure or the trouble is detected by the detection unit, the control unit executes load reduction processing of reducing a battery load of the work machine.

### Claim 7 (depends on 6)

The work machine according to claim 6, wherein the load reduction processing includes processing of lowering a traveling speed of the work machine.

### Claim 8 (depends on 6)

The work machine according to claim 6, wherein the load reduction processing includes processing of lowering a work speed of a work unit provided in the work machine.

### Claim 9 (depends on 6)

The work machine according to claim 6, wherein the load reduction processing includes processing of reducing a work area where the work machine performs a work.

### Claim 10 (depends on 1)

The work machine according to claim 1, further comprising a notification unit configured to make a notification of occurrence of the failure or the trouble if the failure or the trouble is detected by the detection unit.

### Claim 11 (depends on 1)

The work machine according to claim 1, wherein if the failure or the trouble is detected by the detection unit, the control unit performs control of returning the work machine to a station.

### Claim 12 (depends on 4)

The work machine according to claim 4, wherein if the failure or the trouble is not detected any more by the detection unit after the failure or the trouble is detected by the detection unit,
the control unit performs switching from the second analysis model to the first analysis model and controls the work machine using the first analysis model.

### Claim 13 (depends on 1)

The work machine according to claim 1, wherein if the failure or the trouble is detected in all the plurality of cameras by the detection unit, the control unit stops the operation of the work machine.

### Claim 14

A control method of a work machine that operates based on an image of a camera, the control method comprising:
detecting a failure or a trouble in one of a plurality of cameras provided in the work machine;
if the failure or the trouble is not detected, obtaining distance information between the work machine and an object based on images with a parallax which are captured by the plurality of cameras, and if the failure is detected, obtaining the distance information based on an image captured by another camera in which the failure or the trouble is not detected; and
controlling the work machine based on the distance information obtained in the obtaining.

### Claim 15 (depends on 1)

A storage medium storing a program configured to cause a computer to function as a work machine defined in claim 1.
