# US 2021/0171329 A1 · Forklift-truck remote operation system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0171329 A1
- Document ID: US20210171329A1
- Status: Published application
- Kind: A1
- Application number: 17/055,305
- Filed: 2019-05-14
- Published: 2021-06-10
- Earliest claimed: 2018-05-24
- Assignees: Kabushiki Kaisha Toyota Jidoshokki
- Applicants: Kabushiki Kaisha Toyota Jidoshokki
- Inventors: Junji INOUE; Koji HIKA; Hironobu OKAMOTO
- Web page: https://patentgrep.com/patent/US20210171329A1

## CPC

- B66F 9/063: {Automatically guided}
- G05D 1/0038: {by providing the operator with simple or augmented images from one or more cameras located onboard the vehicle, e.g. tele-operation (images analyzed by a computer and used for automatic navigation G05D1/0246)}
- G05D 1/0212: {with means for defining a desired trajectory (involving a plurality of land vehicles G05D1/0287)}
- G05D 1/224: Output arrangements on the remote controller, e.g. displays, haptics or speakers
- G05D 1/646: Following a predefined trajectory, e.g. a line marked on the floor or a flight path
- G06V 20/56: exterior to a vehicle by using sensors mounted on the vehicle
- H04N 7/183: {for receiving images from a single remote source}
- B66F: HOISTING, LIFTING, HAULING OR PUSHING, NOT OTHERWISE PROVIDED FOR, e.g. DEVICES WHICH APPLY A LIFTING OR PUSHING FORCE DIRECTLY TO THE SURFACE OF A LOAD ({invalid lifting devices A61G7/10; } mounting artificial islands on piles or like supports E02B17/00; scaffolding combined with lifting devices E04G1/22; lifting devices for sliding forms E04G11/24; lifting of buildings E04G23/06; shores or struts E04G25/00; lifts or other hoisting devices on ladders E06C7/12; props for mining E21D15/00)
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A forklift-truck remote operation system includes a forklift truck and a remote operation device. The forklift-truck remote operation system further includes: a camera mounted to the forklift truck and configured to capture an image of an area around the forklift truck; a display disposed in the remote operation device and configured to display the image captured by the camera; a pallet detector configured to perform image recognition processing of the image captured by the camera and detect a plurality of pallets; a display controller configured to control the display to display the image captured by the camera with an indication for pallet selection from the pallets detected by the pallet detector; and a travel controller configured to control the forklift truck to move to a position of the selected pallet.

## Claims

### Claim 1

A forklift-truck remote operation system comprising:
a forklift truck including a vehicle communication part; and
a remote operation device including an operation device communication part that is configured to communicate wirelessly with the vehicle communication part and used for remote operation of the forklift truck, wherein the forklift-truck remote operation system includes:
a camera mounted to the forklift truck and configured to capture an image of an area around the forklift truck;
a display disposed in the remote operation device and configured to display the image captured by the camera;
a pallet detector configured to perform image recognition processing of the image captured by the camera and detect a plurality of pallets;
a display controller configured to control the display to display the image captured by the camera with an indication for pallet selection from the pallets detected by the pallet detector; and
a travel controller configured to control the forklift truck to move to a position of the selected pallet.

### Claim 2 (depends on 1)

The forklift-truck remote operation system according to claim 1, wherein the indication for pallet selection includes pop-up boxes corresponding to the respective detected pallets.

### Claim 3 (depends on 1)

The forklift-truck remote operation system according to claim 1, wherein the indication for pallet selection includes highlighting of outlines of the detected pallets.

### Claim 4 (depends on 1)

The forklift-truck remote operation system according to claim 1, wherein the display controller further controls the display to display an enlargement of an area around the selected pallet on a sub-screen.

### Claim 5 (depends on 2)

The forklift-truck remote operation system according to claim 2, wherein the display controller further controls the display to display an enlargement of an area around the selected pallet on a sub-screen.

### Claim 6 (depends on 3)

The forklift-truck remote operation system according to claim 3, wherein the display controller further controls the display to display an enlargement of an area around the selected pallet on a sub-screen.
