Back to results
US 11,237,553 B2Granted
Remote control device and method thereof
AssigneeHanwha Defense Co., Ltd.
InventorHee Seo Chae
Life of this patent
Estimating the term…
Abstract
A remote control device includes: a display configured to receive a driving image and a monitoring image from each of N mobile robots, such that N driving images and M monitoring images are received, and to display the received N driving images and M monitoring images; a sensor configured to track a gaze of a user; and a controller configured to provide a control right to the user for a first robot of the N mobile robots as a master mobile robot based on the gaze of the user being tracked by the sensor as staying on the driving image or the monitoring image of the first robot displayed on the display.
Claims18
A remote control device comprising:
- a display configured to receive a driving image and a monitoring image from each of N mobile robots, such that N driving images and M monitoring images are received, and to display the received N driving images and M monitoring images;
- a sensor configured to track a gaze of a user;
- and
- a controller comprising at least one processor, the controller configured to:
- provide a control right to the user for a first robot of the N mobile robots as a master mobile robot based on the gaze of the user being tracked by the sensor as staying on the driving image or the monitoring image of the first robot displayed on the display;
- and
- based on the user selecting, via the display, one of the N driving images or one of the M monitoring images, other than the driving image and the monitoring image of the first robot that is the master mobile robot, within a certain time after the user is provided the control right of the master mobile robot, perform collective control of the master mobile robot and another mobile robot from which the selected driving image or the selected monitoring image was received, wherein the controller is configured to provide the control right to the user for the first robot as the master mobile robot at a time t1 based on the gaze of the user being tracked by the sensor as staying on a first image that is the driving image or the monitoring image of the first robot displayed on the display, and when the gaze of the user tracked by the sensor at a time t2 moves and stays for more than a preset time on a second image that is the driving image or the monitoring image of a second robot of the N mobile robots displayed on the display, set the second robot as the master mobile robot.
4 more elements
A remote control method comprising:
- receiving a driving image and a monitoring image from each of N mobile robots, such that N driving images and M monitoring images are received;
- displaying, on a display, the received N driving images and M monitoring images;
- tracking, via a sensor, a gaze of a user;
- providing a control right to the user for a first robot of the N mobile robots as a master mobile robot based on the gaze of the user being tracked by the sensor as staying on the driving image or the monitoring image of the first robot displayed on the display;
- and
- performing, based on the user selecting, via the display, one of the N driving images or one of the M monitoring images, other than the driving image and the monitoring image of the first robot that is the master mobile robot, within a certain time after the user is provided the control right of the master mobile robot, collective control of the master mobile robot and another mobile robot from which the selected driving image or the selected monitoring image was received, wherein the providing the control right to the user for the first robot as the master mobile robot is at a time t1, and the remote control method further comprises:
- setting, in a case where the gaze of the user tracked by the sensor moves and stays at a time t2 for more than a preset time on the driving image or the monitoring image of a second robot of the N mobile robots displayed on the display, the second robot as the master mobile robot.
4 more elements
A non-transitory computer readable medium comprising computer instructions that are configured to, when executed by at least one processor, cause the at least one processor to:
- display, via a display, N driving images and M monitoring images that are received, the N driving images and M monitoring images including a driving image and a monitoring image from each of N mobile robots;
- track, via a sensor, a gaze of a user;
- provide a control right to the user for a first robot of the N mobile robots as a master mobile robot based on the gaze of the user being tracked by the sensor as staying on the driving image or the monitoring image of the first robot displayed on the display;
- and
- perform, based on the user selecting, via the display, one of the N driving images or one of the M monitoring images, other than the driving image and the monitoring image of the first robot that is the master mobile robot, within a certain time after the user is provided the control right of the master mobile robot, collective control of the master mobile robot and another mobile robot from which the selected driving image or the selected monitoring image was received, wherein the computer instructions are further configured to cause the at least one processor to provide the control right to the user for the first robot as the master mobile robot at a time t1 based on the gaze of the user being tracked by the sensor as staying on a first image that is the driving image or the monitoring image of the first robot displayed on the display, and when the gaze of the user tracked by the sensor at a time t2 moves and stays for more than a preset time on a second image that is the driving image or the monitoring image of a second robot of the N mobile robots displayed on the display, set the second robot as the master mobile robot.
2 more elements
Dependencies are inferred from the claim text.