Mobile robot performing multiple detections using image frames of same optical sensor
AssigneePixart Imaging Inc.
InventorsGuo-Zhen Wang, Hui-Hsuan Chen
Life of this patent
Estimating the term…
Abstract
There is provided a mobile robot that performs the obstacle avoidance, positioning and object recognition according to image frames captured by the same optical sensor. The mobile robot includes an optical sensor, a light emitting diode, a laser diode and a processor. The processor identifies an obstacle and a distance thereof according to image frames captured by the optical sensor when the laser diode is emitting light. The processor further performs the positioning and object recognition according to image frames captured by the optical sensor when the light emitting diode is emitting light.
Claims20
A mobile robot, comprising:
- a first light source, configured to project a transverse light section toward a moving direction at a first time interval;
- a second light source, configured to project a longitudinal light section toward the moving direction at a second time interval;
- a third light source, configured to illuminate a front area of the moving direction at a third time interval;
- an optical sensor, configured to respectively capture a first image frame, a second image frame and a third image frame within the first time interval, the second time interval and the third time interval;
- and
- a processor, electrically coupled to the first light source, the second light source, the third light source and the optical sensor, and configured to
- perform range estimation according to the first image frame and the second image frame, and
- perform visual simultaneous localization and mapping according to the third image frame.
A mobile robot, comprising:
- a first light source, configured to project a transverse light section toward a moving direction at a first time interval;
- a second light source, configured to project a longitudinal light section toward the moving direction at a second time interval;
- and
- a pixel array, comprising a plurality of first pixels and a plurality of second pixels, the plurality of first pixels being configured to receive incident light via an IR light filter, and the plurality of second pixels being configured to receive incident light without via any light filter, wherein the pixel array is configured to capture a first image frame, a second image frame and a third image frame respectively within a first time interval, a second time interval, and a third time interval between the first time interval and the second time interval;
- and
- a processor, electrically coupled to the first light source, the second light source and the pixel array, and configured to
- perform range estimation according to the first image frame and the second image frame, and
- perform visual simultaneous localization and mapping (VSLAM) according to pixel data of the third image frame associated with the plurality of second pixels.
A mobile robot, comprising:
- a first light source, configured to project a transverse light section toward a moving direction at a first time interval;
- a second light source, configured to project a longitudinal light section toward the moving direction at a second time interval;
- a third light source, configured to illuminate a front area of the moving direction;
- an optical sensor, configured to capture a first image frame and a second image frame respectively within the first time interval and the second time interval;
- and
- a processor, electrically coupled to the first light source, the second light source, the third light source and the optical sensor, and configured to
- identify an obstacle according to the first image frame and the second image frame,
- control the third light source to emit light within a third time interval and control the optical sensor to capture a third image frame within the third time interval when identifying the obstacle,
- determine a region of interest in the third image frame according to an image position of the identified obstacle, and
- recognize an object type of the identified obstacle within the region of interest using a learning model.
Dependencies are inferred from the claim text.