Back to results
US 10,864,633 B2Granted
Automated personalized feedback for interactive learning applications
AssigneeSouthe Autonomy Works, LLC
InventorsRahul D. Chipalkatty, Raphael Segal, Jay Ming Wong
Life of this patent
Estimating the term…
Abstract
A robot-training system permits a user touch, click on or otherwise select items from a display projected in the actual workspace in order to define task goals and constraints for the robot. A planning procedure responds to task definitions and constraints, and creates a sequence of robot instructions implementing the defined tasks.
Claims19
A method of training a robot situated in a workspace, the method comprising the steps of:
- computationally representing, by a controller, the robot in a 3D coordinate space corresponding to at least a portion of the workspace;
- detecting, by the controller, a user gesture within the workspace, the gesture indicating a location, and based on the detected gesture, projecting an interface onto the workspace at the indicated location;
- detecting, by the controller, gestural user selections of an element of the projected interface, the element of the projected interface corresponding to a robot control function involving manipulation of a physical object;
- and
- causing the robot to execute the control function.
2 more elements
For use with a robot in a workspace including a projector and a camera, a robot controller comprising:
- a processor;
- a memory for storing images obtained by the camera and controller instructions executable by the processor to provide:
- perception and interaction modules configured for (i) computationally representing the robot in a 3D coordinate spacer corresponding to at least a portion of the workspace, (ii) analyzing at least one first stored image to detect a user gesture within the workspace, the gesture indicating a location, (iii) based on the detected movement, causing the projector to project an interface onto the workspace at the indicated location, and (iv) analyzing at least one second stored image obtained by the camera subsequent to the at least one first stored image to detect a gestural user selection of an element of the projected interface, the element of the projected interface corresponding to a robot control function involving manipulation of a physical object;
- and
- a planning module configured for computing robot instructions corresponding to the robot control function and causing the robot to execute the robot instructions.
2 more elements
Dependencies are inferred from the claim text.