# US 2022/0032468 A1 · Robotic drawing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0032468 A1
- Document ID: US20220032468A1
- Status: Published application
- Kind: A1
- Application number: 17/282,567
- Filed: 2019-10-03
- Published: 2022-02-03
- Earliest claimed: 2018-10-04
- Assignees: Brown University
- Applicants: Brown University
- Inventors: Stefanie TELLEX; Atsunobu KOTANI
- Web page: https://patentgrep.com/patent/US20220032468A1

## CPC

- B25J 9/1697: {Vision controlled systems}
- B25J 11/00: Manipulators not otherwise provided for
- B25J 11/0075: {Manipulators for painting or coating}
- B25J 13/08: by means of sensing devices, e.g. viewing or touching devices
- B25J 15/0019: {End effectors other than grippers}
- G06V 30/226: of cursive writing
- G06V 30/32: Digital ink
- A61F 2/72: Bioelectric control, e.g. myoelectric
- B25J: MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES ({manipulators specially adapted for use in surgery A61B34/70; manipulators used in cleaning hollow articles B08B9/04}; manipulators associated with rolling mills B21B39/20; manipulators associated with forging machines B21J13/10; {manipulators associated with picking-up and placing mechanisms B23P19/007}; means for holding wheels or parts thereof B60B30/00; {vehicles with ground-engaging propulsion means, e.g. walking members B62D57/02, B62D57/032; devices for picking-up and depositing articles or materials between conveyors B65G47/90, B65G47/91; manipulators with gripping or holding means for transferring packages B65H67/065}; cranes B66C; {manipulators used in the protection or supervision of pipe-line installations F17D5/00; walking equipment adapted for nuclear steam-generators F22B37/006}; manipulators specially adapted for, or associated with, nuclear reactors G21C; {apparatus used for handling wafers during manufacture or treatment of semiconductor H10P72/50})
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- A61F: FILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS (dental prosthetics A61C)

## Abstract

A method includes providing a robot, providing an image of drawn handwritten characters to the robot, enabling the robot to capture a bitmapped image of the image of drawn handwritten characters, enabling the robot to infer a plan to replicate the image with a writing utensil, and enabling the robot to reproduce the image.

## Claims

### Claim at position 1

1-3. (canceled)

### Claim 4

A method comprising:
providing a robot
providing an image of drawn handwritten characters to the robot
enabling the robot to capture a bitmapped image of the image of drawn handwritten characters;
enabling the robot to infer a plan to replicate the image with a writing utensil; and
enabling the robot to reproduce the image;
wherein enabling the robot to reproduce the image comprises enabling the robot to draw each target stroke in one continuous drawing motion to write from a dataset of demonstrations;
wherein enabling the robot to reproduce the image comprises providing the robot commands to execute predicted by a model in real time; and
wherein the robot commands comprise:
commands to make the robot follow each stroke from its start to end; and
commands to predict a starting location of a next stroke at an end of a current stroke.

### Claim 5 (depends on 4)

The method of claim 4 wherein the commands to make the robot follow each stroke from its start to end are derived from a local model.

### Claim 6 (depends on 5)

The method of claim 5 wherein the local model predicts where to move itself next in its 5×5 pixel environment.

### Claim 7 (depends on 6)

The method of claim 6 wherein the commands to predict the starting location of the next stroke at the end of the current stroke are derived from a global model.

### Claim 8 (depends on 7)

The method of claim 7 wherein the global model predicts the next starting point of the new stroke in a full-scale image plane.

### Claim at position 7

9-13. (canceled)
