# US 2020/0264583 A1 · Robotic augmentation of creative tasks

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0264583 A1
- Document ID: US20200264583A1
- Status: Published application
- Kind: A1
- Application number: 16/866,442
- Filed: 2020-05-04
- Published: 2020-08-20
- Earliest claimed: 2016-12-19
- Assignees: Autodesk, Inc.
- Applicants: Autodesk, Inc.
- Inventors: Evan Patrick Atherton; David Thomasson; Maurice Ugo Conti; Heather Kerrick
- Web page: https://patentgrep.com/patent/US20200264583A1

## CPC

- G05B 19/402: characterised by control arrangements for positioning, e.g. centring a tool relative to a hole in the workpiece, additional detection means to correct position (G05B19/19 takes precedence)
- G05B 19/188: {characterised by special applications and not provided for in the relevant subclasses, (e.g. making dies, filament winding)}
- G05B 2219/37582: Position, angle of workpiece surface
- G05B 2219/39004: Assisted by automatic control system for certain functions
- G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G)

## Abstract

A robot is configured to assist an end-user with creative tasks. While the end-user modifies the work piece, the robot observes the modifications made by the end-user and determines one or more objectives that the end-user may endeavor to accomplish. The robot then determines a set of actions to perform that assist the end-user with accomplishing the objectives.

## Claims

### Claim 1

A computer-implemented method, comprising:
receiving sensor data from one or more sensors;
determining a first modification that an end-user has made to a work piece based on the sensor data;
determining a second modification to make to the work piece based on the first modification; and
causing a robot to perform one or more operations on the work piece via an implement in order to make the second modification to the work piece.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein determining the first modification comprises determining a first set of actions executed by the end-user relative to the work piece, and determining the second modification comprises determining a second set of actions relative to the work piece that are derived from the first set of actions.

### Claim 3 (depends on 2)

The computer-implemented method of claim 2, wherein the first set of actions comprises a sequence of repeated operations applied to a first region of the work piece, and the second set of actions comprises the sequence of repeated operations applied to a second region of the work piece.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, wherein the work piece is directed towards a first theme, and determining the second modification comprises:
comparing the work piece to a plurality of other work pieces to identify one or more other work pieces that also are directed towards the first theme; and
extracting the second modification from the one or more other work pieces.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, wherein the work piece is directed towards a first theme, and a plurality of other work pieces are directed towards a second them, and wherein determining the second modification comprises:
comparing the work piece to the plurality of other workpieces to identify one or more other work pieces that include at least one feature common to the work piece; and
extracting the second modification from the one or more other work pieces.

### Claim 6 (depends on 1)

The computer-implemented method of claim 1, further comprising processing additional information received from the end-user to determine a third modification to the work piece that comprises a first number of actions.

### Claim 7 (depends on 6)

The computer-implemented method of claim 6, wherein the second modification to the work piece comprises a second number of actions that includes fewer actions than the first number of actions, and further comprising modifying at least one weight included in a neural network used to control the robot based on the first number of actions.

### Claim 8 (depends on 6)

The computer-implemented method of claim 6, wherein the second modification to the work piece comprises a second number of actions that includes a greater number of actions than the first number of actions, and further comprising modifying at least one weight included in a neural network used to control the robot based on the first number of actions.

### Claim 9

One or more non-transitory computer-readable media storing instructions that, when executed by one or more processors, cause the one or more processors to perform the steps of:
receiving sensor data from one or more sensors;
determining a first modification that an end-user has made to a work piece based on the sensor data;
determining a second modification to make to the work piece based on the first modification; and
causing a robot to perform one or more operations on the work piece via an implement in order to make the second modification to the work piece.

### Claim 10 (depends on 9)

The one or more non-transitory computer-readable media of claim 9, wherein determining the first modification comprises determining a first set of actions executed by the end-user relative to the work piece, and determining the second modification comprises determining a second set of actions relative to the work piece that are derived from the first set of actions.

### Claim 11 (depends on 10)

The one or more non-transitory computer-readable media of claim 10, wherein the first set of actions comprises a sequence of repeated operations applied to a first region of the work piece, and the second set of actions comprises the sequence of repeated operations applied to a second region of the work piece.

### Claim 12 (depends on 9)

The one or more non-transitory computer-readable media of claim 9, wherein the work piece is directed towards a first theme, and determining the second modification comprises:
comparing the work piece to a plurality of other work pieces to identify one or more other work pieces that also are directed towards the first theme; and
extracting the second modification from the one or more other work pieces.

### Claim 13 (depends on 9)

The one or more non-transitory computer-readable media of claim 9, wherein the work piece is directed towards a first theme, and a plurality of other work pieces are directed towards a second them, and wherein determining the second modification comprises:
comparing the work piece to the plurality of other workpieces to identify one or more other work pieces that include at least one feature common to the work piece; and
extracting the second modification from the one or more other work pieces.

### Claim 14 (depends on 9)

The one or more non-transitory computer-readable media of claim 9, further comprising processing additional information received from the end-user to determine a third modification to the work piece that comprises a first number of actions.

### Claim 15 (depends on 14)

The one or more non-transitory computer-readable media of claim 14, wherein the second modification to the work piece comprises a second number of actions that includes fewer actions than the first number of actions, and further comprising modifying at least one weight included in a neural network used to control the robot based on the first number of actions.

### Claim 16 (depends on 14)

The one or more non-transitory computer-readable media of claim 14, wherein the second modification to the work piece comprises a second number of actions that includes a greater number of actions than the first number of actions, and further comprising modifying at least one weight included in a neural network used to control the robot based on the first number of actions.

### Claim 17

A system, comprising:
one or more memories storing instructions; and
one or more processors that are coupled to the one or more memories and, when executing the instructions, are configured to perform the steps of:
receiving sensor data from one or more sensors;
determining a first modification that an end-user has made to a work piece based on the sensor data;
determining a second modification to make to the work piece based on the first modification; and
causing a robot to perform one or more operations on the work piece via an implement in order to make the second modification to the work piece.

### Claim 18 (depends on 17)

The system of claim 17, wherein the one or more processors are configured to determine the first modification by determining a first set of actions executed by the end-user relative to the work piece, and wherein the one or more processors are configured to determine the second modification by determining a second set of actions relative to the work piece that are derived from the first set of actions.

### Claim 19 (depends on 18)

The system of claim 18, wherein the first set of actions comprises a sequence of repeated operations applied to a first region of the work piece, and the second set of actions comprises the sequence of repeated operations applied to a second region of the work piece.

### Claim 20 (depends on 17)

The system of claim 17, wherein the work piece is directed towards a first theme, and the one or more processors are configured to determine the second modification by:
comparing the work piece to a plurality of other work pieces to identify one or more other work pieces that also are directed towards the first theme; and
extracting the second modification from the one or more other work pieces.

### Claim 21 (depends on 17)

The system of claim 17, wherein the work piece is directed towards a first theme, and a plurality of other work pieces are directed towards a second them, and wherein the one or more processors are configured to determine the second modification by:
comparing the work piece to the plurality of other workpieces to identify one or more other work pieces that include at least one feature common to the work piece; and
extracting the second modification from the one or more other work pieces.

### Claim 22 (depends on 17)

The system of claim 17, wherein the one or more processor are further configured to perform the step of processing additional information received from the end-user to determine a third modification to the work piece that comprises a first number of actions.

### Claim 23 (depends on 22)

The system of claim 22, wherein the second modification to the work piece comprises a second number of actions that includes fewer actions than the first number of actions, and wherein the one or more processors are further configured to perform the step of modifying at least one weight included in a neural network used to control the robot based on the first number of actions.

### Claim 24 (depends on 22)

The system of claim 22, wherein the second modification to the work piece comprises a second number of actions that includes a greater number of actions than the first number of actions, and wherein the one or more processors are further configured to perform the step of modifying at least one weight included in a neural network used to control the robot based on the first number of actions.
