# US 2025/0026589 A1 · Robotic tools and methods for operating the same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0026589 A1
- Document ID: US20250026589A1
- Status: Published application
- Kind: A1
- Application number: 18/661,462
- Filed: 2024-05-10
- Published: 2025-01-23
- Earliest claimed: 2020-11-05
- Assignees: MUJIN, Inc.
- Applicants: MUJIN, Inc.
- Inventors: Shintaro Matsuoka; Hironori Mizoguchi; Rosen Nikolaev Diankov
- Web page: https://patentgrep.com/patent/US20250026589A1

## CPC

- B65G 47/917: {control arrangements}
- G06Q 10/08: Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
- B25J 9/1664: {characterised by motion, path, trajectory planning}
- B65G 47/918: {with at least two picking-up heads}
- B65G 67/24: Unloading land vehicles
- B65G 2203/0233: Position of the article
- B65G 2203/0283: Position of the load carrier
- B65G 2203/0291: Speed of the load carrier
- B65G 2203/041: Camera
- B65G: TRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS (packaging B65B; handling thin or filamentary materials, e.g. paper sheets or thread, B65H; cranes B66C; portable mobile or lifting or hauling appliances, e.g. hoists, B66D; devices for lifting or lowering goods for loading or unloading purposes, e.g. fork-lift trucks, B66F9/00; emptying bottles, jars, casks, barrels or similar containers, not otherwise provided for, B67C9/00; delivering or transferring liquids B67D; filling or discharging vessels for liquefied, solidified or compressed gases F17C; pipe-line systems for fluids F17D)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- B25J: MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES ({manipulators specially adapted for use in surgery A61B34/70; manipulators used in cleaning hollow articles B08B9/04}; manipulators associated with rolling mills B21B39/20; manipulators associated with forging machines B21J13/10; {manipulators associated with picking-up and placing mechanisms B23P19/007}; means for holding wheels or parts thereof B60B30/00; {vehicles with ground-engaging propulsion means, e.g. walking members B62D57/02, B62D57/032; devices for picking-up and depositing articles or materials between conveyors B65G47/90, B65G47/91; manipulators with gripping or holding means for transferring packages B65H67/065}; cranes B66C; {manipulators used in the protection or supervision of pipe-line installations F17D5/00; walking equipment adapted for nuclear steam-generators F22B37/006}; manipulators specially adapted for, or associated with, nuclear reactors G21C; {apparatus used for handling wafers during manufacture or treatment of semiconductor H10P72/50})

## Abstract

A system and method for operating a robotic system to use two or more tools to manipulate objects. The robotic system may coordinate planning processes and/or plan implementations based on grouping the objects.

## Claims

### Claim at position 1

1-20. (canceled)

### Claim 21

A method for operating a robotic system, the method comprising:
obtaining image data representing one or more available objects at a start location;
deriving, based on the image data, a set of plans including at least a first plan and a second plan, wherein:
the first plan is for causing transfer of a target object of the available object(s) from the start location to a target location using a first tool, and
the second plan is for causing transfer of the target object of the available object(s) from the start location to the target location using a second tool;
calculating one or more cost measure for each of the first plan and the second plan, wherein the cost measure includes an estimated manipulation error parameter associated with manipulating the target object utilizing the corresponding first tool or second tool; and
selecting a transfer plan from the first plan and the second plan based on the cost measure, wherein the selected transfer plan corresponds to a lower cost measure.

### Claim 22 (depends on 21)

The method recited in claim 21, wherein the estimated manipulation error parameter is an estimated transfer error parameter associated with transferring the target object utilizing the corresponding first tool or second tool.

### Claim 23 (depends on 22)

The method recited in claim 22, wherein the estimated transfer error parameter includes an estimate of whether the target object will be dropped during transfer.

### Claim 24 (depends on 22)

The method recited in claim 22, wherein the estimated transfer error parameter includes an estimate of the movement speed of the target object and/or corresponding first or second tool during transfer.

### Claim 25 (depends on 24)

The method recited in claim 24, wherein the estimate of the movement speed is based on a gripping confidence parameter corresponding to a grip sufficiency of the target object.

### Claim 26 (depends on 21)

The method recited in claim 21, wherein:
the calculating one or more cost measure step further includes calculating a second cost measure for recovering from a transfer error;
the calculating one or more cost measure step further includes calculating a third cost measure for changing from the first tool to the second tool, or vice versa; and
the selecting the transfer plan step includes selecting the transfer plan that lowers the total combination of the cost measure, second cost measure, and third cost measure.

### Claim 27 (depends on 21)

The method recited in claim 21, wherein:
the calculating one or more cost measure step further includes calculating a second cost measure for changing from the first tool to the second tool, or vice versa; and
the selecting the transfer plan step includes selecting the transfer plan that lower the lowers the total combination of the cost measure and the second cost measure.

### Claim 28 (depends on 22)

The method recited in claim 22, wherein the estimated transfer error parameter includes an estimate of a timing and/or a complexity of movements for transferring the target object.

### Claim 29 (depends on 21)

The method recited in claim 21, wherein the estimated manipulation error is an estimated placement error parameter associated with placing the target object at the target location utilizing the corresponding first tool or second tool.

### Claim 30 (depends on 29)

The method recited in claim 29, wherein the estimated placement error parameter includes an estimate of a release pose of the target object and/or includes an estimate of an orientation of the target object at a time of release.

### Claim 31 (depends on 21)

The method recited in claim 21, wherein:
the calculating one or more cost measure step includes calculating a second cost measure for each of the first plan and the second plan, wherein the second cost measure includes a timing and/or a complexity of movements for achieving a release pose; and
the selected transfer plan corresponds to the lower cost measure of the total of the cost measure and the second cost measure.

### Claim 32 (depends on 21)

The method recited in claim 21, wherein the estimated manipulation error is an estimated grasping error parameter associated with grasping the target object at the start location utilizing the corresponding first tool or second tool.

### Claim 33 (depends on 32)

The method recited in claim 32, wherein the estimated grasping error parameter further includes an estimate of the corresponding first tool or second tool colliding with another object or an environmental object before grasping the target object.

### Claim 34 (depends on 21)

The method recited in claim 21, wherein:
the calculating one or more cost measure step further includes calculating a second cost measure for changing between the first tool and the second tool, or vice versa; and
the selecting the transfer plan step includes selecting the transfer plan that lowers the total combination of the cost measure and the second cost measure.

### Claim 35

A tangible, non-transitory computer-readable medium having processor instructions stored thereon that, when executed by one or more processors, cause the one or more processors to perform a method, the method comprising:
obtaining image data representing one or more available objects at a start location;
deriving, based on the image data, a set of plans including at least a first plan and a second plan, wherein:
the first plan is for causing transfer of a target object of the available object(s) from the start location to a target location using a first tool, and
the second plan is for causing transfer of the target object of the available object(s) from the start location to the target location using a second tool;
calculating one or more cost measure for each of the first plan and the second plan, wherein the cost measure includes an estimated manipulation error parameter associated with manipulating the target object utilizing the corresponding first tool or second tool;
selecting a transfer plan from the first plan and the second plan based on the cost measure, wherein the selected transfer plan corresponds to a lower cost measure.

### Claim 36 (depends on 35)

The tangible, non-transitory computer-readable medium of claim 35, wherein the estimated manipulation error parameter is an estimated transfer error parameter associated with transferring the target object utilizing the corresponding first tool or second tool.

### Claim 37 (depends on 35)

The tangible, non-transitory computer-readable medium of claim 35, wherein the estimated manipulation error is an estimated placement error parameter associated with placing the target object at the target location utilizing the corresponding first tool or second tool.

### Claim 38

A robotic system comprising:
at least one processor coupled to the communication circuit and configured to:
obtain image data representing one or more available objects at a start location;
derive, based on the image data, a set of plans including at least a first plan and a second plan, wherein:
the first plan is for causing transfer of a target object of the available object(s) from the start location to a target location using a first tool, and
the second plan is for causing transfer of the target object of the available object(s) from the start location to the target location using a second tool;
calculate one or more cost measure for each of the first plan and the second plan, wherein the cost measure includes an estimated manipulation error parameter associated with manipulating the target object utilizing the corresponding first tool or second tool;
select a transfer plan from the first plan and the second plan based on the cost measure, wherein the selected transfer plan corresponds to a lower cost measure; and
a communication circuit configured to communicate the selected transfer plan.

### Claim 39 (depends on 38)

The system of claim 38, wherein the estimated manipulation error parameter is an estimated transfer error parameter associated with transferring the target object utilizing the corresponding first tool or second tool.

### Claim 40 (depends on 38)

The system of claim 38, wherein the estimated manipulation error is an estimated placement error parameter associated with placing the target object at the target location utilizing the corresponding first tool or second tool.
