# US 2020/0349300 A1 · Systems And Methods For Determining Digital Model Positioning For Grasping

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0349300 A1
- Document ID: US20200349300A1
- Status: Published application
- Kind: A1
- Application number: 16/864,590
- Filed: 2020-05-01
- Published: 2020-11-05
- Earliest claimed: 2019-05-02
- Assignees: Dassault Systemes Americas Corp.
- Applicants: Dassault Systemes Americas Corp.
- Inventors: Pierre-Olivier Lemieux; Quentin Bourret; Rachid Aissaoui; Nicola Hagemeister
- Web page: https://patentgrep.com/patent/US20200349300A1

## CPC

- G06F 30/12: characterised by design entry means specially adapted for CAD, e.g. graphical user interfaces [GUI] specially adapted for CAD
- G06F 30/10: Geometric CAD
- G06V 10/22: by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
- G06V 10/44: Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
- G06V 20/653: {by matching three-dimensional models, e.g. conformal mapping of Riemann surfaces}
- G05B 2219/39543: Recognize object and plan hand shapes in grasping movements
- G06F 2111/04: Constraint-based CAD
- G06V 2201/06: Recognition of objects for industrial automation
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G)

## Abstract

Embodiments determine positioning of a mannequin. One such embodiment begins by determining a frame of a grasping element of a mannequin represented by a computer-aided design (CAD) model and determining a frame of an object to be grasped, where is object is also represented by a CAD model. To continue, degrees of freedom of the mannequin are specified and limits on the specified degrees of freedom are set. In turn, using an inverse kinematic solver, positioning of the mannequin grasping the object is determined based upon: (i) the determined frame of the grasping element, (ii) the determined frame of the object, (iii) the specified degrees of freedom, and (iv) the set limits on the specified degrees of freedom.

## Claims

### Claim 1

A computer implemented method of determining positioning of a mannequin, the method comprising:
determining a frame of a grasping element of a mannequin represented by a computer-aided design (CAD) model;
determining a frame of an object to be grasped, wherein the object is represented by a CAD model;
specifying degrees of freedom of the mannequin;
setting limits on the specified degrees of freedom; and
using an inverse kinematic solver, determining positioning of the mannequin grasping the object based upon: (i) the determined frame of the grasping element, (ii) the determined frame of the object, (iii) the specified degrees of freedom, and (iv) the set limits on the specified degrees of freedom.

### Claim 2 (depends on 1)

The method of claim 1 wherein the CAD model of the mannequin represents at least one of: a human, an animal, and a robot.

### Claim 3 (depends on 1)

The method of claim 1 wherein the CAD model of the object represents a real world tool.

### Claim 4 (depends on 1)

The method of claim 1 wherein determining the frame of the grasping element comprises:
defining a frame at a center of prehension of the grasping element;
relative to the defined frame, offsetting a virtual segment; and
providing the frame of the grasping element at an end of the virtual segment as offset.

### Claim 5 (depends on 4)

The method of claim 4 wherein a length of the offset is a function of a radius of a cylinder approximating a handle of the object.

### Claim 6 (depends on 1)

The method of claim 1 wherein determining the frame of the object comprises:
receiving indications of physical features of the object that indicate functionality of elements of the object; and
determining the frame of the object based upon the received indications.

### Claim 7 (depends on 1)

The method of claim 1 wherein the specified degrees of freedom include as least one of:
rotation of the grasping element about an axis of the frame of the object;
translation of the grasping element about an axis of the frame of the object;
a constraint on the inverse kinematic solver that an axis of the frame of the grasping element and an axis of the frame of the object coincide;
a constraint on the inverse kinematic solver of a neutral posture for the mannequin;
a frame constraint on the inverse kinematic solver;
a hinge constraint on the inverse kinematic solver;
a cylindrical constraint on the inverse kinematic solver; and
a flexible cylindrical constraint on the inverse kinematic solver.

### Claim 8 (depends on 1)

The method of claim 1 furthering comprising:
receiving an indication of relative importance for at least one of the degrees of freedom.

### Claim 9 (depends on 8)

The method of claim 8 wherein the inverse kinematic solver is further configured to determine the positioning of the mannequin based upon the received indication of relative importance for the at least one degree of freedom.

### Claim 10 (depends on 9)

The method of claim 9 wherein the inverse kinematic solver is further configured to determine the positioning of the mannequin by optimizing posture of the mannequin that is defined by an objective function representing the degrees of freedom with the received indication of relative importance.

### Claim 11 (depends on 1)

The method of claim 1 wherein the determined positioning of the mannequin indicates position of the grasping element of the mannequin.

### Claim 12 (depends on 1)

The method of claim 1 wherein the determined positioning of the mannequin indicates global positioning of the mannequin in three-dimensional (3D) space and positioning of the grasping element of the mannequin in 3D space.

### Claim 13 (depends on 1)

The method of claim 1 wherein the degrees of freedom are applied to at least one of:
the grasping element of the mannequin; and
a joint of the mannequin.

### Claim 14 (depends on 1)

The method of claim 1 wherein the inverse kinematic solver is configured to determine the positioning of the mannequin by minimizing deviation of the mannequin from a neutral posture.

### Claim 15 (depends on 1)

The method of claim 1 further comprising:
based on the determined positioning, determining closure of the grasping element around the object using a linear interpolation.

### Claim 16 (depends on 1)

The method of claim 1 further comprising:
associating, in computer memory, the determined positioning of the mannequin with the CAD model of the mannequin.

### Claim 17 (depends on 16)

The method of claim 16 further comprising:
simulating real-world use of the object using the CAD model of the mannequin with the associated determined positioning.

### Claim 18

A system for determining positioning of a mannequin, the system comprising:
a processor; and
a memory with computer code instructions stored thereon, the processor and the memory, with the computer code instructions being configured to cause the system to:
determine a frame of a grasping element of a mannequin represented by a computer-aided design (CAD) model;
determine a frame of an object to be grasped, wherein the object is represented by a CAD model;
specify degrees of freedom of the mannequin;
set limits on the specified degrees of freedom; and
using an inverse kinematic solver, determine positioning of the mannequin grasping the object based upon: (i) the determined frame of the grasping element, (ii) the determined frame of the object, (iii) the specified degrees of freedom, and (iv) the set limits on the specified degrees of freedom.

### Claim 19 (depends on 18)

The system of claim 18 wherein, in determining the frame of the grasping element, the processor and the memory, with the computer code instructions, are further configured to cause the system to:
define a frame at a center of prehension of the grasping element;
relative to the defined frame, offset a virtual segment; and
provide the frame of the grasping element at an end of the virtual segment as offset.

### Claim 20

A non-transitory computer program product for determining positioning of a mannequin, the computer program product executed by a server in communication across a network with one or more clients and comprising:
a computer readable medium, the computer readable medium comprising program instructions which, when executed by a processor, causes the processor to:
determine a frame of a grasping element of a mannequin represented by a computer-aided design (CAD) model;
determine a frame of an object to be grasped, wherein the object is represented by a CAD model;
specify degrees of freedom of the mannequin;
set limits on the specified degrees of freedom; and
using an inverse kinematic solver, determine positioning of the mannequin grasping the object based upon: (i) the determined frame of the grasping element, (ii) the determined frame of the object, (iii) the specified degrees of freedom, and (iv) the set limits on the specified degrees of freedom.
