# US 2019/0376860 A1 · Visuo-haptic sensor

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0376860 A1
- Document ID: US20190376860A1
- Status: Published application
- Kind: A1
- Application number: 16/550,519
- Filed: 2019-08-26
- Published: 2019-12-12
- Earliest claimed: 2016-05-13
- Applicants: Visevi Robotics GmbH
- Inventors: Nicolas Alt; Eckehard Steinbach; Martin Freundl
- Web page: https://patentgrep.com/patent/US20190376860A1

## CPC

- G01L 5/226: {to manipulators, e.g. the force due to gripping}
- G01L 1/24: by measuring variations of optical properties of material when it is stressed, e.g. by photoelastic stress analysis {using infrared, visible light, ultraviolet}
- G01L 3/08: involving optical means for indicating
- G01L 3/1421: {using optical transducers}
- G01L 5/16: for measuring several components of force
- G06T 7/248: {involving reference images or patches}
- G06T 7/74: {involving reference images or patches}
- G06T 2207/10016: Video; Image sequence
- G06T 2207/30164: Workpiece; Machine component
- G01L: MEASURING FORCE, STRESS, TORQUE, WORK, MECHANICAL POWER, MECHANICAL EFFICIENCY, OR FLUID PRESSURE (weighing G01G)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

The present disclosure presents a visuo-haptic sensor, which is based on a passive, deformable element whose deformation is observed by a camera. In particular, the improved simplified sensor may determine the force and/or torque applied to a point of the sensor in multiple spatial dimensions.

## Claims

### Claim 1

An apparatus, comprising:
a haptic element comprising at least one passive elastically deformable element deformable in multiple dimensions;
at least one camera external to the haptic element and operable to capture images of the elastically deformable element; and
a processor operable to
determine a change of pose of the elastically deformable element by visual tracking and
determine a measurement of force and torque applied to the elastically deformable element based on the captured images and the determined change of pose, wherein the measurement includes at least three components comprising forces and/or torques.

### Claim 2 (depends on 1)

The apparatus of claim 1 wherein the measurement comprises a 6-axis force and/or torque vector comprising forces along all three spatial dimensions and torques along all three spatial dimensions.

### Claim 3 (depends on 1)

The apparatus of claim 1,
wherein the haptic element further comprises a rigid base element and a rigid front element coupled via the elastically deformable element; and
wherein the processor is further operable to determine the change of pose of the rigid front element with respect to the base element.

### Claim 4 (depends on 3)

The apparatus of claim 3, wherein the deformable element comprises a beam and/or a tool which is mounted to the front element.

### Claim 5 (depends on 3)

The apparatus of claim 3, wherein the rigid base element and rigid front element comprise planar structures.

### Claim 6 (depends on 1)

The apparatus of claim 1, wherein the change of pose is determined by observing at least two points on the haptic element.

### Claim 7 (depends on 1)

The apparatus of claim 1, wherein the change of pose is determined by observing three or more points on the haptic element.

### Claim 8 (depends on 1)

The apparatus of claim 1, further comprising a visual tracker to determine the change of pose.

### Claim 9 (depends on 1)

The apparatus of claim 1, wherein the haptic element is mechanically attached to a movable robotic element and the movable robotic element is arranged in a field of view of the camera.

### Claim 10

A method, comprising:
providing a haptic element comprising at least one passive elastically deformable element deformable in multiple dimensions;
capturing images of the elastically deformable element with at least one camera;
determining a change of pose of the elastically deformable element by visual tracking; and
determining a measurement of force applied to the elastically deformable element based on the captured images and the determined change of pose, wherein the measurement of force includes at least three dimensions including both force and torque components.

### Claim 11 (depends on 10)

The method of claim 10, wherein the measurement comprises a 6-axis force and/or torque vector comprising forces along all three spatial dimensions and torques along all three spatial dimensions.

### Claim 12 (depends on 10)

The method of claim 10, wherein the step of determining the change of pose comprises observing at least two points on the haptic element.

### Claim 13 (depends on 10)

The method of claim 10, wherein the step of determining the change of pose comprises observing three or more points on the haptic element.
