# US 2021/0174545 A1 · System and method for trailer pose estimation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0174545 A1
- Document ID: US20210174545A1
- Status: Published application
- Kind: A1
- Application number: 16/707,461
- Filed: 2019-12-09
- Published: 2021-06-10
- Earliest claimed: 2019-12-09
- Assignees: PlusAI, Inc.
- Applicants: Plusai Corp
- Inventors: Ankur Agarwal
- Web page: https://patentgrep.com/patent/US20210174545A1

## CPC

- G06T 7/80: Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
- G06T 7/73: using feature-based methods
- G08G 1/167: {Driving aids for lane monitoring, lane changing, e.g. blind spot detection}
- G06T 2207/10016: Video; Image sequence
- G06T 2207/30236: Traffic on road, railway or crossing
- G06T 2207/30252: Vehicle exterior; Vicinity of vehicle
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93})

## Abstract

The present teaching relates to method, system, medium, and implementations for trailer pose estimation. At least a dimension of a trailer connected to a vehicle is obtained where the vehicle and the trailer have respective opposing surfaces facing one another. A first set of feature points is identified from a first image of a target present on one the opposing surfaces acquired at a first time instant by a sensor deployed on the other the opposing surfaces. A second set of corresponding feature points is identified from a second image of the target acquired at a subsequent time instant by the sensor. Based on the first and second sets of feature points, a first transformation is determined and used to compute a second transformation that the trailer undergoes from the first to the second time instants. A pose of the trailer at the second time instant is estimated based on the second transformation and the dimension.

## Claims

### Claim 1

A method implemented on at least one machine including at least one processor, memory, and communication platform capable of connecting to a network for pose estimation, the method comprising:
obtaining at least a dimension of a trailer connected to a vehicle, wherein the vehicle and the trailer have respective opposing surfaces facing one another;
identifying a first set of feature points from a first image of a target present on a first of the opposing surfaces acquired at a first time instant by a sensor deployed on a second of the opposing surfaces;
identifying a second set of feature points from a second image of the target acquired at a second time instant by the sensor, wherein each of the second set of feature points corresponds to one of the first set of feature points;
determining, based on the first and second sets of feature points, a first transformation;
computing a second transformation that the trailer undergoes from the first to the second time instants in accordance with the first transformation; and
estimating, for autonomous driving of the vehicle, a pose of the trailer at the second time instant based on the second transformation and the dimension.

### Claim 2 (depends on 1)

The method of claim 1, wherein
the first of the opposing surfaces is the rear surface of the vehicle; and
the second of the opposing surfaces is the front surface of the trailer.

### Claim 3 (depends on 1)

The method of claim 1, wherein
the first of the opposing surfaces is the front surface of the trailer; and
the second of the opposing surfaces is the rear surface of the vehicle.

### Claim 4 (depends on 1)

The method of claim 1, wherein the pose of the trailer is represented by one or more coordinates of corresponding one or more points located on the trailer.

### Claim 5 (depends on 1)

The method of claim 1, wherein the target corresponds to one of
a fiducial marker placed on one of the opposing surfaces; and
a region in one of the opposing surfaces with identifiable visual features.

### Claim 6 (depends on 1)

The method of claim 1, wherein the first time instant corresponds to one of:
an initialization time instant where the vehicle and the trailer are aligned in a straight line; and
any time instant prior to the second time instant so that the estimated pose for the second time instant represents a change in trailer's pose as compared to that at the first time instant.

### Claim 7 (depends on 1)

The method of claim 1, wherein the pose of the trailer is estimated based on planar homography.

### Claim 8

Machine readable and non-transitory medium having information recorded thereon for pose estimation, wherein the information, when read by the machine, causes the machine to perform:
obtaining at least a dimension of a trailer connected to a vehicle, wherein the vehicle and the trailer have respective opposing surfaces facing one another;
identifying a first set of feature points from a first image of a target present on a first of the opposing surfaces acquired at a first time instant by a sensor deployed on a second of the opposing surfaces;
identifying a second set of feature points from a second image of the target acquired at a second time instant by the sensor, wherein each of the second set of feature points corresponds to one of the first set of feature points;
determining, based on the first and second sets of feature points, a first transformation;
computing a second transformation that the trailer undergoes from the first to the second time instants in accordance with the first transformation; and
estimating, for autonomous driving of the vehicle, a pose of the trailer at the second time instant based on the second transformation and the dimension.

### Claim 9 (depends on 8)

The medium of claim 8, wherein
the first of the opposing surfaces is the rear surface of the vehicle; and
the second of the opposing surfaces is the front surface of the trailer.

### Claim 10 (depends on 8)

The medium of claim 8, wherein
the first of the opposing surfaces is the front surface of the trailer; and
the second of the opposing surfaces is the rear surface of the vehicle.

### Claim 11 (depends on 8)

The medium of claim 8, wherein the pose of the trailer is represented by one or more coordinates of corresponding one or more points located on the trailer.

### Claim 12 (depends on 8)

The medium of claim 8, wherein the target corresponds to one of
a fiducial marker placed on one of the opposing surfaces; and
a region in one of the opposing surfaces with identifiable visual features.

### Claim 13 (depends on 8)

The medium of claim 8, wherein the first time instant corresponds to one of:
an initialization time instant where the vehicle and the trailer are aligned in a straight line; and
any time instant prior to the second time instant so that the estimated pose for the second time instant represents a change in trailer's pose as compared to that at the first time instant.

### Claim 14 (depends on 8)

The medium of claim 8, wherein the pose of the trailer is estimated based on planar homography.

### Claim 15

A system for pose estimation, comprising:
a configuration unit configured for obtaining at least a dimension of a trailer connected to a vehicle, wherein the vehicle and the trailer have respective opposing surfaces facing one another;
a target image feature extractor configured for:
identifying a first set of feature points from a first image of a target present on a first of the opposing surfaces acquired at a first time instant by a sensor deployed on a second of the opposing surfaces, and
identifying a second set of feature points from a second image of the target acquired at a second time instant by the sensor, wherein each of the second set of feature points corresponds to one of the first set of feature points;
a transformation generation unit configured for determining, based on the first and second sets of feature points, a first transformation; and
a trailer pose estimator configured for:
computing a second transformation that the trailer undergoes from the first to the second time instants in accordance with the first transformation, and
estimating, for autonomous driving of the vehicle, a pose of the trailer at the second time instant based on the second transformation and the dimension.

### Claim 16 (depends on 15)

The system of claim 15, wherein
the first of the opposing surfaces is the rear surface of the vehicle; and
the second of the opposing surfaces is the front surface of the trailer.

### Claim 17 (depends on 15)

The system of claim 15, wherein
the first of the opposing surfaces is the front surface of the trailer; and
the second of the opposing surfaces is the rear surface of the vehicle.

### Claim 18 (depends on 15)

The system of claim 15, wherein the pose of the trailer is represented by one or more coordinates of corresponding one or more points located on the trailer.

### Claim 19 (depends on 15)

The system of claim 15, wherein the target corresponds to one of
a fiducial marker placed on one of the opposing surfaces; and
a region in one of the opposing surfaces with identifiable visual features.

### Claim 20 (depends on 15)

The system of claim 15, wherein the first time instant corresponds to one of:
an initialization time instant where the vehicle and the trailer are aligned in a straight line; and
any time instant prior to the second time instant so that the estimated pose for the second time instant represents a change in trailer's pose as compared to that at the first time instant.

### Claim 21 (depends on 15)

The system of claim 15, wherein the pose of the trailer is estimated based on planar homography.
