# US 2024/0174310 A1 · Stair Tracking for Modeled and Perceived Terrain

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0174310 A1
- Document ID: US20240174310A1
- Status: Published application
- Kind: A1
- Application number: 18/431,841
- Filed: 2024-02-02
- Published: 2024-05-30
- Earliest claimed: 2020-04-22
- Assignees: Boston Dynamics, Inc.
- Applicants: Boston Dynamics, Inc.
- Inventors: Eric Cary Whitman
- Web page: https://patentgrep.com/patent/US20240174310A1

## CPC

- B62D 57/024: specially adapted for moving on inclined or vertical surfaces (endless-track vehicles for ascending or descending stairs B62D55/075; hand-carts with provision for travelling up or down stairs B62B5/02)
- B62D 57/032: with alternately or sequentially lifted supporting base and legs; with alternately or sequentially lifted feet or skid (B62D57/024 takes precedence)
- G05D 1/2435: {Extracting 3D information}
- G05D 1/246: using environment maps, e.g. simultaneous localisation and mapping [SLAM]
- G05D 1/2465: {using a 3D model of the environment}
- G05D 1/435: resulting in a change of level, e.g. negotiating lifts or stairs
- G05D 1/617: Safety or protection, e.g. defining protection zones around obstacles or avoiding hazards (arrangements for controlling the position or course of two or more vehicles for avoiding collisions therebetween G05D1/693; arrangements for reacting to or preventing system or operator failure G05D1/80)
- G05D 1/628: following the obstacle profile, e.g. a wall or undulated terrain
- G05D 2109/12: with legs
- G05D 2111/10: Optical signals
- G05D 2111/64: {taken simultaneously from spaced apart sensors, e.g. stereovision}
- B62D: MOTOR VEHICLES; TRAILERS (steering, or guiding on a desired track, of agricultural machines or implements A01B69/00; wheels, castors, axles, increasing wheel adhesion B60B; vehicle tyres, tyre inflation or tyre changing B60C; connections between vehicles of a train or the like B60D; vehicles for use on rail and road, amphibious or convertible vehicles B60F; suspension arrangements B60G; heating, cooling, ventilating or other air treating devices B60H; windows, windscreens, non-fixed roofs, doors or similar devices, protective coverings for vehicles not in use B60J; propulsion plant arrangements, auxiliary drives, transmissions, controls, instrumentation or dashboards B60K; electric equipment or propulsion of electrically-propelled vehicles B60L; power supply for electrically-propelled vehicles B60M; passenger accommodation not otherwise provided for B60N; adaptations for load transportation or to carry special loads or objects B60P; arrangement of signalling or lighting devices, the mounting or supporting thereof or circuits therefor, for vehicles in general B60Q; vehicles, vehicle fittings or vehicle parts not otherwise provided for B60R; servicing, cleaning, repairing, supporting, lifting, or manoeuvring, not otherwise provided for, B60S; brake arrangements, brake control systems or parts thereof B60T; air-cushion vehicles B60V; motor-cycles, accessories therefor B62J, B62K; testing of vehicles G01M)
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES

## Abstract

A method for a stair tracking for modeled and perceived terrain includes receiving, at data processing hardware, sensor data about an environment of a robot. The method also includes generating, by the data processing hardware, a set of maps based on voxels corresponding to the received sensor data. The set of maps includes a ground height map and a map of movement limitations for the robot. The map of movement limitations identifies illegal regions within the environment that the robot should avoid entering. The method further includes generating a stair model for a set of stairs within the environment based on the sensor data, merging the stair model and the map of movement limitations to generate an enhanced stair map, and controlling the robot based on the enhanced stair map or the ground height map to traverse the environment.

## Claims

### Claim 1

A method comprising:
receiving, at data processing hardware, sensor data of an environment of a robot;
generating, by the data processing hardware, a map of at least one of an obstacle or a no-step region within the environment based on the sensor data;
generating, by the data processing hardware, a stair model of at least one stair within the environment based on the sensor data, wherein the stair model is separate from the map; and
instructing, by the data processing hardware, the robot to traverse a first portion of the environment based on the map and a second portion of the environment based on the stair model.

### Claim 2 (depends on 1)

The method of claim 1, wherein generating the map comprises:
generating the map using a first system of the robot,
wherein generating the stair model comprises:
generating the stair model using a second system of the robot.

### Claim 3 (depends on 1)

The method of claim 1, wherein generating the map comprises:
generating the map using a first model of the robot,
wherein generating the stair model comprises:
generating the stair model using a second model of the robot.

### Claim 4 (depends on 1)

The method of claim 1, wherein the map and the stair model indicate different obstacles or different no-step regions.

### Claim 5 (depends on 1)

The method of claim 1, wherein a portion of the stair model corresponding to a portion of the environment is different as compared to a portion of the map corresponding to the portion of the environment.

### Claim 6 (depends on 1)

The method of claim 1, wherein instructing the robot to traverse the second portion of the environment comprises:
instructing the robot to traverse the at least one stair based on the stair model, wherein the robot is capable of traversing the at least one stair separately using the map and the stair model.

### Claim 7 (depends on 1)

The method of claim 1, wherein instructing the robot to traverse the first portion of the environment is further based on deactivation of a stair mode, wherein instructing the robot to traverse the second portion of the environment is further based on activation of the stair mode.

### Claim 8 (depends on 1)

The method of claim 1, further comprising:
based on data associated with the robot, identifying the first portion of the environment for traversal based on the map and the second portion of the environment for traversal based on the stair model.

### Claim 9 (depends on 1)

The method of claim 1, wherein instructing the robot to traverse the first portion of the environment based on the map comprises instructing the robot to traverse the first portion of the environment according to a first manner of obstacle avoidance, and wherein instructing the robot to traverse the second portion of the environment based on the stair model comprises instructing the robot to traverse the second portion of the environment according to a second manner of obstacle avoidance.

### Claim 10 (depends on 1)

The method of claim 1, further comprising:
adjusting the stair model based on additional sensor data, wherein the sensor data and the additional sensor data indicate different features within the environment,
wherein instructing the robot to traverse the second portion of the environment based on the stair model comprises instructing the robot to traverse the second portion of the environment based on the adjusted stair model.

### Claim 11 (depends on 1)

The method of claim 1, further comprising:
adjusting the stair model based on the map,
wherein instructing the robot to traverse the second portion of the environment based on the stair model comprises instructing the robot to traverse the second portion of the environment based on the adjusted stair model.

### Claim 12 (depends on 1)

The method of claim 1, further comprising:
merging the stair model and the map to generate a merged map,
wherein instructing the robot to traverse the second portion of the environment based on the stair model comprises instructing the robot to traverse the second portion of the environment based on the merged map.

### Claim 13 (depends on 1)

The method of claim 1, wherein the map identifies the obstacle, wherein the obstacle comprises a wall of the at least one stair.

### Claim 14 (depends on 1)

The method of claim 1, wherein the map identifies the obstacle, wherein the obstacle comprises an obstacle on the at least one stair.

### Claim 15 (depends on 1)

The method of claim 1, wherein the map identifies the obstacle, wherein the obstacle comprises an object.

### Claim 16 (depends on 1)

The method of claim 1, wherein the map identifies the no-step region, wherein the no-step region comprises an area of the environment.

### Claim 17 (depends on 1)

The method of claim 1, wherein the map identifies the no-step region, wherein the no-step region comprises an edge of the at least one stair.

### Claim 18 (depends on 1)

The method of claim 1, wherein generating the stair model comprises:
generating a first stair model of the at least one stair corresponding to ascent of the at least one stair; and
generating a second stair model of the at least one stair corresponding to descent of the at least one stair, wherein the stair model comprises the first stair model or the second stair model.

### Claim 19

A robot comprising:
a body;
two or more legs coupled to the body and configured to traverse an environment; and
a control system comprising data processing hardware and memory hardware in communication with the data processing hardware, the memory hardware storing instructions, wherein execution of the instructions by the data processing hardware causes the data processing hardware to:
receive sensor data of the environment;
generate a map of at least one of an obstacle or a no-step region within the environment based on the sensor data;
generate a stair model of at least one stair within the environment based on the sensor data, wherein the stair model is separate from the map; and
instruct the robot to traverse a first portion of the environment based on the map and a second portion of the environment based on the stair model.

### Claim 20

A computing system comprising:
data processing hardware; and
memory hardware in communication with the data processing hardware, the memory hardware storing instructions, wherein execution of the instructions by the data processing hardware causes the data processing hardware to:
receive sensor data of an environment of a robot;
generate a map of at least one of an obstacle or a no-step region within the environment based on the sensor data;
generate a stair model of at least one stair within the environment based on the sensor data, wherein the stair model is separate from the map; and
instruct the robot to traverse a first portion of the environment based on the map and a second portion of the environment based on the stair model.
