# US 2026/0062028 A1 · Sensor data filtering for machine learning model prompt generation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0062028 A1
- Document ID: US20260062028A1
- Status: Published application
- Kind: A1
- Application number: 19/309,076
- Filed: 2025-08-25
- Published: 2026-03-05
- Earliest claimed: 2024-08-27
- Assignees: Boston Dynamics, Inc.
- Applicants: Boston Dynamics, Inc.
- Inventors: Matthew Jacob Klingensmith; Michael James McDonald; Gordon Finnie, III; Marco da Silva; Amanda Gonano
- Web page: https://patentgrep.com/patent/US20260062028A1

## CPC

- B60W 50/14: Means for informing the driver, warning the driver or prompting a driver intervention
- G05D 1/223: Command input arrangements on the remote controller, e.g. joysticks or touch screens
- G05D 1/43: Control of position or course in two dimensions [2D]
- G06N 3/008: based on physical entities controlled by simulated intelligence so as to replicate intelligent life forms, e.g. based on robots replicating pets or humans in their appearance or behaviour
- G06N 3/0475: Generative networks
- G06V 20/56: exterior to a vehicle by using sensors mounted on the vehicle
- B60W 2050/146: {Display means}
- G05D 2101/15: using machine learning, e.g. neural networks
- G05D 2105/89: {for inspecting structures, e.g. wind mills, bridges, buildings or vehicles}
- G05D 2107/70: Industrial sites, e.g. warehouses or factories
- G05D 2109/12: with legs
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Systems and methods are described for provision of alerts. A system can obtain sensor data associated with an environment. The system can obtain an input indicating one or more filter parameters, one or more requests, and/or one or more alert parameters. For example, the input may indicate a request, a region of the environment, a region of sensor data, etc. The system can filter the sensor data based on the one or more filter parameters to obtain a filtered portion of the sensor data. The system may generate a prompt for a machine learning model that includes the filtered portion of the sensor data, the one or more requests, and the one or more alert parameters. The system can provide the prompt to a computing system. The system can obtain a output from the computing system and can provide an alert based on the output.

## Claims

### Claim 1

A method comprising:
obtaining, by data processing hardware, sensor data associated with traversal of an environment by one or more mobile robots;
obtaining, by the data processing hardware from a first computing system, an input indicating one or more filter parameters;
filtering, by the data processing hardware, the sensor data based on the input to obtain a filtered portion of the sensor data;
generating, by the data processing hardware, a prompt for a machine learning model, wherein the prompt for the machine learning model comprises the filtered portion of the sensor data;
providing, by the data processing hardware to a second computing system, the prompt for the machine learning model; and
providing, by the data processing hardware to the first computing system, an alert based on an output of the second computing system, wherein the output comprises one or more responses to the prompt for the machine learning model.

### Claim 2 (depends on 1)

The method of claim 1, wherein the sensor data comprises panoramic image data.

### Claim 3 (depends on 1)

The method of claim 1, wherein the sensor data is associated with a mission of the one or more mobile robots.

### Claim 4 (depends on 1)

The method of claim 1, wherein obtaining the sensor data comprises:
obtaining the sensor data from a sensor of the one or more mobile robots.

### Claim 5 (depends on 1)

The method of claim 1, wherein obtaining the sensor data comprises:
obtaining a first portion of the sensor data from a first sensor of the one or more mobile robots; and
obtaining a second portion of the sensor data from a second sensor of the one or more mobile robots.

### Claim 6 (depends on 1)

The method of claim 1, wherein the one or more filter parameters indicate a portion of the environment.

### Claim 7 (depends on 1)

The method of claim 1, wherein the one or more filter parameters indicate a point of view associated with the one or more mobile robots.

### Claim 8 (depends on 1)

The method of claim 1, wherein the one or more filter parameters indicate a sensor of the one or more mobile robots.

### Claim 9 (depends on 1)

The method of claim 1, wherein the one or more filter parameters indicate an object within the environment.

### Claim 10 (depends on 1)

The method of claim 1, wherein the one or more filter parameters indicate at least one of a route waypoint associated with the environment, a pose associated with the one or more mobile robots, a position associated with the one or more mobile robots, a time period, or a mission associated with the one or more mobile robots.

### Claim 11 (depends on 1)

The method of claim 1, wherein the prompt for the machine learning model further comprises one or more multiple choice questions or one or more open-ended questions.

### Claim 12 (depends on 1)

The method of claim 1, wherein the output comprises at least one of a flag, a visual sorting, a visual top K, or a ranking.

### Claim 13 (depends on 1)

The method of claim 1, further comprising:
determining that at least one of text associated with the output or a value associated with the output is greater than or matches a threshold, wherein the input comprises one or more alert parameters, wherein the one or more alert parameters indicate the threshold; and
generating the alert based on determining that the at least one of the text or the value is greater than or matches the threshold.

### Claim 14 (depends on 1)

The method of claim 1, wherein the alert indicates at least one of a portion of the environment, an anomalous behavior, a presence of an anomaly condition, or a quantity of an object.

### Claim 15 (depends on 1)

The method of claim 1, wherein the prompt for the machine learning model indicates that the filtered portion of the sensor data is associated with the one or more mobile robots and each of the one or more mobile robots comprises two or more legs.

### Claim 16 (depends on 1)

The method of claim 1, wherein the machine learning model comprises at least one of a visual question answering model or an object detector.

### Claim 17 (depends on 1)

The method of claim 1, wherein the sensor data comprises a plurality of images, wherein filtering the sensor data comprises:
filtering the sensor data to at least one of remove an image from the plurality of images or remove a portion of an image of the plurality of images.

### Claim 18 (depends on 1)

The method of claim 1, further comprising:
instructing performance of one or more actions by the one or more mobile robots based on the output.

### Claim 19 (depends on 1)

The method of claim 1, further comprising:
instructing display of a user interface based on the output, wherein the user interface indicates the alert.

### Claim 20

A system comprising:
data processing hardware; and
memory in communication with the data processing hardware, the memory storing instructions that when executed on the data processing hardware cause the data processing hardware to:
obtain sensor data associated with traversal of an environment by one or more mobile robots;
obtain, from a first computing system, an input indicating one or more filter parameters;
filter the sensor data based on the input to obtain a filtered portion of the sensor data;
generate a prompt for a machine learning model, wherein the prompt for the machine learning model comprises the filtered portion of the sensor data;
provide, to a second computing system, the prompt for the machine learning model; and
provide, to the first computing system, an alert based on an output of the second computing system, wherein the output comprises one or more responses to the prompt for the machine learning model.

### Claim 21 (depends on 20)

The system of claim 20, wherein the one or more filter parameters indicate a mission associated with the one or more mobile robots, wherein the mission is associated with one or more first mission parameters, and wherein the prompt for the machine learning model is associated with one or more second mission parameters.

### Claim 22 (depends on 20)

The system of claim 20, wherein the prompt for the machine learning model further comprises one or more questions requesting a comparison of at least a first image of the filtered portion of the sensor data to a second image of the filtered portion of the sensor data.

### Claim 23

A mobile robot comprising:
data processing hardware; and
memory in communication with the data processing hardware, the memory storing instructions that when executed on the data processing hardware cause the data processing hardware to:
obtain sensor data associated with traversal of an environment by one or more mobile robots;
obtain, from a first computing system, an input indicating one or more filter parameters;
filter the sensor data based on the input to obtain a filtered portion of the sensor data;
generate a prompt for a machine learning model, wherein the prompt for the machine learning model comprises the filtered portion of the sensor data;
provide, to a second computing system, the prompt for the machine learning model; and
provide, to the first computing system, an alert based on an output of the second computing system, wherein the output comprises one or more responses to the prompt for the machine learning model.

### Claim 24 (depends on 23)

The mobile robot of claim 23, wherein the prompt for the machine learning model further comprises one or more questions requesting a comparison of at least a first image of the filtered portion of the sensor data to a second image of the filtered portion of the sensor data, and wherein the output comprises a visual sorting of the first image and the second image.

### Claim 25 (depends on 23)

The mobile robot of claim 23, wherein to filter the sensor data, execution of the instructions on the data processing hardware further causes the data processing hardware to:
filter the sensor data to remove a portion of the sensor data.
