# US 2026/0086569 A1 · Optimizing robot devices using fused 6-degrees-of-freedom context

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0086569 A1
- Document ID: US20260086569A1
- Status: Published application
- Kind: A1
- Application number: 18/893,772
- Filed: 2024-09-23
- Published: 2026-03-26
- Earliest claimed: 2024-09-23
- Assignees: QUALCOMM Incorporated
- Applicants: QUALCOMM Incorporated
- Inventors: Nisarg Keyurbhai TRIVEDI; Diyan TENG; Junsheng HAN; Danlu ZHANG
- Web page: https://patentgrep.com/patent/US20260086569A1

## CPC

- G05D 1/249: from positioning sensors located off-board the vehicle, e.g. from cameras
- G05D 1/646: Following a predefined trajectory, e.g. a line marked on the floor or a flight path
- A47L 11/4011: {Regulation of the cleaning machine by electric means; Control systems and remote control systems therefor}
- G05D 1/246: using environment maps, e.g. simultaneous localisation and mapping [SLAM]
- G05D 1/2465: {using a 3D model of the environment}
- G05D 1/6486: {by taking into account surface condition, e.g. soiled}
- G06V 20/56: exterior to a vehicle by using sensors mounted on the vehicle
- A47L 2201/04: Automatic control of the travelling movement; Automatic obstacle detection
- A47L 2201/06: Control of the cleaning action for autonomous devices; Automatic detection of the surface condition before, during or after cleaning
- G05D 2105/10: for cleaning, vacuuming or polishing
- G05D 2107/40: Indoor domestic environment
- G05D 2109/10: Land vehicles
- G05D 2111/10: Optical signals
- G05D 2111/52: {generated by inertial navigation means, e.g. gyroscopes or accelerometers}
- G06V 10/462: {Salient features, e.g. scale invariant feature transforms [SIFT]}
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- A47L: DOMESTIC WASHING OR CLEANING (brushes A46B; cleaning quantities of bottles or of other hollow articles of one kind B08B9/00; laundry D06F); SUCTION CLEANERS IN GENERAL (cleaning in general B08)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Techniques and systems are provided for image generation. For instance, a process can include obtaining remote sensing information from a user device, wherein the remote sensing information comprises at least one of 6-degrees-of-freedom (6DOF) trajectory information or presence information; obtaining an environment map from the robot device; reorienting the remote sensing information based on a determined offset and rotation for the remote sensing information; applying the offset and rotation to the remote sensing information to identify portions of the environment map that include detected objects; determining candidate areas for movement of the robot device based on the portions of the environment map that include the detected objects; and outputting the candidate areas for movement of the robot device for transmission to the robot device.

## Claims

### Claim 1

An apparatus for controlling a robot device, the apparatus comprising:
at least one memory; and
at least one processor coupled to the at least one memory, the at least one processor being configured to:
obtain remote sensing information from a user device, wherein the remote sensing information comprises at least one of 6-degrees-of-freedom (6DOF) trajectory information or presence information;
obtain an environment map from the robot device;
reorient the remote sensing information based on a determined offset and rotation for the remote sensing information;
apply the offset and rotation to the remote sensing information to identify portions of the environment map that include detected objects;
determine candidate areas for movement of the robot device based on the portions of the environment map that include the detected objects; and
output the candidate areas for movement of the robot device for transmission to the robot device.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the remote sensing information comprises activity information indicating an activity performed in an associated location, and wherein the at least one processor is configured to determine a label for the environment map at least based on the activity information.

### Claim 3 (depends on 2)

The apparatus of claim 2, wherein the at least one processor is configured to:
determine a cleaning setting of the robot device based on the label; and
output the cleaning setting of the robot device for transmission to the robot device.

### Claim 4 (depends on 2)

The apparatus of claim 2, wherein the candidate areas for movement of the robot device are determined based on at least one of the label for the environment map or the activity information.

### Claim 5 (depends on 1)

The apparatus of claim 1, wherein the environment map includes one or more landmarks, and wherein the at least one processor is configured to determine the offset and rotation based on the one or more landmarks.

### Claim 6 (depends on 5)

The apparatus of claim 5, wherein the one or more landmarks include at least one non-visible landmark.

### Claim 7 (depends on 5)

The apparatus of claim 5, wherein the environment map comprises simultaneous localization and mapping (SLAM) map information of the robot device, and wherein the at least one processor is configured to:
determine the offset and rotation by matching the SLAM map information of the robot device to an environment map of the apparatus based on the one or more landmarks; and
apply the offset and rotation to the remote sensing information.

### Claim 8 (depends on 1)

The apparatus of claim 1, wherein the detected objects comprise at least one of people or animals.

### Claim 9 (depends on 1)

The apparatus of claim 1, wherein the remote sensing information includes presence information, and wherein the at least one processor is configured to output a user prompt to confirm the offset and rotation to the presence information.

### Claim 10 (depends on 1)

The apparatus of claim 1, wherein the remote sensing information includes presence information, wherein the presence information includes one of a heatmap or crowd density map.

### Claim 11 (depends on 1)

The apparatus of claim 1, wherein the at least one processor is configured to:
receive cleaning scores indicating detected contaminants on a surface for portions of the candidate areas; and
update the candidate areas based on the cleaning scores.

### Claim 12

An apparatus for controlling a robot device, comprising:
at least one memory; and
at least one processor coupled to the at least one memory, the at least one processor being configured to:
receive a set of candidate areas from a controller, wherein the set of candidate areas were selected based on at least one of 6-degrees-of-freedom (6DOF) trajectory information or presence information;
receive a schedule for cleaning, wherein the schedule for cleaning is determined based on presence information;
select a cleaning tool or cleaning supplies of the robot device based on the schedule for cleaning and the set of candidate areas; and
clean a portion of the set of candidate areas using the selected cleaning tool or cleaning supplies.

### Claim 13 (depends on 12)

The apparatus of claim 12, wherein the at least one processor is configured to:
detect one or more landmarks of an environment around the robot device;
generate an environment map based on the detected one or more landmarks; and
transmit the environment map to the controller.

### Claim 14 (depends on 12)

The apparatus of claim 12, further comprising:
receive remote sensing information from the controller, wherein the remote sensing information comprises a simultaneous localization and mapping (SLAM) map rotated and offset based on one or more landmarks of an environment map of the robot device;
detect one or more features of an environment from the SLAM map; and
update the environment map based on the detected one or more features of the environment from the SLAM map.

### Claim 15 (depends on 12)

The apparatus of claim 12, further comprising:
receive cleaning settings from the controller, and
select the cleaning tool or the cleaning supplies of the robot device based on the cleaning settings.

### Claim 16 (depends on 12)

The apparatus of claim 12, wherein the set of candidate areas includes a heatmap or crowd density map.

### Claim 17 (depends on 12)

The apparatus of claim 12, wherein the at least one processor is configured to:
track a path of the robot device based on an environment map and information from an inertial measurement unit (IMU);
determine a coverage score, the coverage score indicating a confidence that the path of the robot device covered a portion of the set of candidate areas; and
transmit the coverage score for the portion of the set of candidate areas to the controller.

### Claim 18 (depends on 17)

The apparatus of claim 17, wherein the at least one processor is configured to receive an updated set of candidate areas from the controller, wherein the set of candidate areas are updated based on the coverage score for the portion of the set of candidate areas.

### Claim 19 (depends on 12)

The apparatus of claim 12, wherein the at least one processor is configured to:
obtain images of an environment, the images including a surface in the environment;
determine a cleaning score by detecting contaminants on the surface in the images; and
transmit the cleaning score for the portion of the set of candidate areas to the controller.

### Claim 20 (depends on 19)

The apparatus of claim 19, wherein the at least one processor is configured to receive an updated set of candidate areas from the controller, wherein the set of candidate areas are updated based on the cleaning score for the portion of the set of candidate areas.

### Claim 21 (depends on 12)

The apparatus of claim 12, wherein the at least one processor is configured to:
track an amount of contaminants being picked up; and
adjust the schedule for cleaning based on the set of candidate areas and the tracked amount of contaminants being picked up in the candidate areas of the set of candidate areas.

### Claim 22 (depends on 12)

The apparatus of claim 12, wherein the at least one processor is configured to:
determine an amount of time spent cleaning the set of candidate areas;
determine a size of the set of candidate areas;
determine an overall cleaning task score based on the amount of time spent cleaning the set of candidate areas and the size of the set of candidate areas; and
output the overall cleaning task score.

### Claim 23 (depends on 12)

The apparatus of claim 12, wherein the set of candidate areas have been rotated and offset based on one or more landmarks of an environment map of the robot device.

### Claim 24

A method for controlling a robot device, the method comprising:
obtaining remote sensing information from a user device, wherein the remote sensing information comprises at least one of 6-degrees-of-freedom (6DOF) trajectory information or presence information;
obtaining an environment map from the robot device;
reorienting the remote sensing information based on a determined offset and rotation for the remote sensing information;
applying the offset and rotation to the remote sensing information to identify portions of the environment map that include detected objects;
determining candidate areas for movement of the robot device based on the portions of the environment map that include the detected objects; and
outputting the candidate areas for movement of the robot device for transmission to the robot device.

### Claim 25 (depends on 24)

The method of claim 24, wherein the remote sensing information comprises activity information indicating an activity performed in an associated location, and further comprising determining a label for the environment map at least based on the activity information.

### Claim 26 (depends on 25)

The method of claim 25, further comprising:
determining a cleaning setting of the robot device based on the label; and
outputting the cleaning setting of the robot device for transmission to the robot device.

### Claim 27 (depends on 25)

The method of claim 25, wherein the candidate areas for movement of the robot device are determined based on at least one of the label for the environment map or the activity information.

### Claim 28 (depends on 24)

The method of claim 24, wherein the environment map includes one or more landmarks, and further comprising determining the offset and rotation based on the one or more landmarks.

### Claim 29 (depends on 28)

The method of claim 28, wherein the one or more landmarks include at least one non-visible landmark.

### Claim 30 (depends on 28)

The method of claim 28, wherein the environment map further comprises simultaneous localization and mapping (SLAM) map information of the robot device, and further comprising:
determining the offset and rotation by matching the SLAM map information of the robot device to an environment map of a controller based on the one or more landmarks; and
applying the offset and rotation to the remote sensing information.

### Claim 31 (depends on 24)

The method of claim 24, wherein the detected objects comprise at least one of people or animals.

### Claim 32 (depends on 24)

The method of claim 24, wherein the remote sensing information includes presence information, and further comprising outputting a user prompt to confirm the offset and rotation to the presence information.

### Claim 33 (depends on 24)

The method of claim 24, wherein the remote sensing information includes presence information, wherein the presence information includes one of a heatmap or crowd density map.

### Claim 34 (depends on 24)

The method of claim 24, further comprising:
receiving cleaning scores indicating detected contaminants on a surface for portions of the candidate areas; and
updating the candidate areas based on the cleaning scores.

### Claim 35

A method for controlling a robot device, comprising:
receiving a set of candidate areas from a controller, wherein the set of candidate areas were selected based on at least one of 6-degrees-of-freedom (6DOF) trajectory information or presence information;
receiving a schedule for cleaning, wherein the schedule for cleaning is determined based on presence information;
selecting a cleaning tool or cleaning supplies of the robot device based on the schedule for cleaning and the set of candidate areas; and
cleaning a portion of the set of candidate areas using the selected cleaning tool or cleaning supplies.

### Claim 36 (depends on 35)

The method of claim 35, further comprising:
detecting one or more landmarks of an environment around the robot device;
generating an environment map based on the detected one or more landmarks; and
transmitting the environment map to the controller.

### Claim 37 (depends on 35)

The method of claim 35, further comprising:
receiving remote sensing information from the controller, wherein the remote sensing information comprises a simultaneous localization and mapping (SLAM) map rotated and offset based on one or more landmarks of an environment map of the robot device;
detecting one or more features of an environment from the SLAM map; and
updating the environment map based on the detected one or more features of the environment from the SLAM map.

### Claim 38 (depends on 35)

The method of claim 35, further comprising:
receive cleaning settings from the controller, and
select the cleaning tool or the cleaning supplies of the robot device based on the cleaning settings.

### Claim 39 (depends on 35)

The method of claim 35, wherein the set of candidate areas includes a heatmap or crowd density map.

### Claim 40 (depends on 35)

The method of claim 35, further comprising:
tracking a path of the robot device based on an environment map and information from an inertial measurement unit (IMU);
determining a coverage score, the coverage score indicating a confidence that the path of the robot device covered a portion of the set of candidate areas; and
transmitting the coverage score for the portion of the set of candidate areas to the controller.

### Claim 41 (depends on 40)

The method of claim 40, further comprising receiving an updated set of candidate areas from the controller, wherein the set of candidate areas are updated based on the coverage score for the portion of the set of candidate areas.

### Claim 42 (depends on 35)

The method of claim 35, further comprising:
obtaining images of an environment, the images including a surface in the environment;
determining a cleaning score by detecting contaminants on the surface in the images; and
transmit the cleaning score for the portion of the set of candidate areas to the controller.

### Claim 43 (depends on 42)

The method of claim 42, further comprising receiving an updated set of candidate areas from the controller, wherein the set of candidate areas are updated based on the cleaning score for the portion of the set of candidate areas.

### Claim 44 (depends on 35)

The method of claim 35, further comprising:
tracking an amount of contaminants being picked up; and
adjusting the schedule for cleaning based on the set of candidate areas and the tracked amount of contaminants being picked up in the candidate areas of the set of candidate areas.

### Claim 45 (depends on 35)

The method of claim 35, further comprising:
determining an amount of time spent cleaning the set of candidate areas;
determining a size of the set of candidate areas;
determining an overall cleaning task score based on the amount of time spent cleaning the set of candidate areas and the size of the set of candidate areas; and
outputting the overall cleaning task score.

### Claim 46 (depends on 35)

The method of claim 35, wherein the set of candidate areas have been rotated and offset based on one or more landmarks of an environment map of the robot device.
