# US 2023/0410656 A1 · Autonomous control with encoded visual signals

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0410656 A1
- Document ID: US20230410656A1
- Status: Published application
- Kind: A1
- Application number: 17/842,527
- Filed: 2022-06-16
- Published: 2023-12-21
- Earliest claimed: 2022-06-16
- Assignees: GM Cruise Holdings LLC
- Applicants: GM Cruise Holdings LLC
- Inventors: Siyuan Lu
- Web page: https://patentgrep.com/patent/US20230410656A1

## CPC

- G08G 1/166: {for active traffic, e.g. moving vehicles, pedestrians, bikes}
- G08G 1/163: {involving continuous checking}
- G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93})

## Abstract

To provide control for an autonomous vehicle based on a physical object near an autonomous vehicle (AV), the AV monitors its environment with an imaging sensor, such as an infrared sensor or visible light camera. The imaging sensor captures a sensor view of the environment and an encoded signal is detected in the sensor view. The encoded signal may be emitted by a mobile device with a respective emitter for the imaging sensor, such as an IR emitter or a visual light source. After detecting the encoded signal, the AV identifies the location of the mobile device within the sensor view and the environment. Then, based on the determined location in the environment, the AV performs a control action, such as navigating to a stopping place near the location.

## Claims

### Claim 1

A method comprising:
detecting an encoded signal within a sensor view captured by a sensor of an autonomous vehicle;
verifying the encoded signal is authorized to affect control of the autonomous vehicle; and
responsive to verifying the encoded signal:
determining a location of a device emitting the encoded signal; and
performing a control action of the automated vehicle based on the determined location of the device.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
determining a distance of the autonomous vehicle to an expected location of the device; and
wherein the encoded signal is detected after the distance is below a threshold.

### Claim 3 (depends on 1)

The method of claim 1, further comprising exchanging the encoded signal with the device.

### Claim 4 (depends on 1)

The method of claim 1, wherein verifying the encoded signal includes matching the encoded signal to one or more registered signals and determining the control action based on the match.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
monitoring the location of the device in the sensor view and identifying a motion of the device in the sensor view; and
wherein the control action is based on the motion of the device.

### Claim 6 (depends on 1)

The method of claim 1, wherein the control action comprises navigating the autonomous vehicle to a stopping position based on the determined location of the device.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
determining the location of the device is within a threshold distance; and
wherein the control action comprises providing access to the autonomous vehicle.

### Claim 8

A non-transitory computer-readable medium containing instructions executable by one or more processors for:
detecting an encoded signal within a sensor view captured by a sensor of an autonomous vehicle;
verifying the encoded signal is authorized to affect control of the autonomous vehicle; and
responsive to verifying the encoded signal:
determining a location of a device emitting the encoded signal; and
performing a control action of the automated vehicle based on the determined location of the device.

### Claim 9 (depends on 8)

The computer-readable medium of claim 8, wherein the instructions are further executable for:
determining a distance of the autonomous vehicle to an expected location of the device; and
wherein the encoded signal is detected after the distance is below a threshold.

### Claim 10 (depends on 8)

The computer-readable medium of claim 8, wherein the instructions are further executable for exchanging the encoded signal with the device.

### Claim 11 (depends on 8)

The computer-readable medium of claim 8, wherein verifying the encoded signal includes matching the encoded signal to one or more registered signals and determining the control action based on the match.

### Claim 12 (depends on 8)

The computer-readable medium of claim 8, wherein the instructions are further executable for:
monitoring the location of the device in the sensor view and identifying a motion of the device in the sensor view; and
wherein the control action is based on the motion of the device.

### Claim 13 (depends on 8)

The computer-readable medium of claim 8, wherein the control action comprises navigating the autonomous vehicle to a stopping position based on the determined location of the device.

### Claim 14 (depends on 8)

The computer-readable medium of claim 8, wherein the instructions are further executable for:
determining the location of the device is within a threshold distance; and
wherein the control action comprises providing access to the autonomous vehicle.

### Claim 15

A system comprising:
a processor; and
a non-transitory computer-readable storage medium containing instructions for execution by the processor for:
detecting an encoded signal within a sensor view captured by a sensor of an autonomous vehicle;
verifying the encoded signal is authorized to affect control of the autonomous vehicle; and
responsive to verifying the encoded signal:
determining a location of a device emitting the encoded signal; and
performing a control action of the automated vehicle based on the determined location of the device.

### Claim 16 (depends on 15)

The system of claim 15, wherein the instructions are further executable for:
determining a distance of the autonomous vehicle to an expected location of the device; and
wherein the encoded signal is detected after the distance is below a threshold.

### Claim 17 (depends on 15)

The system of claim 15, wherein the instructions are further executable for exchanging the encoded signal with the device.

### Claim 18 (depends on 15)

The system of claim 15, wherein verifying the encoded signal includes matching the encoded signal to one or more registered signals and determining the control action based on the match.

### Claim 19 (depends on 15)

The system of claim 15, wherein the instructions are further executable for:
monitoring the location of the device in the sensor view and identifying a motion of the device in the sensor view; and
wherein the control action is based on the motion of the device.

### Claim 20 (depends on 15)

The system of claim 15, wherein the control action comprises navigating the autonomous vehicle to a stopping position based on the determined location of the device.
