Controlling vehicles in response to users of other vehicles

A system for controlling vehicles in response to users of other vehicles, the system comprising:

• at least one processing unit configured to perform operations, the operations comprise:
• obtaining one or more images captured using one or more image sensors from an environment of a first vehicle;
• analyzing the one or more images to detect a second vehicle;
• analyzing the one or more images to determine a state of a user associated with the second vehicle, wherein the state of the user comprises at least one of the user embarking on the second vehicle or the user disembarking from the second vehicle, and indicates that the second vehicle has stopped for a longer period of time;
• and
• causing the first vehicle to initiate an action responding to the second vehicle in response to the indication that the second vehicle has stopped for the longer period of time, the action comprising passing the second vehicle instead of waiting for the second vehicle to resume moving.

A method for controlling vehicles in response to users of other vehicles, the method comprising:

• obtaining one or more images captured using one or more image sensors from an environment of a first vehicle;
• analyzing the one or more images to detect a second vehicle;
• analyzing the one or more images to determine a state of a user associated with the second vehicle, wherein the state of the user comprises at least one of the user embarking on the second vehicle or the user disembarking from the second vehicle, and indicates that the second vehicle has stopped for a longer period of time;
• and
• causing the first vehicle to initiate an action responding to the second vehicle in response to the indication that the second vehicle has stopped for the longer period of time, the action comprising passing the second vehicle instead of waiting for the second vehicle to resume moving.