Active speaker based intelligent audio-visual call-response system
AssigneeRockwell Collins, Inc.
InventorsDavid Watkins, Naresh Yarlapati Ganesh
Life of this patent
Estimating the term…
Abstract
A system and method for determining an incapacitation state of an occupant is disclosed. The system may include an audio sensor configured to sense sensor data including active speaker audio of an occupant of two or more occupants. The system may also include a controller communicatively coupled to the audio sensor and configured to execute program instructions causing the processors to identify the active speaker, assign an identification code, receive a trigger, query a call response module, determine the occupant state, and direct aircraft operations based on the occupant state.
Claims20
A method for determining an incapacitation state of an occupant, the method comprising:
- receiving sensor data including active speaker audio of an occupant of two or more occupants;
- identifying the occupant as an active speaker, based on the sensor data;
- assigning an identification code to the occupant based on the identification of the occupant as the active speaker;
- receiving a trigger associated with the identification code and the occupant;
- querying a call response module based on the trigger, wherein the call response module is configured to generate and direct a communication to the occupant and receive an audio response from the occupant;
- determining an occupant state of the occupant based on the audio response from the occupant;
- and
- directing an aircraft operation based on the occupant state.
A system for determining an incapacitation state of an occupant, the system comprising:
- an audio sensor configured to sense sensor data including active speaker audio of an occupant of two or more occupants;
- and
- a controller communicatively coupled to the audio sensor, the controller comprising one or more processors configured to execute program instructions causing the one or more processors to:
- receive the sensor data including the active speaker audio of the occupant of the two or more occupants;
- identify the occupant as an active speaker, based on the sensor data;
- assign an identification code to the occupant based on the identification of the occupant as the active speaker;
- receive a trigger associated with the identification code and the occupant;
- query a call response module based on the trigger, wherein the call response module is configured to generate and direct a communication to the occupant and receive an audio response from the occupant;
- determine an occupant state of the occupant based on the audio response from the occupant;
- and
- direct an aircraft operation based on the occupant state.
Dependencies are inferred from the claim text.