Artificial intelligence assistance for an audio, video and control system using room environment contextualization and oral command inferencing

A system, comprising:

• one or more peripheral devices;
• and
• an audio, video and control (“AVC”) processing core communicably coupled to the peripheral devices, the AVC processing core having an AVC operating system executable thereon to manage and control functionality of the peripheral devices,
• wherein the AVC operating system is adapted to perform actions using oral commands detected within audio signals, the oral commands corresponding to the actions,
• wherein the AVC operating system is configured to perform operations comprising:
• detecting, using a large language model (“LLM”) module communicably coupled to the AVC processing core, one or more audio signals obtained from a user;
• inferring, using the LLM module, one or more oral commands from the audio signals;
• and
• performing actions on the peripheral devices or AVC processing core which correspond to the oral commands.

A non-transitory computer-readable storage medium storing instructions that, when executed by a computing system, cause the computing system to perform operations comprising:

• implementing an audio, video and control (“AVC”) operating system on an AVC processing core communicably coupled to one or more peripheral devices, the AVC processing core being configured to manage and control functionality of the peripheral devices,
• wherein the AVC operating system is adapted to perform actions using oral commands detected within audio signals, the oral commands corresponding to the actions,
• wherein the AVC operating system is configured to perform operations comprising:
• detecting, using a large language model (“LLM”) module communicably coupled to the AVC processing core, one or more audio signals obtained from a user;
• inferring, using the LLM module, one or more oral commands from the audio signals;
• and
• performing actions on the peripheral devices or AVC processing core which correspond to the oral commands.

A computer-implemented method, comprising:

• implementing an audio, video and control (“AVC”) operating system on an AVC processing core communicably coupled to one or more peripheral devices, the AVC processing core being configured to manage and control functionality of the peripheral devices,
• obtaining contextual awareness data of a room environment in which the AVC operating system functions;
• and
• based upon the contextual awareness data, performing actions on the peripheral devices or AVC processing core.

A system, comprising:

• one or more peripheral devices;
• and
• an audio, video and control (“AVC”) processing core communicably coupled to the peripheral devices, the AVC processing core having an AVC operating system executable thereon to manage and control functionality of the peripheral devices,
• wherein the AVC operating system is adapted to perform operations comprising:
• obtaining contextual awareness data of a room environment in which the AVC operating system functions;
• and
• based upon the contextual awareness data, performing actions on the peripheral devices or AVC processing core.

A non-transitory computer-readable storage medium storing instructions that, when executed by a computing system, cause the computing system to perform operations comprising:

• implementing an audio, video and control (“AVC”) operating system on an AVC processing core communicably coupled to one or more peripheral devices, the AVC processing core being configured to manage and control functionality of the peripheral devices,
• obtaining contextual awareness data of a room environment in which the AVC operating system functions;
• and
• based upon the contextual awareness data, performing actions on the peripheral devices or AVC processing core.