Voice agent system

A voice agent system comprising:

• a memory storing instructions;
• and
• a processor communicatively coupled to the memory and configured to execute the instructions to:
• establish a plurality of user-agent conversations, wherein:
• each user-agent conversation between a user and the voice agent system is established in response to the user speaking a trigger word and the plurality of user-agent conversations continue simultaneously in a same physical area, and
• the voice agent system is communicatively coupled to one or more industrial devices in one or more industrial automation systems;
• detect an utterance in an audio stream associated with the same physical area;
• determine, based on the utterance, that the utterance potentially belongs to a particular user-agent conversation among the plurality of user-agent conversations and determine a confidence score that the utterance belongs to the particular user-agent conversation;
• identify a candidate action to be performed by the voice agent system based on the utterance, wherein the candidate action is associated with an industrial device of the one or more industrial devices;
• retrieve device information associated with the industrial device;
• determine an overall confidence score of the candidate action based at least on:
• the confidence score that the utterance belongs to the particular user-agent conversation, and
• the retrieved device information;
• and
• perform an operation on the industrial device based on the overall confidence score of the candidate action.

A non-transitory computer-readable medium storing instructions that, when executed, direct a processor of a voice agent system to:

• establish a plurality of user-agent conversations, wherein:
• each user-agent conversation between a user and the voice agent system is established in response to the user speaking a trigger word and the plurality of user-agent conversations continue simultaneously in a same physical area, and
• the voice agent system is communicatively coupled to one or more industrial devices in one or more industrial automation systems;
• detect an utterance in an audio stream associated with the same physical area;
• determine, based on the utterance, that the utterance potentially belongs to a particular user-agent conversation among the plurality of user-agent conversations and determine a confidence score that the utterance belongs to the particular user-agent conversation;
• identify a candidate action to be performed by the voice agent system based on the utterance, wherein the candidate action is associated with an industrial device of the one or more industrial devices;
• retrieve device information associated with the industrial device;
• determine an overall confidence score of the candidate action based at least on:
• the confidence score that the utterance belongs to the particular user-agent conversation, and
• the retrieved device information;
• and
• perform an operation on the industrial device based on the overall confidence score of the candidate action.