Secure digital assistant integration in web pages

A method implemented by one or more processors, the method comprising:

• receiving, from a client computing device rendering an electronic resource, audio data and an identifier corresponding to an account associated with the client computing device;
• processing the audio data to determine a user intent;
• determining a semantic foreground state of the electronic resource indicating a current context of the electronic resource;
• identifying, based on the user intent and the semantic foreground state, a target action defined in an intent manifest associated with the electronic resource;
• determining, based on the identifier corresponding to the account associated with the client computing device, a candidate data value for a parameter of the target action;
• generating an audio response confirming the candidate data value;
• and
• responsive to receiving a confirmation input, transmitting, to the client computing device, instructions to cause the electronic resource to execute the target action using the candidate data value.

A computer program product comprising one or more computer-readable storage media having program instructions collectively stored on the one or more computer-readable storage media, the program instructions executable to:

• receive, from a client computing device rendering an electronic resource, audio data and an identifier corresponding to an account associated with the client computing device;
• process the audio data to determine a user intent;
• determine a semantic foreground state of the electronic resource indicating a current context of the electronic resource;
• identify, based on the user intent and the semantic foreground state, a target action defined in an intent manifest associated with the electronic resource;
• determine, based on the identifier corresponding to the account associated with the client computing device, a candidate data value for a parameter of the target action;
• generate an audio response confirming the candidate data value;
• and
• responsive to receiving a confirmation input, transmit, to the client computing device, instructions to cause the electronic resource to execute the target action using the candidate data value.

A system comprising:

• a processor, a computer-readable memory, one or more computer-readable storage media, and program instructions collectively stored on the one or more computer-readable storage media, the program instructions executable to:
• receive, from a client computing device rendering an electronic resource, audio data and an identifier corresponding to an account associated with the client computing device;
• process the audio data to determine a user intent;
• determine a semantic foreground state of the electronic resource indicating a current context of the electronic resource;
• identify, based on the user intent and the semantic foreground state, a target action defined in an intent manifest associated with the electronic resource;
• determine, based on the identifier corresponding to the account associated with the client computing device, a candidate data value for a parameter of the target action;
• generate an audio response confirming the candidate data value;
• and
• responsive to receiving a confirmation input, transmit, to the client computing device, instructions to cause the electronic resource to execute the target action using the candidate data value.