Back to results
US 10,652,170 B2Granted
Modification of audio-based computer program output
AssigneeGoogle Inc.
InventorsLaura Eidem, Alex Jacobson
Life of this patent
Estimating the term…
Abstract
Modifying computer program output in a voice or non-text input activated environment is provided. A system can receive audio signals detected by a microphone of a device. The system can parse the audio signal to identify a computer program to invoke. The computer program can identify a dialog data structure. The system can modify the identified dialog data structure to include a content item. The system can provide the modified dialog data structure to a computing device for presentation.
Claims18
A system to modify computer program output, comprising:
- a data processing system having one or more processors and memory to:
- receive, from a computing device, a digital file corresponding to a first acoustic signal carrying voice content detected by a microphone of the computing device, the first acoustic signal converted to the digital file by an analog to digital converter of the computing device;
- select, responsive to the voice content of the digital file, a computer program comprising a chatbot from a plurality of computer programs comprising chatbots for execution;
- identify, via the chatbot based on the voice content of the digital file, a dialog data structure comprising a placeholder field;
- generate, responsive to identification of the placeholder field in the dialog data structure, a request for content in a parameterized format configured for a parametrically driven text to speech technique;
- transmit the request for the content to a content selection component of the data processing system;
- select, via a content selection process responsive to the request, a content item for insertion into the placeholder field of the dialog data structure, the content item in the parameterized format configured for the parametrically driven text to speech technique;
- and
- provide, to the chatbot, the content item in the parameterized format selected via the content selection process to cause the computing device to perform the parametrically driven text to speech technique to generate a second acoustic signal corresponding to the dialog data structure modified with the content item, wherein the computing device plays the content item with an acoustic fingerprint corresponding to the chatbot.
6 more elements
A method of modifying computer program output, comprising:
- detecting, by a sensor of a computing device, a first image comprising visual content;
- converting, by the computing device, the first image to a digital file corresponding to the visual content;
- selecting, responsive to the visual content of the digital file, a computer program comprising a chatbot from a plurality of computer programs comprising chatbots for execution;
- identifying, by the chatbot based on the visual content of the digital file, a dialog data structure comprising a placeholder field;
- generating, responsive to identifying the placeholder field in the dialog data structure, a request for content in a parameterized format configured for a parametrically driven text to speech technique;
- transmitting, by the chatbot, the request for the content to a content selection server;
- selecting, by the content selection server responsive to the request, a content item for insertion into the placeholder field of the dialog data structure, the content item in the parameterized format configured for the parametrically driven text to speech technique;
- and
- providing, to the chatbot via a secure network communication channel, the content item for insertion in the dialog data structure by the chatbot, the content item provided in the parameterized format selected via the content selection process to cause the computing device to perform the parametrically driven text to speech technique to generate an acoustic signal corresponding to the dialog data structure modified with the content item.
6 more elements
Dependencies are inferred from the claim text.