Methods and systems for speech detection
AssigneeSoapBox Labs Ltd.
InventorPatricia Scanlon
Life of this patent
Estimating the term…
Abstract
Methods and systems for processing user input to a computing system are disclosed. The computing system has access to an audio input and a visual input such as a camera. Face detection is performed on an image from the visual input, and if a face is detected this triggers the recording of audio and making the audio available to a speech processing function. Further verification steps can be combined with the face detection step for a multi-factor verification of user intent to interact with the system.
Claims20
A method of processing user input to a computing system having an audio input and a visual input, the method comprising:
- receiving, at the computing system, an audio input signal from the audio input;
- performing a determination of whether a user has demonstrated an intent to interact with the computing system via the audio input, wherein performing the determination of whether the user has demonstrated the intent to interact with the computing system via the audio input comprises:
- determining whether a face has been detected using the visual input;
- and
- responsive to the determination that the user has demonstrated the intent to interact with the computing system via the audio input, confirming whether the determination that the user has demonstrated the intent to interact with the computing system via the audio input is reliable by (i) performing additional verification operations comprising two or more of matching the face against a user profile of the user, determining whether the face is detected at an expected distance from a camera, or determining whether the face is detected at an expected angle with respect to the camera, and (ii) determining whether a weighted combination of results of the additional verification operations satisfies a threshold;
- and
- responsive to confirming that the determination that the user has demonstrated the intent to interact with the computing system via the audio input is reliable:
- recording the audio input signal from the audio input.
A computing system for processing user input having an audio input and a visual input, the system comprising:
- a memory;
- and
- a processor, coupled to the memory, to perform a method comprising:
- receiving, at the computing system, an audio input signal from the audio input;
- performing a determination of whether a user has demonstrated an intent to interact with the computing system via the audio input, wherein performing the determination of whether the user has demonstrated the intent to interact with the computing system via the audio input comprises:
- determining whether a face has been detected using the visual input;
- and
- responsive to the determination that the user has demonstrated the intent to interact with the computing system via the audio input, confirming whether the determination that the user has demonstrated the intent to interact with the computing system via the audio input is reliable by (i) performing additional verification operations comprising two or more of matching the face against a user profile of the user, determining whether the face is detected at an expected distance from a camera, or determining whether the face is detected at an expected angle with respect to the camera, and (ii) determining whether a weighted combination of results of the additional verification operations satisfies a threshold;
- and
- responsive to confirming that the determination that the user has demonstrated the intent to interact with the computing system via the audio input is reliable:
- recording the audio input signal from the audio input.
A non-transitory computer readable medium comprising instructions, which when executed by a processor, cause the processor to perform a method of processing user input to a computing system having an audio input and a visual input, the method comprising:
- receiving, at the computing system, an audio input signal from the audio input;
- performing a determination of whether a user has demonstrated an intent to interact with the computing system via the audio input, wherein performing the determination of whether the user has demonstrated the intent to interact with the computing system via the audio input comprises:
- determining whether a face has been detected using the visual input;
- and
- responsive to the determination that the user has demonstrated the intent to interact with the computing system via the audio input, confirming whether the determination that the user has demonstrated the intent to interact with the computing system via the audio input is reliable by (i) performing additional verification operations comprising two or more of matching the face against a user profile of the user, determining whether the face is detected at an expected distance from a camera, or determining whether the face is detected at an expected angle with respect to the camera, and (ii) determining whether a weighted combination of results of the additional verification operations satisfies a threshold;
- and
- responsive to confirming that the determination that the user has demonstrated the intent to interact with the computing system via the audio input is reliable:
- recording the audio input signal from the audio input.
Dependencies are inferred from the claim text.