Back to results
US 12,014,732 B2Granted
Energy efficient custom deep learning circuits for always-on embedded applications
AssigneeAondevices, Inc.
InventorsMouna Elkhatib, Adil Benyassine
Life of this patent
Estimating the term…
Abstract
A system can include a circuit holistically customized for the detection of commands in an audio or video input signal to meet certain application-specific requirements. The circuit can have a neural network topology that is hardwired to perform detection based on application-specific detection criteria. The hardwired custom circuit can provide improved energy efficiencies compared to similar functionality carried out using software and generic hardware modules. The system can also include a sound change trigger module and perform non-voiced sound detection.
Claims22
A system comprising:
- non-transitory computer-readable medium comprising a plurality of command instructions stored thereon;
- and
- a customized neural network detector comprising a fixed deep learning neural network hardware topology with a set of fixed weights tailored for system-specific functions and programmable weights providing limited adaptability, predetermined structural parameters optimized for low power consumption, fixed activation functions for specific network operations and customizable activation functions, the neural network detector hardwired to receive an audio signal and/or video signal, and hardwired to select, based at least in part on the audio signal and/or video signal, a command instruction of the plurality of command instructions independently within the system without external network data transmission.
A method comprising:
- determining a plurality of detection criteria;
- associating each of the detection criteria with a respective command instruction of a plurality of command instructions;
- and
- hardwiring a customized fixed neural network based on the detection criteria such that the neural network is hardwired to receive an audio signal and/or video signal and select a command instruction based on the received audio signal and/or video signal and based on the detection criteria independently without external network data transmission, the detection criteria including a set of fixed weights tailored for specific functions and programmable weights providing limited adaptability, fixed activation functions for specific network operations and customizable activation functions, with predetermined structural parameters optimized for low power consumption.
1 more element
Dependencies are inferred from the claim text.