Local small foundation system for inferencing
AssigneeDell Products L.P.
InventorsWilliam Jeffery White, Xin Ma, George Currie
Life of this patent
Estimating the term…
Loading patent…
AssigneeDell Products L.P.
InventorsWilliam Jeffery White, Xin Ma, George Currie
Estimating the term…
The disclosure is directed to a local small foundation system which leverages a generative Artificial Intelligence (AI) model to produce classification results. The local small foundation system includes less than 10 billion parameters and is located on an edge site. The local small foundation system is customized towards the edge site. The local small foundation system produces classification results based on a query by making an inference with the generative AI model. An output guardrail module determines if the classification results can be resolved to an existing class of a plurality of existing classes. The output guardrail module also provides instructions on how to implement classification results at the endpoint management system. The output guardrail module also determines if a centralized large foundation system needs to be consulted and what to send to the centralized large foundation system.
A method of operating a local small foundation system, comprising:
A non-transitory computer readable medium comprising computer readable program code, which when executed by a computer processor enables the computer processor to perform a method of operating a local small foundation system, comprising:
A local small foundation system, comprising:
Dependencies are inferred from the claim text.