Back to results
US 2025/0156162 A1Published application
Resource constraint aware deep learning model optimization for serverless-based inference systems
AssigneeRed Hat, Inc.
InventorsHuamin Chen, Jinjun Xiong, Roland Ludwig Huss
Life of this patent
Estimating the term…
Abstract
A method includes generating an optimized version of an inference serverless function using a graph compiler. The method further includes replacing a storage volume in an init container of the inference serverless function with a new storage volume comprising the optimized version of the inference serverless function.
Claims20
A method, comprising:
- generating an optimized version of an inference serverless function using a graph compiler;
- and
- replacing, by a processing device of a webhook controller, a storage volume in an init container of the inference serverless function with a new storage volume comprising the optimized version of the inference serverless function.
A system, comprising:
- a memory;
- and
- a processing device operatively coupled to the memory, the processing device to:
- generate an optimized version of an inference serverless function using a deep neural network optimizer;
- and
- replace a storage volume in an init container of the inference serverless function with a new storage volume comprising the optimized version of the inference serverless function.
3 more elements
A non-transitory computer-readable storage medium including instructions that, when executed by a processing device, cause the processing device to:
- generate an optimized version of an inference serverless function using a graph compiler;
- and
- replace, by the processing device, a storage volume in an init container of the inference serverless function with a new storage volume comprising the optimized version of the inference serverless function.
Dependencies are inferred from the claim text.