US 2022/0066829 A1 · METHOD AND SYSTEM FOR PREDICTING AND OPTIMIZING RESOURCE UTILIZATION OF AI APPLICATIONS IN AN EMBEDDED COMPUTING SYSTEM

Abstract

Disclosed herein is a method and an optimization unit for optimizing and/or improving efficiency of resource utilization in an embedded computing system executing Artificial Intelligence (AI) applications. The method includes: detecting, by an optimization unit comprising processing circuitry and/or executable program instructions configured in the embedded computing system, a launch of an AI application on the embedded computing system; retrieving a runtime profile corresponding to the AI application, the runtime profile indicating resource requirements for executing the AI application; and configuring a runtime environment of the embedded computing system for the AI application based on the runtime profile corresponding to the AI application.

Claims20

Dependent claims

A method of improving efficiency of resource utilization in an embedded computing system executing Artificial Intelligence (AI) applications, the method comprising:

detecting, by an optimization unit comprising processing circuitry and/or executable program instructions configured in the embedded computing system, a launch of an AI application on the embedded computing system;
retrieving, by the optimization unit, a runtime profile corresponding to the AI application, wherein the runtime profile indicates resource requirements for executing the AI application;
and
configuring, by the optimization unit, a runtime environment of the embedded computing system for the AI application based on the runtime profile corresponding to the AI application.

1 more element

An optimization unit configured to improve efficiency of resource utilization in an embedded computing system executing Artificial Intelligence (AI) applications, the optimization unit comprising:

a processor;
and
a memory, communicatively coupled to the processor, wherein the memory stores processor-executable instructions, which on execution, cause the processor to:
detect a launch of an AI application on the embedded computing system;
retrieve a runtime profile corresponding to the AI application, wherein the runtime profile indicates resource requirements for executing the AI application;
and
configure a runtime environment of the embedded computing system for the AI application based on the runtime profile corresponding to the AI application.

4 more elements

Dependencies are inferred from the claim text.

Facts

Application

17/453,945Filed 8 Nov 2021

Priority

IN 201941001913614 May 2019

Published

3 Mar 2022

Term ends

Not estimatedThe source records don’t support an estimate.

Classification9 codes

G06F 9/5016
The resources being hardware resources other than CPUs, Servers and Terminals: the resource being the memory
G06F 9/5022
The resources being hardware resources other than CPUs, Servers and Terminals: mechanisms to release resources
G06F 9/44505
Program loading or initiating: configuring for program initiating, e.g. using registry, configuration files
G06F 9/485
By program, e.g. task dispatcher, supervisor, operating system: task life-cycle, e.g. stopping, restarting, resuming execution

Method and system for predicting and optimizing resource utilization of ai applications in an embedded computing system

Life of this patent

Method and system for predicting and optimizing resource utilization of ai applications in an embedded computing system

Life of this patent

Abstract

Claims20