Electronic device for performing artificial neural network-based inference in trusted execution environment and operating method thereof

A method of performing an artificial neural network-based inference of one or more central processors included in an electronic device, wherein the electronic device further comprises one or more neural processors and memory comprising at least one neural processor enclave having a trusted execution environment (TEE) isolated from a rich execution environment (REE) in which system software of the one or more central processors is executed,

• the method comprising:
• based on computational graph information of an artificial neural network stored in the at least one neural processor enclave, identify a first operator supported by the one or more neural processors and a second operator not supported by the one or more neural processors;
• and
• adjusting an execution order of operators of a computational graph to reduce a number of transitions between the TEE configured to perform the first operator and the REE configured to perform the second operator.

An electronic device comprising:

• a system on chip (SoC) comprising one or more central processors and one or more neural processors;
• and
• memory comprising at least one neural processor enclave having a trusted execution environment (TEE) isolated from a rich execution environment (REE) in which system software of the central processors is executed,
• wherein the central processors are configured to:
• based on computational graph information of an artificial neural network stored in the at least one neural processor enclave, identify a first operator supported by the one or more neural processors and a second operator not supported by the one or more neural processors, and
• adjust an execution order of operators of a computational graph to reduce a number of transitions between the TEE configured to perform the first operator and the REE configured to perform the second operator.