Camera device enhanced for artificial neural network
AssigneeDeepx Co., Ltd.
InventorsHa Joon Yu, Lok Won Kim, Jung Boo Park, You Jun Kim
Life of this patent
Estimating the term…
Abstract
According to an example of the present disclosure, a neural processing unit (NPU) capable of encoding is provided. The NPU comprises one or more processing elements (PEs) which perform operations for a plurality of layers of an artificial neural network and generate a plurality of output feature maps. The NPU also comprises an encoder which encodes at least one particular output feature map among a plurality of output feature maps into a bitstream and then transmits thereof.
Claims14
A camera device capable of communicating with a server, comprising:
- a first circuit arranged for at least one processing element (PE) configured to obtain, from a captured video, a plurality of feature maps corresponding to each of convolution layers by using multiple convolution layers of an artificial neural network model;
- and
- a second circuit arranged for an encoder configured to select at least one feature map from the plurality of feature maps and encode the selected at least one feature map thereby being outputting as a bitstream;
- wherein the bitstream is transmitted to the server through a communication network, and
- wherein the at least one feature map is selected based on particular information received from a server including a decoder.
A server capable of communicating with a camera device via a communication network, comprising:
- a first circuit arranged for a decoder configured to decode a bitstream received from the camera device and reconstruct at least one feature map for a video captured by the camera device;
- and
- a second circuit arranged for at least one processing element (PE) configured to perform operations of an artificial neural network model;
- wherein the at least one feature map is applied as input data to a N-th layer among a plurality of layers of the artificial neural network model, thereby allowing the at least one PE to perform operations of the artificial neural network model,
- wherein the at least one feature map is an output feature map of a M-th layer among the plurality of layers,
- wherein the N-th layer follows the M-th layer,
- wherein the N and the M are integers, and
- wherein the output feature is selected by an encoder and based on particular information transmitted from the server.
An electronic device for distributed processing of an artificial neural network, comprising:
- a first circuit arranged for a multiply-accumulate (MAC) operator configured to perform operations of two or more convolution layers among a plurality of convolution layers of the artificial neural network thereby generating a plurality of output feature maps;
- a second circuit arranged for an encoder configured to selectively encode at least one output feature map from the plurality of output feature maps thereby being outputted as a bitstream;
- wherein the electronic device is configured for distributed processing of the artificial neural network and includes a first electronic device and a second electronic device,
- wherein the electronic device refers to the first electronic device,
- wherein the bitstream is transmitted to the second electronic device, and
- wherein the at least one output feature map is selected based on particular information received from a server including a decoder.
Dependencies are inferred from the claim text.