Apparatus and method for adaptive image scaling and object tracking using npu
AssigneeDeepx Co., Ltd.
InventorsHa Joon YU, You Jun KIM, Lok Won KIM
Life of this patent
Estimating the term…
Abstract
An electronic device mounted on a fixed or a movable apparatus is provided. The electronic device may comprise a neural processing unit (NPU), including a plurality of processing elements (PEs), configured to process an operation of an artificial neural network model trained to detect or track at least one object and output an inference result based on at least one image acquired from at least one camera; and a signal generator generating a signal applicable to the at least one camera.
Claims20
An electronic device mounted on a movable apparatus, comprising:
- a sensing unit configured to measure environmental condition data including a flight altitude of the movable apparatus;
- a camera comprising an image sensor and an image signal processor (ISP);
- a central processing unit (CPU) configured to generate determination data based on the flight altitude of the movable apparatus;
- wherein the ISP is configured to generate an input feature map having an adjustable dimension by down-scaling or up-scaling an image captured by the image sensor based on the determination data;
- and
- a neural processing unit (NPU) comprising a plurality of processing elements (PEs), configured to process an operation of an artificial neural network (ANN) model to detect or track an object by inputting the input feature map to the plurality of PEs.
A method for detecting or tracking an object using a movable apparatus, the method comprising:
- measuring, by a sensing unit, environmental condition data including a flight altitude of the movable apparatus;
- generating, by a central processing unit (CPU), determination data based on the flight altitude of the movable apparatus;
- generating, by an image signal processor (ISP), an input feature map having an adjustable dimension by down-scaling or up-scaling an image captured by a camera based on the determination data;
- and
- processing, by a neural processing unit (NPU), an operation of an artificial neural network (ANN) model to detect or track the object based on the generated input feature map.
An electronic device mounted on a movable apparatus, comprising:
- a sensing unit configured to measure environmental condition data including a flight altitude of the movable apparatus;
- a camera configured to capture an image;
- a central processing unit (CPU) configured to select an artificial neural network (ANN) model among a plurality of ANN models based on the flight altitude of the movable apparatus, and to output index information corresponding to the selected ANN model;
- and
- a neural processing unit (NPU) configured to load a machine code set among a plurality of machine code sets based on the index information, and to process an operation of the selected ANN model based on the loaded machine code set to detect or track an object in the image.
Dependencies are inferred from the claim text.