US 2026/0030482 A1 · SYSTEM

Abstract

A system with high processing speed and low power consumption is provided. The system includes an imaging device and an arithmetic circuit. The imaging device includes an imaging portion, a first memory portion, and an arithmetic portion, and the arithmetic circuit includes a second memory portion. The imaging portion has a function of converting light reflected by an external subject into image data, and the first memory portion has a function of storing the image data and a first filter for performing first convolutional processing in a first layer of a neural network. The arithmetic portion has a function of performing the first convolutional processing using the image data and the first filter to generate first data. The second memory portion has a function of storing the first data and a plurality of filters for performing convolutional processing in and after a second layer of the neural network. The arithmetic circuit has a function of performing processing in and after the second layer of the neural network using the first data to generate a depth map of the image data.

Claims12

Dependent claims

A system comprising:

a first neural network, the first neural network being a Global Coarse-Scale Network;
and
a second neural network, the second neural network being a Local Fine-Scale Network,
wherein the first neural network and the second neural network are configured to perform depth estimation of an image,
wherein a feature map is generated from input image data by the first neural network, and
wherein a depth map is generated on the basis of the input image data and the feature map by the second neural network.

3 more elements

A system comprising:

a first neural network, the first neural network being a Global Coarse-Scale Network;
and
a second neural network, the second neural network being a Local Fine-Scale Network,
wherein the first neural network and the second neural network are configured to perform depth estimation of an image,
wherein a feature map is generated from input image data by the first neural network,
wherein a depth map is generated on the basis of the input image data and the feature map by the second neural network,
wherein the first neural network is configured to perform first convolutional processing on the input image data in a first layer using a first filter,
wherein the first neural network is configured to perform first pooling processing in a second layer after the first convolutional processing,
wherein the first neural network is configured to perform second convolutional processing in a third layer after the first pooling processing,
wherein the first neural network is configured to perform first arithmetic processing in a fully connected layer after the second convolutional processing,
wherein the second neural network is configured to perform third convolutional processing on the input image data in a first layer using a second filter,
wherein the second neural network is configured to perform second pooling processing in a second layer after the third convolutional processing,
wherein the second neural network is configured to perform combining of image data which has been processed in the second layer of the second neural network and the feature map in a third layer, and
wherein the system is configured to generate a three-dimensional image using the depth map and the input image data.

11 more elements

Dependencies are inferred from the claim text.

System

Life of this patent

System

Life of this patent

Abstract

Claims12