Method for analyzing material using neural network based on multimodal input and apparatus using the same

Abstract

Disclosed herein are a method for analyzing material using a neural network based on multimodal input and an apparatus for the same. The method includes obtaining multimodal sensor data pertaining to at least one type of material to be analyzed using a multimodal sensor and augmenting the multimodal sensor data; merging the multimodal sensor data; training a neural network, provided for classifying the at least one type of material to be analyzed, using the merged multimodal sensor data; and classifying the type of target material by inputting multimodal sensor data pertaining to the target material, which is obtained using the multimodal sensor data, to the neural network.

Dependencies are inferred from the claim text.