Method and system for product search based on deep-learning

A system for performing a deep learning based product search, the system comprising:

• a computing device executing a product search application configured to perform a deep learning based product search;
• a product search server configured to operate in association with the product search application;
• and
• a shopping mall server configured to provide data required for the deep learning based product search for an online shopping mall service, wherein the computing device is configured to:
• preconfigure a first standard pose used as a reference to unify model poses in images into one predetermined model pose for product search by determining the preconfigured first standard pose, which is used as the reference optimized for performing the product search by an image deep-learning neural network, and setting coordinates of key-points of the preconfigured first standard pose based on the image deep-learning neural network, wherein the image deep-learning neural network is trained to transform the model poses in the images into the preconfigured first standard pose based on a training data set comprising a plurality of product images based on the preconfigured first standard pose, receive an input image including a target product to be searched, transform a pose of a model included in the received input image into the preconfigured first standard pose by the image deep-learning neural network based on the preconfigured first standard pose, obtain a standard input image in which the pose of the model included in the received input image is transformed into the preconfigured first standard pose, obtain a main product image having an area including the target product to be searched by performing deep learning based on the standard input image, extracting a feature vector from the main product image which has the area including the target product and is obtained by performing the deep learning based on the standard input image having the transformed pose of the model, perform the product search for a product similar to the target product based on the feature vector extracted from the main product image, and output a result of the product search.

A method for performing deep learning based product search by a product search application executed by a computing device, the method comprising:

• preconfiguring a first standard pose used as a reference to unify model poses in images into one predetermined model pose for product search by determining the preconfigured first standard pose, which is used as the reference optimized for performing the product search by an image deep-learning neural network, and setting coordinates of key-points of the preconfigured first standard pose based on the image deep-learning neural network, wherein the image deep-learning neural network is trained to transform the model poses in the images into the preconfigured first standard pose based on a training data set comprising a plurality of product images based on the preconfigured first standard pose;
• receiving an input image including a target product to be searched;
• detecting a model in the received input image;
• transforming a pose of the detected model into the preconfigured first standard pose by the image deep-learning neural network based on the preconfigured first standard pose;
• generating a standard input image in which the pose of the detected model included in the received input image is transformed into the preconfigured first standard pose;
• determining an area including the target product based on the generated standard input image having the preconfigured first standard pose;
• obtaining a main product image by extracting an image of the determined area including the target product;
• extracting a feature vector from the main product image obtained by extracting the image of the determined area including the target product;
• performing the product search for a product similar to the target product based on the feature vector extracted from the main product image;
• and
• providing a product search result including an image of a product similar to the target product.