Method, apparatus, and computer program for detecting unauthorized use of brand logos

A brand logo illegal use detection method comprising:

• acquiring a logo image and logo text that are targets of illegal use detection;
• generating image illegal use information indicating whether an illegal use suspect image in which a logo is suspected to be illegally used includes the logo image by using a logo identification model;
• performing text analysis on the illegal use suspect image and generating text illegal use information indicating whether the logo text is illegally used;
• and
• generating illegal use detection information on the illegal use suspect image based on the image illegal use information and the text illegal use information,
• wherein the image illegal use information includes a probability that the illegal use suspect image includes the logo image, and the text illegal use information includes a probability that the illegal use suspect image includes the logo text, and
• wherein the generating of the text illegal use information comprises:
• identifying surrounding text present around the illegal use suspect image and internal text present inside the illegal use suspect image in an online shopping mall or a phishing site,
• querying texts associated with the logo text from an associated text pool of the logo, and
• calculating the probability that the illegal use suspect image includes the logo text based on similarity discrimination results between each of the associated texts and the surrounding text and similarity discrimination results between each of the associated texts and the internal text.

A non-transitory computer-readable recording medium on which a computer program to be executed by at least one processor is recorded, wherein the computer program includes instructions for:

• analyzing a brand logo that is a target of illegal use detection to extract a logo image and logo text;
• generating logo transformation images including transformed forms of the logo image to generate a machine learning dataset;
• performing learning based on the machine learning dataset to generate a logo identification model;
• generating image illegal use information indicating whether an illegal use suspect image in which the brand logo is suspected to be illegally used includes the logo image by using the logo identification model;
• performing text analysis on the illegal use suspect image and generating text illegal use information indicating whether the logo text is illegally used;
• and
• generating illegal use detection information on the illegal use suspect image based on the image illegal use information and the text illegal use information,
• wherein the image illegal use information includes a probability that the illegal use suspect image includes the logo image, and the text illegal use information includes a probability that the illegal use suspect image includes the logo text, and
• wherein the generating of the text illegal use information comprises;
• identifying surrounding text present around the illegal use suspect image and internal text present inside the illegal use suspect image in an online shopping mall or a phishing site, and
• calculating the probability that the illegal use suspect image includes the logo text based on a similarity discrimination result between the surrounding text and the logo text and a similarity discrimination result between the internal text and the logo text.

A brand logo illegal use detection device comprising:

• a memory configured to store instructions;
• and
• a processor configured to execute the instructions to:
• analyze a brand logo that is a target of illegal use detection to extract a logo image and logo text;
• generate image illegal use information indicating whether an illegal use suspect image in which the brand logo is suspected to be illegally used includes the logo image by using a logo identification model;
• perform text analysis on the illegal use suspect image and generate text illegal use information indicating whether the logo text is illegally used;
• and
• generate illegal use detection information on the illegal use suspect image based on the image illegal use information and the text illegal use information,
• wherein the image illegal use information includes a probability that the illegal use suspect image includes the logo image, and the text illegal use information includes a probability that the illegal use suspect image includes the logo text, and
• wherein the generating of the text illegal use information comprises:
• identifying surrounding text present around the illegal use suspect image and internal text present inside the illegal use suspect image in an online shopping mall or a phishing site, and
• calculating the probability that the illegal use suspect image includes the logo text based on a similarity discrimination result between the surrounding text and the logo text and a similarity discrimination result between the internal text and the logo text.