System for recognizing player behavior and game situation in sports game video

A system for recognizing a player behavior and a game situation in a sports game video, comprising:

• at least one processor;
• and
• a memory configured to store a program that is executed by the at least one processor,
• wherein the processor is configured to:
• generate a video clip by extracting a game video every predetermined time,
• generate a game situation information by analyzing the video clip through a trained analysis model, and
• generate a game situation service information through the game situation information and provide the game situation service information to a user, and
• wherein the game video is a video of a sport game being played between a first team and a second team on a court,
• wherein the processor is further configured to:
• generate a court recognition information by recognizing a court area by analyzing the game video using semantic segmentation,
• generate an object information by recognizing players and referees participating in the game in the recognized court area and equipment used in the game,
• generate a group information by recognizing a behavior of a group by inputting the court recognition information and the object information to a first prediction model,
• generate a team information by recognizing the first team and the second team based on the group information, and
• generate the game situation information by inputting the court recognition information, the object information, the team information and the group information to a second prediction model,
• wherein the first prediction model is pre-trained with a pre-annotated label by encoding the court recognition information and the object information and extracting a specific vector, and
• wherein the second prediction model is pre-built by training with a game situation information label by encoding the court recognition information, the object information, the team information and the group information and extracting a specific vector.