System and method for analyzing videos in real-time

A method for analyzing a live video broadcast stream of a sporting event, the method employing a sports analytics system comprising at least one processor configured to execute computer program instructions for performing said method, said method comprising:

• receiving said live video broadcast stream of said sporting event from a video capturing device, by a video demuxer of said sports analytics system;
• splitting said live broadcast stream into a real time messaging protocol stream and a hypertext transfer protocol live stream, by said video demuxer of said sports analytics system;
• analyzing said real time messaging protocol stream within a predetermined time interval, wherein said predetermined time interval comprises a phase difference between said real time messaging protocol stream and said hypertext transfer protocol live stream, wherein said analysis comprises:
• detecting one or more persons present in a frame of said real time messaging protocol stream, using one or more cues selected from a first set of cues comprising a facial detection, a head detection, a person detection, and a jersey number detection based on availability of said first set of cues;
• tracking said detected persons in said frame, by analyzing one or more preceding frames of said real time messaging protocol stream;
• recognizing said tracked persons in said frame using one or more cues selected from a second set of cues comprising a facial recognition, a person recognition, a jersey recognition, a live score feed of said sporting event, and a commentary of said sporting event based on availability of said second set of cues, wherein individual weights are assigned to each of said facial recognition, said person recognition, and said jersey recognition when said facial recognition, said person recognition, and said jersey recognition are performed in said frame;
• and
• identifying one or more players in said frame by comparing said assigned weights for each of said recognized persons with pre-existing data of all players;
• and
• transmitting said hypertext transfer protocol live stream and analysis data comprising contextual interactive content of said identified players to a client application provided on a user device by said sports analytics system within said predetermined time interval;
• whereby said live video broadcast stream is transformed into an interactive video comprising said contextual interactive content of said identified players and transmitted to said user device.

A non-transitory computer readable storage medium having embodied thereon, computer program codes comprising instructions executable by at least one processor for analyzing a live video broadcast stream of a sporting event, said computer program codes comprising:

• a first computer program code for receiving said live video broadcast stream of said sporting event from one or more video capturing devices;
• a second computer program code for splitting said live broadcast stream into a real time messaging protocol stream and a hypertext transfer protocol live stream;
• a third computer program code for analyzing said real time messaging protocol stream within a predetermined time interval, wherein said predetermined time interval comprises a phase difference between said real time messaging protocol stream and said hypertext transfer protocol live stream;
• a fourth computer program code for detecting one or more persons present in a frame of said real time messaging protocol stream, using one or more cues selected from a first set of cues comprising a facial detection, a head detection, a person detection, and a jersey number detection based on availability of said first set of cues;
• a fifth computer program code for tracking said detected persons in said frame, by analyzing one or more preceding frames of said real time messaging protocol stream;
• a sixth computer program code for recognizing said tracked persons in said frame using one or more cues selected from a second set of cues comprising a facial recognition, a person recognition, a jersey recognition, a live score feed of said sporting event, and a commentary of said sporting event based on availability of said second set of cues, wherein individual weights are assigned to each of said facial recognition, said person recognition, and said jersey recognition when said facial recognition, said person recognition, and said jersey recognition performed in said frame;
• a seventh computer program code for identifying one or more players in said frame by comparing said assigned weights for each of said recognized persons with pre-existing data of all players;
• and
• an eighth computer program code for transmitting said hypertext transfer protocol live stream and analysis data comprising contextual interactive content of said identified players to a client application provided on a user device by said sports analytics system within said predetermined time interval.

A sports analytics system incorporating a computer server for analyzing a pre-recorded video stream of a sporting event, said sport analytics system comprising:

• a non-transitory computer readable storage media for storing computer program instructions defined by modules of said sport analytics system;
• and
• at least one processor communicatively coupled to said non-transitory computer readable storage media, said at least one processor configured to execute said computer program instructions defined by said modules of said sport analytics system, said modules comprising:
• an analytics module for analyzing said pre-recorded video stream, wherein said analytics module comprises:
• a detection module for detecting one or more persons present in a frame of said pre-recorded video stream, using one or more cues selected from a first set of cues comprising a facial detection, a head detection, a person detection, and a jersey number detection based on availability of said first set of cues;
• a tracking module for tracking said detected persons in said frame, by analyzing one or more preceding frames;
• a recognition module for recognizing said tracked persons in said frame using one or more cues selected from a second set of cues comprising a facial recognition, a person recognition, a jersey recognition, a score feed of said sporting event, and a commentary of said sporting event based on availability of said second set of cues, wherein individual weights are assigned to each of said facial recognition, said person recognition, and said jersey recognition when said facial recognition, said person recognition, and said jersey recognition are performed in said frame;
• a comparison module for identifying one or more players in said frame by comparing said assigned weights for each of said recognized persons with pre-existing data of all players;
• and
• a transmission module for transmitting said pre-recorded video stream and analysis data comprising contextual interactive content of said identified players to a client application provided on a user device by said sports analytics system, wherein said pre-recorded video stream is transformed into an interactive video comprising said contextual interactive content of said identified players.

A method for analyzing a pre-recorded video stream of a sporting event, the method employing a sports analytics system comprising at least one processor configured to execute computer program instructions for performing said method, said method comprising:

• analyzing said pre-recorded video stream, wherein said analysis comprises:
• detecting one or more persons present in a frame of said pre-recorded video stream, using one or more cues selected from a first set of cues comprising a facial detection, a head detection, a person detection, and a jersey number detection based on availability of said first set of cues;
• tracking said detected persons in said frame, by analyzing one or more preceding frames;
• recognizing said tracked persons in said frame using one or more cues selected from a second set of cues comprising a facial recognition, a person recognition, a jersey recognition, a score feed of said sporting event, and a commentary of said sporting event based on availability of said second set of cues, wherein individual weights are assigned to each of said facial recognition, said person recognition, and said jersey recognition when said facial recognition, said person recognition, and said jersey recognition are performed in said frame;
• and
• identifying one or more players in said frame by comparing said assigned weights for each of said recognized persons with pre-existing data of all players;
• and
• transmitting said pre-recorded video stream and analysis data comprising contextual interactive content of said identified players to a client application provided on a user device by said sports analytics system;
• whereby said pre-recorded video stream is transformed into an interactive video comprising said contextual interactive content of said identified players and transmitted to said user device.