US 2025/0159309 A1 · AN AUGMENTED REALITY INTERFACE FOR WATCHING LIVE SPORT GAMES

Abstract

A system for controlling the rendering of a broadcasted game at a spectator side, comprising a set of cameras deploying around a real game field a memory for storing acquired video footages being a sequence of frames of the real game field and players in the real game; a 3D model of each player, generated before the game according to the performance of the each player, within previously taken video streams; an object detection module comprising at least one processor which is adapted to receive and processes the video footages; identify the each player and the real game field in each frame of the video footages; determine the location of each player on the game field in each frame; extract skeletal and skin features of each player from the video footages using deep learning models; generate 3D avatars for all players using the 3D model and the extracted features, to animate the respective 3D avatars; continuously track the location and movements of each player over the acquired video footages; determine pose features of each player over time. A transmitter transmits data related to the game field, the location data and the 3D avatars to a software application at the spectator side and a computerized terminal device at the spectator side executes the software application to thereby generate a synthesized game field and animate the 3D avatars according to pose features of each player.

Claims38

Dependent claims

A method for controlling the rendering of a broadcasted game at a spectator side, comprising:

a) deploying a set of cameras around a real game field;
b) acquiring, in real time, video footages being a sequence of frames of said real game field and players in said real game;
c) before said game, generating a 3D model of each player according to his performance within previously taken video streams;
d) identifying said each player and said real game field in each frame of said video footages, by an object detection module that receives and processes said video footages;
e) determining the location of each player on said game field in each frame;
f) extracting skeletal and skin features of each player from said video footages using deep learning models;
g) generating 3D avatars for all players using said 3D model and said extracted features, to animate the respective 3D avatars;
h) continuously tracking the location and movements of each player over the acquired video footages;
i) determining pose features of each player over time;
j) transmitting data related to said game field, the location data and said 3D avatars to a software application at the spectator side;
and
k) generating, on a computerized terminal device that executes a software application at said spectator side, a synthesized game field and animating, by said software application, said 3D avatars according to pose features of each player.

9 more elements

A system for controlling the rendering of a broadcasted game at a spectator side, comprising:

a) a set of cameras deploying around a real game field;
b) a memory for storing:
b.1) acquired video footages being a sequence of frames of said real game field and players in said real game;
c) a 3D model of each player, generated before said game according to the performance of said each player, within previously taken video streams;
d) an object detection module comprising at least one processor which is adapted to:
d.1) receive and processes said video footages;
d.2) identify said each player and said real game field in each frame of said video footages;
d.3) determine the location of each player on said game field in each frame;
d.4) extract skeletal and skin features of each player from said video footages using deep learning models;
d.5) generate 3D avatars for all players using said 3D model and said extracted features, to animate the respective 3D avatars;
d.6) continuously track the location and movements of each player over the acquired video footages;
d.7) determine pose features of each player over time;
e) a transmitter for transmitting data related to said game field, the location data and said 3D avatars to a software application at the spectator side;
and
f) a computerized terminal device at the spectator side that executes said software application to thereby generate a synthesized game field and animate said 3D avatars according to pose features of each player.

12 more elements

Dependencies are inferred from the claim text.

An augmented reality interface for watching live sport games

Life of this patent

An augmented reality interface for watching live sport games

Life of this patent

Abstract

Claims38