AI player model gameplay training and highlight review
AssigneeSony Interactive Entertainment Inc.
InventorsMahdi Azmandian, Kazuyuki Arimatsu, Lakshmish Kaushik
Life of this patent
Estimating the term…
Abstract
Methods and systems for engaging an AI player of a user to play a video game on behalf of the user includes creating the AI player for the user using at least some of the attributes of the user, training the AI player using inputs provided by the user during game play of the video game, and providing access to the video game for game play to the AI player. The access allows the AI player to provide inputs to the video game that substantially mimics a play style of the user. Control of the game play of the video game can be transitioned to the user at any time during the game play of the AI player. The user can also control the game play of the AI player from a video recording of the game play.
Claims21
A method comprising:
- accessing first game play data comprising a plurality of first video frames, wherein the first game play data is generated based on one or more first game states generated based on first input data received from a client device associated with a user, and wherein the first input data represents first inputs provided by the user to the client device during a progression of a video game from a starting point in a video game to a first progress point in the video game;
- transferring the first game play data to the client device;
- creating an artificial intelligence (AI) player using first training data generated by identifying, based in-part on the first input data, a first play style exhibited by the user from the starting point in the video game to the first progress point in the video game, wherein the AI player is configured to mimic the first play style exhibited by the user;
- accessing second game play data comprising a plurality of second video frames, the plurality of second video frames occurring in a sequence of video frames after the plurality of first video frames, wherein the second game play data is generated based on one or more second game states generated based on second input data received from the client device, and wherein the second input data represents second inputs provided by the user to the client device during the progression of the video game from the first progress point in the video game to a second progress point in the video game that occurs after the first progress point;
- transferring the second game play data to the client device;
- training the AI player to result in a trained AI player using second training data generated by identifying, based in-part on the second input data, a second play style exhibited by the user from the first progress point to the second progress point in the video game, wherein the trained AI player is configured to mimic the second play style exhibited by the user;
- using the trained AI player to generate third game play data comprising a plurality of third video frames, the plurality of third video frames occurring in the sequence of video frames after the plurality of second video frames, wherein the third game play data is generated based on one or more third game states generated based on third input data, and wherein the third input data represents third inputs generated by the trained AI player during the progression of the video game from the second progress point to a third progress point in the video game, wherein the third progress point occurs after the second progress point in the video game;
- transferring the third game play data to the client device;
- extrapolating a plurality of fourth video frames from two or more third video frames of the plurality of third video frames, the plurality of fourth video frames depicting a character that mimics the second play style exhibited by the user and played by the trained AI player;
- and
- generating a video recording of the trained AI player progressing in the video game based on the third game play data and the plurality of fourth video frames.
A server device comprising:
- one or more processors;
- and
- a memory storing computer readable instructions which, when executed by the one or more processors, cause the server device to perform operations comprising:
- accessing first game play data comprising a plurality of first video frames, wherein the first game play data is generated based on one or more first game states generated based on first input data received from a client device associated with a user, and wherein the first input data represents first inputs provided by the user to the client device during a progression of a video game from a starting point in a video game to a first progress point in the video game;
- transferring the first game play data to the client device;
- creating an artificial intelligence (AI) player using first training data generated by identifying, based in-part on the first input data, a first play style exhibited by the user from the starting point in the video game to the first progress point in the video game, wherein the AI player is configured to mimic the first play style exhibited by the user;
- accessing second game play data comprising a plurality of second video frames, the plurality of second video frames occurring in a sequence of video frames after the plurality of first video frames, wherein the second game play data is generated based on one or more second game states generated based on second input data received from the client device, and wherein the second input data represents second inputs provided by the user to the client device during the progression of the video game from the first progress point in the video game to a second progress point in the video game that occurs after the first progress point;
- transferring the second game play data to the client device;
- training the AI player to result in a trained AI player using second training data generated by identifying, based in-part on the second input data, a second play style exhibited by the user from the first progress point to the second progress point in the video game, wherein the trained AI player is configured to mimic the second play style exhibited by the user;
- using the trained AI player to generate third game play data comprising a plurality of third video frames, the plurality of third video frames occurring in the sequence of video frames after the plurality of second video frames, wherein the third game play data is generated based on one or more third game states generated based on third input data, and wherein the third input data represents third inputs generated by the trained AI player during the progression of the video game from the second progress point to a third progress point in the video game, wherein the third progress point occurs after the second progress point in the video game;
- transferring the third game play data to the client device;
- extrapolating a plurality of fourth video frames from two or more third video frames of the plurality of third video frames, the plurality of fourth video frames depicting a character that mimics the second play style exhibited by the user and played by the trained AI player;
- and
- generating a video recording of the trained AI player progressing in the video game based on the third game play data and the plurality of fourth video frames.
One or more non-transitory computer readable media storing computer readable instructions that, when executed by one or more processors, cause a system to perform operations comprising:
- accessing first game play data comprising a plurality of first video frames, wherein the first game play data is generated based on one or more first game states generated based on first input data received from a client device associated with a user, and wherein the first input data represents first inputs provided by the user to the client device during a progression of a video game from a starting point in a video game to a first progress point in the video game;
- transferring the first game play data to the client device;
- creating an artificial intelligence (AI) player using first training data generated by identifying, based in-part on the first input data, a first play style exhibited by the user from the starting point in the video game to the first progress point in the video game, wherein the AI player is configured to mimic the first play style exhibited by the user;
- accessing second game play data comprising a plurality of second video frames, the plurality of second video frames occurring in a sequence of video frames after the plurality of first video frames, wherein the second game play data is generated based on one or more second game states generated based on second input data received from the client device, and wherein the second input data represents second inputs provided by the user to the client device during the progression of the video game from the first progress point in the video game to a second progress point in the video game that occurs after the first progress point;
- transferring the second game play data to the client device;
- training the AI player to result in a trained AI player using second training data generated by identifying, based in-part on the second input data, a second play style exhibited by the user from the first progress point to the second progress point in the video game, wherein the trained AI player is configured to mimic the second play style exhibited by the user;
- using the trained AI player to generate third game play data comprising a plurality of third video frames, the plurality of third video frames occurring in the sequence of video frames after the plurality of second video frames, wherein the third game play data is generated based on one or more third game states generated based on third input data, and wherein the third input data represents third inputs generated by the trained AI player during the progression of the video game from the second progress point to a third progress point in the video game, wherein the third progress point occurs after the second progress point in the video game;
- transferring the third game play data to the client device;
- extrapolating a plurality of fourth video frames from two or more third video frames of the plurality of third video frames, the plurality of fourth video frames depicting a character that mimics the second play style exhibited by the user and played by the trained AI player;
- and
- generating a video recording of the trained AI player progressing in the video game based on the third game play data and the plurality of fourth video frames.
Dependencies are inferred from the claim text.