# US 10,245,509 B2 · System and method of inferring user interest in different aspects of video game streams > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,245,509 B2 - Document ID: US10245509B2 - Status: Granted - Kind: B2 - Application number: 14/919,444 - Filed: 2015-10-21 - Published: 2017-04-27 - Granted: 2019-04-02 - Earliest claimed: 2015-10-21 - Assignees: Activision Publishing, Inc. - Applicants: Activision Publishing, Inc. - Inventors: Michael D. Marr; Keith S. Kaplan - Web page: https://patentgrep.com/patent/US10245509B2 ## CPC - H04L 67/131: Protocols for games, networked simulations or virtual reality - A63F 13/355: Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client - A63F 13/497: Partially or entirely replaying previous game actions - H04L 65/1089: by adding media; by removing media - H04L 65/611: for multicast or broadcast (systems for broadcast or conference H04L12/18; arrangements for broadcast or distribution combined with broadcast H04H20/00; arrangements for broadcast applications with a direct linkage to broadcast information or to broadcast space-time H04H60/00; selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS], H04W4/06) - H04L 65/762: {at the source (reformatting of additional data in video distribution servers H04N21/2355)} - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR ## Abstract A system and method is provided that generates a game log that specifies game events during gameplay to enable efficient distribution of video game playback, facilitates the annotation of gameplay through content from users and others, and generates a video game stream that includes the game log and content. The system facilitates the efficient sharing of video game playback, as well as annotations from users and others. For example, e-sportscasters may use the system to broadcast video game playback with their commentary and/or graphical overlays. Video game players may use the system to share video game playback efficiently with other users. The system may also facilitate the sharing of loadout conditions and micro-transactions relevant to video game playback. ## Claims ### Claim 1 A computer-implemented method of determining interest in a portion or all of a video game stream used for playback of gameplay of a video games, the method being implemented in a computer system having one or more physical processors programmed with computer program instructions that, when executed by the one or more physical processors, cause the computer system to perform the method, the method comprising: detecting, by the computer, an occurrence of an in-game action by one or more users engaged in the gameplay of the video game, wherein the occurrence of the in-game action is indicative that an event of interest has occurred or will occur during the gameplay, wherein the video game stream used for playback of the gameplay of the video game includes a game log and a metadata track, the game log specifies at least a first event that occurred during the gameplay of the video game and information that indicates at least a first time in which the first event occurred during the gameplay, and the metadata track includes annotation content relating to the gameplay; generating, by the computer, an inference object based on the detected occurrence, wherein the inference object comprises portions of the video game stream used in the gameplay; and causing, by the computer, at least one of a playback of a replay clip based on the inference object, wherein the replay clip comprises at least a portion of the gameplay that has been completed, or a generation of a virtual trading card based on the inference object. ### Claim 2 (depends on 1) The method of claim 1, wherein detecting an occurrence of an in-game action by one or more users engaged in the gameplay of the video game comprises: detecting, by the computer, one or more user inputs, indicative of user interest, by the one or more users during the gameplay of the video game. ### Claim 3 (depends on 1) The method of claim 1, wherein detecting an occurrence of an in-game action by one or more users engaged in the gameplay of the video game comprises: detecting, by the computer, one or more user inputs, indicative of user interest, by the one or more users, the user inputs being based on the video game playback. ### Claim 4 (depends on 1) The method of claim 1, wherein generating the inference object comprises: generating, by the computer, the inference object during gameplay. ### Claim 5 (depends on 4) The method of claim 4, the method further comprising: detecting, by the computer, an inference trigger that indicates that an event of interest has occurred or will occur during the gameplay of the video game, wherein the inference object is generated upon the detection of the inference trigger. ### Claim 6 (depends on 5) The method of claim 5, wherein the inference trigger comprises an occurrence of an in-game action by one or more users engaged in the gameplay of the video game, wherein the in-game action comprises an occurrence of at least one of a user obtaining a predefined performance metric during the gameplay or an in-game taunt. ### Claim 7 (depends on 5) The method of claim 5, wherein the inference trigger comprises an occurrence of a predictive trigger that uses predefined events to predict an occurrence of predefined gameplay during the gameplay of the video game. ### Claim 8 (depends on 1) The method of claim 1, wherein detecting an occurrence of an in-game action by one or more users engaged in the gameplay of the video game comprises: identifying, by the computer, at least a portion of the metadata track of likely interest to the one or more users, the metadata track of likely interest comprising annotations conveying interest of the one or more users corresponding to at least a portion of the video game stream. ### Claim 9 (depends on 1) The method of claim 1, wherein detecting an occurrence of an in-game action by one or more users engaged in the gameplay of the video game comprises: identifying, by the computer, one or more events of the game log of likely interest to the one or more users, wherein the game log comprises a record of at least one event that occurred during the gameplay of the video game, and wherein the at least one event corresponds to an in-game action by the one or more users and wherein the in-game action conveys an interest of the one or more users corresponding to at least a portion of the video game stream. ### Claim 10 A system for determining interest in a portion or all of a video game stream used for playback of a gameplay of a video games, the system comprising: one or more physical processors programmed with one or more computer program instructions which, when executed, cause the one or more physical processors to: detect an occurrence of an in-game action by one or more users engaged in said gameplay of the video game, wherein the occurrence of the in-game action is indicative that an event of interest has occurred or will occur during the gameplay, wherein the video game stream includes a game log and a metadata track, the game log specifies at least a first event that occurred during gameplay of a video game and information that indicates at least a first time in which the first event occurred during the gameplay, and the metadata track includes annotation content relating to the gameplay; generate an inference object based on the detected occurrence, wherein the inference object comprises portions of the video game stream used in the gameplay; and generate at least one of a playback of a replay clip based on the inference object, wherein the replay clip comprises at least a portion of the gameplay that has been completed, or a generation of a virtual trading card based on the inference object. ### Claim 11 (depends on 10) The system of claim 10, wherein to detect an occurrence of an in-game action by one or more users engaged in the gameplay of the video game, the one or more physical processors are further caused to detect one or more user inputs, indicative of user interests, by the one or more users during the gameplay of the video game. ### Claim 12 (depends on 10) The system of claim 10, wherein to detect an occurrence of an in-game action by one or more users engaged in the gameplay of the video game, the one or more physical processors are further caused to detect one or more user inputs, indicative of user interests, by the one or more users, the user inputs being based on the video game playback. ### Claim 13 (depends on 10) The system of claim 10, wherein to generate the inference object, the one or more physical processors are further caused to: generate the inference object during gameplay. ### Claim 14 (depends on 13) The system of claim 13, wherein the one or more physical processors are further caused to: detect an inference trigger that indicates that an event of interest has occurred or will occur during the gameplay of the video game, wherein the inference object is generated upon the detection of the inference trigger. ### Claim 15 (depends on 14) The system of claim 14, wherein the inference trigger comprises an occurrence of an in-game action by one or more users engaged in the gameplay of the video game, wherein the in-game action comprises an occurrence of at least one of a user obtaining a predefined performance metric during the gameplay or an in-game taunt. ### Claim 16 (depends on 14) The system of claim 14, wherein the inference trigger comprises an occurrence of a predictive trigger that uses predefined events to predict an occurrence of interesting gameplay. ### Claim 17 (depends on 10) The system of claim 10, wherein to detect an occurrence of an in-game action by one or more users engaged in the gameplay of the video game, the one or more physical processors are further caused to identify at least a portion of the metadata track of likely interest to the one or more users, wherein the metadata track of likely interest comprises annotations conveying interest of the one or more users corresponding to at least a portion of the video game stream. ### Claim 18 (depends on 10) The system of claim 10, wherein to detect an occurrence of an in-game action by one or more users engaged in the gameplay of the video game, the one or more physical processors are further caused to identify one or more events of the game log of likely interest to the one or more users, wherein the game log comprises a record of at least one event that occurred during the gameplay of the video game, wherein the at least one event corresponds to an in-game action by the one or more users, and wherein the in-game action conveys interest of the one or more users corresponding to at least a portion of the video game stream. ### Claim 19 A computer program product for determining interest in a portion or all of a video game stream used for playback of a gameplay of a video games, the computer program product comprising: one or more tangible, non-transitory computer-readable storage devices; program instructions, stored on at least one of the one or more tangible, non-transitory computer-readable tangible storage devices that, when executed, cause a computer to: detect an occurrence of an in-game action by one or more users engaged in the gameplay of the video game, wherein the occurrence of the in-game action is indicative that an event of interest has occurred or will occur during the gameplay, wherein the video game stream includes a game log and a metadata track, the game log specifies at least a first event that occurred during gameplay of a video game and information that indicates at least a first time in which the first event occurred during the gameplay, and the metadata track includes annotation content relating to the gameplay; generate, an inference object based on the detected occurrence, wherein the inference object comprises portions of the video game stream used in the gameplay; and generate at least one of: a playback of a replay clip based on the inference object, wherein the replay clip comprises at least a portion of the gameplay that has been completed, or a generation of a virtual trading card based on the inference object. ### Claim 20 (depends on 19) The computer program product of claim 19, wherein to detect an occurrence of an in-game action by one or more users engaged in the gameplay of the video game, the program instructions, when executed, further cause the computer to: detect one or more user inputs, indicative of user interests, by the one or more users during the gameplay of the video game. ### Claim 21 (depends on 19) The computer program product of claim 19, wherein to detect an occurrence of an in-game action by one or more users engaged in the gameplay of the video game, the program instructions, when executed, further cause the computer to: detect one or more user inputs, indicative of user interests, by the one or more users, the user inputs being based on the video game playback. ### Claim 22 (depends on 19) The computer program product of claim 19, wherein to generate the inference object, the program instructions, when executed, further cause the computer to: generate the inference object during gameplay and detect an inference trigger that indicates that an event of interest has occurred or will occur during the gameplay of the video game, wherein the inference object is generated upon detection of the inference trigger. ### Claim 23 (depends on 22) The computer program product of claim 22, wherein the inference trigger comprises at least one of: an occurrence of an in-game action by one or more players during the gameplay of the video game or an occurrence of an in-game achievement by one or more players during the gameplay of the video game. ### Claim 24 (depends on 19) The computer program product of claim 19, wherein to detect an occurrence of an in-game action by one or more users engaged in the gameplay of the video game, the program instructions, when executed, further cause the computer to: identify at least a portion of the metadata track of likely interest to the one or more users, the metadata track of likely interest comprising annotations conveying interest of the one or more users corresponding to at least a portion of the video game stream. ### Claim 25 (depends on 19) The computer program product of claim 19, wherein to detect an occurrence of an in-game action by one or more users engaged in the gameplay of the video game, the program instructions, when executed, further cause the computer to: identify one or more events of the game log of likely interest to the one or more users, wherein the game log comprises a record of at least one event that occurred during the gameplay of the video game, and wherein the at least one event corresponds to an in-game action by the one or more users, the in-game action conveying interest of the one or more users corresponding to at least a portion of the video game stream.