# US 2017/0282079 A1 · System and method of generating and providing interactive annotation items based on triggering events in a video game > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2017/0282079 A1 - Document ID: US20170282079A1 - Status: Published application - Kind: A1 - Application number: 15/136,386 - Filed: 2016-04-22 - Published: 2017-10-05 - Earliest claimed: 2016-04-01 - Assignees: Activision Publishing, Inc. - Applicants: Activision Publishing, Inc. - Inventors: Allen Joseph DE LA CRUZ - Web page: https://patentgrep.com/patent/US20170282079A1 ## CPC - A63F 13/67: adaptively or by learning from player actions, e.g. skill level adjustment or by storing successful combat sequences for re-use - A63F 13/537: using indicators, e.g. showing the condition of a game character on screen - A63F 13/5375: for graphically or textually suggesting an action, e.g. by displaying an arrow indicating a turn in a driving game - A63F 13/63: by the player, e.g. authoring using a level editor - A63F 13/795: for finding other players; for building a team; for providing a buddy list - A63F 13/86: Watching games played by other players - A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR ## Abstract A system and method is provided that automatically annotates gameplay based on triggering events that occur during a gameplay session. The system may automatically annotate the gameplay in real-time, such as during a gameplay session associated with an electronic-sports tournament. For example, the system may obtain and parse a game log corresponding to the gameplay session, identify triggering events based on the game log, obtain an annotation rule associated with the triggering event, generate an annotation item based on the annotation rule, and cause the annotation item to be presented in association with video of the gameplay session. An annotation item may be displayed interactively such that, when selected, causes the system to take an action. The action may include obtaining additional information relating to the selected annotation item; saving, sharing, liking/disliking or commenting on the selected annotation item; removing the selected annotation item from a display, and/or other actions. ## Claims ### Claim 1 A computer-implemented method of providing interactive annotation items, which are generated based on triggering events during gameplay, and performing actions responsive to user interactions with the interactive annotation items, the method being implemented in a computer system having one or more physical processors programmed with computer program instructions that, when executed by the one or more physical processors, cause the computer system to perform the method, the method comprising: obtaining, by the computer system, an annotation item that is generated based on one or more triggering events during the gameplay; generating, by the computer system, a user interface comprising a display portion that includes video of the gameplay and an annotation portion that includes the annotation item; receiving, by the computer system, an indication that the annotation item was interacted with via the user interface; determining, by the computer system, an action to be taken based on the indication; and causing, by the computer system, the action to be taken. ### Claim 2 (depends on 1) The method of claim 1, wherein determining the action to be taken comprises: determining, by the computer system, that the annotation item should be shared, and wherein causing the action to be taken comprises sharing, by the computer system, the annotation item. ### Claim 3 (depends on 2) The method of claim 2, wherein sharing the annotation item comprises: causing, by the computer system, the annotation item to be posted to a social media site. ### Claim 4 (depends on 2) The method of claim 2, wherein sharing the annotation item comprises: causing, by the computer system, the annotation item to be transmitted via electronic mail. ### Claim 5 (depends on 1) The method of claim 1, wherein determining the action to be taken comprises: determining, by the computer system, that the annotation item should be stored in association with a user identification, and wherein causing the action to be taken comprises causing, by the computer system, the annotation item to be stored in association with the user identification. ### Claim 6 (depends on 1) The method of claim 1, wherein determining the action to be taken comprises: determining, by the computer system, that additional information relating to the annotation item should be obtained and provided, and wherein causing the action to be taken comprises obtaining, by the computer system, the additional information and providing the additional information via the user interface. ### Claim 7 (depends on 1) The method of claim 1, wherein determining the action to be taken comprises: determining, by the computer system, that the annotation item should be removed from the annotation portion, and wherein causing the action to be taken comprises removing, by the computer system, the annotation item from the annotation portion. ### Claim 8 (depends on 7) The method of claim 7, the method further comprising: replacing, by the computer system, the removed annotation item with a different annotation item. ### Claim 9 (depends on 1) The method of claim 1, the method further comprising: obtaining, by the computer system, at least a portion of a game log for a gameplay session during which the gameplay occurs; identifying, by the computer system, a triggering event based on the game log; generating, by the computer system, the annotation item based on the triggering event. ### Claim 10 (depends on 9) The method of claim 9, the method further comprising: storing, by the computer system, the indication that the annotation item was interacted with along with a previous indication that a previous annotation item was interacted with, wherein generating the annotation item is based further on the previous indication that the previous annotation item was interacted with, indicating that a given user was interested in the previous annotation item. ### Claim 11 A system of providing interactive annotation items, which are generated based on triggering events during gameplay, and performing actions responsive to user interactions with the interactive annotation items, the system comprising: a computer system comprising one or more physical processors programmed with computer program instructions that, when executed by the one or more physical processors, program the computer system to: obtain an annotation item that is generated based on one or more triggering events during the gameplay; generate a user interface comprising a display portion that includes video of the gameplay and an annotation portion that includes the annotation item; receive an indication that the annotation item was interacted with via the user interface; determine an action to be taken based on the indication; and cause the action to be taken. ### Claim 12 (depends on 11) The system of claim 11, wherein to determine the action to be taken, the computer system is programmed to: determine that the annotation item should be shared, and wherein to cause the action to be taken, the computer system is programmed to share the annotation item. ### Claim 13 (depends on 12) The system of claim 12, wherein to share the annotation item, the computer system is programmed to: cause the annotation item to be posted to a social media site. ### Claim 14 (depends on 12) The system of claim 12, wherein to share the annotation item, the computer system is programmed to: cause the annotation item to be transmitted via electronic mail. ### Claim 15 (depends on 11) The system of claim 11, wherein to determine the action to be taken, the computer system is programmed to: determine that the annotation item should be stored in association with a user identification, and wherein to cause the action to be taken, the computer system is programmed to cause the annotation item to be stored in association with the user identification. ### Claim 16 (depends on 11) The system of claim 11, wherein to determine the action to be taken, the computer system is programmed to: determine that additional information relating to the annotation item should be obtained and provided, and wherein to cause the action to be taken, the computer system is programmed to obtain the additional information and providing the additional information via the user interface. ### Claim 17 (depends on 11) The system of claim 11, wherein to determine the action to be taken, the computer system is programmed to: determine that the annotation item should be removed from the annotation portion, and wherein to cause the action to be taken, the computer system is programmed to remove the annotation item from the annotation portion. ### Claim 18 (depends on 17) The system of claim 17, wherein the computer system is programmed to: replace the removed annotation item with a different annotation item. ### Claim 19 (depends on 11) The system of claim 11, wherein the computer system is programmed to: obtain at least a portion of a game log for a gameplay session during which the gameplay occurs; identify a triggering event based on the game log; generate the annotation item based on the triggering event. ### Claim 20 (depends on 19) The system of claim 19, wherein the computer system is programmed to: store the indication that the annotation item was interacted with along with a previous indication that a previous annotation item was interacted with, wherein the annotation item is generated based further on the previous indication that the previous annotation item was interacted with, indicating that a given user was interested in the previous annotation item.