# US 12,594,504 B2 · Identifying game video highlights > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,594,504 B2 - Document ID: US12594504B2 - Status: Granted - Kind: B2 - Application number: 18/322,895 - Filed: 2023-05-24 - Published: 2024-11-28 - Granted: 2026-04-07 - Earliest claimed: 2023-05-24 - Assignees: Sony Interactive Entertainment Inc. - Applicants: Sony Interactive Entertainment LLC - Inventors: Alex Benbassat - Web page: https://patentgrep.com/patent/US12594504B2 ## CPC - A63F 13/86: Watching games played by other players - A63F 13/212: using sensors worn by the player, e.g. for measuring heart beat or leg activity - A63F 13/216: using geographical information, e.g. location of the game device or player using GPS - A63F 13/537: using indicators, e.g. showing the condition of a game character on screen - A63F 13/67: adaptively or by learning from player actions, e.g. skill level adjustment or by storing successful combat sequences for re-use - A63F 13/798: for assessing skills or for ranking players, e.g. for generating a hall of fame - A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR ## Abstract A computer game as presented from spectator side may use clusters of marginally high heart rate to infer something interesting occurring on platform, which may be used in turn for video bookmarking highlights, other uses on the platform. ## Claims ### Claim 1 One or more non-transitory computer-readable media comprising computer-executable instructions that, when executed by one or more processors of an electronic device associated with a participant of a computer game being played by a player, cause the electronic device to perform operations comprising: presenting, on a display of the electronic device, a plurality of visual representations, wherein each visual representation of the plurality of visual representations corresponds to a different participant of a plurality of participants participating in the computer game; receiving a plurality of data values, wherein each data value of the plurality of data values is generated by a sensor and corresponds to a physiological condition of a different participant of the plurality of participants in the computer game; presenting, on the display, at least one data value of the plurality of data values that is associated with a first visual representation of the plurality of visual representations; determining that one or more data values of the plurality of data values satisfies a threshold condition; and changing, on the display, the first visual representation from a first graphic to a second graphic based on the one or more data values of the plurality of data values satisfying the threshold condition. ### Claim 2 (depends on 1) The one or more non-transitory computer-readable media of claim 1, wherein the physiological condition comprises a heart rate. ### Claim 3 (depends on 1) The one or more non-transitory computer-readable media of claim 1, wherein the plurality of participants comprise players of the computer game. ### Claim 4 (depends on 1) The one or more non-transitory computer-readable media of claim 1, wherein the plurality of participants comprise spectators of the computer game. ### Claim 5 (depends on 1) The one or more non-transitory computer-readable media of claim 1, wherein the electronic device comprises a game player system. ### Claim 6 (depends on 1) The one or more non-transitory computer-readable media of claim 1, wherein the electronic device comprises a game participant system. ### Claim 7 (depends on 1) The one or more non-transitory computer-readable media of claim 1, wherein presenting the plurality of visual representations includes presenting each visual representation of the plurality of visual representations in a visual cluster based at least in part on, for each participant of the plurality of participants, an age, skill, or geography of the participants. ### Claim 8 (depends on 7) The one or more non-transitory computer-readable media of claim 7, prior to presenting the plurality of visual representations in the visual cluster, determining the age, skill, or geography of each participant of the plurality of participants. ### Claim 9 An apparatus comprising: a memory comprising computer-executable instructions; and a processor configured to access the memory and execute the computer-executable instructions to perform operations comprising: presenting, on a display of an electronic device, a plurality of visual representations, wherein each visual representation of the plurality of visual representations corresponds to a different participant of a plurality of participants participating in a computer game; receiving a plurality of data values, wherein each data value of the plurality of data values is generated by a sensor and corresponds to a physiological condition of a different participant of the plurality of participants of the computer game; presenting, on the display, at least one data value of the plurality of data values that is associated with a first visual representation of the plurality of visual representations; determining that one or more data values of the plurality of data values satisfies a threshold condition; and changing, on the display, the first visual representation from a first graphic to a second graphic based on the one or more data values of the plurality of data values satisfying the threshold condition. ### Claim 10 (depends on 9) The apparatus of claim 9, wherein the sensor comprise a heart rate sensor. ### Claim 11 (depends on 9) The apparatus of claim 9, wherein presenting the plurality of visual representations includes presenting each visual representation of the plurality of visual representations in a visual cluster based at least in part on, for each participant of the plurality of participants, an age, skill, or geography of each participant of the plurality of participants. ### Claim 12 (depends on 11) The apparatus of claim 11, wherein the memory comprises additional computer-executable instructions and the processor is further configured to access the memory and execute the additional computer-executable instructions to perform additional operations comprising: prior to presenting the plurality of visual representations in the visual cluster, determining the age, skill, or geography of each participant of the plurality of participants. ### Claim 13 (depends on 9) The apparatus of claim 9, wherein the memory comprises additional computer-executable instructions and the processor is further configured to access the memory and execute the additional computer-executable instructions to perform additional operations comprising: presenting, on the display, at least one selector selectable to switch between presenting, of the plurality of visual representations, at least one of visual representations of players or spectators. ### Claim 14 A computer-implemented method comprising: presenting, on a display of an electronic device, a plurality of visual representations, wherein each visual representation of the plurality of visual representations corresponds to a different participant of a plurality of participants participating in a computer game; receiving a plurality of data values, wherein each data value of the plurality of data values is generated by a sensor and corresponds to a physiological condition of a different participant of the plurality of participants in the computer game; presenting, on the display, at least one data value of the plurality of data values that is associated with a first visual representation of the plurality of visual representations; determining that one or more data values of the plurality of data values satisfies a threshold condition; and changing, on the display, the first visual representation from a first graphic to a second graphic based on the one or more data values of the plurality of data values satisfying the threshold condition. ### Claim 15 (depends on 14) The computer-implemented method of claim 14, wherein presenting the plurality of visual representations includes presenting each visual representation of the plurality of visual representations in a visual cluster based at least in part on, for each participant of the plurality of participants, an age, skill, or geography of each participant of the plurality of participants. ### Claim 16 (depends on 15) The computer-implemented method of claim 15, further comprising, prior to presenting the plurality of visual representations in the visual cluster, determining the age, skill, or geography of each participant of the plurality of participants. ### Claim 17 (depends on 14) The computer-implemented method of claim 14, further comprising presenting at least one selector to select between presenting, of the plurality of visual representations, at least one of visual representations of players or spectators. ### Claim 18 (depends on 1) The one or more non-transitory computer-readable media of claim 1, further comprising additional computer-executable instructions that, when executed by the one or more processors, cause the electronic device to perform additional operations comprising presenting at least one selector to select between presenting, of the plurality of visual representations, at least one of visual representations of players or spectators. ### Claim 19 (depends on 9) The apparatus of claim 9, wherein the physiological condition comprises a heart rate. ### Claim 20 (depends on 16) The computer-implemented method of claim 16, wherein the physiological condition comprises a heart rate.