# US 2025/0061716 A1 · Generating customized summaries of virtual actions and events

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0061716 A1
- Document ID: US20250061716A1
- Status: Published application
- Kind: A1
- Application number: 18/933,948
- Filed: 2024-10-31
- Published: 2025-02-20
- Earliest claimed: 2022-07-21
- Assignees: Sony Interactive Entertainment Inc.
- Applicants: Sony Interactive Entertainment LLC; Sony Interactive Entertainment Inc.
- Inventors: Angela Bartolome; Supriti Dan; Genie-Rose Luluquisin; Benaisha Patel; Celeste Bean
- Web page: https://patentgrep.com/patent/US20250061716A1

## CPC

- A63F 13/497: Partially or entirely replaying previous game actions
- G06V 20/47: {Detecting features for summarising video content}
- A63F 13/53: involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game
- A63F 13/533: for prompting the player, e.g. by displaying a game menu
- A63F 13/85: Providing additional services to players
- A63F 13/86: Watching games played by other players
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A method and system for generating a customized summary of virtual actions and events. Gameplay data sent over a communication network from a client device of the player engaged in a current activity of the respective interactive content title within a current gameplay session may be monitored. A trigger in the monitored gameplay data is detected and associated with a request for a summary that encapsulates actions and events of past gameplay associated with the trigger. A subset of the actions and events of the past gameplay for the summary is selected based on one or more selected customized tags associated with the trigger. The summary is generated based on the selected subset of the actions and events and provided to the client device for presentation.

## Claims

### Claim 1

A computer-implemented method for generating customized summary of virtual actions and events, the computer-implemented method comprising:
tracking gaze data via a camera associated with a client device during a current interactive session to identify a point of focus within a stream of a three-dimensional virtual environment of a respective interactive content title towards which one or both eyes of a player are focused;
identifying a period of distraction during which the point of focus is determined not to be focused within the three-dimensional virtual environment, wherein a set of events occurred within the three-dimensional virtual environment during the period of distraction;
selecting a subset of events from among the set of events that occurred within the three-dimensional virtual environment during the period of distraction, wherein each of the events in the selected subset is associated with a portion of the stream; and
generating customized content for the client device in accordance with the gaze data, wherein generating the customized content is based on one or more portions of the stream associated with the selected subset of events.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, further comprising assigning one or more customized tags to one or more portions of the stream associated with the period of distraction based on the associated events meeting a threshold of significance in an identified storyline of the interactive content title, wherein selecting the subset of event is based on the customized tags.

### Claim 3 (depends on 2)

The computer-implemented method of claim 2, wherein the threshold of significance is met by one of the events when the event is determined to have adjusted a storyline of the interactive content title.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, wherein the customized content includes a custom flashback sequence regarding a storyline specific to a user of the client device, and wherein the customized content further includes a display regarding one or more combos or cheat codes input by the user during one of the events in the selected subset.

### Claim 5 (depends on 4)

The computer-implemented method of claim 4, further comprising:
tracking combos that have been input by the user to implement one of the actions within the virtual environment; and
generating the display including instructions for input of the combos into the client device.

### Claim 6 (depends on 4)

The computer-implemented method of claim 4, wherein the customized content is presented during a testing period, wherein the customized content includes data regarding on previously played combos associated with the respective event.

### Claim 7 (depends on 2)

The computer-implemented method of claim 2, further comprising:
storing one or more captured media clips associated with the customized tags; and
deleting one or more other captured media clips that are not associated with the customized tags.

### Claim 8 (depends on 7)

The computer-implemented method of claim 7, wherein the customized content includes a highlight reel based on the stored captured media clips.

### Claim 9 (depends on 1)

The computer-implemented method of claim 1, wherein the customized content includes generated virtual effects indicators correlated with directional sounds during the period of distraction.

### Claim 10 (depends on 1)

The computer-implemented method of claim 1, wherein the customized content includes an overlay that superimposes a ghost version of a previous interactive session over a display of the current interactive session.

### Claim 11 (depends on 1)

The computer-implemented method of claim 1, wherein generating the customized content includes restoring a status or setting from a previous interactive session of a user of the client device.

### Claim 12 (depends on 1)

The computer-implemented method of claim 1, further comprising detecting a trigger during the current interactive session, wherein detecting the trigger is based on the player not moving for a period of time that passes a threshold limit, and wherein selecting the subset of events is responsive to the detected trigger.

### Claim 13

A system for generating a customized summary of virtual actions and events, the system comprising:
a communication interface that communicates with a client device over a communication network, wherein the communication interface receives gaze data captured via a camera associated with the client device during a current interactive session to identify a point of focus within a stream of a three-dimensional virtual environment of a respective interactive content title towards which one or both eyes of a player are focused;
memory that tracks the received gaze data; and
one or more processors that execute instructions stored in memory, wherein the processors execute the instructions to:
identifying a period of distraction during which the point of focus is determined not to be focused within the three-dimensional virtual environment, wherein a set of events occurred within the three-dimensional virtual environment during the period of distraction,
select a subset of events from among the set of events that occurred within the three-dimensional virtual environment during the period of distraction, wherein each of the events in the selected subset is associated with a portion of the stream, and
generate customized content for the client device in accordance with the gaze data, wherein generating the customized content is based on one or more portions of the stream associated with the selected subset of events.

### Claim 14 (depends on 13)

The system of claim 13, wherein the processors execute further instructions to assign one or more customized tags to one or more portions of the stream associated with the period of distraction based on the associated events meeting a threshold of significance in an identified storyline of the interactive content title, wherein selecting the subset of event is based on the customized tags.

### Claim 15 (depends on 14)

The system of claim 14, wherein the threshold of significance is met by one of the events when the event is determined to have adjusted a storyline of the interactive content title.

### Claim 16 (depends on 13)

The system of claim 13, wherein the customized content includes a custom flashback sequence regarding a storyline specific to a user of the client device, and wherein the customized content further includes a display regarding one or more combos or cheat codes input by the user during one of the events in the selected subset.

### Claim 17 (depends on 16)

The system of claim 16, wherein the processors execute further instructions to:
track combos that have been used and associated objects; and
generate instructions regarding entry of the combos into the client device.

### Claim 18 (depends on 16)

The system of claim 16, wherein the customized content is presented during a testing period, wherein the customized content includes data regarding on previously played combos associated with the respective event.

### Claim 19 (depends on 14)

The system of claim 14, wherein the memory further:
stores one or more captured media clips associated with the customized tags; and
deletes one or more other captured media clips that are not associated with the customized tags.

### Claim 20 (depends on 19)

The system of claim 19, wherein the customized content includes a highlight reel based on the stored captured media clips.

### Claim 21 (depends on 13)

The system of claim 13, wherein the customized content includes generated virtual effects indicators correlated with directional sounds during the period of distraction.

### Claim 22 (depends on 13)

The system of claim 13, wherein the customized content includes an overlay that superimposes a ghost version of a previous interactive session over a display of the current interactive session.

### Claim 23 (depends on 13)

The system of claim 13, wherein the processor generates the customized content by restoring a status or setting from a previous interactive session of a user of the client device.

### Claim 24 (depends on 13)

The system of claim 13, wherein the processors execute further instructions to detect a trigger during the current interactive session based on the player not moving for a period of time that passes a threshold limit, and wherein the processors selects the subset of events responsive to the detected trigger.

### Claim 25

A non-transitory computer-readable storage medium having embodied thereon a program executable by one or more processors to perform a method for generating a customized summary of virtual actions and events, the method comprising:
tracking gaze data via a camera associated with a client device during a current interactive session to identify a point of focus within a stream of a three-dimensional virtual environment of a respective interactive content title towards which one or both eyes of a player are focused;
identifying a period of distraction during which the point of focus is determined not to be focused within the three-dimensional virtual environment, wherein a set of events occurred within the three-dimensional virtual environment during the period of distraction;
selecting a subset of events from among the set of events that occurred within the three-dimensional virtual environment during the period of distraction, wherein each of the events in the selected subset is associated with a portion of the stream; and
generating customized content for the client device in accordance with the gaze data, wherein generating the customized content is based on one or more portions of the stream associated with the selected subset of events.
