# US 2023/0067090 A1 · Methods, systems and devices for providing portions of recorded game content in response to an audio trigger

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0067090 A1
- Document ID: US20230067090A1
- Status: Published application
- Kind: A1
- Application number: 17/507,985
- Filed: 2021-10-22
- Published: 2023-03-02
- Earliest claimed: 2021-09-02
- Assignees: STEELSERIES ApS
- Applicants: STEELSERIES ApS
- Inventors: Raphaël Greff; Nathan Souviraa-Labastie; Thomas Jacques Roland Serre
- Web page: https://patentgrep.com/patent/US20230067090A1

## CPC

- A63F 13/424: involving acoustic input signals, e.g. by using the results of pitch or rhythm extraction or voice recognition
- A63F 13/213: comprising photodetecting means, e.g. cameras, photodiodes or infrared cells (A63F13/219 takes precedence)
- A63F 13/215: comprising means for detecting acoustic signals, e.g. using a microphone
- A63F 13/54: involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall
- A63F 13/67: adaptively or by learning from player actions, e.g. skill level adjustment or by storing successful combat sequences for re-use
- A63F 13/79: involving player-related data, e.g. identities, accounts, preferences or play histories
- A63F 13/86: Watching games played by other players
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- A63F 13/533: for prompting the player, e.g. by displaying a game menu
- A63F 13/537: using indicators, e.g. showing the condition of a game character on screen
- A63F 13/87: Communicating with other players during game play, e.g. by e-mail or chat
- A63F 2300/308: Details of the user interface
- A63F 2300/5546: using player registration data, e.g. identification, account, preferences, game history
- A63F 2300/572: Communication between players during game play of non game information, e.g. e-mail, chat, file transfer, streaming of audio and streaming of video
- A63F 2300/6072: of an input signal, e.g. pitch and rhythm extraction, voice recognition
- A63F 2300/6081: generating an output signal, e.g. under timing constraints, for spatialization
- G06N 3/02: Neural networks
- G06N 3/08: Learning methods
- G06N 3/09: Supervised learning
- G10L 15/16: using artificial neural networks
- G10L 15/26: Speech to text systems (G10L15/08 takes precedence)
- G10L 25/51: for comparison or discrimination
- H04R 1/1083: {Reduction of ambient noise (active noise reduction per se G10K11/175; protective devices for the ear, e.g. providing acoustic protection A61F11/06)}
- H04R 3/12: for distributing signals to two or more loudspeakers {(specially adapted for hearing aids H04R25/407)}
- H04R 5/033: Headphones for stereophonic communication {(details thereof, e.g. relating to batteries, cables or control elements H04R1/10)}
- H04R 5/04: Circuit arrangements, {e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments (combinations of amplifiers H03F3/68; stereophonic systems H04S)}
- H04S 7/302: {Electronic adaptation of stereophonic sound system to listener position or orientation (H04S7/301 takes precedence)}
- H04S 7/308: {Electronic adaptation dependent on speaker or headphone connection}
- H04S 2400/01: Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
- H04S 2420/01: Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)
- H04S: STEREOPHONIC SYSTEMS

## Abstract

A system that incorporates the subject disclosure may include, for example, a gaming system that cooperates with a graphical user interface to enable user modification and enhancement of one or more audio streams associated with the gaming system. In embodiments, the audio streams may include a game audio stream, a chat audio stream of conversation among players of a video game, and a microphone audio stream of a player of the video game. One of the audio streams may trigger an action in the gaming system such as recording a portion of game content for a timer period. Additional embodiments are disclosed.

## Claims

### Claim 1

A method, comprising:
receiving, by a processing system including a processor, a gaming system output stream during a video game, the gaming system output stream including audio output captured by a microphone, video output captured by a camera, or a combination thereof;
detecting, by the processing system, a current trigger in the gaming system output stream during the video game;
recording, by the processing system, a trigger clip of game content, wherein the trigger clip comprises a portion of game content that includes the current trigger; and
providing, by the processing system, the trigger clip to a group of gaming devices over a communication network, wherein each gaming device of the group of gaming devices is associated with one player of the video game.

### Claim 2 (depends on 1)

The method of claim 1, wherein the detecting a current trigger comprises:
providing, by the processing system, the gaming system output stream to a neural network; and
receiving, by the processing system, an indication that the current trigger has been detected.

### Claim 3 (depends on 2)

The method of claim 2, wherein the receiving an indication that the current trigger has been detected comprises:
receiving, by the processing system, from the neural network a value that corresponds to a probability that the current trigger has been detected.

### Claim 4 (depends on 3)

The method of claim 3, further comprising:
comparing, by the processing system, the value that corresponds to a probability with a predetermined threshold; and
determining, by the processing system, that the current trigger has been detected responsive to the comparing.

### Claim 5 (depends on 2)

The method of claim 2, wherein the neural network has been trained on training data from one or more video games.

### Claim 6 (depends on 5)

The method of claim 5, wherein the training data comprises data corresponding to vocal utterances and non-vocal utterances of players of the one or more video games.

### Claim 7 (depends on 6)

The method of claim 6, wherein the training data comprises data corresponding to conversations, laughter and screaming of players of the one or more video games.

### Claim 8 (depends on 1)

The method of claim 1, wherein the detecting a current trigger in the gaming system output stream comprises:
identifying, by the processing system, one of a laugh or a scream by a player of the video game in the gaming system output stream.

### Claim 9 (depends on 1)

The method of claim 1, wherein the receiving a gaming system output stream comprises:
receiving, by the processing system; a plurality of audio streams including a chat audio stream, a game audio stream and a microphone audio stream; and
detecting, by the processing system, the current trigger in one of the chat audio stream and the microphone audio stream.

### Claim 10 (depends on 1)

The method of claim 1, further comprising:
determining, by the processing system, a group of players involved in the current trigger;
recording, by the processing system, the trigger clip of game content for each player in the group of players, resulting in a group of trigger clips, wherein each trigger clip of the group of trigger clips comprises a portion of game content that includes the current trigger from a perspective of each player of the group of players; and
providing, by the processing system, the group of trigger clips to the group of gaming devices over the communication network, wherein each gaming device of the group of gaming devices is associated with one player of the group of players.

### Claim 11

A method comprising:
receiving, by a processing system including a processor, an input stream during a video game, the input stream including audio input captured by a microphone, video input captured by a camera, or a combination thereof;
applying, by the processing system, a trigger model to the input stream, wherein the trigger model is generated by a neural network trained on a training audio input, a training video input, or a combination thereof;
detecting, by the processing system according to the trigger model, a current trigger in the input stream during the video game, wherein the current trigger comprises an audio trigger, a video trigger or combination thereof; and
recording, by the processing system, a trigger clip of game content, wherein the trigger clip comprises a portion of game content for a time period before and after the current trigger.

### Claim 12 (depends on 11)

The method of claim 11, wherein the training audio input includes speech, laughing, and screaming.

### Claim 13 (depends on 11)

The method of claim 11, wherein the training video input includes facial expressions, hand gestures, body movements, or a combination thereof.

### Claim 14 (depends on 11)

The method of claim 11, wherein the time period before and after the current trigger is selected from a group of time periods according to a type of current trigger.

### Claim 15 (depends on 11)

The method of claim 11, comprising:
identifying a characteristic of the current trigger resulting in a trigger characteristic, wherein the time period before and after the current trigger is selected from a group of time periods according to the trigger characteristic.

### Claim 16 (depends on 15)

The method of claim 15, wherein the trigger characteristic includes a volume, a pitch, or a word.

### Claim 17 (depends on 11)

The method of claim 11, wherein the time period before and after the current trigger is selected from a group of time periods according to a game characteristic.

### Claim 18 (depends on 11)

The method of claim 11, wherein the detecting the current trigger in the input stream during the video game is based on detecting an emotion change of a player from video input of the player and audio input captured from the player.

### Claim 19 (depends on 11)

The method of claim 11, comprising:
selecting, by the processing system, the trigger model from a group of trigger models according to the video game, a genre of the video game, a location of a gaming device where the audio input or video input was captured, or a combination thereof.

### Claim 20 (depends on 11)

The method of claim 11, further comprising
capturing speech by the microphone as the audio input; and
converting the speech to text and analyzing the text, wherein the detecting the current trigger in the input stream during the video game is based on the analyzing the text.
