# US 2026/0097308 A1 · Live voice synthetization

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0097308 A1
- Document ID: US20260097308A1
- Status: Published application
- Kind: A1
- Application number: 18/907,242
- Filed: 2024-10-04
- Published: 2026-04-09
- Earliest claimed: 2024-10-04
- Assignees: Microsoft Technology Licensing, LLC
- Applicants: Microsoft Technology Licensing, LLC
- Inventors: Mastafa Hamza FOUFA; Corentin Alexandre BRAUGE
- Web page: https://patentgrep.com/patent/US20260097308A1

## CPC

- A63F 13/54: involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall
- A63F 13/215: comprising means for detecting acoustic signals, e.g. using a microphone
- A63F 13/424: involving acoustic input signals, e.g. by using the results of pitch or rhythm extraction or voice recognition
- A63F 13/67: adaptively or by learning from player actions, e.g. skill level adjustment or by storing successful combat sequences for re-use
- A63F 13/87: Communicating with other players during game play, e.g. by e-mail or chat
- G10L 13/033: Voice editing, e.g. manipulating the voice of the synthesiser
- G10L 13/047: Architecture of speech synthesisers
- G10L 21/007: characterised by the process used
- G10L 25/18: the extracted parameters being spectral information of each sub-band
- G10L 21/003: Changing voice quality, e.g. pitch or formants
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Systems, devices, methods, and machine-readable media configured to provide voice synthetization in a multiplayer video game are provided. A system can include a multiplayer video game including a character selection interface through which a player selects a character to represent them in playing the video game, and a voice model trained to convert audio from the player directly into audio in a voice of the character and provide an output that includes the audio in the voice of the character.

## Claims

### Claim 1

A system comprising:
a multiplayer video game including a character selection interface through which a player selects a character to represent them in playing the video game; and
a voice model trained to convert audio from the player directly into audio in a voice of the character and provide an output that includes the audio in the voice of the character.

### Claim 2 (depends on 1)

The video game system of claim 1, wherein the trained voice model includes a sequence-to-sequence model that converts a spectrogram of the audio from the player to a spectrogram consistent with the voice of the character.

### Claim 3 (depends on 1)

The video game system of claim 1, wherein the video game is configured to generate a game log including data indicating character states of characters, including a character state of the character, of the video game.

### Claim 4 (depends on 3)

The video game system of claim 3, further comprising a character state model, the character state model trained to (i) generate, based on the game log, a character state of the character and (ii) provide the character state as input to the trained voice model.

### Claim 5 (depends on 4)

The video game system of claim 4, wherein the character state is constrained to include only parameters of the character state that affect the voice of the character and that the trained voice model uses to alter the voice of the character.

### Claim 6 (depends on 3)

The video game system of claim 3, wherein the state of the players represents an environment about the characters in the video game, a physical state of the characters in the video game, and a movement state of the characters in the video game.

### Claim 7 (depends on 1)

The video game system of claim 1, wherein the trained voice model includes:
a trained character voice model trained to generate, for a plurality of characters including the character and for a plurality of character states, a character spectrogram consistent with a selected character and a given character state; and
a vocoder configured to synthesize the audio in the voice of the character based on the character spectrogram.

### Claim 8 (depends on 7)

The video game system of claim 7, further comprising a speaker encoder model trained to generate a speaker encoding of the audio of the player and provide the speaker encoding as input to the trained character voice model, wherein the trained character voice model maintains characteristics of the voice of the player in the player audio in the voice of the character.

### Claim 9 (depends on 8)

The video game system of claim 8, wherein the characteristics include volume, rhythm, and rate.

### Claim 10 (depends on 3)

The video game system of claim 3, wherein the video game is configured to update the game log for each frame of the video game and the character state is updated for each frame.

### Claim 11

A method comprising:
receiving, from a multiplayer video game and at a trained voice model, character data indicating a character selected by a player of the video game to represent them in playing the video game;
converting, by the trained voice model, audio from the player directly into audio in a voice of the character; and
providing, by the trained voice model, the audio in the voice of the character to another player of the video game.

### Claim 12 (depends on 11)

The method of claim 11, wherein the trained voice model includes a sequence-to-sequence model that is trained, in a supervised manner, to convert a spectrogram of the audio from the player to a spectrogram consistent with the voice of the character.

### Claim 13 (depends on 11)

The method of claim 11, wherein converting the audio from the player is performed based on a game log that includes data indicating a state of characters, including the character, actively operating in the video game.

### Claim 14 (depends on 13)

The method of claim 13, further comprising receiving, from a character state model and at the trained voice model, the character state, the character state model trained to generate, based on the game log, the character state of the character.

### Claim 15 (depends on 14)

The method of claim 14, wherein the character state is constrained to include only parameters of the character state that affect the voice of the character and that the trained voice model uses to alter the voice of the character.

### Claim 16 (depends on 13)

The method of claim 13, wherein the character state of the players includes an environment about the characters in the video game, a physical state of the characters in the video game, and a movement state of the characters in the video game.

### Claim 17 (depends on 11)

The method of claim 11, wherein the trained voice model includes:
a trained character voice model trained to generate, for a plurality of characters including the character and for a plurality of character states, a character spectrogram consistent with a selected character and a given character state; and
a vocoder configured to synthesize the audio in the voice of the character based on the character spectrogram.

### Claim 18

A non-transitory machine-readable medium including instructions that, when executed by a machine, cause the machine to perform operations for voice synthetization in a multiplayer video game, the operations comprising:
receiving, from the multiplayer video game and at a trained voice model, character data indicating a character selected by a player of the video game to represent them in playing the video game;
converting, by the trained voice model, audio from the player directly into audio in a voice of the character, the trained voice model including a sequence-to-sequence transformer model trained, in a supervised manner, to convert a spectrogram of audio from the player to a spectrogram consistent with the voice of the character; and
providing, by a vocoder of the trained voice model, the audio in the voice of the character to another player of the video game.

### Claim 19 (depends on 18)

The non-transitory machine-readable medium of claim 18, wherein the operations further comprise generating, by a speaker encoder model, a speaker encoding of the audio of the player and providing the speaker encoding as input to the trained character voice model, wherein the trained character voice model maintains characteristics of the voice of the player in the player audio in the voice of the character.

### Claim 20 (depends on 19)

The non-transitory machine-readable medium of claim 19, wherein the characteristics include volume, rhythm, and rate.
