# US 2023/0069271 A1 · Audio analytics and accessibility across applications and platforms

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0069271 A1
- Document ID: US20230069271A1
- Status: Published application
- Kind: A1
- Application number: 17/462,757
- Filed: 2021-08-31
- Published: 2023-03-02
- Earliest claimed: 2021-08-31
- Assignees: Sony Interactive Entertainment Inc.
- Applicants: Sony Interactive Entertainment LLC
- Inventors: Ellana Fortuna; Sarah Karp; Elizabeth Juenger
- Web page: https://patentgrep.com/patent/US20230069271A1

## CPC

- A63F 13/215: comprising means for detecting acoustic signals, e.g. using a microphone
- G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path}
- A63F 13/424: involving acoustic input signals, e.g. by using the results of pitch or rhythm extraction or voice recognition
- A63F 13/54: involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall
- A63F 13/79: involving player-related data, e.g. identities, accounts, preferences or play histories
- H04L 67/306: User profiles
- H04N 21/4788: communicating with other users, e.g. chatting {(arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104)}
- H04N 21/439: Processing of audio elementary streams
- H04N 21/4532: {involving end-user characteristics, e.g. viewer profile, preferences (monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18)}
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Systems and methods for audio analytics and audio-based accessibility are provided. A user audio profile may be stored in memory for a user. The user audio profile may include a custom prioritization of one or more audio parameters associated with one or more audio modifications. Audio streams associated with a user device of the user may be monitored based on the user audio profile during a current session. The audio parameters may be detected as being present in the monitored audio streams, and the detected audio parameters may be prioritized based on the custom prioritization of the user audio profile. A sound property of at least one of the audio streams may be modified in real-time based on the prioritization of the detected audio parameters by applying the audio modifications of the user audio profile to the at least one audio stream before the at least one audio stream is provided to the user device.

## Claims

### Claim 1

A method for audio analytics and audio-based accessibility, the method comprising:
storing a user audio profile in memory for a user, wherein the user audio profile includes a custom prioritization of one or more audio parameters associated with one or more audio modifications;
monitoring one or more audio streams associated with a user device of the user during a current session, wherein monitoring the audio streams is based on the user audio profile;
detecting that one or more of the audio parameters are present in the monitored audio streams;
prioritizing the detected audio parameters based on the custom prioritization of the user audio profile; and
modifying a sound property of at least one of the audio streams in real-time based on the prioritization of the detected audio parameters, wherein modifying the sound level includes applying the audio modifications of the user audio profile to the at least one audio stream before the at least one audio stream is provided to the user device.

### Claim 2 (depends on 1)

The method of claim 1, wherein the sound property of the at least one audio stream includes at least one of volume, speed, and frequency response relative to one or more other ones of the audio streams.

### Claim 3 (depends on 1)

The method of claim 1, wherein monitoring the audio streams includes analyzing each of the audio streams to distinguish speech from other sounds, and wherein modifying the sound property includes boosting the sound property of the at least one audio stream that includes the speech relative to one or more other ones of the audio streams.

### Claim 4 (depends on 1)

The method of claim 1, wherein the detected audio parameters include speech by a plurality of different users, and wherein the custom prioritization includes a prioritization order of one or more user groups.

### Claim 5 (depends on 1)

The method of claim 1, further comprising monitoring data regarding sound in a real-world environment associated with the user as captured by a microphone associated with the user device, wherein detecting the detected audio parameters is further based on the sound in the real-world environment.

### Claim 6 (depends on 5)

The method of claim 5, wherein the sound in the real-world environment includes speech by the user, and wherein detecting that the audio parameters are present is based on identifying the speech by the user.

### Claim 7 (depends on 6)

The method of claim 6, wherein the user audio profile further includes data regarding a voice of the user, and further comprising providing the at least one modified audio stream to one or more other user devices associated with the current session.

### Claim 8 (depends on 1)

The method of claim 1, wherein the audio streams are associated with a plurality of different applications or platforms operating concurrently during the current session.

### Claim 9 (depends on 1)

The method of claim 1, wherein the audio modifications include at least one of adjusting one of the audio parameters, dampening, adjusting transparency, and noise cancellation.

### Claim 10

A system for audio analytics and audio-based accessibility, the system comprising:
memory that stores a user audio profile in memory for a user, wherein the user audio profile includes a custom prioritization of one or more audio parameters associated with one or more audio modifications;
a communication interface that communicates over a communication network, wherein the communication interface receives one or more audio streams associated with a user device of the user during a current session;
a processor that executes instructions stored in memory, wherein the processor executes the instructions to:
monitor the audio streams based on the user audio profile;
detect that one or more of the audio parameters are present in the monitored audio streams;
prioritize the detected audio parameters based on the custom prioritization of the user audio profile; and
modify a sound property of at least one of the audio streams in real-time based on the prioritization of the detected audio parameters, wherein modifying the sound level includes applying the audio modifications of the user audio profile to the at least one audio stream before the at least one audio stream is provided to the user device.

### Claim 11 (depends on 10)

The system of claim 10, wherein the sound property of the at least one audio stream includes at least one of volume, speed, and frequency response relative to one or more other ones of the audio streams.

### Claim 12 (depends on 10)

The system of claim 10, wherein the processor monitors the audio streams by analyzing each of the audio streams to distinguish speech from other sounds, and wherein the processor modifies the sound property by boosting the sound property of the at least one audio stream that includes the speech relative to one or more other ones of the audio streams.

### Claim 13 (depends on 10)

The system of claim 10, wherein the detected audio parameters include speech by a plurality of different users, and wherein the custom prioritization includes a prioritization order of one or more user groups.

### Claim 14 (depends on 10)

The system of claim 10, wherein the processor further monitors data regarding sound in a real-world environment associated with the user as captured by a microphone associated with the user device, wherein the processor detects that the audio parameters are present further based on the sound in the real-world environment.

### Claim 15 (depends on 14)

The system of claim 14, wherein the sound in the real-world environment includes speech by the user, and wherein the processor detects that the audio parameters are present further based on identifying the speech by the user.

### Claim 16 (depends on 15)

The system of claim 15, wherein the user audio profile further includes data regarding a voice of the user, and wherein the communication interface further provides the at least one modified audio stream to one or more other user devices associated with the current session.

### Claim 17 (depends on 10)

The system of claim 10, wherein the audio streams are associated with a plurality of different applications or platforms operating concurrently during the current session.

### Claim 18 (depends on 10)

The system of claim 10, wherein the audio modifications include at least one of adjusting one of the audio parameters, dampening, adjusting transparency, and noise cancellation.

### Claim 19

A non-transitory, computer-readable storage medium, having embodied thereon a program executable by a processor to perform a method for audio analytics and audio-based accessibility, the method comprising:
storing a user audio profile in memory for a user, wherein the user audio profile includes a custom prioritization of one or more audio parameters associated with one or more audio modifications;
monitoring one or more audio streams associated with a user device of the user during a current session, wherein monitoring the audio streams is based on the user audio profile;
detecting that one or more of the audio parameters are present in the monitored audio streams;
prioritizing the detected audio parameters based on the custom prioritization of the user audio profile; and
modifying a sound property of at least one of the audio streams in real-time based on the prioritization of the detected audio parameters, wherein modifying the sound level includes applying the audio modifications of the user audio profile to the at least one audio stream before the at least one audio stream is provided to the user device.
