# US 2021/0243528 A1 · Spatial Audio Signal Filtering > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2021/0243528 A1 - Document ID: US20210243528A1 - Status: Published application - Kind: A1 - Application number: 17/238,542 - Filed: 2021-04-23 - Published: 2021-08-05 - Earliest claimed: 2014-09-05 - Assignees: Nokia Technologies Oy - Applicants: Nokia Technologies Oy - Inventors: Roope Olavi Jarvinen; Kari Juhani Järvinen; Juha Henrik Arrasvuori; Miikka Vilermo - Web page: https://patentgrep.com/patent/US20210243528A1 ## CPC - H04R 5/00: Stereophonic arrangements (stereophonic pick-ups H04R9/16, H04R11/12, H04R17/08, H04R19/10) - G06F 3/16: Sound input; Sound output (speech processing G10L) - G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path} - G10L 15/142: {Hidden Markov Models [HMMs]} - G10L 17/18: Artificial neural networks; Connectionist approaches - H04N 21/233: Processing of audio elementary streams {(monitoring, identification or recognition of audio in broadcast systems H04H60/58)} - H04R 27/00: Public address systems (circuits for preventing acoustic reaction H04R3/02; circuits for distributing signals to loudspeakers H04R3/12; {monitoring or testing arrangements for public address systems H04R29/007}; amplifiers H03F) - G10L 2015/088: {Word spotting} - H04R 2227/003: Digital PA systems using, e.g. LAN or internet - H04R 2420/01: Input selection or mixing for amplifiers or loudspeakers - H04R 2430/01: Aspects of volume control, not necessarily automatic, in sound systems - H04R 2499/11: Transducers incorporated or for use in hand-held devices, e.g. mobile phones, PDA's, camera's - H04S 1/007: {in which the audio signals are in digital form (data reduction aspects thereof based on psychoacoustics G10L19/02)} - H04S 7/30: {Control circuits for electronic adaptation of the sound field} - H04S 2400/13: Aspects of volume control, not necessarily automatic, in stereophonic sound systems - H04S 2420/01: Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD] - H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - H04S: STEREOPHONIC SYSTEMS ## Abstract An apparatus comprising: an analyser configured to analyse at least one input to determine one or more expression within the at least one input; and a controller configured to control at least one audio signal associated with the at least one input dependent on the determination of the one or more expression. ## Claims ### Claim 1 An apparatus comprising at least one processor and at least one memory including computer code for one or more programs, the at least one memory and the computer code configured to with the at least one processor cause the apparatus to at least: receive at least one speech input using a microphone configured to generate a signal based on a sound field surrounding the apparatus; analyse the at least one speech input to determine one or more expressions within the at least one speech input: and control at least one audio output signal dependent upon the one or more expression, wherein the at least one speech input is independent of the at least one audio output signal and wherein the controlling of the at least one audio output signal is dependent upon determining the expression within the at least one speech input. ### Claim 2 (depends on 1) An apparatus as claimed in claim 1, wherein controlling the at least one audio output signal comprises controlling the volume of the at least one audio output signal. ### Claim 3 (depends on 1) An apparatus as claimed in claim 1, wherein controlling the at least one audio output signal comprises pausing the at least one audio output signal. ### Claim 4 (depends on 1) An apparatus as claimed in claim 1, wherein the speech input is detected using one or more microphones. ### Claim 5 (depends on 1) An apparatus as claimed in claim 1, wherein the at least one memory and the computer code are further configured to with the at least one processor cause the apparatus to identify new expressions which are to be stored in an expression database. ### Claim 6 (depends on 5) An apparatus as claimed in claim 5, wherein the at least one memory and the computer code are further configured to with the at least one processor cause the apparatus to store the new expressions in the expression database. ### Claim 7 (depends on 6) An apparatus as claimed in claim 6, wherein the new expressions stored in the expression database are capable of being used as the one or more expressions for controlling the at least one audio output signal. ### Claim 8 (depends on 1) An apparatus as claimed in claim 1, wherein the at least one memory and the computer code are configured to with the at least one processor cause the apparatus to analyse at least one speech input using at least one of: hidden Markov model analysing; pattern detection analysing; dynamic time warping speech recognition analysing; neural network pattern recognition analysing; maximum entropy Markov model analysing; Bayesian network analysing; tonal analysing; or beat pattern analysing. ### Claim 9 (depends on 1) An apparatus as claimed in claim 1, wherein the expression comprises at least one of: at least one phoneme; a defined musical note sequence; a defined silence period; a defined click; a defined noise burst; or a defined hand clap. ### Claim 10 (depends on 1) An apparatus as claimed in claim 1, wherein the at least one memory and the computer code are further configured to with the at least one processor cause the apparatus to receive audio signals from an external apparatus and convert the received audio signals into the at least one audio output signal to be output via one or more acoustic transducers. ### Claim 11 (depends on 1) An apparatus as claimed in claim 1, wherein the audio output signal comprises at least one: a music audio stream or a recorded speech broadcast. ### Claim 12 (depends on 1) An apparatus as claimed in claim 1, wherein the apparatus further comprises at least one microphone and at least one acoustic transducer. ### Claim 13 (depends on 12) An apparatus as claimed in claim 12, wherein the at least one microphone is configured to enable the at least one speech input and the at least one acoustic transducer is configured to provide the audio output signal as an analogue audio signal. ### Claim 14 A method comprising: receiving at least one speech input using a microphone configured to generate a signal based on a sound field surrounding an apparatus; analysing the at least one speech input to determine one or more expressions within the at least one speech input: and controlling at least one audio output signal dependent upon the one or more expression, wherein the at least one speech input is independent of the at least one audio output signal and wherein the controlling of the at least one audio output signal is dependent upon determining the expression within the at least one speech input. ### Claim 15 (depends on 14) A method as claimed in claim 14, wherein controlling the at least one audio output signal comprises controlling the volume of the at least one audio output signal. ### Claim 16 (depends on 14) A method as claimed in claim 14, wherein controlling the at least one audio output signal comprises pausing the at least one audio output signal. ### Claim 17 (depends on 14) A method as claimed in claim 14, wherein the speech input is detected using one or more microphones. ### Claim 18 (depends on 14) A method as claimed in claim 14, further comprising identifying new expressions which are to be stored in an expression database. ### Claim 19 (depends on 18) A method as claimed in claim 18, further comprising storing the new expressions in the expression database. ### Claim 20 A computer program product comprising a non-transitory computer-readable medium having computer code stored thereon, the computer code, upon execution, causing: receiving at least one speech input using a microphone configured to generate a signal based on a sound field surrounding an apparatus; analysing the at least one speech input to determine one or more expressions within the at least one speech input: and controlling at least one audio output signal dependent upon the one or more expression, wherein the at least one speech input is independent of the at least one audio output signal and wherein the controlling of the at least one audio output signal is dependent upon determining the expression within the at least one speech input.