# US 2024/0185853 A1 · System and method for adapted interactive experiences

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0185853 A1
- Document ID: US20240185853A1
- Status: Published application
- Kind: A1
- Application number: 18/440,935
- Filed: 2024-02-13
- Published: 2024-06-06
- Earliest claimed: 2017-12-23
- Assignees: SoundHound AI IP, LLC
- Applicants: SoundHound AI IP, LLC
- Inventors: Joel McKENZIE; Qindi ZHANG
- Web page: https://patentgrep.com/patent/US20240185853A1

## CPC

- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G06F 40/30: Semantic analysis
- G06Q 30/0267: {Wireless devices}
- G06Q 30/0271: {Personalized advertisement}
- G10L 15/1815: {Semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning}
- G10L 15/1822: {Parsing for meaning understanding}
- G10L 15/19: Grammatical context, e.g. disambiguation of the recognition hypotheses based on word sequence rules
- G10L 13/00: Speech synthesis; Text to speech systems
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR

## Abstract

Natural language grammars interpret expressions at the conversational human-machine interfaces of devices. Under conditions favoring engagement, as specified in a unit of conversational code, the device initiates a discussion using one or more of TTS, images, video, audio, and animation depending on the device capabilities of screen and audio output. Conversational code units specify conditions based on conversation state, mood, and privacy. Grammars provide intents that cause calls to system functions. Units can provide scripts for guiding the conversation. The device, or supporting server system, can provide feedback to creators of the conversational code units for analysis and machine learning.

## Claims

### Claim 1

A method comprising:
maintaining, for a conversational human-machine interface, a current conversation state variable; and
analyzing an offer for a message in relation to the conversational human-machine interface,
wherein:
the offer indicates an interesting value of the conversation state variable; and
the offer is influenced by the current conversation state variable having the interesting conversation state variable value.

### Claim 2 (depends on 1)

The method of claim 1 wherein the current conversation state variable represents one or more keywords or related words.

### Claim 3 (depends on 1)

The method of claim 1 wherein the current conversation state variable represents a domain.

### Claim 4 (depends on 1)

The method of claim 1 wherein the interesting value is the result of a programmatic equation.

### Claim 5 (depends on 1)

The method of claim 1 further comprising detecting a current mood value, wherein the offer is influenced by the current mood value.

### Claim 6 (depends on 1)

The method of claim 1 further comprising receiving a current mood value, wherein the offer is influenced by the current mood value.

### Claim 7 (depends on 1)

The method of claim 1 further comprising determining whether a the human-machine interface is in a private listening environment, wherein the offer is conditioned on whether the human-machine interface is in a private listening environment.

### Claim 8 (depends on 7)

The method of claim 7 wherein determining whether the human-machine interface is in a private listening environment is by means of detecting presence of people.

### Claim 9 (depends on 1)

The method of claim 1, further comprising:
performing voice activity detection; and
delivering an introductory message of an experience unit associated,
wherein delivering the introductory message is conditioned on no voice activity being detected.

### Claim 10

A method of identifying a message opportunity comprising:
monitoring natural language interactions at a human-machine interface;
interpreting a natural language expression as a query that identifies a zero moment of truth intent;
identifying a type of product or service referenced in the query; and
alerting a message offer.

### Claim 11 (depends on 10)

The method of claim 10 further comprising delivering an experience unit identified by the message offer.

### Claim 12 (depends on 10)

The method of claim 10 further comprising delivering an introductory message associated with the message offer.

### Claim 13 (depends on 12)

The method of claim 12, further comprising receiving a follow-up that matches a grammar.
