# US 2023/0410833 A1 · User presence detection

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0410833 A1
- Document ID: US20230410833A1
- Status: Published application
- Kind: A1
- Application number: 18/131,531
- Filed: 2023-04-06
- Published: 2023-12-21
- Earliest claimed: 2017-03-30
- Assignees: Amazon Technologies, Inc.
- Applicants: Amazon Technologies, Inc.
- Inventors: Shiva Kumar Sundaram; Chao Wang; Shiv Naga Prasad Vitaladevuni; Spyridon Matsoukas; Arindam Mandal
- Web page: https://patentgrep.com/patent/US20230410833A1

## CPC

- G10L 25/30: using neural networks
- G10L 15/02: Feature extraction for speech recognition; Selection of recognition unit
- G10L 15/16: using artificial neural networks
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L 15/30: Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
- G10L 25/51: for comparison or discrimination
- G10L 25/78: Detection of presence or absence of voice signals (switching of direction of transmission by voice frequency in two-way loud-speaking telephone systems H04M9/10)
- G10L 2015/088: {Word spotting}
- G10L 2025/783: {based on threshold decision}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

A speech-capture device can capture audio data during wakeword monitoring and use the audio data to determine if a user is present nearby the device, even if no wakeword is spoken. Audio such as speech, human originating sounds (e.g., coughing, sneezing), or other human related noises (e.g., footsteps, doors closing) can be used to detect audio. Audio frames are individually scored as to whether a human presence is detected in the particular audio frames. The scores are then smoothed relative to nearby frames to create a decision for a particular frame. Presence information can then be sent according to a periodic schedule to a remote device to create a presence “heartbeat” that regularly identifies whether a user is detected proximate to a speech-capture device.

## Claims

### Claim at position 1

-20. (canceled)

### Claim 21

A computer-implemented method, comprising:
determining presence data indicating that a user is present in an environment of a first device;
determining a second device corresponds to a prior unsuccessful request to initiate a communication from the second device to the first device; and
sending, to the second device, an indication that the user is present in the environment.

### Claim 22 (depends on 21)

The computer-implemented method of claim 21, wherein the first device is capable of being controlled through a far field voice interface.

### Claim 23 (depends on 21)

The computer-implemented method of claim 21, wherein the presence data is based at least in part on audio data captured by at least one microphone of the first device.

### Claim 24 (depends on 23)

The computer-implemented method of claim 23, wherein the audio data represents speech in the environment.

### Claim 25 (depends on 23)

The computer-implemented method of claim 23, wherein the audio data comprises data corresponding to a plurality of audio frames.

### Claim 26 (depends on 21)

The computer-implemented method of claim 21, wherein the presence data is based at least in part on camera data representing the environment.

### Claim 27 (depends on 21)

The computer-implemented method of claim 21, wherein the presence data corresponds to output of a machine learning model.

### Claim 28 (depends on 21)

The computer-implemented method of claim 21, wherein the presence data is based at least in part on a signal from a third device.

### Claim 29 (depends on 21)

The computer-implemented method of claim 21, further comprising:
determining a first user profile associated with the first device; and
determining the second device is associated with contact data corresponding to the first user profile.

### Claim 30 (depends on 21)

The computer-implemented method of claim 21, further comprising:
determining permission data indicating that the second device is permitted to receive presence information corresponding to the first device.

### Claim 31

A system comprising:
at least one processor; and
at least one memory comprising instructions that, when executed by the at least one processor, cause the system to:
determine presence data indicating that a user is present in an environment of a first device;
determine a second device corresponds to a prior unsuccessful request to initiate a communication from the second device to the first device; and
send, to the second device, an indication that the user is present in the environment.

### Claim 32 (depends on 31)

The system of claim 31, wherein the first device is capable of being controlled through a far field voice interface.

### Claim 33 (depends on 31)

The system of claim 31, wherein the presence data is based at least in part on audio data captured by at least one microphone of the first device.

### Claim 34 (depends on 33)

The system of claim 33, wherein the audio data represents speech in the environment.

### Claim 35 (depends on 34)

The system of claim 34, wherein the audio data comprises data corresponding to a plurality of audio frames.

### Claim 36 (depends on 31)

The system of claim 31, wherein the presence data is based at least in part on camera data representing the environment.

### Claim 37 (depends on 31)

The system of claim 31, wherein the presence data corresponds to output of a machine learning model.

### Claim 38 (depends on 31)

The system of claim 31, wherein the presence data is based at least in part on a signal from a third device.

### Claim 39 (depends on 31)

The system of claim 31, wherein the at least one memory further comprises instructions that, when executed by the at least one processor, further cause the system to:
determine a first user profile associated with the first device; and
determine the second device is associated with contact data corresponding to the first user profile.

### Claim 40 (depends on 31)

The system of claim 31, wherein the at least one memory further comprises instructions that, when executed by the at least one processor, further cause the system to:
determine permission data indicating that the second device is permitted to receive presence information corresponding to the first device.
