# US 2024/0005768 A1 · Apparatus, system, and method for motion sensing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0005768 A1
- Document ID: US20240005768A1
- Status: Published application
- Kind: A1
- Application number: 18/177,889
- Filed: 2023-03-03
- Published: 2024-01-04
- Earliest claimed: 2017-12-22
- Assignees: ResMed Sensor Technologies Limited
- Applicants: ResMed Sensor Technologies Limited
- Inventors: Redmond SHOULDICE; Stephen MCMAHON; Michael WREN
- Web page: https://patentgrep.com/patent/US20240005768A1

## CPC

- A61B 5/4806: {Sleep evaluation (A61B5/4821 takes precedence; devices for inducing sleep A61M21/02)}
- G08B 21/0469: {Presence detectors to detect unsafe condition, e.g. infrared sensor, microphone (G08B21/0476 takes precedence)}
- A61B 5/6898: {Portable consumer electronic devices, e.g. music players, telephones, tablet computers}
- A61B 5/7228: {Signal modulation applied to the input signal sent to patient or subject; Demodulation to recover the physiological signal}
- G06F 21/32: using biometric data, e.g. fingerprints, iris scans or voiceprints
- G08B 5/222: {Personal calling arrangements or devices, i.e. paging systems (selective calling systems and call receivers H04W84/00, H04W68/00)}
- G08B 21/0423: {detecting deviation from an expected pattern of behaviour or schedule}
- G08B 21/06: indicating a condition of sleep, e.g. anti-dozing alarms
- G08B 21/22: responsive to presence or absence of persons
- G08B 27/005: {with transmission via computer network}
- G10L 25/51: for comparison or discrimination
- G10L 25/78: Detection of presence or absence of voice signals (switching of direction of transmission by voice frequency in two-way loud-speaking telephone systems H04M9/10)
- A61B 5/0053: {by applying pressure, e.g. compression, indentation, palpation, grasping, gauging}
- A61B 5/024: Measuring pulse rate or heart rate
- A61B 5/113: occurring during breathing
- A61B 8/02: Measuring pulse or heart rate
- A61B 8/0883: {for diagnosis of the heart}
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Methods and devices provide physiological movement detection, such as gesture, breathing, cardiac and/or gross body motion, with active sound generation such as for an interactive audio device. The processor may evaluate, via a microphone coupled to the interactive audio device, a sensed audible verbal communication. The processor may control producing, via a speaker coupled to the processor, a sound signal in a user's vicinity. The processor may control sensing, via a microphone coupled to the processor, a reflected sound signal. This reflected sound signal is a reflection of the generated sound signal from the vicinity or user. The processor may process the reflected sound, such as by a demodulation technique, to derive a physiological movement signal. The processor may generate, in response to the sensed audible verbal communication, an output based on an evaluation of the derived physiological movement signal.

## Claims

### Claim 1

A non-transitory processor-readable medium, having stored thereon processor-executable instructions which, when executed by a processor of an interactive audio device, cause the processor to detect physiological movement of a user, the processor-executable instructions comprising:
instructions to control transmitting, via a transmitter that is coupled to the interactive audio device, a radio frequency (RF) signal in a vicinity of the interactive audio device;
instructions to control sensing, via a receiver that is coupled to the interactive audio device, a reflection of the transmitted signal;
instructions to derive a physiological movement signal with at least a portion of the sensed reflected signal and a signal representative of at least a portion of the transmitted signal; and
instructions to generate an output based on an evaluation of at least a portion of the derived physiological movement signal, and
wherein the generated output comprises an interactive query and response presentation.

### Claim 2 (depends on 1)

The non-transitory processor-readable medium of claim 1, wherein the derived physiological movement signal comprises one or more of respiratory motion, gross motion, or cardiac motion.

### Claim 3 (depends on 1)

The non-transitory processor-readable medium of claim 1, further comprising the processor-executable instructions to evaluate, via a microphone coupled to the interactive audio device, a sensed audible verbal communication; and wherein the instructions to generate the output are configured to generate the output in response to the sensed audible verbal communication.

### Claim 4 (depends on 1)

The non-transitory processor-readable medium of claim 1, further comprising processor-executable instructions to operate a beam forming process to further localize a detected area.

### Claim 5 (depends on 1)

The non-transitory processor-readable medium of claim 1, wherein the generated output based on the evaluation of the portion of the derived physiological movement signal comprises monitored user sleep information.

### Claim 6 (depends on 1)

The non-transitory processor-readable medium of claim 1, wherein the evaluation of the portion of the derived physiological movement signal comprises detecting one or more physiological parameters, comprising any one or more of breathing rate, relative amplitude of breathing, heart rate, cardiac amplitude, relative cardiac amplitude, and heart rate variability.

### Claim 7 (depends on 1)

The non-transitory processor-readable medium of claim 1, wherein:
(a) the generated output comprises an interactive query and response presentation effected by way of a speaker; or
(b) the generated output comprises an interactive query and response presentation effected by way of a speaker and comprises advice to improve user sleep.

### Claim 8 (depends on 1)

The non-transitory processor-readable medium of claim 1, wherein:
(a) the generated output based on the evaluation of the portion of the derived physiological movement signal is further based on accessing a server on a network and/or conducting a search of a network resource;
(b) the generated output based on the evaluation of the portion of the derived physiological movement signal comprises a control signal to control an automated appliance or a system; or
(c) the generated output based on the evaluation of the portion of the derived physiological movement signal comprises a control signal to control an automated appliance or a system and the processor-readable medium further comprises processor control instructions to transmit the control signal to the automated appliance or system over a network.

### Claim 9 (depends on 1)

The non-transitory processor-readable medium of claim 1, further comprising:
(a) processor control instructions to generate a control signal to change a setting of the interactive audio device based on an evaluation of at least a portion of the derived physiological movement signal; or
(b) processor control instructions to generate a control signal to change a setting of the interactive audio device based on an evaluation of at least a portion of the derived physiological movement signal, wherein the control signal to change a setting of the interactive audio device comprises a change in volume based on a detection of user distance from the interactive audio device, user's state or user's location.

### Claim 10 (depends on 1)

The non-transitory processor-readable medium of claim 1, wherein the processor-executable instructions are configured to evaluate motion characteristics of different sensing ranges to monitor sleep characteristics of a plurality of users.

### Claim 11 (depends on 1)

The non-transitory processor-readable medium of claim 1, further comprising processor-executable instructions to detect presence or absence of a user based on at least a portion of the derived physiological movement signal.

### Claim 12 (depends on 1)

The non-transitory processor-readable medium of claim 1, further comprising processor-executable instructions to conduct biometric recognition of a user based on at least a portion of the derived physiological movement signal.

### Claim 13 (depends on 1)

The non-transitory processor-readable medium of claim 1, further comprising processor-executable instructions to generate a communication over a network based on (a) a biometric evaluation determined from an analysis of the derived physiological movement signal, and/or (b) a detected presence determined from an analysis of at least a portion of the derived physiological movement signal.

### Claim 14 (depends on 1)

The non-transitory processor-readable medium of claim 1, further comprising processor-executable instructions configured to cause the interactive audio device to detect motion presence of a user, audibly challenge the user, audibly authenticate the user, and authorize the user or communicate an alarm message about the user.

### Claim 15 (depends on 14)

The non-transitory processor-readable medium of claim 14, wherein:
(a) the processor-executable instructions to audibly authenticate the user are configured to compare a verbal sound wave of the user, sensed by a microphone that is coupled to the processor, with a previously recorded verbal sound wave; and/or
(b) processor-executable instructions are configured to authenticate the user with motion-based biometric sensing.

### Claim 16 (depends on 1)

The non-transitory processor-readable medium of claim 1, further comprising:
processor-executable instructions to cause the interactive audio device to detect a motion gesture based on at least a portion of the derived physiological movement signal; and
processor-executable instructions to generate a control signal, based on the detected motion gesture, to send a notification, or to control a change to an operation of (a) an automated appliance and/or (b) the interactive audio device.

### Claim 17 (depends on 16)

The non-transitory processor-readable medium of claim 16, wherein:
(a) the control signal to control the change to the operation of the interactive audio device comprises activating microphone sensing for initiating interactive voice assistant operations of the interactive audio device, whereby an inactive interactive voice assistant process is engaged; or
(b) the control signal to control the change to the operation of the interactive audio device comprises activating microphone sensing for initiating interactive voice assistant operations of the interactive audio device, whereby an inactive interactive voice assistant process is engaged, wherein initiating the interactive voice assistant operations is further based on detection of a verbal keyword by the microphone sensing.

### Claim 18 (depends on 1)

The non-transitory processor-readable medium of claim 1, further comprising:
processor-executable instructions to cause the interactive audio device to receive a communication from another interactive audio device, controlled by another processing device via inaudible sound waves sensed by a microphone of the interactive audio device.

### Claim 19 (depends on 1)

The non-transitory processor-readable medium of claim 1, wherein:
(a) the evaluation of the portion of the derived physiological movement signal further comprises a detection of sleep onset or wake onset, and wherein the output based on the evaluation comprises a service control signal; or
(b) the evaluation of the portion of the derived physiological movement signal further comprises a detection of sleep onset or wake onset, and wherein the output based on the evaluation comprises a service control signal, and wherein the service control signal comprises one or more of: a lighting control; an appliance control; a volume control; a thermostat control; and a window covering control.

### Claim 20 (depends on 1)

The non-transitory processor-readable medium of claim 1, further comprising processor-executable instructions to provide a sleep improvement service, the sleep improvement service comprising any of: (a) generating advice in response to detected sleep condition and/or collected user feedback; and (b) generating control signals to control environmental appliances to set environmental sleep conditions and/or provide a sleep related advice message to the user.

### Claim 21 (depends on 1)

The non-transitory processor-readable medium of claim 1, further comprising processor-executable instructions to detect a gesture based on at least a portion of the derived physiological movement signal and to initiate microphone sensing for initiating interactive voice assistant operations of the interactive audio device.

### Claim 22 (depends on 1)

The non-transitory processor-readable medium of claim 1, further comprising processor-executable instructions to initiate and monitor a nap session based on at least a portion of the derived physiological movement signal.

### Claim 23 (depends on 1)

The non-transitory processor-readable medium of claim 1, further comprising processor-executable instructions to vary a detection range by varying parameters of at least a portion of the transmitted signal to track movement of a user through the vicinity.

### Claim 24 (depends on 1)

The non-transitory processor-readable medium of claim 1, further comprising:
(a) processor-executable instructions to detect unauthorized movement with at least a portion of the derived physiological movement signal and generate an alarm or a communication to notify the user or a third party; or
(b) processor-executable instructions to detect unauthorized movement with at least a portion of the derived physiological movement signal and generate an alarm or a communication to notify the user or a third party, wherein the communication provides an alarm on a smart phone or smart watch.

### Claim 25 (depends on 1)

A server with access to the non-transitory processor-readable medium of claim 1, wherein the server is configured to receive requests for downloading the processor-executable instructions of the processor-readable medium to an interactive audio device over a network.

### Claim 26 (depends on 1)

An interactive audio device comprising: one or more processors; a speaker coupled to the one or more processors; a microphone coupled to the one or more processors; and the non-transitory processor-readable medium of claim 1.

### Claim 27 (depends on 26)

The interactive audio device of claim 26, wherein the interactive audio device comprises a mobile phone, a smart watch, a tablet computer or a smart speaker.

### Claim 28 (depends on 1)

A method of a server having access to the non-transitory processor-readable medium of claim 1, the method comprising receiving, at the server, a request for downloading the processor-executable instructions of the processor-readable medium to an interactive audio device over a network; and transmitting the processor-executable instructions to the interactive audio device in response to the request.

### Claim 29

A method of an interactive audio device to detect physiological movement of a user, the method comprising:
transmitting, from the interactive audio device, a signal in a vicinity of the interactive audio device;
sensing, by the interactive audio device, a reflection of the transmitted signal;
deriving, in a processor, a physiological movement signal with at least a portion of the sensed reflected sound signal and a signal representative of at least a portion of the transmitted signal; and
generating from the processor an output based on an evaluation of at least a portion of the derived physiological movement signal, and
wherein the generated output comprises an interactive query and response presentation.
