# US 11,030,289 B2 · Human presence detection

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,030,289 B2
- Document ID: US11030289B2
- Status: Granted
- Kind: B2
- Application number: 16/050,628
- Filed: 2018-07-31
- Published: 2019-01-31
- Granted: 2021-06-08
- Earliest claimed: 2017-07-31
- Assignees: STMicroelectronics S.r.l.
- Applicants: STMicroelectronics, Inc.
- Inventors: Xiaoyong Yang; Sankalp Dayal
- Web page: https://patentgrep.com/patent/US11030289B2

## CPC

- G06F 21/32: using biometric data, e.g. fingerprints, iris scans or voiceprints
- G01C 3/08: Use of electric radiation detectors
- G01C 19/58: Turn-sensitive devices without moving masses
- G01P 15/165: {for measuring angular accelerations}
- G06F 21/316: {by observing the pattern of computer usage, e.g. typical user behaviour}
- G10L 17/00: Speaker identification or verification techniques
- G06F 2221/2139: Recurrent verification
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G01P: MEASURING LINEAR OR ANGULAR SPEED, ACCELERATION, DECELERATION, OR SHOCK; INDICATING PRESENCE, ABSENCE, OR DIRECTION, OF MOVEMENT (measuring or recording blood flow A61B5/02, A61B8/06; monitoring speed or deceleration of electrically-propelled vehicles B60L3/00; vehicle lighting systems adapted to indicate speed B60Q1/54; determining position or course in navigation, measuring ground distance in geodesy or surveying G01C; combined measuring devices for measuring two or more variables of movement G01C23/00; measuring velocity of sound G01H; measuring velocity of light G01J7/00; measuring direction or velocity of solid objects by reception or emission of radiowaves or other waves and based on propagation effects, e.g. Doppler effect, propagation time, direction of propagation, G01S; measuring speed of nuclear radiation G01T; measuring acceleration of gravity G01V; {measuring or recording the speed of trains B61L23/00; speed indicators incorporated in motor vehicles B60K35/00; measuring frequency or phase G01R; traffic control G08G})
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

A method includes sensing through time-of-flight measurements a distance of an object from an electronic device, sensing motion of the electronic device, sensing acoustic signals received by the electronic device, and detecting the presence of a human proximate the electronic device based on the sensed distance, motion and acoustic signals. Access to the electronic device is controlled based on whether a human is detected as being present.

## Claims

### Claim 1

A method, comprising:
sensing through time-of-flight measurements a distance of an object from an electronic device;
sensing motion of the electronic device;
sensing acoustic signals received by the electronic device;
detecting presence of a human proximate the electronic device based on the sensed distance, motion and acoustic signals;
determining a plurality of system states of the electronic device based on the sensed distance and motion, the plurality of system states including:
a lid vertical state indicating whether a lid of the electronic device is vertical,
a resting position state indicating whether the electronic device is resting on a lap,
a moved state indicating whether a position of the electronic device has moved since last detection of human presence, and
a vibration state indicating a reliability of sensed vibration data the last time human presence was detected; and
controlling access to the electronic device based on the determined system states.

### Claim 2 (depends on 1)

The method of claim 1 further comprising controlling access to the electronic device based on detecting the presence of a human proximate the electronic device.

### Claim 3 (depends on 1)

The method of claim 1 further comprising processing one or more of the sensed distance, motion and acoustic signals based on the system state.

### Claim 4 (depends on 3)

The method of claim 3 further comprising providing or denying access to the electronic device based on the determined system state and the processing of the one or more of the sensed distance, motion and audio signals.

### Claim 5 (depends on 4)

The method of claim 4, wherein sensing motion of the electronic device includes sensing vibration signals received by the electronic device, and wherein determining the system state comprises:
determining whether the time-of-flight measurements sensing the distance of the object are reliable measurements.

### Claim 6 (depends on 1)

The method of claim 1, wherein sensing through time-of-flight measurements the distance of the object from the electronic device includes determining whether the object is a human [or an inanimate object based on whether the object is moving relative to the electronic device].

### Claim 7 (depends on 1)

The method of claim 1, wherein sensing acoustic signals received by the electronic device comprises processing the sensed acoustic signals to detect at least one of human walking or human talking proximate the electronic device.

### Claim 8

An electronic device, comprising:
a time-of-flight sensor that in operation generates a distance signal indicating a distance of an object from the electronic device;
a motion sensor that in operation generates a motion signal indicating motion of the electronic device;
an audio sensor that in operation generates a sensed audio signal in response to acoustic signals received by the electronic device; and
a processor coupled to the time-of-flight, motion and audio sensors that in operation processes the distance, motion, and sensed audio signals and controls access to the electronic device based on the processed distance, motion and sensed audio signals,
wherein the processor is configured to determine a plurality of system states of the electronic device based on the distance signal and the motion signal, the plurality of system states including:
a lid vertical state indicating whether a lid of the electronic device is vertical,
a resting position state indicating whether the electronic device is resting on a lap,
a moved state indicating whether a position of the electronic device has moved since last detection of human presence, and
a vibration state indicating a reliability of sensed vibration data the last time human presence was detected.

### Claim 9 (depends on 8)

The electronic device of claim 8, wherein the processor comprises a plurality of modules configured to process the distance, motion, and audio signals.

### Claim 10 (depends on 9)

The electronic device of claim 9, wherein the processor in operation activates and deactivates selected ones of the plurality of modules based on the determined system state.

### Claim 11 (depends on 10)

The electronic device of claim 10, wherein the motion sensor comprises an accelerometer and a gyroscope that in operation sense vibrations received by the electronic device, sense movement of the electronic device, and sense an orientation of the electronic device.

### Claim 12 (depends on 8)

The electronic device of claim 8, wherein the system state comprises a TOF state indicating whether the distance signal from the time-of-flight sensor should be processed to control access to the electronic device.

### Claim 13 (depends on 8)

The electronic device of claim 8, wherein the electronic device comprises a laptop computer having the lid and a base, and the time-of-flight sensor is positioned in the lid of the laptop computer, and wherein the lid vertical states indicate whether the lid of the laptop is vertical relative to the base to properly orient the time-of-flight sensor.

### Claim 14 (depends on 8)

The electronic device of claim 8, wherein the processor includes:
a sound intensity estimator module configured to estimate an intensity of sound sensed by the audio sensor;
a sound intensity trigger module configured to determine whether the estimated sound intensity exceeds a sound intensity trigger threshold; and
a sound type classifier module configured to process the sensed audio signal, in response to the estimated sound intensity exceeding the sound intensity trigger threshold, and to classify the sensed audio signal as being generated by a human or not.

### Claim 15

An electronic device, comprising:
a time-of-flight sensor configured to sense a distance of an object from the electronic device and to generate a distance signal indicating the sensed distance;
a motion sensor configured to generate a motion signal indicating motion of the electronic device;
an audio sensor configured to sense acoustic signals incident on the electronic device and to generate a sensed audio signal based on the acoustic signals; and
a processor coupled to the time-of-flight, motion and audio sensors, the processor including a plurality of modules configured to process the distance, motion, and audio signals to detect whether a user is proximate the electronic device and to determine a plurality of system states indicating current and prior operating conditions of the electronic device, the processor further configured to control access to the electronic device based upon the determined system states and whether the user is detected proximate the electronic device,
wherein the plurality of system states includes:
a lid vertical state indicating whether a lid of the electronic device is vertical,
a resting position state indicating whether the electronic device is resting on a lap,
a moved state indicating whether a position of the electronic device has moved since last detection of human presence, and
a vibration state indicating a reliability of sensed vibration data the last time human presence was detected.

### Claim 16 (depends on 15)

The electronic device of claim 15, wherein the processor is further configured to selectively activate and deactivate ones of the plurality of modules based on the determined system state.

### Claim 17 (depends on 15)

The electronic device of claim 15, wherein the motion sensor comprises at least one accelerometer and at least one gyroscope.

### Claim 18 (depends on 15)

The electronic device of claim 15, wherein the audio sensor comprises a microphone.

### Claim 19 (depends on 15)

The electronic device of claim 15, wherein the electronic device comprises a laptop computer including the lid and a base, and wherein the time-of-flight sensor is contained in the lid and each of the motion sensor and audio sensor is contained in the lid or the base of the laptop computer.

### Claim 20 (depends on 15)

The electronic device of claim 15, wherein the processor includes:
a sound intensity estimator module configured to estimate an intensity of sound sensed by the audio sensor;
a sound intensity trigger module configured to determine whether the estimated sound intensity exceeds a sound intensity trigger threshold; and
a sound type classifier module configured to process the sensed audio signal, in response to the estimated sound intensity exceeding the sound intensity trigger threshold, and to classify the sensed audio signal as being generated by a human or not.