Back to results
US 12,602,949 B2Granted
System and method for detecting human presence based on depth sensing and inertial measurement
AssigneeSTMicroelectronics S.r.l.
InventorsXiaoyong Yang, Kalyan-Kumar Vadlamudi-Reddy
Life of this patent
Estimating the term…
Abstract
An electronic device includes a depth sensor and an inertial measurement unit. The electronic device detects a presence of the user of the electronic device by analyzing a combination of inertial sensor signals from the inertial measurement unit and depth sensor signals from the depth sensor.
Claims16
An electronic device, comprising:
- a top lid;
- a bottom lid;
- a hinge coupled to the top lid and the bottom lid;
- a display in the top lid;
- a depth sensor in the top lid and including a reflectance sensor and configured to sense a distance between the display and objects in view of the depth sensor and to generate a depth map including a plurality of zones;
- a first inertial measurement unit in the top lid and configured to generate first inertial sensor data;
- a second inertial measurement unit in the bottom lid and configured to generate second inertial sensor data;
- and
- a sensor processing unit configured to:
- receive the first inertial sensor data, the second inertial sensor data, and the depth map;
- to determine a heading of the electronic device based on one or both of the first inertial sensor data and the second inertial sensor data;
- to determine a rotational angle of the top lid and the bottom lid;
- to identify an expected zone from the plurality of zones of the depth map in which a user of the electronic device is expected to be located based on the heading and the rotational angle, wherein identifying an expected zone includes identifying the expected zone based on rotation motion indicated by first and second inertial sensor data;
- to detect a presence of the user within the expected zone by analyzing the expected zone;
- and
- tracking a face of the user based on the first and second inertial sensor data indicating rotational motion.
13 more elements
A method, comprising:
- generating depth sensor data with a depth sensor in a top lid of an electronic device and including a reflectance sensor;
- generating first inertial sensor data with a first inertial sensor in the top lid of the electronic device;
- generating second inertial sensor signals with a second inertial sensor in a bottom lid of the electronic device, the bottom lid being rotatably coupled to the top lid by a hinge;
- generating a depth map based on the depth sensor signals;
- receiving, with a sensor processing unit of the electronic device, the first inertial sensor data, the second inertial sensor data, and the depth map;
- determining, with the sensor processing unit, a heading of the electronic device based on one or both of the first inertial sensor data and the second inertial sensor data;
- determining, with the sensor processing unit, a rotational angle of the top lid and the bottom lid;
- identifying, with the sensor processing unit, an expected zone from a plurality of zones of the depth map in which a user of the electronic device is expected to be located based on the heading and the rotational angle, wherein identifying an expected zone includes identifying the expected zone based on rotation motion indicated by first and second inertial sensor data;
- detecting, with the sensor processing unit, a presence of the user within the expected zone by analyzing the expected zone;
- and
- tracking a face of the user based on the first and second inertial sensor data indicating rotational motion.
8 more elements
A device, comprising:
- an upper lid;
- a lower lid coupled to the upper lid;
- a depth sensor positioned in the upper lid, the depth sensor configured to generate a depth map including a plurality of zones;
- a first inertial measurement unit positioned in the upper lid, the first inertial measurement unit configured to generate a first inertial measurement of the device;
- a second inertial measurement unit positioned in the lower lid, the second inertial measurement unit configured to generate a second inertial measurement of the device;
- and
- a sensor processing unit configured to:
- receive the first inertial sensor data, the second inertial sensor data, and the depth map;
- to determine a heading of the device based on one or both of the first inertial sensor data and the second inertial sensor data;
- to determine a rotational angle of the upper lid and the lower lid;
- to identify an expected zone from the plurality of zones of the depth map in which a user of the electronic device is expected to be located based on the heading and the rotational angle, wherein identifying an expected zone includes identifying the expected zone based on rotation motion indicated by first and second inertial sensor data;
- to detect a presence of the user within the expected zone by analyzing the expected zone;
- and
- track a face of the user based on the first and second inertial sensor data indicating rotational motion.
11 more elements
Dependencies are inferred from the claim text.