Proactively pausing media playing based on ambient motion for assistant systems
AssigneeMeta Platforms, Inc.
InventorsXin Ming Fan, Rongzhou Shen, Shijun Sun, Qian Fang, Amy Lawson Bearman, Kyle Archie
Life of this patent
Estimating the term…
Abstract
In one embodiment, a method includes accessing signals from inertial measurement unit (IMU) sensors of a head-mounted device associated with a user from the head-mounted device, wherein the head-mounted device is worn on the user's head, detecting a removal of the head-mounted device from the user's head by machine-learning models based only on the signals from the IMU sensors, determining a media file is playing on the head-mounted device, and providing instructions for pausing the playing of the media file to the head-mounted device.
Claims20
A method comprising:
- accessing, from a head-mounted device associated with a user, one or more signals from one or more inertial measurement unit (IMU) sensors of the head-mounted device, wherein the head-mounted device is worn on the user's head;
- detecting, by one or more machine-learning models subject to a memory, computation, or binary size constraint to be executable on a computationally-constrained microcontroller unit of the head-mounted device, a removal of the head-mounted device from the user's head based on the one or more signals from the IMU sensors;
- determining a media file is playing on the head-mounted device;
- and
- providing, to the head-mounted device, instructions for pausing the playing of the media file.
A computer-readable non-transitory storage media embodying software that is operable when executed to:
- access, from a head-mounted device associated with a user, one or more signals from one or more inertial measurement unit (IMU) sensors of the head-mounted device, wherein the head-mounted device is worn on the user's head;
- detect, by one or more machine-learning models subject to a memory, computation, or binary size constraint to be executable on a computationally-constrained microcontroller unit of the head-mounted device, a removal of the head-mounted device from the user's head based on the one or more signals from the IMU sensors;
- determine a media file is playing on the head-mounted device;
- and
- provide, to the head-mounted device, instructions for pausing the playing of the media file.
A system comprising:
- one or more processors;
- and a non-transitory memory coupled to the processors comprising instructions executable by the processors, the processors operable when executing the instructions to:
- access, from a head-mounted device associated with a user, one or more signals from one or more inertial measurement unit (IMU) sensors of the head-mounted device, wherein the head-mounted device is worn on the user's head;
- detect, by one or more machine-learning models subject to a memory, computation, or binary size constraint to be executable on a computationally-constrained microcontroller unit of the head-mounted device, a removal of the head-mounted device from the user's head based on the one or more signals from the IMU sensors;
- determine a media file is playing on the head-mounted device;
- and
- provide, to the head-mounted device, instructions for pausing the playing of the media file.
Dependencies are inferred from the claim text.