US 2023/0400565 A1 · FULL BODY TRACKING USING FUSION DEPTH SENSING

Abstract

Techniques disclosed herein may be utilized to detect, measure, and/or track the location of objects via radar sensor devices that are affixed to a wearable device. Each of the radar sensors (e.g., MIMIC radar sensor) generates, captures, and evaluates radar signals associated with the wearable device (e.g., HMD) and the surrounding environment. Objects located within the field of view with sufficient reflectivity will result in radar return signals each with a characteristic time of arrival (TOA), angle of arrival (AOA), and frequency shift (Doppler shift). The sensed return signals can be processed to determine distance and direction, as well as identification of the objects based on radar characteristics of the object (e.g., radar back-scatter or cross-section pattern). Object information, including position and identification, may be further resolved based on correlation with measurements from one or more of the digital cameras or inertial measurement units.

Claims20

Dependent claims

A body worn device that is worn by a user to track real world objects in a virtual space, the body worn device comprising:

a first RF transceiver system at a first position of the body worn device and configured to capture radar return signals in a first field of view;
a second RF transceiver system at a second position of the body worn device and configured to capture radar return signals in a second field of view;
a third RF transceiver system at a third position of the body worn device and configured to capture radar return signals in a third field of view;
a fourth RF transceiver system at a fourth position of the body worn device and configured to capture radar return signals in a fourth field of view;
and
an application processor that is configured to receive the captured radar return signals from the first, second, third and fourth RF transceiver systems, wherein the application processor is configured to:
cluster the captured radar return signals into one or more localized objects;
evaluate signals from the clusters to identify localized objects as one or more of the real world objects;
and
update tracking position information associated with each identified real world object in the virtual space.

7 more elements

Dependencies are inferred from the claim text.

Full body tracking using fusion depth sensing

Life of this patent

Full body tracking using fusion depth sensing

Life of this patent

Abstract

Claims20