Back to results
US 2025/0053234 A1Published application
Systems and methods for virtual and augmented reality
AssigneeMagic Leap, Inc.
InventorEric C. BROWY
Life of this patent
Estimating the term…
Abstract
Disclosed herein are systems and methods for distributed computing and/or networking for mixed reality systems. A method may include capturing an image via a camera of a head-wearable device. Inertial data may be captured via an inertial measurement unit of the head-wearable device. A position of the head-wearable device can be estimated based on the image and the inertial data via one or more processors of the head-wearable device. The image can be transmitted to a remote server. A neural network can be trained based on the image via the remote server. A trained neural network can be transmitted to the head-wearable device.
Claims20
A method comprising:
- receiving, at a first time, local target data captured via one or more sensors of a first wearable system comprising a first head-wearable device, the local target data comprising a direction associated with the first wearable system;
- receiving image data captured via a camera of the first wearable system, the image data associated with a field of view of the first head-wearable device;
- in response to receiving the local target data and further in response to receiving the image data, determining trained target data based on the local target data and further based on the image data, wherein said determining the trained target data comprises applying the local target data and the image data as inputs to a convolutional neural network;
- and
- transmitting, to a second wearable system, the trained target data;
- wherein the second wearable system is configured to:
- detect an object in a field of view of the second wearable system;
- and
- determine, at the second wearable system based on the trained target data, whether the detected object comprises a target object, wherein said determining whether the detected object comprises a target object is based on the convolutional neural network.
6 more elements
A system comprising:
- a computing device comprising one or more processors, the one or more processors configured to perform a method comprising:
- receiving, at a first time, local target data captured via one or more sensors of a first wearable system comprising a first head-wearable device, the local target data comprising a direction associated with the first wearable system;
- receiving image data captured via a camera of the first wearable system, the image data associated with a field of view of the first head-wearable device;
- in response to receiving the local target data and further in response to receiving the image data, determining trained target data based on the local target data and further based on the image data, wherein said determining the trained target data comprises applying the local target data and the image data as inputs to a convolutional neural network;
- and
- transmitting, to a second wearable system, the trained target data;
- wherein the second wearable system is configured to:
- detect an object in a field of view of the second wearable system;
- and
- determine, at the second wearable system based on the trained target data, whether the detected object comprises a target object, wherein said determining whether the detected object comprises a target object is based on the convolutional neural network.
7 more elements
A non-transitory computer-readable storage medium storing instructions which, when executed by one or more processors, cause the one or more processors to perform a method comprising:
- receiving, at a first time, local target data captured via one or more sensors of a first wearable system comprising a first head-wearable device, the local target data comprising a direction associated with the first wearable system;
- receiving image data captured via a camera of the first wearable system, the image data associated with a field of view of the first head-wearable device;
- in response to receiving the local target data and further in response to receiving the image data, determining trained target data based on the local target data and further based on the image data, wherein said determining the trained target data comprises applying the local target data and the image data as inputs to a convolutional neural network;
- and
- transmitting, to a second wearable system, the trained target data;
- wherein the second wearable system is configured to:
- detect an object in a field of view of the second wearable system;
- and
- determine, at the second wearable system based on the trained target data, whether the detected object comprises a target object, wherein said determining whether the detected object comprises a target object is based on the convolutional neural network.
6 more elements
Dependencies are inferred from the claim text.