Systems and methods for virtual and augmented reality
AssigneeMagic Leap, Inc.
InventorEric C. Browy
Life of this patent
Estimating the term…
Abstract
Disclosed herein are systems and methods for distributed computing and/or networking for mixed reality systems. A method may include capturing an image via a camera of a head-wearable device. Inertial data may be captured via an inertial measurement unit of the head-wearable device. A position of the head-wearable device can be estimated based on the image and the inertial data via one or more processors of the head-wearable device. The image can be transmitted to a remote server. A neural network can be trained based on the image via the remote server. A trained neural network can be transmitted to the head-wearable device.
Claims18
A method comprising:
- receiving, at a server remote to a wearable head device, an image captured via a camera of the wearable head device;
- receiving, at the server, an estimated orientation of a handheld device in communication with the wearable head device, the estimated orientation determined by the wearable head device;
- in response to receiving the image and the estimated orientation, training a neural network based on the image to produce a trained neural network;
- and
- transmitting the trained neural network to the wearable head device.
A system comprising:
- a server that is remote to a wearable head device, the wearable head device comprising a camera;
- and
- one or more processors configured to execute a method comprising:
- receiving, at the server, an image captured via the camera of the wearable head device;
- receiving, at the server, an estimated orientation of a handheld device in communication with the wearable head device, the estimated orientation determined by the wearable head device;
- in response to receiving the image and the estimated orientation, training a neural network based on the image to produce a trained neural network;
- and
- transmitting the trained neural network to the wearable head device.
A non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to execute a method comprising:
- receiving, at a server remote to a wearable head device, an image captured via a camera of the wearable head device;
- receiving, at the server, an estimated orientation of a handheld device in communication with the wearable head device, the estimated orientation determined by the wearable head device;
- in response to receiving the image and the estimated orientation, training a neural network based on the image to produce a trained neural network;
- and
- transmitting the trained neural network to the wearable head device.
Dependencies are inferred from the claim text.