Systems and methods for virtual and augmented reality
AssigneeMagic Leap, Inc.
InventorEric C. BROWY
Life of this patent
Estimating the term…
Abstract
Disclosed herein are systems and methods for distributed computing and/or networking for mixed reality systems. A method may include capturing an image via a camera of a head-wearable device. Inertial data may be captured via an inertial measurement unit of the head-wearable device. A position of the head-wearable device can be estimated based on the image and the inertial data via one or more processors of the head-wearable device. The image can be transmitted to a remote server. A neural network can be trained based on the image via the remote server. A trained neural network can be transmitted to the head-wearable device.
Claims20
A method comprising:
- receiving, at a first time, local target data captured via one or more sensors associated with a first vehicle, the local target data comprising a direction associated with the first vehicle;
- receiving image data captured via a camera associated with the first vehicle, the image data associated with a field of view of the camera;
- in response to receiving the local target data and further in response to receiving the image data, determining trained target data based on the local target data and further based on the image data, wherein said determining the trained target data comprises applying the local target data and the image data as inputs to a convolutional neural network;
- and
- transmitting, to a second vehicle, the trained target data;
- wherein the second vehicle is configured to:
- detect an object in a field of view of a camera associated with the second vehicle;
- and
- determine, based on the trained target data, whether the detected object comprises a target object, wherein said determining whether the detected object comprises a target object is based on the convolutional neural network.
A system comprising:
- a computing device comprising one or more processors, the one or more processors configured to perform a method comprising:
- receiving, at a first time, local target data captured via one or more sensors associated with a first vehicle, the local target data comprising a direction associated with the first vehicle;
- receiving image data captured via a camera associated with the first vehicle, the image data associated with a field of view of the camera;
- in response to receiving the local target data and further in response to receiving the image data, determining trained target data based on the local target data and further based on the image data, wherein said determining the trained target data comprises applying the local target data and the image data as inputs to a convolutional neural network;
- and
- transmitting, to a second vehicle, the trained target data;
- wherein the second vehicle is configured to:
- detect an object in a field of view of a camera associated with the second vehicle;
- and
- determine, based on the trained target data, whether the detected object comprises a target object, wherein said determining whether the detected object comprises a target object is based on the convolutional neural network.
A non-transitory computer-readable storage medium storing instructions which, when executed by one or more processors, cause the one or more processors to perform a method comprising:
- receiving, at a first time, local target data captured via one or more sensors associated with a first vehicle, the local target data comprising a direction associated with the first vehicle;
- receiving image data captured via a camera associated with the first vehicle, the image data associated with a field of view of the camera;
- in response to receiving the local target data and further in response to receiving the image data, determining trained target data based on the local target data and further based on the image data, wherein said determining the trained target data comprises applying the local target data and the image data as inputs to a convolutional neural network;
- and
- transmitting, to a second vehicle, the trained target data;
- wherein the second vehicle is configured to:
- detect an object in a field of view of a camera associated with the second vehicle;
- and
- determine, based on the trained target data, whether the detected object comprises a target object, wherein said determining whether the detected object comprises a target object is based on the convolutional neural network.
Dependencies are inferred from the claim text.