Multi-soc hand-tracking platform
AssigneeSnap Inc.
InventorsLiviu Marius Coconu, Daniel Colascione, Farid Zare Seisan, Daniel Harris, Jennica Pounds
Life of this patent
Estimating the term…
Abstract
A multi-System on Chip (SoC) hand-tracking platform is provided. The multi-SoC hand-tracking platform includes a computer vision SoC and one or more application SoCs. The computer vision SoC hosts a hand-tracking input pipeline. The one or more application SoCs host one or more applications that are consumers of input event data generated by the hand-tracking input pipeline. The applications communicate with some components of the hand-tracking input pipeline using a shared-memory buffer and with some of the components of the hand-tracking input pipeline using Inter-Process Communication (IPC) method calls.
Claims21
A computing system comprising:
- a first System on Chip (SoC) comprising:
- first one or more processors;
- and
- a first memory storing first instructions that, when executed by the first one or more processors, cause the first SoC to perform operations of a hand-tracking input pipeline of an Augmented Reality (AR) system, the operations comprising:
- generating real-world scene environment frame data based on hand movements being made by a user of the AR system using a camera component of the hand-tracking input pipeline;
- generating gesture input event data based on the real-world scene environment frame data;
- and
- communicating the gesture input event data to a component of the AR system;
- and
- a second SoC comprising:
- second one or more processors;
- and
- a second memory storing second instructions that, when executed by the second one or more processors, cause the second SoC to perform operations of the component of the AR system, the operations comprising:
- receiving the gesture input event data;
- and
- utilizing the gesture input event data as user input data.
A computer-implemented method, comprising:
- generating, by first one or more processors of a first System on Chip (SoC), real-world scene environment frame data based on hand movements being made by a user of an Augmented Reality (AR) system using a camera component of a hand-tracking input pipeline of the AR system;
- generating, by the hand-tracking input pipeline of the AR system using the first one or more processors, gesture input event data based on the real-world scene environment frame data;
- communicating, by the hand-tracking input pipeline of the AR system using the first one or more processors, the gesture input event data to a component of the AR system;
- receiving, by the component using second one or more processors of a second SoC, the gesture input event data;
- and
- utilizing, by the component using the second one or more processors, the gesture input event data as user input data.
A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computer, cause the computer to perform operations comprising:
- generating real-world scene environment frame data based on hand movements being made by a user of an Augmented Reality (AR) system using a camera component of a hand-tracking input pipeline of the AR system;
- generating gesture input event data based on the real-world scene environment frame data;
- and
- communicating the gesture input event data to a component of the AR system that receives the gesture input event data and utilizes the gesture input event data as user input data.
Dependencies are inferred from the claim text.