Wearable multimedia device and cloud computing platform with application ecosystem

A system comprising:

• one or more processors;
• memory storing instructions that when executed by the one or more processors, causes the one or more processors to perform operations comprising:
• receiving two or more data streams, each data stream including a unique identifier and context data captured by a wearable multimedia device in a real-world environment, the context data including one or more digital images and depth data;
• for each data stream:
• identifying, based on the context data, a real-world object and one or more gestures associated with the real-world object;
• and
• creating a data processing pipeline with one or more applications based on one or more characteristics of the context data and the unique identifier;
• generating, using the data processing pipeline, a description of the identified real-world object, the description including a label for the real-world object;
• and
• sending the description to the wearable multimedia device or other device.

A non-transitory, computer-readable storage medium having instructions stored thereon, that when executed by one or more processors, cause the one or more processors to perform operations comprising:

• receiving two or more data streams, each data stream including a unique identifier and context data captured by a wearable multimedia device in a real-world environment, the context data including one or more digital images and depth data;
• for each data stream:
• identifying, based on the context data, a real-world object and one or more gestures associated with the real-world object;
• and
• creating a data processing pipeline with one or more applications based on one or more characteristics of the context data and the unique identifier;
• generating, using the data processing pipeline, a description of the identified real-world object, the description including a label for the real-world object;
• and
• sending the description to the wearable multimedia device or other device.

A method comprising:

• capturing, using a camera of a wearable multimedia device, a first set of digital images, the first set of digital images including two or more objects;
• capturing, using a depth sensor of the wearable multimedia device, first depth data, the first depth data indicative of a first gesture by a user wearing the wearable multimedia device;
• isolating a portion of at least one digital image in the first set of digital images based on the first gesture, the isolated portion including one of the two or more objects;
• sending, using a wireless transceiver of the wearable multimedia device, the isolated portion to a network-based data processing pipeline;
• receiving, using the wireless transceiver, first data from the network-based data processing pipeline, the first data associated with the object, the first data including a label for the object;
• and
• projecting, using a laser projection system of the wearable multimedia device, an ephemeral display on a surface, the ephemeral display including at least a portion of the first data.

An apparatus comprising:

• a camera;
• a laser projection system;
• a wireless transceiver;
• one or more processors;
• memory storing instructions that when executed by the one or more processors, cause the one or more processors to perform operations comprising:
• capturing, using the camera, a first set of digital images, the first set of digital images including two or more real-world objects;
• isolating a first portion of at least one digital image in the first set of digital images, the isolated first portion including a first object of the two or more real-world objects;
• isolating a second portion of the at least one digital image in the first set of digital images, the isolated second portion including a second object of the two or more real-world objects;
• sending, using the wireless transceiver, a first data stream have a first unique identifier to a network-based data processing pipeline;
• sending, using the wireless transceiver, a second data stream have a second unique identifier to the network-based data processing pipeline;
• receiving, using the wireless transceiver, first data from the network-based data processing pipeline, the first data associated with the first real-world object
• receiving, using the wireless transceiver, second data from the network-based data processing pipeline, the second data associated with the second real-world object;
• and
• projecting, using the laser projection system, an ephemeral display on a surface that includes at least a portion of the first data or the second data on a surface.

An apparatus comprising:

• an attachment mechanism for attaching the apparatus to a user's clothing;
• a camera;
• a depth sensor;
• a laser projection system;
• one or more processors;
• memory storing instructions that when executed by the one or more processors, cause the one or more processors to perform operations comprising:
• capturing, using the camera, a set of digital images;
• capturing, using the depth sensor, depth data;
• identifying one or more real-world objects using the set of digital images and the depth data, wherein identifying the one or more real-world objects includes determining a label for each of the one or more real-world objects;
• obtaining data associated with the identified one or more real-world objects;
• and
• projecting, using the laser projection system, the data associated on a surface.

A screenless apparatus comprising:

• an attachment mechanism for attaching the apparatus to a user's clothing;
• a camera;
• a laser projection system;
• one or more processors;
• memory storing instructions that when executed by the one or more processors, cause the one or more processors to perform operations comprising:
• capturing, using the camera, a set of digital images;
• labeling, using the one or more processors, one or more real-world objects in the set of digital images;
• obtaining, using the one or more processors, data associated with the one or more real-world objects based at least in part on the labeling;
• and
• projecting, using the laser projection system, the data on a surface.