Back to results
US 11,307,412 B1Granted
Audio visualizer eyewear device
AssigneeSnap Inc.
InventorDavid Meisenholder
Life of this patent
Estimating the term…
Abstract
System, method, and non-transitory computer readable medium for presenting audio-based visual overlays on see-through optical assemblies. Overlays are presented by capturing, via a camera of an eyewear device, initial images of a scene, receiving an audio signal, modifying the initial images responsive to the audio signal to create overlay images, and displaying, via a see-through optical assembly of the eyewear device, the overlay images to a wearer of the eyewear device over the scene in a viewing area of the eyewear device.
Claims20
A system comprising:
- an eyewear device, including:
- a frame;
- a see-through optical assembly supported by the frame, the see-through optical assembly having a viewing area for viewing a scene and configured to present overlay images to a user over the scene in the viewing area;
- and
- a camera connected to the frame to capture initial images of a scene;
- a processor coupled to the eyewear device and connected to the camera;
- a memory accessible to the processor;
- and
- programming in the memory, wherein execution of the programming by the processor configures the system to perform functions, including functions to:
- capture, via the camera, the initial images of the scene;
- receive an audio signal;
- select at least one aspect of an initial image of the scene in the viewing area captured by the camera using image processing techniques based on pattern recognition;
- modify the at least one selected aspect of the initial image responsive to the audio signal to create the overlay images, the overlay images blurring boundaries or fading in and out the at least one selected aspect of the initial image in response to features of the audio signal including at least one of tone or beat;
- display, via the see-through optical assembly, the overlay images to the user over the at least one selected aspect of the initial image in the viewing area;
- and
- adjust time between capture and display to reduce an offset between a first position of the at least one aspect of the initial image of the scene at the time of capture and a second position of the at least one aspect of the initial image of the scene at the time of display.
13 more elements
A method comprising:
- capturing, via a camera of an eyewear device, initial images of a scene;
- receiving an audio signal;
- selecting at least one aspect of an initial image of the scene captured by the camera using image processing techniques based on pattern recognition;
- modifying the at least one selected aspect of the initial image responsive to the audio signal to create overlay images that blur boundaries or fade in and out the at least one selected aspect of the initial image in response to features of the audio signal including at least one of tone or beat;
- displaying, via a see-through optical assembly of the eyewear device, the overlay images to a wearer of the eyewear device over the at least one selected aspect of the initial image in a viewing area of the eyewear device;
- and
- adjusting time between capture and display to reduce an offset between a first position of the at least one aspect of the initial image of the scene at the time of capture and a second position of the at least one aspect of the initial image of the scene at the time of display.
4 more elements
A non-transitory computer-readable medium storing program code which, when executed, is operative to cause an electronic processor to perform the steps of:
- capturing, via a camera of an eyewear device, initial images of a scene;
- receiving an audio signal;
- selecting at least one aspect of an initial image of the scene captured by the camera using image processing techniques based on pattern recognition;
- modifying the at least one selected aspect of the initial image responsive to the audio signal to create overlay images that blur boundaries or fade in and out the at least one selected aspect of the initial image in response to features of the audio signal including at least one of tone or beat;
- displaying, via a see-through optical assembly of the eyewear device, the overlay images to a wearer of the eyewear device over the at least one selected aspect of the initial image in a viewing area of the eyewear device;
- and
- adjusting time between capture and display to reduce an offset between a first position of the at least one aspect of the initial image of the scene at the time of capture and a second position of the at least one aspect of the initial image of the scene at the time of display.
4 more elements
Dependencies are inferred from the claim text.