Magnified overlays correlated with virtual markers
AssigneeSnap Inc.
InventorsAlexander Sourov, John James Robertson
Life of this patent
Estimating the term…
Abstract
A magnification application for use with augmented reality (AR) eyewear devices. The magnification application enables a user of an eyewear device to activate a magnification overlay on a display whenever a camera on the eyewear device detects that the field of view includes a registered virtual marker. The magnified overlay includes one or more frames of the captured video data, presented according to a predefined and configurable magnification power. A pointer including a vector and a visual tether guides the user toward the virtual marker. When the eyewear device location is near a perimeter associated with the virtual marker, the magnified overlay appears in a predefined and configurable frame on the display.
Claims20
A method comprising:
- capturing frames of video data using a camera coupled to an eyewear device, wherein the eyewear device comprises a display and a touchpad;
- determining an eyewear device location relative to a structure in a physical environment based on the frames of video data;
- presenting on the display at a frame position a visual guide as a foreground overlay relative to the structure;
- registering, based on the frame position, a virtual marker location relative to the structure, wherein the registering comprises receiving an input relative to the touchpad, and wherein the virtual marker location is associated with a perimeter;
- presenting on the display a virtual marker relative to the structure in accordance with the virtual marker location and the eyewear device location;
- estimating a range based on the frame position relative to the perimeter;
- and
- selectively presenting on the display a magnified overlay according to the range, wherein the magnified overlay comprises one or more of the frames of video data.
An eyewear device, comprising:
- a processor;
- a memory;
- a camera;
- a display;
- a touchpad;
- and
- programming in the memory, wherein execution of the programming by the processor configures the eyewear device to perform functions, including functions to:
- capture frames of video data using the camera;
- determine an eyewear device location relative to a structure in a physical environment based on the frames of video data;
- present on the display at a frame position a visual guide as a foreground overlay relative to the structure;
- register, based on the frame position, a virtual marker location relative to the structure, wherein the function to register comprises a function to receive an input relative to the touchpad, and wherein the virtual marker location is associated with a perimeter;
- present on the display a virtual marker relative to the structure in accordance with the virtual marker location and the eyewear device location;
- estimate a range based on the frame position relative to the perimeter;
- and
- selectively present on the display a magnified overlay according to the range, wherein the magnified overlay comprises one or more of the frames of video data.
A non-transitory computer-readable medium storing program code that, when executed, is operative to cause a processor of an eyewear device to perform the steps of:
- capturing frames of video data using a camera coupled to the eyewear device, wherein the eyewear device comprises a display and a touchpad;
- determining an eyewear device location relative to a structure in a physical environment based on the frames of video data;
- presenting on the display at a frame position a visual guide as a foreground overlay relative to the structure;
- registering, based on the frame position, a virtual marker location relative to the structure, wherein the registering comprises receiving an input relative to the touchpad, and wherein the virtual marker location is associated with a perimeter;
- presenting on the display a virtual marker relative to the structure in accordance with the virtual marker location and the eyewear device location;
- estimating a range based on the frame position relative to the perimeter;
- and
- selectively presenting on the display a magnified overlay according to the range, wherein the magnified overlay comprises one or more of the frames of video data.
Dependencies are inferred from the claim text.