Magnified overlays correlated with virtual markers
AssigneeSnap Inc.
InventorsAlexander Sourov, John James Robertson
Life of this patent
Estimating the term…
Abstract
A magnification application for use with augmented reality (AR) eyewear devices. The magnification application enables a user of an eyewear device to activate a magnification overlay on a display whenever a camera on the eyewear device detects that the field of view includes a registered virtual marker. The magnified overlay includes one or more frames of the captured video data, presented according to a predefined and configurable magnification power. A pointer including a vector and a visual tether guides the user toward the virtual marker. When the eyewear device location is near a perimeter associated with the virtual marker, the magnified overlay appears in a predefined and configurable frame on the display.
Claims17
A method of presenting a magnified overlay with an eyewear device comprising a camera and a display, the method comprising:
- capturing frames of video data using the camera;
- registering a virtual marker associated with a marker location relative to a physical environment, wherein the virtual marker comprises a perimeter;
- determining an eyewear device location relative to the marker location based on the captured frames of video data;
- defining a frame relative to the display, wherein the frame is associated with a frame size and a frame position;
- and
- presenting on the display the virtual marker at the marker location based on the eyewear device location;
- presenting on the display within the frame a pointer aligned with the frame position wherein the pointer comprises a vector pointing toward the marker location,
- calculating a range based on the frame position relative to at least one of the marker location or the perimeter;
- and
- selectively presenting on the display within the frame a magnified overlay according to the range, wherein the magnified overlay comprises one or more of the captured frames of video data magnified by a magnification power.
An eyewear device for presenting a magnified overlay, comprising:
- a processor;
- a memory;
- a camera;
- a display;
- and
- programming in the memory, wherein execution of the programming by the processor configures the eyewear device to perform functions, including functions to:
- capture frames of video data using the camera;
- register a virtual marker associated with a marker location relative to a physical environment, wherein the virtual marker comprises a perimeter;
- determine an eyewear device location relative to the marker location based on the captured frames of video data;
- define a frame relative to the display, wherein the frame is associated with a frame size and a frame position;
- and
- present on the display within the frame a pointer aligned with the frame position, wherein the pointer comprises a vector pointing toward the marker location,
- calculate a range based on the frame position relative to at least one of the marker location or the perimeter;
- selectively present on the display within the frame a magnified overlay according to the range, wherein the magnified overlay comprises one or more of the captured frames of video data magnified by a magnification power.
A non-transitory computer-readable medium storing program code that, when executed, is operative to cause a processor of an eyewear device to perform the steps of:
- capturing frames of video data using a camera coupled to the eyewear device, wherein the eyewear device comprises a display;
- registering a virtual marker associated with a marker location relative to a physical environment, wherein the virtual marker comprises a perimeter;
- determining an eyewear device location relative to the marker location based on the captured frames of video data;
- defining a frame relative to the display, wherein the frame is associated with a frame size and a frame position;
- presenting on the display the virtual marker at the marker location based on the eyewear device location;
- presenting on the display within the frame a pointer aligned with the frame position, wherein the pointer comprises a vector pointing toward the marker location,
- calculating a range based on the frame position relative to at least one of the marker location or the perimeter;
- and
- selectively presenting on the display, within the frame, and as an overlay in a foreground relative to the physical environment, a magnified overlay according to the range, wherein the magnified overlay comprises one or more of the captured frames of video data presented according to a magnification power.
Dependencies are inferred from the claim text.