Augmented reality platform using captured footage from multiple angles
AssigneeAugmently, LLC
InventorsSagi Kormandel, Kelly Chu
Life of this patent
Estimating the term…
Abstract
This disclosure relates to systems and methods for augmenting visual information to simulate an appearance of an object and/or a person at an adjustable position and angle. The visual information may be captured by an image sensor. The object and/or the person may have been captured at multiple angles. A user may select at which particular position and angle the appearance will be superimposed and/or otherwise combined with the visual information.
Claims18
A system for augmenting real-world visual information to simulate an appearance of a previously captured real-world object and/or a real-world person at an adjustable position and angle within the real-world visual information, the system comprising:
- a display component configured to display images;
- an image sensor configured to capture image output signals in the real world, wherein the image output signals convey image information corresponding to a first viewing frustum of the image sensor, wherein the first viewing frustum originates from a first point of view in the real world;
- electronic storage configured to store information electronically, wherein the stored information includes previously captured visual information of an object and/or a person that has been previously captured in the real world from at least eight angles around the object and/or the person;
- and
- one or more physical processors configured by machine-readable instructions to:
- determine the image information based on the image output signals captured by the image sensor;
- receive user input indicating a position within the first viewing frustum of the image sensor, wherein the position as indicated corresponds to a real-world position where an appearance of the previously captured object and/or person will be simulated through composite visual information, wherein the received user input further indicates a preferred orientation of the object and/or the person in relation to the real world;
- retrieve, from the electronic storage, the previously captured visual information of the object and/or the person, wherein the previously captured visual information as retrieved has been captured at a first particular angle, wherein the first particular angle corresponds to the preferred orientation;
- determine the composite visual information based on the image information and the previously captured visual information such that the object and/or the person appear to be positioned at the real-world position and further such that the object and/or the person appear to be positioned at the preferred orientation;
- effectuate displaying of the composite visual information on the display component such that the object and/or the person appear to be positioned at the real-world position;
- detect a positional adjustment of the image sensor, wherein the image sensor, subsequent to the positional adjustment, is configured to capture secondary image output signals in the real world, wherein the secondary image output signals convey secondary image information corresponding to a second viewing frustum of the image sensor, wherein the second viewing frustum originates from a second point of view, and wherein the second viewing frustum is different than the first viewing frustum;
- determine a difference between the first point of view and the second point of view;
- retrieve, from the electronic storage, additional previously captured visual information of the object and/or the person, wherein the additional previously captured visual information as retrieved has been captured at a second particular angle, wherein the second particular angle corresponds to the preferred orientation and the determined difference between the first point of view and the second point of view, wherein the second particular angle is different than the first particular angle;
- responsive to detection of the positional adjustment, re-determine the composite visual information based on the secondary image information and the additional previously captured visual information such that the object and/or the person continues to appear to be positioned at the real-world position and further such that the object and/or the person appear to be positioned at the preferred orientation in relation to the real world;
- and
- effectuate displaying of the re-determined composite visual information on the display component such that the object and/or the person appear to be positioned at the real-world position.
A method for augmenting real-world visual information to simulate an appearance of a previously captured real-world object and/or a real-world person at an adjustable position and angle within the real-world visual information, the method comprising:
- capturing, by an image sensor, image output signals in the real world, wherein the image output signals convey image information corresponding to a first viewing frustum of the image sensor, wherein the first viewing frustum originates from a first point of view in the real world;
- storing information electronically in electronic storage, wherein the stored information includes previously captured visual information of an object and/or a person that has been previously captured in the real world from at least eight angles around the object and/or the person;
- determining the image information based on the image output signals captured by the image sensor;
- receiving user input indicating a position within the first viewing frustum of the image sensor, wherein the position as indicated corresponds to a real-world position where an appearance of the previously captured object and/or person will be simulated through composite visual information, wherein the received user input further indicates a preferred orientation of the object and/or the person in relation to the real world;
- retrieving, from the electronic storage, the previously captured visual information of the object and/or the person, wherein the previously captured visual information as retrieved has been captured at a first particular angle, wherein the first particular angle corresponds to the preferred orientation;
- determining the composite visual information based on the image information and the previously captured visual information such that the object and/or the person appear to be positioned at the real-world position and further such that the object and/or the person appear to be positioned at the preferred orientation;
- effectuating displaying of the composite visual information on the display component such that the object and/or the person appear to be positioned at the real-world position;
- detecting a positional adjustment of the image sensor;
- capturing, by the image sensor, subsequent to the positional adjustment, secondary image output signals in the real world, wherein the secondary image output signals conveys secondary image information corresponding to a second viewing frustum of the image sensor, wherein the second viewing frustum originates from a second point of view, wherein the second viewing frustum is different than the first viewing frustum;
- determining a difference between the first point of view and the second point of view;
- retrieving, from the electronic storage, additional previously captured visual information of the object and/or the person, wherein the additional previously captured visual information as retrieved has been captured at a second particular angle, wherein the second particular angle corresponds to the preferred orientation and the determined difference between the first point of view and the second point of view, wherein the second particular angle is different than the first particular angle;
- responsive to detection of the positional adjustment, re-determining the composite visual information based on the secondary image information and the additional previously captured visual information such that the object and/or the person continues to appear to be positioned at the real-world position and further such that the object and/or the person appear to be positioned at the preferred orientation in relation to the real world;
- and
- effectuating displaying of the re-determined composite visual information on a display component such that the object and/or the person appear to be positioned at the real-world position.
Dependencies are inferred from the claim text.