Visually coherent lighting for mobile augmented reality
AssigneeWorcester Polytechnic Institute
InventorsYiqin Zhao, Tian Guo
Life of this patent
Estimating the term…
Abstract
In a mobile computerized device, a method for generating visually coherent lighting for mobile augmented reality comprises capturing a set of near-field observations and a set of far-field observations of an environment; generating an environment map based upon the set of near-field observations of the environment and the set of far-field observations of the environment; applying the environment map to a virtual object to render a visually-coherent virtual object; and displaying an image of the environment and the visually-coherent virtual object within the environment on a display of the mobile computerized device.
Claims18
In a mobile computerized device, a method for generating visually coherent lighting for mobile augmented reality, comprising:
- capturing a set of near-field observations and a set of far-field observations of an environment, comprising:
- capturing a data frame of the environment by a camera system of the mobile computerized device;
- applying a near field boundary to the data frame;
- defining a portion of the data frame within the near field boundary as a near-field observation when a lighting reconstruction position falls within the field-of-view of the camera system;
- and
- defining a portion of the data frame outside the near field boundary as a far-field observation when the lighting reconstruction position falls outside of the field-of-view of the camera system;
- generating an environment map based upon the set of near-field observations of the environment and the set of far-field observations of the environment, the environmental map representing lighting of the environment;
- applying the environment map to a virtual object to render a visually-coherent virtual object in the mobile augmented reality, the visually-coherent virtual object comprising lighting corresponding to the lighting of the environment, the visually-coherent virtual object comprising a reflective surface of the virtual object in the mobile augmented reality corresponding to the lighting of the environment;
- and
- displaying an image of the environment and the visually-coherent virtual object within the environment in the mobile augmented reality on a display of the mobile computerized device.
A mobile computerized device, comprising:
- a controller having a processor and a memory;
- a camera system disposed in electrical communication with the controller;
- and
- a display disposed in electrical communication with the controller;
- the controller configured to:
- capture a set of near-field observations and a set of far-field observations of an environment, wherein when capturing the set of near-field observations and the set of far-field observations of an environment, the controller is configured to:
- capture a data frame of the environment by a camera system of the mobile computerized device;
- apply a near field boundary to the data frame;
- define a portion of the data frame within the near field boundary as a near-field observation when a lighting reconstruction position falls within the field-of-view of the camera system;
- and
- define a portion of the data frame outside the near field boundary as a far-field observation when the lighting reconstruction position falls outside of the field-of-view of the camera system;
- generate an environment map based upon the set of near-field observations of the environment and the set of far-field observations of the environment, the environmental map representing lighting of the environment;
- apply the environment map to a virtual object to render a visually-coherent virtual object in the mobile augmented reality, the visually-coherent virtual object comprising lighting corresponding to the lighting of the environment, the visually-coherent virtual object comprising a reflective surface of the virtual object in the mobile augmented reality corresponding to the lighting of the environment;
- and
- display an image of the environment and the visually-coherent virtual object within the environment in the mobile augmented reality on a display of the mobile computerized device.
Dependencies are inferred from the claim text.