Time-warping adjustment based on depth information in a virtual/augmented reality system
AssigneeGoogle Inc.
InventorJohn Paul Bates
Life of this patent
Estimating the term…
Abstract
A technique includes determining a depth value for each of a plurality of pixels of a frame, down-sampling the depth values of a tile of the frame to obtain a plurality of down-sampled depth values, the frame including one or more tiles, determining a change in a head pose, determining, from the plurality of down-sampled depth values, a down-sampled depth value for a vertex, determining an adjusted position for the vertex based on the change in head pose and the down-sampled depth value for the vertex, performing, based on at least the adjusted position for the vertex, a depth-adjusted time-warping of the frame to obtain a depth-adjusted time-warped frame, and triggering display of the depth-adjusted time-warped frame.
Claims17
A method of adjusting time-warping of a frame for a virtual reality system based on depth information, the method including:
- determining a depth value for each of a plurality of pixels of a frame;
- down-sampling the depth values of a tile of the frame to obtain a plurality of down-sampled depth values, the frame including one or more tiles;
- determining a change in a head pose;
- determining, from the plurality of down-sampled depth values, a down-sampled depth value for a vertex;
- determining an adjusted position for the vertex based on the change in head pose and the down-sampled depth value for the vertex;
- performing, based on at least the adjusted position for the vertex, a depth-adjusted time-warping of the frame to obtain a depth-adjusted time-warped frame;
- and
- triggering display of the depth-adjusted time-warped frame.
An apparatus comprising at least one processor and at least one memory including computer instructions, when executed by the at least one processor, cause the apparatus to:
- determine a depth value for each of a plurality of pixels of a frame;
- down-sample the depth values of a tile of the frame to obtain a plurality of down-sampled depth values, the frame including one or more tiles;
- determine a change in a head pose;
- determine, from the plurality of down-sampled depth values, a down-sampled depth value for a vertex;
- determine an adjusted position for the vertex based on the change in head pose and the down-sampled depth value for the vertex;
- perform, based on at least the adjusted position for the vertex, a depth-adjusted time-warping of the frame to obtain a depth-adjusted time-warped frame;
- and
- trigger display of the depth-adjusted time-warped frame.
A computer program product, the computer program product comprising a computer-readable storage medium and storing executable code that, when executed by at least one data processing apparatus, is configured to cause the at least one data processing apparatus to perform a method comprising:
- determining a depth value for each of a plurality of pixels of a frame;
- down-sampling the depth values of a tile of the frame to obtain a plurality of down-sampled depth values, the frame including one or more tiles;
- determining a change in a head pose;
- determining, from the plurality of down-sampled depth values, a down-sampled depth value for a vertex;
- determining an adjusted position for the vertex based on the change in head pose and the down-sampled depth value for the vertex;
- performing, based on at least the adjusted position for the vertex, a depth-adjusted time-warping of the frame to obtain a depth-adjusted time-warped frame;
- and
- triggering display of the depth-adjusted time-warped frame.
Dependencies are inferred from the claim text.