Back to results
US 12,732,589 B2Granted
Dynamic binning passthrough content
AssigneeApple Inc.
InventorsKaushik Raghunath, Venu M. Duggineni
Life of this patent
Estimating the term…
Abstract
A method is provided that includes determining a gaze position of a user relative to mixed-reality content displayed in a first frame, setting a binning mode for a first camera based on the determined gaze position, and capturing, using the first camera, passthrough content for a second frame at a resolution determined by the binning mode.
Claims20
A method, comprising:
- determining a gaze position of a user relative to mixed-reality content displayed in a first frame, wherein the mixed-reality content displayed in the first frame comprises rendered virtual content, and wherein the gaze position of the user is determined relative to the rendered virtual content;
- and
- in response to determining that the gaze position lies within a region of the first frame occupied by the rendered virtual content:
- setting a binning mode for a first camera based on the determined gaze position;
- and
- capturing, using the first camera, passthrough content for a second frame at a resolution determined by the binning mode.
3 more elements
A non-transitory computer-readable medium storing instructions which, when executed by one or more processors, cause the one or more processors to perform operations comprising:
- determining a gaze position of a user relative to mixed-reality content displayed in a first frame;
- determining a contrast level of passthrough content displayed in the first frame,
- setting a binning mode for a first camera based on the determined gaze position and the determined contrast level;
- and
- capturing, using the first camera, passthrough content for a second frame at a resolution determined by the binning mode.
2 more elements
An electronic device, comprising:
- a memory storing one or more computer programs;
- and
- one or more processors configured to execute instructions of the one or more computer programs to:
- determine a gaze position of a user relative to mixed-reality content displayed in a first frame;
- set a first binning mode for a first camera based on the determined gaze position;
- set a second binning mode for a second camera based on the determined gaze position, wherein the second binning mode for the second camera is different from the first binning mode for the first camera;
- capture, using the first camera, first passthrough content for a second frame at a first resolution determined by the first binning mode;
- and
- capture, using the second camera, second passthrough content for a third frame at a second resolution determined by the second binning mode.
6 more elements
Dependencies are inferred from the claim text.