# US 11,308,682 B2 · Dynamic stereoscopic rendering method and processor > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,308,682 B2 - Document ID: US11308682B2 - Status: Granted - Kind: B2 - Application number: 16/665,924 - Filed: 2019-10-28 - Published: 2021-04-29 - Granted: 2022-04-19 - Earliest claimed: 2019-10-28 - Assignees: Apical Limited; Arm Limited - Applicants: Apical Limited; Arm Limited - Inventors: Daren Croxford; Mathieu Jean Joseph Robart - Web page: https://patentgrep.com/patent/US11308682B2 ## CPC - G06T 15/06: Ray-tracing - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - G06T 15/20: Perspective computation - H04N 13/161: Encoding, multiplexing or demultiplexing different image signal components (for multi-view video sequence encoding H04N19/597) - H04N 13/194: Transmission of image signals - H04N 13/239: using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance (H04N13/243 takes precedence) - G06T 2210/21: Collision detection, intersection - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A method comprising the steps of generating a first representation and a second representation, where the first representation represents a first view of a computer-generated scene obtained from a first virtual camera and the second representation represents a second view of the computer-generated scene obtained from a second virtual camera. Each of the first and second representation comprises a plurality of rays which intersect with objects of the scene. A relationship is determined between a ray of the first representation and a ray of the second representation; which are grouped based on the relationship, to form a group of substantially similar rays. One or more of the groups of substantially similar rays are processed substantially simultaneously to produce a first a second rendered view of the computer-generated scene. The first the second rendered view are output to one or more display devices. ## Claims ### Claim 1 A method comprising the steps of: identifying at least one target region of a computer-generated scene, the at least one target region being associated with data relating to a gaze direction of a viewer; generating at least a first computer-generated representation and a second computer- generated representation, where the first computer-generated representation represents a first view of the computer-generated scene obtained from a first virtual camera and the second computer-generated representation represents a second view of the computer-generated scene obtained from a second virtual camera, and each of the first computer-generated representation and the second computer-generated representation comprises a plurality of rays which intersect with objects of the computer-generated scene, wherein the first virtual camera and the second virtual camera are positioned within the computer-generated scene so as to represent an interocular distance associated with the viewer, and wherein generating at least the first computer-generated representation and the second computer-generated representation comprises: increasing the number of rays in the first view and the second view, arranged to intersect with objects in the target region of the computer-generated scene; and decreasing the number of rays in the first view and the second view arranged to intersect with objects outside the target region of the computer-generated scene; determining a relationship between at least one ray of the first computer-generated representation and at least one ray of the second computer-generated representation; grouping the at least one ray of the first computer-generated representation and the at least one ray of the second computer-generated representation based on the relationship, to form a group of substantially similar rays; processing one or more of the group of substantially similar rays, substantially simultaneously to produce a first rendered view and a second rendered view of the computer-generated scene, wherein the first rendered view and the second rendered view are rendered using a first rendering technique in the target region and a second rendering technique outside the target region; and outputting the first rendered view and the second rendered view to one or more display devices. ### Claim 2 (depends on 1) The method of claim 1, wherein determining the relationship comprises determining whether a ray of the first computer-generated representation and a ray of the second computer-generated representation intersect an object in the computer-generated scene. ### Claim 3 (depends on 2) The method of claim 2, wherein determining whether a ray of the first computer-generated representation and a ray of the second computer-generated representation intersect an object in the computer-generated scene, is based on at least: a start point and a direction of each of the ray of the first computer-generated representation and the ray of the second computer-generated representation; and a distance between the first virtual camera and the second virtual camera. ### Claim 4 (depends on 2) The method of claim 2, wherein determining the relationship is also based on an intersect between the ray of the first computer-generated representation and the ray of the second computer-generated representation. ### Claim 5 (depends on 4) The method of claim 4, wherein the intersect is determined using at least one of rasterization or ray tracing. ### Claim 6 (depends on 2) The method of claim 2, where the ray of the first computer-generated representation and the ray of the second computer-generated representation have a substantially similar direction, and wherein processing the ray of the second computer-generated representation comprises processing the ray of the first computer-generated representation and applying an offset associated with a distance between the first virtual camera and the second virtual camera. ### Claim 7 (depends on 1) The method of claim 1, wherein the first rendering technique and the second rendering technique are at least one of rasterization; or ray tracing. ### Claim 8 (depends on 1) The method of claim 1, wherein the data relating to the gaze direction of a viewer comprises eye-tracking data. ### Claim 9 (depends on 1) The method of claim 1, wherein the one or more display devices comprises at least one of a head-mounted display; a stereoscopic display, a multiview display, and a holographic display. ### Claim 10 A processor comprising: an input module for receiving an input from at least a first virtual camera and a second virtual camera arranged to obtain at least a first view and a second view of a computer-generated scene, wherein the first virtual camera and the second virtual camera are positioned within the computer-generated scene so as to represent an interocular distance associated with the viewer; a target region identification module arranged to identify at least one target region of the computer-generated scene, the at least one target region being associated with a gaze direction of a viewer; a generation module for generating a first computer-generated representation representative of the first view based on the input from the first virtual camera and a second computer-generated representation of the second view based on the input from the second virtual camera, the first computer-generated representation and the second computer-generated representation comprising a plurality of rays which intersect with objects of the scene, wherein generating the first computer-generated representation and second computer-generated representation comprises: increasing the number of rays in the first view and the second view, arranged to intersect with objects in the target region of the computer-generated scene; and decreasing the number of rays in the first view and the second view arranged to intersect with objects outside the target region of the computer-generated scene; a relationship determination module for determining a relationship between at least one ray of the first computer-generated representation and at least one ray of the second computer-generated representation; a grouping module arranged to group at least one ray of the first computer-generated representation and the at least one ray of the second computer-generated representation based on the relationship, to form a group of rays; a processing module arranged to process one or more of the group of rays, substantially simultaneously to produce a first rendered view and a second rendered view of the computer-generated scene, wherein the first rendered view and the second rendered view are rendered using a first rendering technique in the target region and a second rendering technique outside the target region; and an output module arranged to output the first rendered view and the second rendered view to one or more display devices. ### Claim 11 (depends on 10) The processor of claim 10, wherein the relationship determination module comprises an intersection detection module for determining whether a ray of the first computer-generated representation and a ray of the second computer-generated representation intersect an object in the computer-generated scene. ### Claim 12 (depends on 11) The processor of claim 11, wherein determining whether a ray of the first computer-generated representation and a ray of the second computer-generated representation intersect and object in the computer-generated scene, is based on at least: a start point and a direction of each of the ray of the first computer-generated representation and the ray of the second computer-generated representation; and a distance between the first virtual camera and the second virtual camera. ### Claim 13 (depends on 11) The processor of claim 11, wherein the intersection detection module is arranged to determine an intersect between the ray of the first computer-generated representation and the second computer-generated representation. ### Claim 14 (depends on 10) The processor of claim 10, wherein the target region identification module comprises an eye-tracking sensor arranged to track at least one eye of the viewer. ### Claim 15 (depends on 10) The processor of claim 10, wherein the one or more display devices comprises at least one of a head-mounted display; a stereoscopic display, a multiview display, and a holographic display. ### Claim 16 A non-transitory computer-readable storage medium comprising a set of computer-readable instructions stored thereon which, when executed by at least one processor, cause the at least one processor to: identify at least one target region of a computer-generated scene, the at least one target region being associated with data relating to a gaze direction of a viewer; generate at least a first computer-generated representation and a second computer-generated representation, where the first computer-generated representation represents a first view of the computer-generated scene obtained from a first virtual camera and the second computer-generated representation represents a second view of the computer-generated scene obtained from a second virtual camera, and each of the first computer-generated representation and the second computer-generated representation comprises a plurality of rays which intersect with objects of the computer-generated scene, wherein the first virtual camera and the second virtual camera are positioned within the computer-generated scene so as to represent an interocular distance associated with the viewer, and wherein generating at least the first representation and the second representation comprises: increasing the number of rays in the first view and the second view, arranged to intersect with objects in the target region of the computer-generated scene; and decreasing the number of rays in the first view and the second view arranged to intersect with objects outside the target region of the computer-generated scene; determine a relationship between at least one ray of the first computer-generated representation and at least one ray of the computer-generated second representation; group the at least one ray of the first computer-generated representation and the at least one ray of the second computer-generated representation based on the relationship, to form a group of substantially similar rays; process one or more of the group of substantially similar rays, substantially simultaneously to produce a first rendered view and a second rendered view of the computer-generated scene, wherein the first rendered view and the second rendered view are rendered using a first rendering technique in the target region and a second rendering technique outside the target region; and output the first rendered view and the second rendered view to one or more display devices.