# US 12,111,963 B2 · Using prediction information with light fields > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,111,963 B2 - Document ID: US12111963B2 - Status: Granted - Kind: B2 - Application number: 18/358,461 - Filed: 2023-07-25 - Published: 2023-11-16 - Granted: 2024-10-08 - Earliest claimed: 2019-08-30 - Assignees: Shopify Inc. - Applicants: Shopify Inc. - Inventors: Jonathan Wade - Web page: https://patentgrep.com/patent/US12111963B2 ## CPC - G06F 3/012: {Head tracking input arrangements} - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06N 20/00: Machine learning - G06Q 30/0641: {utilising user interfaces specially adapted for shopping} - G06T 15/08: Volume rendering - G06T 15/20: Perspective computation - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract An example process executed by a processor of a computing device to communicate a first light field data to a user device, wherein the first light field data is limited to a first volume of space that represents a first plurality of views for display on the user device; receive a sensor data associated with the user device; predict a behavior based at least in part from the received sensor data; generate a second light field data based at least in part on the predicted behavior, wherein the second light field data is limited to a second volume of space that is different from the first volume of space and represents a second plurality of views for display on the user device; and communicate the second light field data to the user device. ## Claims ### Claim 1 A computer-implemented method comprising: receiving, at a computing device, data indicative of a current state of a user device displaying content based on light field data, including data indicative of a display field of view of display and sensor data associated with the user device, the light field data including light field data points defining a first three-dimensional volume; predicting, by the computing device, a behavior based at least in part on the received sensor data; generating, by the computing device based at least in part on the predicted behavior, further light field data for use in displaying content at the user device, the further light field data including light field data points defining a second three-dimensional volume corresponding to a visual content greater than the display field of view of the user device; and sending the further light field data to the user device. ### Claim 2 (depends on 1) The method of claim 1, wherein the user device includes a head-mounted device and wherein the sensor data represents movement of the head-mounted device. ### Claim 3 (depends on 1) The method of claim 1, wherein the user device includes a wearable device and the sensor data represents movement of the wearable device. ### Claim 4 (depends on 1) The method of claim 1, wherein the user device includes a hand-held device and the sensor data represents movement of the hand-held device. ### Claim 5 (depends on 1) The method of claim 1, further comprising: prior to receiving the data indicative of the current state of the user device, providing the first light field data to the user device, the first light field data including a first light field spatial volume, wherein a second light field spatial volume is adjusted in size based on the sensor data associated with the user device. ### Claim 6 (depends on 1) The method of claim 1, wherein the further light field data includes data for enabling the user device to display: a first field of view for a user in a first viewing perspective and a second field of view for the user in a second viewing perspective different from the first viewing perspective. ### Claim 7 (depends on 1) The method of claim 1, wherein at least one of the first three-dimensional volume of light field data points and the second three-dimensional volume of light field data points describes the light flowing in a plurality of directions through a plurality of light field data points. ### Claim 8 (depends on 1) The method of claim 1, wherein at least one of the first three-dimensional volume of light field data points and the second three-dimensional volume of light field data points is a partial volume with respect to a determined direction of motion of the user device. ### Claim 9 (depends on 1) The method of claim 1, wherein the light field data is based on a data model for light characterization in a volume of space. ### Claim 10 A computer system comprising: a processor; and a memory storing instructions that, when executed by the processor, cause the computer system to: receive data indicative of a current state of a user device displaying content based on light field data, including data indicative of a display field of view of display and sensor data associated with the user device, the light field data including light field data points defining a first three-dimensional volume; predict a behavior based at least in part on the received sensor data; generate based at least in part on the predicted behavior, further light field data for use in displaying content at the user device, the further light field data including light field data points defining a second three-dimensional volume corresponding to a visual content greater than the display field of view of the user device; and send the further light field data to the user device. ### Claim 11 (depends on 10) The computer system of claim 10, wherein the sensor data represents movement of at least one head-mounted device, a wearable device, or a hand-held device associated with the user device. ### Claim 12 (depends on 10) The computer system of claim 10, wherein the instructions stored in the memory, when executed by the processor, further cause the computer system to: prior to receiving the data indicative of the current state of the user device, provide the first light field data to the user device, the first light field data including a first light field spatial volume, wherein a second light field spatial volume is adjusted in size based on the sensor data associated with the user device. ### Claim 13 (depends on 10) The computer system of claim 10, wherein the further light field data includes data for enabling the user device to display: a first field of view for a user in a first viewing perspective and a second field of view for the user in a second viewing perspective different from the first viewing perspective. ### Claim 14 (depends on 10) The computer system of claim 10, wherein at least one of the first three-dimensional volume of light field data points and the second three-dimensional volume of light field data points describes the light flowing in a plurality of directions through a plurality of light field data points. ### Claim 15 (depends on 10) The computer system of claim 10, wherein at least one of the first three-dimensional volume of light field data points and the second three-dimensional volume of light field data points is a partial volume with respect to a determined direction of motion of the user device. ### Claim 16 (depends on 10) The computer system of claim 10, wherein the light field data is based on a data model for light characterization in a volume of space. ### Claim 17 A non-transitory computer-readable storage medium storing instructions that, when executed by a processor of a computer system, cause the computer system to: receive data indicative of a current state of a user device displaying content based on light field data, including data indicative of a display field of view of display and sensor data associated with the user device the light field data including light field data points defining a first three-dimensional volume; predict a behavior based at least in part on the received sensor data; generate based at least in part on the predicted behavior, further light field data for use in displaying content at the user device, the further light field data including light field data points defining a second three-dimensional volume corresponding to a visual content greater than the display field of view of the user device; and send the further light field data to the user device. ### Claim 18 (depends on 17) The non-transitory computer-readable storage medium of claim 17, wherein the sensor data represents movement of at least one head-mounted device, a wearable device, or a hand-held device associated with the user device. ### Claim 19 (depends on 17) The non-transitory computer-readable storage medium of claim 17, wherein the instructions, when executed, further cause the computer system to: prior to receiving the data indicative of the current state of the user device, provide the first light field data to the user device, the first light field data including a first light field spatial volume, wherein a second light field spatial volume is adjusted in size based on the sensor data associated with the user device. ### Claim 20 (depends on 17) The non-transitory computer-readable storage medium of claim 17, wherein the further light field data includes data for enabling the user device to display: a first field of view for a user in a first viewing perspective and a second field of view for the user in a second viewing perspective different from the first viewing perspective.