# US 2020/0288105 A1 · Selective culling of multi-dimensional data sets > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2020/0288105 A1 - Document ID: US20200288105A1 - Status: Published application - Kind: A1 - Application number: 16/832,720 - Filed: 2020-03-27 - Published: 2020-09-10 - Earliest claimed: 2016-08-29 - Assignees: Stratus Systems, Inc. - Applicants: Stratus Systems, Inc. - Inventors: Russell T. HAINES - Web page: https://patentgrep.com/patent/US20200288105A1 ## CPC - H04N 13/167: Synchronising or controlling image signals - H04N 7/183: {for receiving images from a single remote source} - H04N 13/156: Mixing image signals - H04N 13/178: Metadata, e.g. disparity information - H04N 13/194: Transmission of image signals - H04N 13/344: with head-mounted left-right displays - H04N 13/383: for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes - H04N 5/60: for the sound signals - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Method and system for selective culling of multi-dimensional data sets. Selective culling system introduces a feedback control method for remote users (e.g., client-side) to customize the selection, transmission, and display of datasets (e.g., on server-side) or any collection or subset of datasets. ## Claims ### Claim at position 1 -2. (canceled) ### Claim 3 An immersive display system, comprising: a display, in communication with one or more processors; and a plurality of sensor modules, in communication with the one or more processors, wherein the one or more processors are configured to: receive data obtained by the plurality of sensors modules to determine a control command; selectively cull one or more subsets of a plurality of data sets according to the control command; and transmit the one or more subsets to the display. ### Claim 4 (depends on 3) The immersive display system of claim 3, wherein the one or more processors are configured to determine the control command further based at least on one or more information about the immersive display system selected from the group consisting of display type, display resolution, display size, display frame rate, and distance from a viewer to the display. ### Claim 5 (depends on 3) The immersive display system of claim 3, wherein the plurality of data sets comprise video and audio content. ### Claim 6 (depends on 3) The immersive display system of claim 3, wherein the one or more processors is configured to determine a field of interest of a viewer of the display based at least on the data obtained by the plurality of sensor modules, wherein the control command is determined based at least in part on the field of interest. ### Claim 7 (depends on 3) The immersive display system of claim 3, wherein the plurality of sensor modules are configured to track body movement, head movement, and eye movement of a viewer of the display. ### Claim 8 (depends on 7) The immersive display system of claim 7, wherein the plurality of sensor modules are configured to track stereo view information for each eye of the viewer. ### Claim 9 (depends on 3) The immersive display system of claim 3, wherein the immersive display system is a head-mounted display (HMD). ### Claim 10 (depends on 3) The immersive display system of claim 3, wherein an amount of culling is configured to be proportional to an available or desired bandwidth between a server system and the processor. ### Claim 11 A computer-implemented method for selectively culling data sets at data source for a viewer of a display system, comprising: (a) determining a control command based at least on requested data sets, field of interest of the viewer, and available bandwidth; (b) receiving, at a server, the control command, wherein the control command comprises encoding of instructions on which one or more subsets among the data sets are to be culled; (c) selectively culling, at the server, one or more subsets among the requested data sets according to the transmitted control command; and (d) serving, to the display system, the selectively culled data set. ### Claim 12 (depends on 11) The method of claim 11, wherein the requested data sets comprise video and audio content. ### Claim 13 (depends on 11) The method of claim 11, wherein the requested data sets comprise sensor data. ### Claim 14 (depends on 11) The method of claim 11, wherein the control command is further based at least on display system information, wherein the display system information includes display type, display resolution, display size, display frame rate, and distance from the user to the display system. ### Claim 15 (depends on 14) The method of claim 14, wherein the control command is further based at least on metatags and metadata embedded or associated with the requested data sets. ### Claim 16 (depends on 11) The method of claim 11, wherein a size of the control command is 128 bytes or less. ### Claim 17 (depends on 12) The method of claim 12, wherein the video and audio content comprises two-dimensional, three-dimensional, or virtual reality video and audio content. ### Claim 18 (depends on 17) The method of claim 17, wherein the control command information is further based at least on foveal area and foveal area target shape. ### Claim 19 (depends on 11) The method of claim 11, wherein the field of interest information is further adjusted based on user input methods. ### Claim 20 (depends on 11) The method of claim 11, wherein the one or more subsets that are within the viewer's field of interest are selectively culled. ### Claim 21 (depends on 11) The method of claim 11, wherein the field of interest of the viewer is obtained by monitoring one or more sensors local to the viewer. ### Claim 22 (depends on 21) The system of claim 21, wherein the one or more sensors are configured to track body movement, head movement, eye movement of the viewer.