# US 2018/0322846 A1 · Client-server visualization system with hybrid data processing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0322846 A1
- Document ID: US20180322846A1
- Status: Published application
- Kind: A1
- Application number: 16/036,451
- Filed: 2018-07-16
- Published: 2018-11-08
- Earliest claimed: 2007-11-23
- Assignees: Pme IP Pty Ltd
- Applicants: Pme IP Pty Ltd
- Inventors: Malte Westerhoff; Detlev Stalling
- Web page: https://patentgrep.com/patent/US20180322846A1

## CPC

- G09G 5/006: {Details of the interface to the display terminal (specific for a display terminal using a CRT G09G1/167; using a flat panel G09G3/2096; circuits for interfacing with colour displays G09G5/04)}
- G06T 15/00: Three-dimensional [3D] image rendering
- G06T 15/005: {General purpose rendering architectures}
- G09G 5/363: {Graphics controllers}
- G09G 5/395: Arrangements specially adapted for transferring the contents of the bit-mapped memory to the screen (G09G5/399 takes precedence)
- G09G 5/001: {Arbitration of resources in a display system, e.g. control of access to frame buffer by video controller and/or main processor}
- G09G 2360/12: Frame memory handling
- G09G 2360/18: Use of a frame buffer in a display terminal, inclusive of the display panel
- G09G 2370/022: Centralised management of display operation, e.g. in a server instead of locally
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

The invention comprises a system of client-server visualization with hybrid data processing, having a server digital data processor, that allows for server side rendering and processing image data, and client digital data processors simultaneously connected to the server, which receives messages from the clients, creates rendered images of data sets or other data processing results and sends those rendered images and results to the clients for display or further processing. Performing certain image rendering operations on either the server or the client according to which is better suited for the tasks requested by the user at any point in time, and possibly adjusting this division of work dynamically, improves rendering speed and application responsiveness on the clients.

## Claims

### Claim 1

A file server method comprising:
(a) monitoring for requests from a client computer, where the client computer comprises one or more local processing resources and a display device;
(b) receiving one or more requests from the client computer for rendering aspects of one or more images, at least one image of the one or more images including at least a first aspect and a second aspect;
(c) responding to the one or more requests by making a file server buffer available for processing by the client computer;
(d) rendering using a render module the first aspect of the at least one image in response to the one or more requests;
(e) storing the first aspect in the file server buffer;
(f) receiving the second aspect of the at least one image from the client computer, where the second aspect was rendered using the one or more local processing resources; and
(g) storing the second aspect in the file server buffer.

### Claim 2 (depends on 1)

The method of claim 1, further comprising includes making the file server buffer available for further processing.

### Claim 3 (depends on 2)

The method of claim 2, where further processing includes adding one or more textual elements to the file server buffer.

### Claim 4 (depends on 1)

The method of claim 1, where the first aspect comprises one or both an acquired and a synthesized image.

### Claim 5 (depends on 1)

The method of claim 1, where the first aspect comprises one or more graphical elements.

### Claim 6 (depends on 1)

The method of claim 1, where the second aspect comprises one or more textual elements.

### Claim 7 (depends on 1)

The method of claim 1, where the second aspect comprises an overlay aspect.

### Claim 8 (depends on 1)

The method of claim 1, where the render module responds to multiple application requests for rendering by allocating rendering and compute tasks between the one or more local processing resources and a file server digital data processor.

### Claim 9 (depends on 8)

The method of claim 8, where the render module responds to multiple application requests by messaging the file server digital data processor to render a first graphics aspect of a composite image, effecting rendering of a second graphics aspect of the composite image using the one or more local processing resources and further processing includes adding one or more textual elements to the composite image.

### Claim 10 (depends on 8)

The method of claim 8, where the render module combines a composite image including:
(i) a graphics aspect rendered by the file server digital data processor;
(ii) a graphics aspect rendered by the one or more local processing resources; and
(iii) a non graphics element rendered by the one or more local processing resources during further processing.

### Claim 11 (depends on 8)

The method of claim 8, where the render module:
(i) pastes into the file server buffer the first aspect of a composite image generated by the file server digital data processor;
(ii) adds to the file server buffer the second aspect of the composite image rendered by the one or more local processing resources; and
(iii) adds to the file server buffer a non graphics aspect of the composite image rendered by the one or more local processing resources during further processing.

### Claim 12 (depends on 8)

The method of claim 8, where the one or more local processing resources has a first capability to process tasks and the file server digital data processor has a second capability to process tasks.

### Claim 13 (depends on 12)

The method of claim 12, where the render module allocates rendering and compute tasks between the one or more local processing resources and the file server digital data processor based on the first capability and the second capability.

### Claim 14 (depends on 8)

The method of claim 8, where allocation of rendering and compute tasks places a first load on the one or more local processing resources and a second load on the file server digital data processor.

### Claim 15 (depends on 14)

The method of claim 14, where the render module allocates rendering and compute tasks between the one or more local processing resources and the file server digital data processor based on one or both the first load and the second load.

### Claim 16 (depends on 15)

The method of claim 15, where the render module identifies a load on a resource based on one or both any communications from the file server digital data processor and rapidity with which the file server digital data processor responds to messages submitted to it by the client computer.

### Claim 17 (depends on 8)

The method of claim 8, further comprising a network connecting the client computer and the file server digital data processor.

### Claim 18 (depends on 17)

The method of claim 17, where the render module allocates rendering and compute tasks between the one or more local processing resources and the file server digital data processor based on a throughput of the network.

### Claim 19 (depends on 8)

The method of claim 8, where the render module allocates rendering and compute tasks between the one or more local processing resources and the file server digital data processor based on image rendering capabilities of the file server digital data processor.

### Claim 20

A file server method comprising:
(a) monitoring for requests from a client computer, where the client computer comprises one or more local processing resources and a display device;
(b) receiving one or more requests from the client computer for rendering aspects of one or more images, at least one image of the one or more images including at least a first aspect and a second aspect;
(c) responding to the one or more requests by making a file server buffer available for processing by the client computer;
(d) rendering with a render module the first aspect of the at least one image in response to the one or more requests;
(e) storing the first aspect in the file server buffer;
(f) receiving the second aspect of the at least one image from the client computer, where the second aspect was rendered using the one or more local processing resources;
(g) storing the second aspect in the file server buffer; and
(h) sending the at least one image to the client computer for display on the display device.
