# US 2010/0146139 A1 · Method for streaming parallel user sessions, system and computer software

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2010/0146139 A1
- Document ID: US20100146139A1
- Status: Published application
- Kind: A1
- Application number: 12/443,571
- Filed: 2007-10-01
- Published: 2010-06-10
- Earliest claimed: 2006-09-29
- Assignees: Avinity Systems B.V.
- Inventors: Ronald Brockmann
- Web page: https://patentgrep.com/patent/US20100146139A1

## CPC

- H04N 21/2662: Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
- H04N 19/17: the unit being an image region, e.g. an object
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/40: using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
- H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence)
- H04N 19/61: in combination with predictive coding
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N 21/234318: {by decomposing into objects, e.g. MPEG-4 objects}
- H04N 21/2665: Gathering content from different sources, e.g. Internet and satellite
- H04N 21/6373: for rate control {, e.g. request to the server to modify its transmission rate (flow control in packet networks H04L47/10)}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

The present invention provides a method for streaming of parallel user sessions, system and computer software server to at least one client device of a number of client devices for representation of the sessions on a monitor that is connectable to a client device, in which the sessions comprise video data and optional additional data, such as audio data, in which the method comprises steps for: defining coded fragments, based on reusable image data, in which the encoded fragments are suitable for assembling of the video data in a predefined data format, such as a video standard or a video codec, and in which the encoded fragments are suitable for application in one or more images and/or one or more sessions, and assembling of a data stream per session, comprising video data in which the encoded fragments are applied.

## Claims

### Claim 1

A method for streaming of parallel user sessions of at least one server to at least one client device of a number of client devices for representation of the sessions on a monitor that is connectable to a client device, in which the sessions comprise video data and optional additional data, such as audio data, in which the method comprises steps for:
defining coded fragments, based on reusable image data, in which the encoded fragments are suitable for assembling of the video data in a predefined data format, such as a video standard or a video codec, and in which the encoded fragments are suitable for application in one or more images and/or one or more sessions, and
assembling of a data stream per session, comprising video data in which the encoded fragments are applied.

### Claim 2 (depends on 1)

The method according to claim 1, comprising steps for applying a number of codec slices that may be arrangeable in a frame and/or mutually independent codec slices depending on picture objects of the user interface that is to be shown in defining the encoded fragments.

### Claim 3 (depends on 1)

The method according to claim 1, comprising steps for providing a reference of an encoded fragment to pixels of a reference image buffer in a decoder, even when the pixels in this buffer are not set based on this coded fragment.

### Claim 4 (depends on 1)

The method according to claim 1, comprising steps for combining of codec slices or coded fragments in order to perform sequential processing on pixels in reference buffers in a way that is in accordance with the standard of the data format.

### Claim 5 (depends on 1)

The method according to claim 1, comprising steps for temporarily storing image fragments in a quickly accessible memory.

### Claim 6 (depends on 5)

The method according to claim 5, comprising steps for accessing from the quickly accessible memory of the temporary stored image fragments and/or slices.

### Claim 7 (depends on 1)

The method according to claim 1, comprising steps for adding a tag to the coded fragments.

### Claim 8 (depends on 7)

The method according to claim 7, comprising steps for retrieving encoded fragments, based on the tag.

### Claim 9 (depends on 1)

The method according to claim 1, comprising steps for creating texture mapping data for application thereof in coded fragments.

### Claim 10 (depends on 1)

The method according to claim 1, comprising steps for the use of data referring to the shape and/or dimensions of the slices in the steps for defining the encoded fragments.

### Claim 11 (depends on 1)

The method according to claim 1, in which the steps for assembling of the data stream comprise steps for reuse of media assets, such as text, images, video and/or audio.

### Claim 12 (depends on 1)

The method according to claim 1, comprising steps for sending of fill up frames or for not sending image information.

### Claim 13

A method for streaming of parallel user sessions of at least one server to at least one client device of a plural of client devices, for representation of the sessions on a display device that is connected to the client device, in which the sessions comprise video data and optionally additional data, such as audio data, in which the method comprises the steps for:
defining of coded fragments based on reusable image information by an application fragment creation server, in which the encoded fragments are suitable for composing of video data in a predetermined data format, such as a video standard or a video codec and in which the encoded fragments are suitable for application in one or more pictures and/or one or more sessions, transmitting of the encoded fragments for reception by a video stream composing server by the application fragment creation server.

### Claim 14

A method for streaming of a parallel user sessions from at least one server to at least one client device of a number of client devices for representing of the sessions on a display device that is connectable to the client device, in which the sessions comprise video data and optionally additional data, such as audio data, and in which the encoded fragments are suitable for composing the video data in a predetermined data format, such as a video standard or a video codec, and in which the coded fragments are suitable for application in one or more pictures and/or one or more sessions, in which the method comprises steps for:
receiving of encoded fragments from an application fragment creation server by a video stream composer service;
proceeding and/or storing into a local memory for later application of the fragments; and
assembling of a data stream comprising video data making use of the coded fragments per session.

### Claim 15

(canceled)

### Claim 16 (depends on 13)

The method according to claim 13, comprising steps for retrieving fragments from an application fragment creation server by the video stream composing server.

### Claim 17 (depends on 13)

The method according to claim 13, comprising steps for creating assembly information for assembling a video stream based on the information with application of a number of fragments.

### Claim 18

A system for streaming of a number of parallel user sessions of at least one server to at least one client device of a number of client devices for displaying of the sessions on a display device that is connectable to the client device, in which the sessions comprise video data and optional additional data such as audio data, the system comprising:
a) at least a server for:
coding of reusable image data to encoded fragments, and
assembling of video streams comprising at least one encoded fragment,
b) receiving means for receiving at least user instructions, and
c) transmitting means for transmitting of video streams in a predefined data format, such as mpeg or H.264, towards the client devices.

### Claim 19 (depends on 18)

The system according to claim 18, comprising a quickly accessible memory, such as a cache memory, for temporary storage of the encoded fragments.

### Claim 20 (depends on 18)

The system according to claim 18, comprising means for transforming and/or multiplexing of data streams for transmission thereof to the client devices.

### Claim 21 (depends on 18)

The system according to claim 18, comprising an application server comprising the receiving means, in which the application server is arranged for modifying of a server application and/or a user application for representation via the client device.

### Claim 22 (depends on 18)

The system according to claim 18, comprising means for exchanging data with respect to the contents of the quickly accessible memory and the application server.

### Claim 23

(canceled)

### Claim 24

(canceled)

### Claim 25

(canceled)

### Claim 26

(canceled)

### Claim 27 (depends on 18)

A method for rendering of video streams by means of the system of claim 18, comprising steps of:
forming of bit requirements for a session,
determine which fragments of which sessions are to be processed, and
providing an authorisation signal for a data stream for the session.

### Claim 28 (depends on 27)

The method according to claim 27, comprising steps for making a distinction between fragments that are preferably rendered in real time and fragments that may be rendered non-real time without quality loss other than delay.

### Claim 29 (depends on 27)

The method according to claim 27, comprising steps for making a distinction between fragments that are connectable to audio data and fragments that are not connectable to audio data.

### Claim 30 (depends on 27)

The method according to claim 27, comprising steps for skipping of one or more of the fragments.

### Claim 31 (depends on 27)

The method according to claim 27, comprising steps for delaying one or more of the fragments.

### Claim 32 (depends on 27)

The method according to claim 27, comprising steps for providing of additional intra frames.

### Claim 33 (depends on 27)

The method according to claim 27, comprising steps for coding of the fragments with each an individual quant value.

### Claim 34

(canceled)

### Claim 35

(canceled)
