# US 2020/0404375 A1 · Rendering Video Stream In Sub-Area Of Visible Display Area > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2020/0404375 A1 - Document ID: US20200404375A1 - Status: Published application - Kind: A1 - Application number: 16/903,234 - Filed: 2020-06-16 - Published: 2020-12-24 - Earliest claimed: 2019-06-19 - Assignees: Koninklijke KPN N.V.; Nederlandse Organisatie voor toegepast-natuurwetenschappelijk onderzoek TNO - Applicants: Koninklijke KPN N.V.; Nederlandse Organisatie Voor Toegepast-Natuurwetenschappelijk Onderzoek TNO - Inventors: Hans Maarten Stokking; Alexandre da Silva Pratas Gabriel - Web page: https://patentgrep.com/patent/US20200404375A1 ## CPC - H04N 21/4621: {Controlling the complexity of the content stream or additional data, e.g. lowering the resolution or bit-rate of the video stream for a mobile client with a small screen (arrangements for using the results of monitoring on user's side in broadcast systems H04H60/65; flow control in packet networks H04L47/10)} - H04N 21/4728: for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - H04N 21/2343: involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements {(video transcoding H04N19/40; media packet handling at the source H04L65/762)} - H04N 21/23439: {for generating different versions} - H04N 21/2662: Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities - H04N 21/4356: {by altering the spatial resolution, e.g. to reformat additional data on a handheld device, attached to the STB} - H04N 21/4358: {for generating different versions, e.g. for different peripheral devices} - H04N 21/6373: for rate control {, e.g. request to the server to modify its transmission rate (flow control in packet networks H04L47/10)} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract A system and method for rendering a video stream for display on a display device, which may comprise receiving the video stream by streaming and generating display data defining a visible display area to be displayed by the display device, wherein said generating of the display data comprises rendering the video stream in a sub-area of the visible display area. A selection mechanism may be provided by which a version of the video stream may be selected for streaming having a spatial resolution and/or a bitrate which is selected based on a size of the sub-area. Thereby, the video stream may be adapted in terms of visual quality to the effective spatial resolution provided by the sub-area. For a smaller sub-area, it may be avoided to stream a version of the video stream which contains spatial detail which cannot be perceived when the video stream is rendered in the sub-area but which may incur more technical cost, e.g., in terms of required network bandwidth, decoding capabilities and decoding resource allocation, etc., than a video stream which has a lower resolution and/or lower bitrate and is thereby adapted to the size of the sub-area. ## Claims ### Claim 1 A system for rendering a video stream for display on a display device, comprising: a network interface for receiving the video stream by streaming; a processor subsystem configured to: generate display data defining a visible display area to be displayed by the display device, wherein said generating of the display data comprises rendering the video stream in a sub-area of the visible display area; and select a version of the video stream for streaming having a spatial resolution and/or a bitrate selected based on a size of the sub-area. ### Claim 2 (depends on 1) The system according to claim 1, wherein the video stream is streamed in a streaming session, and wherein the processor subsystem is configured to select the version of the video stream before or in a setup phase of the streaming session. ### Claim 3 (depends on 1) The system according to claim 1, wherein the processor subsystem is configured to select the version of the video stream for streaming in response to a change in the size of the sub-area. ### Claim 4 (depends on 3) The system according to claim 3, wherein the processor subsystem is configured to: generate the display data by rendering a 3D environment from a viewing position in the 3D environment, wherein said rendering of the 3D environment comprises rendering the video stream on a virtual display in the 3D environment; and select the version of the video stream for streaming in response to a change in a relative position and/or a relative orientation between the viewing position and the virtual display which results in the change in the size of the sub-area. ### Claim 5 (depends on 1) The system according to claim 1, wherein the display device is configured to display the display data using an active display area having a display resolution, and wherein the processor subsystem is configured to: determine an equivalent display resolution for a part of the active display area with which the sub-area of the visible display area is to be displayed; and select the spatial resolution and/or the bitrate for streaming the video stream based on the equivalent display resolution. ### Claim 6 (depends on 1) The system according to claim 1, wherein the processor subsystem is configured to select the version of the video stream from a list, the list identifying versions of the video stream having different spatial resolutions and/or bitrates. ### Claim 7 (depends on 5) The system according to claim 5, wherein the processor subsystem is configured to select the version of the video stream having the spatial resolution which best matches the equivalent display resolution. ### Claim 8 (depends on 1) The system according to claim 1, wherein the processor subsystem is configured to request the version of the video stream by sending a message identifying a selected spatial resolution via the network interface to another entity. ### Claim 9 (depends on 8) The system according to claim 8, wherein the system is configured as a HAS (HTTP Adaptive Streaming) client and configured to send the message as a status message to a HAS streaming management system. ### Claim 10 (depends on 1) The system according to claim 1, wherein the processor subsystem is configured to generate the display data by: rendering a 3D environment from a viewing position in the 3D environment, wherein said rendering of the 3D environment comprises rendering the video stream on a virtual display in the 3D environment; rendering an omnidirectional image or video and rendering the video stream as an overlay over a part of the omnidirectional image or video; or rendering a windowed environment in which the video stream is rendered in a resizable and/or repositionable window. ### Claim 11 (depends on 1) The system according to claim 1, wherein the system is one of a group of: a client device comprising or being the display device, or comprising a display interface to the display device; and an edge computing system configured to stream the display data to a client device which is connected to the display device. ### Claim 12 A data structure defining a status message from a HAS (HTTP Adaptive Streaming) client to a HAS streaming management system, wherein the status message identifies a spatial resolution for streaming a video stream which is to be rendered by the HAS client in a sub-area of a visible display area. ### Claim 13 (depends on 12) A non-transitory computer-readable medium comprising the data structure according to claim 12. ### Claim 14 A computer-implemented method for rendering a video stream on a display device, comprising: receiving the video stream by streaming; generating display data defining a visible display area to be displayed by the display device, wherein said generating of the display data comprises rendering the video stream in a sub-area of the visible display area; the method further comprising: selecting a version of the video stream for streaming having a spatial resolution and/or a bitrate selected based on a size of the sub-area. ### Claim 15 (depends on 14) A non-transitory computer-readable medium comprising a computer program, the computer program comprising instructions for causing a processor system to perform the method according to claim 14.