# US 2025/0165064 A1 · System and method for foveating video stream

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0165064 A1
- Document ID: US20250165064A1
- Status: Published application
- Kind: A1
- Application number: 18/513,590
- Filed: 2023-11-19
- Published: 2025-05-22
- Earliest claimed: 2023-11-19
- Assignees: Varjo Technologies Oy
- Applicants: Varjo Technologies Oy
- Inventors: Mikko Strandborg; Tarmo Räntilä
- Web page: https://patentgrep.com/patent/US20250165064A1

## CPC

- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- H04N 19/115: Selection of the code volume for a coding unit prior to coding
- H04N 19/167: Position within a video image, e.g. region of interest [ROI]
- H04N 19/196: being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters (processing of motion vectors H04N19/513)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Disclosed is a system with server(s) that is communicably coupled to display apparatus(es). The server(s) is/are configured to: receive, from display apparatus(es), information indicative of gaze directions of a user's eye; process the information to detect a beginning of a saccade; predict a target gaze location of the saccade, based on the information; and foveate a video stream according to the target gaze location after the beginning of the saccade and before an end of the saccade.

## Claims

### Claim 1

A system comprising at least one server that is communicably coupled to at least one display apparatus, wherein the at least one server is configured to:
receive, from the at least one display apparatus, information indicative of a gaze direction of a user's eye;
process the information to detect a beginning of a saccade;
predict a target gaze location of the saccade, based on the information; and
foveate a video stream according to the target gaze location after the beginning of the saccade and before an end of the saccade.

### Claim 2 (depends on 1)

The system of claim 1, wherein the at least one server is further configured to:
predict a duration of the saccade, based on the information; and
choose at least one encoding parameter to be used for encoding the video stream during the saccade.

### Claim 3 (depends on 2)

The system of claim 2, wherein the at least one encoding parameter is chosen based on the duration of the saccade.

### Claim 4 (depends on 2)

The system of claim 2, wherein the at least one server is further configured to employ the at least one encoding parameter to reduce a video stream bitrate during the saccade.

### Claim 5 (depends on 4)

The system of claim 4, wherein the at least one server is further configured to change the at least one encoding parameter and employ the at least one encoding parameter to increase the video stream bitrate before the saccade ends.

### Claim 6 (depends on 2)

The system of claim 2, wherein the at least one server is further configured to prioritize at least one other data stream during the saccade.

### Claim 7 (depends on 2)

The system of claim 2, wherein the at least one server is further configured to increase a bitrate for encoding at least one other data stream during the saccade.

### Claim 8 (depends on 1)

The system of claim 1, wherein the at least one server is further configured to:
determine a region of interest within the video stream based on the target gaze location of the saccade; and
choose different encoding parameters to be used for encoding the region of interest and a remaining region of the video stream.

### Claim 9 (depends on 1)

The system of claim 1, wherein the at least one server is further configured to refine a prediction of the target gaze location during the saccade.

### Claim 10 (depends on 1)

The system of claim 1, wherein the at least one server is further configured to send, to a congestion control network device, information indicative of at least one of: the beginning of the saccade, a duration of the saccade.

### Claim 11 (depends on 1)

The system of claim 1, wherein the at least one server is further configured to choose at least one foveation parameter to be used for foveating the video stream during the saccade.

### Claim 12

A method comprising:
receiving, from at least one display apparatus, information indicative of a gaze direction of a user's eye;
processing the information to detect a beginning of a saccade;
predicting a target gaze location of the saccade, based on the information; and
foveating a video stream according to the target gaze location after the beginning of the saccade and before an end of the saccade.

### Claim 13 (depends on 12)

The method of claim 12, further comprising:
predicting a duration of the saccade, based on the information; and
choosing at least one encoding parameter to be used for encoding the video stream during the saccade,

### Claim 14 (depends on 13)

The method of claim 13, further comprising employing the at least one encoding parameter to reduce a video stream bitrate during the saccade,
wherein optionally, the method further comprises changing the at least one encoding parameter and employing the at least one encoding parameter to increase the video stream bitrate before the saccade ends.

### Claim 15 (depends on 12)

The method of claim 12, further comprising:
determining a region of interest within the video stream based on the target gaze location of the saccade; and
choosing different encoding parameters to be used for encoding the region of interest and a remaining region of the video stream.
