# US 10,121,337 B2 · Gaze controlled bit rate

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,121,337 B2
- Document ID: US10121337B2
- Status: Granted
- Kind: B2
- Application number: 15/395,856
- Filed: 2016-12-30
- Published: 2018-07-05
- Granted: 2018-11-06
- Earliest claimed: 2016-12-30
- Assignees: Axis AB
- Applicants: Axis AB
- Inventors: Song Yuan
- Web page: https://patentgrep.com/patent/US10121337B2

## CPC

- G08B 13/19693: {using multiple video sources viewed on a single or compound screen}
- G08B 13/19682: {Graphic User Interface [GUI] presenting system data to the user, e.g. information on a screen helping a user interacting with an alarm system}
- H04N 7/181: {for receiving images from a plurality of remote sources}
- H04N 19/115: Selection of the code volume for a coding unit prior to coding
- H04N 19/162: User input
- H04N 19/167: Position within a video image, e.g. region of interest [ROI]
- H04N 19/17: the unit being an image region, e.g. an object
- H04N 21/42222: {Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device}
- H04N 21/440281: {by altering the temporal resolution, e.g. by frame skipping (television signal recording using magnetic recording on tape for reproducing at a rate different from the recording rate H04N5/783)}
- H04N 19/132: Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
- H04N 19/40: using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method may include receiving a video stream from a camera and displaying the video stream on a display. The method may further include obtaining, via an eye tracking sensor, information identifying a gaze area for a user watching the display; generating a gradient from the gaze area to edges of the display; and instructing the camera to decrease a bit rate of the video stream outside the gaze area based on the generated gradient.

## Claims

### Claim 1

A method, performed by one or more computer devices, the method comprising:
receiving a video stream from a camera;
displaying the video stream on a display;
obtaining, via an eye tracking sensor, information identifying a gaze area for a user watching the display;
generating a gradient from the gaze area towards edges of the display; and
instructing the camera to decrease a bit rate of the video stream outside the gaze area based on the generated gradient.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
calculating a predicted gaze trajectory based on the obtained information; and
increasing the bit rate of the video stream along the predicted gaze trajectory.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
determining that the gaze area falls outside the display; and
decreasing the bit rate for the entire video stream, in response to determining that the gaze area falls outside the display.

### Claim 4 (depends on 2)

The method of claim 2, further comprising:
detecting a moving object in the video stream outside the gaze area; and
correlating the gaze area to the moving object.

### Claim 5 (depends on 1)

The method of claim 1, wherein generating the gradient from the gaze area to edges of the display includes:
defining a first bit rate reduction factor for a first region from an edge of the gaze area to a particular distance from the edge of the gaze area, wherein the first bit rate reduction factor indicates an extent by which a bit rate for the first region is reduced; and
defining a second bit rate reduction factor for a second region from the particular distance to the edges of the display, wherein the second bit rate reduction factor indicates an extent by which a bit rate for the second region is reduced, wherein the second bit rate reduction factor is higher than the first bit rate reduction factor.

### Claim 6 (depends on 1)

The method of claim 1, wherein generating the gradient from the gaze area to edges of the display includes:
defining a linearly decreasing bit rate reduction factor from an edge of the gaze area towards the edges of the display, wherein the bit rate reduction factor at a particular location of the display indicates an extent by which a bit rate at the particular location is reduced.

### Claim 7 (depends on 1)

The method of claim 1, wherein instructing the camera to decrease a bit rate of the video stream outside the gaze area based on the generated gradient includes:
instructing the camera to reduce a sampling rate for a sensor associated with an area of the video stream outside the gaze area.

### Claim 8 (depends on 1)

The method of claim 1, wherein instructing the camera to decrease a bit rate of the video stream outside the gaze area based on the generated gradient includes:
instructing the camera to lower resolution for an area of the video stream outside the gaze area prior to encoding the video stream.

### Claim 9 (depends on 1)

The method of claim 1, wherein instructing the camera to decrease a bit rate of the video stream outside the gaze area based on the generated gradient includes:
instructing the camera to increase a noise reduction process for an area of the video stream outside the gaze area prior to encoding the video stream.

### Claim 10 (depends on 1)

The method of claim 1, wherein instructing the camera to decrease a bit rate of the video stream outside the gaze area based on the generated gradient includes:
instructing the camera to increase a compression parameter value for an encoding processing unit associated with an area of the video stream outside the gaze area.

### Claim 11 (depends on 1)

The method of claim 1, wherein the video stream includes a plurality of video streams and wherein the display includes a plurality of displays.

### Claim 12

A computer device comprising:
a memory storing instructions; and
a processor configured to execute the instructions to:
receive a video stream from a camera;
display the video stream on a display;
obtain, via an eye tracking sensor, information identifying a gaze area for a user watching the display;
generate a gradient from the gaze area to edges of the display; and
instruct the camera to decrease a bit rate of the video stream outside the gaze area based on the generated gradient.

### Claim 13 (depends on 12)

The computer device of claim 12, wherein the processor is further configured to execute the instructions to:
calculate a predicted gaze trajectory based on the obtained gaze information; and
increase the bit rate of the video stream along the predicted gaze trajectory.

### Claim 14 (depends on 12)

The computer device of claim 12, wherein, when generating the gradient from the gaze area to edges of the display, the processor is further configured to:
define a first bit rate reduction factor for a first region from an edge of the gaze area to a particular distance from the edge of the gaze area, wherein the first bit rate reduction factor indicates an extent by which a bit rate for the first region is reduced; and
define a second bit rate reduction factor for a second region from the particular distance towards the edges of the display, wherein the second bit rate reduction factor indicates an extent by which a bit rate for the second region is reduced, wherein the second bit rate reduction factor is higher than the first bit rate reduction factor.

### Claim 15 (depends on 12)

The computer device of claim 12, wherein, when generating the gradient from the gaze area to edges of the display, the processor is further configured to:
define a linearly decreasing bit rate reduction factor from an edge of the gaze area towards the edges of the display, wherein the bit rate reduction factor at a particular location of the display indicates an extent by which a bit rate at the particular location is reduced.

### Claim 16 (depends on 12)

The computer device of claim 12, wherein, when instructing the camera to decrease a bit rate of the video stream outside the gaze area based on the generated gradient, the processor is further configured to:
instruct the camera to reduce a sampling rate for a sensor associated with an area of the video stream outside the gaze area.

### Claim 17 (depends on 12)

The computer device of claim 12, wherein, when instructing the camera to decrease a bit rate of the video stream outside the gaze area based on the generated gradient, the processor is further configured to:
instruct the camera to lower resolution for an area of the video stream outside the gaze area prior to encoding the video stream.

### Claim 18 (depends on 12)

The computer device of claim 12, wherein, when instructing the camera to decrease a bit rate of the video stream outside the gaze area based on the generated gradient, the processor is further configured to:
instruct the camera to increase a noise reduction process for an area of the video stream outside the gaze area prior to encoding the video stream.

### Claim 19 (depends on 12)

The computer device of claim 12, wherein, when instructing the camera to decrease a bit rate of the video stream outside the gaze area based on the generated gradient, the processor is further configured to:
instruct the camera to increase a compression parameter value for an encoding processing unit associated with an area of the video stream outside the gaze area.

### Claim 20

A system comprising:
a camera configured to:
generate a video stream; and
a computer device configured to:
receive the video stream from the camera;
display the video stream on a display;
obtain, via an eye tracking sensor, information identifying a gaze area for a user watching the display;
generate a gradient from the gaze area to edges of the display; and
send an instruction to the camera to decrease a bit rate of the video stream outside the gaze area based on the generated gradient; and
wherein the camera is further configured to:
decrease the bit rate of the video stream outside the gaze area based on the received instruction.