# US 2020/0288164 A1 · Adaptive foveated encoder and global motion predictor

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0288164 A1
- Document ID: US20200288164A1
- Status: Published application
- Kind: A1
- Application number: 16/651,676
- Filed: 2017-11-23
- Published: 2020-09-10
- Earliest claimed: 2017-11-23
- Assignees: Intel Corporation
- Applicants: Intel Corporation
- Inventors: Yunbiao Lin; Changliang Wang; Ce Wang; Yongfa Zhou; Bo Zhao; Ping Liu; Jianwei Yang; Zhan Lou; Yu Yang; Yating Wang; Wenyi Tang; Bo Qiu
- Web page: https://patentgrep.com/patent/US20200288164A1

## CPC

- H04N 19/527: Global motion vector estimation
- G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking}
- G02B 27/017: {Head mounted}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/012: {Head tracking input arrangements}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- H04N 19/00: Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N 19/154: Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion (use of rate-distortion criteria H04N19/147)
- H04N 19/162: User input
- H04N 19/167: Position within a video image, e.g. region of interest [ROI]
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/189: characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding
- H04N 19/52: by predictive encoding
- H04N 21/234345: {the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment}
- H04N 21/234354: {by altering signal-to-noise ratio parameters, e.g. requantization}
- H04N 21/42202: {environmental sensors, e.g. for detecting temperature, luminosity, pressure, earthquakes}
- H04N 21/44218: {Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV programme (methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45)}
- H04N 21/4728: for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
- H04N 21/6587: Control parameters, e.g. trick play commands, viewpoint selection
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye}
- H04N 13/161: Encoding, multiplexing or demultiplexing different image signal components (for multi-view video sequence encoding H04N19/597)
- H04N 19/30: using hierarchical techniques, e.g. scalability (H04N19/63 takes precedence)
- H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence)
- H04N 19/50: using predictive coding (H04N19/61 takes precedence)
- H04N 19/85: using pre-processing or post-processing specially adapted for video compression
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An embodiment of an adaptive video encoder may include technology to determine headset-related information including at least one of focus-related information and motion-related information, and determine one or more video encode parameters based on the headset-related information. Other embodiments are disclosed and claimed.

## Claims

### Claim at position 1

1-24. (canceled)

### Claim 25

An electronic processing system, comprising:
a processor;
memory communicatively coupled to the processor; and
logic communicatively coupled to the processor to:
determine headset-related information including at least one of focus-related information and motion-related information, and
determine one or more video encode parameters based on the headset-related information.

### Claim 26 (depends on 25)

The system of claim 25, wherein the logic is further to:
adjust a quality parameter for an encode of a macroblock based on the focus-related information.

### Claim 27 (depends on 26)

The system of claim 26, wherein the logic is further to:
identify a focus region based on the focus-related information; and
adjust the quality parameter for the encode to provide relatively higher quality for macroblocks inside the focus region as compared to macroblocks outside of the focus region.

### Claim 28 (depends on 25)

The system of claim 25, wherein the logic is further to:
determine a global motion predictor for an encode of a macroblock based on the motion-related information.

### Claim 29 (depends on 28)

The system of claim 28, wherein the logic is further to:
determine a hierarchical motion estimation offset based on a current head position from the motion-related information, a previous head position, and a center point.

### Claim 30 (depends on 25)

The system of claim 25, wherein the logic is further to:
encode a macroblock of a video image based on the one or more determined video encode parameters.

### Claim 31

A semiconductor package apparatus, comprising:
a substrate; and
logic coupled to the substrate, wherein the logic is at least partly implemented in one or more of configurable logic and fixed-functionality hardware logic, the logic coupled to the substrate to:
determine headset-related information including at least one of focus-related information and motion-related information, and
determine one or more video encode parameters based on the headset-related information.

### Claim 32 (depends on 31)

The apparatus of claim 31, wherein the logic is further to:
adjust a quality parameter for an encode of a macroblock based on the focus-related information.

### Claim 33 (depends on 32)

The apparatus of claim 32, wherein the logic is further to:
identify a focus region based on the focus-related information; and
adjust the quality parameter for the encode to provide relatively higher quality for macroblocks inside the focus region as compared to macroblocks outside of the focus region.

### Claim 34 (depends on 31)

The apparatus of claim 31, wherein the logic is further to:
determine a global motion predictor for an encode of a macroblock based on the motion-related information.

### Claim 35 (depends on 34)

The apparatus of claim 34, wherein the logic is further to:
determine a hierarchical motion estimation offset based on a current head position from the motion-related information, a previous head position, and a center point.

### Claim 36 (depends on 31)

The apparatus of claim 31, wherein the logic is further to:
encode a macroblock of a video image based on the one or more determined video encode parameters.

### Claim 37

A method of adaptive encoding, comprising:
determining headset-related information including at least one of focus-related information and motion-related information; and
determining one or more video encode parameters based on the headset-related information.

### Claim 38 (depends on 37)

The method of claim 37, further comprising:
adjusting a quality parameter for an encode of a macroblock based on the focus-related information.

### Claim 39 (depends on 38)

The method of claim 38, further comprising:
identifying a focus region based on the focus-related information; and
adjusting the quality parameter for the encode to provide relatively higher quality for macroblocks inside the focus region as compared to macroblocks outside of the focus region.

### Claim 40 (depends on 37)

The method of claim 37, further comprising:
determining a global motion predictor for an encode of a macroblock based on the motion-related information.

### Claim 41 (depends on 40)

The method of claim 40, further comprising:
determining a hierarchical motion estimation offset based on a current head position from the motion-related information, a previous head position, and a center point.

### Claim 42 (depends on 37)

The method of claim 37, further comprising:
encoding a macroblock of a video image based on the one or more determined video encode parameters.

### Claim 43

At least one computer readable medium, comprising a set of instructions, which when executed by a computing device, cause the computing device to:
determine headset-related information including at least one of focus-related information and motion-related information; and
determine one or more video encode parameters based on the headset-related information.

### Claim 44 (depends on 43)

The at least one computer readable medium of claim 43, comprising a further set of instructions, which when executed by the computing device, cause the computing device to:
adjust a quality parameter for an encode of a macroblock based on the focus-related information.

### Claim 45 (depends on 44)

The at least one computer readable medium of claim 44, comprising a further set of instructions, which when executed by the computing device, cause the computing device to:
identify a focus region based on the focus-related information; and
adjust the quality parameter for the encode to provide relatively higher quality for macroblocks inside the focus region as compared to macroblocks outside of the focus region.

### Claim 46 (depends on 43)

The at least one computer readable medium of claim 43, comprising a further set of instructions, which when executed by the computing device, cause the computing device to:
determine a global motion predictor for an encode of a macroblock based on the motion-related information.

### Claim 47 (depends on 46)

The at least one computer readable medium of claim 46, comprising a further set of instructions, which when executed by the computing device, cause the computing device to:
determine a hierarchical motion estimation offset based on a current head position from the motion-related information, a previous head position, and a center point.

### Claim 48 (depends on 43)

The at least one computer readable medium of claim 43, comprising a further set of instructions, which when executed by the computing device, cause the computing device to:
encode a macroblock of a video image based on the one or more determined video encode parameters.