# US 2013/0156407 A1 · Progressive video streaming apparatus and method based on visual perception

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0156407 A1
- Document ID: US20130156407A1
- Status: Published application
- Kind: A1
- Application number: 13/713,083
- Filed: 2012-12-13
- Published: 2013-06-20
- Earliest claimed: 2011-12-15
- Assignees: Electronics and Telecommunications Research Institute
- Inventors: Joo Myoung SEOK; Ji Hun CHA
- Web page: https://patentgrep.com/patent/US20130156407A1

## CPC

- H04N 5/76: Television signal recording
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- H04N 5/783: Adaptations for reproducing at a rate different from the recording rate
- H04N 9/7921: {for more than one processing mode}
- H04N 21/44218: {Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV programme (methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45)}
- H04N 21/6587: Control parameters, e.g. trick play commands, viewpoint selection
- H04N 5/765: Interface circuits between an apparatus for recording and another apparatus
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A progressive video streaming apparatus and method based on a visual perception are provided, and the progressive video streaming apparatus may include a gaze detector to detect gaze information including at least one of a location of a focus and a viewing angle of a user, a video playback quality determiner to determine video playback quality layers, based on the detected gaze information, a progressive streaming receiver to request video data and receive the video data, using a visual perception priority based on the detected gaze information, and a visual perception-based player to play back the received video data, by controlling an interactive delay to be reduced below a selected criterion, while reducing a visually recognized quality change in the received video data below another selected criterion.

## Claims

### Claim 1

A progressive video streaming apparatus based on a visual perception, the progressive video streaming apparatus comprising:
a gaze detector to detect gaze information including at least one of a location of a focus and a viewing angle of a user;
a video playback quality determiner to determine video playback quality layers, based on the detected gaze information;
a progressive streaming receiver to request video data and receive the video data, using a visual perception priority based on the detected gaze information; and
a visual perception-based player to play back the received video data, by controlling an interactive delay to be reduced below a selected criterion, while reducing a visually recognized quality change in the received video data below another selected criterion.

### Claim 2 (depends on 1)

The progressive video streaming apparatus of claim 1, wherein the interactive delay is computed by adding at least one of a packetizing delay time, a network delay time, a group-of-pictures (GOP) delay time, and a buffering delay time.

### Claim 3 (depends on 1)

The progressive video streaming apparatus of claim 1, wherein the progressive streaming receiver transmits, first, video data with a high priority based on a visual perception sensitivity of a user, and enables a playback order to be determined based on the visual perception sensitivity.

### Claim 4 (depends on 1)

The progressive video streaming apparatus of claim 1, wherein the video playback quality determiner equalizes a visual perception cutoff function based on a spatial frequency to an average spatial frequency, based on a size of a slice determined by a number of horizontal pixels, and determines the video playback quality layers.

### Claim 5 (depends on 4)

The progressive video streaming apparatus of claim 4, wherein the video playback quality determiner selects a video quality layer with a minimum difference with the average spatial frequency based on a maximum spatial frequency included in each video quality layer, and determines the video playback quality layers.

### Claim 6

A progressive video streaming method based on a visual perception, the progressive video streaming method comprising:
detecting gaze information including at least one of a location of a focus and a viewing angle of a user;
determining video playback quality layers, based on the detected gaze information;
requesting video data and receiving the video data, using a visual perception priority based on the detected gaze information; and
playing back the received video data, by controlling an interactive delay to be reduced below a selected criterion, while reducing a visually recognized quality change in the received video data below another selected criterion.

### Claim 7 (depends on 6)

The progressive video streaming method of claim 6, wherein the interactive delay is computed by adding at least one of a packetizing delay time, a network delay time, a group-of-pictures (GOP) delay time, and a buffering delay time.

### Claim 8 (depends on 6)

The progressive video streaming method of claim 6, wherein the requesting comprises transmitting, first, video data with a high priority based on a visual perception sensitivity of a user, and enabling a playback order to be determined based on the visual perception sensitivity,
wherein the video data is played back with an original image quality when a predetermined period of time elapses.

### Claim 9 (depends on 6)

The progressive video streaming method of claim 6, wherein the determining comprises equalizing a visual perception cutoff function based on a spatial frequency to an average spatial frequency, based on a size of a slice determined by a number of horizontal pixels, and determining the video playback quality layers.

### Claim 10 (depends on 9)

The progressive video streaming method of claim 9, wherein the determining comprises selecting a video quality layer with a minimum difference with the average spatial frequency based on a maximum spatial frequency included in each video quality layer, and determining the video playback quality layers.
