# US 11,909,999 B2 · Coding management method and apparatus based on high efficiency video coding

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,909,999 B2
- Document ID: US11909999B2
- Status: Granted
- Kind: B2
- Application number: 17/601,848
- Filed: 2020-04-20
- Published: 2022-06-30
- Granted: 2024-02-20
- Earliest claimed: 2019-06-13
- Assignees: Sanechips Technology Co., Ltd.
- Applicants: Sanechips Technology Co., Ltd.
- Inventors: Ke Xu; Jianjun Song
- Web page: https://patentgrep.com/patent/US11909999B2

## CPC

- H04N 19/137: Motion inside a coding unit, e.g. average field, frame or block difference
- H04N 19/50: using predictive coding (H04N19/61 takes precedence)
- H04N 19/119: Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
- H04N 19/14: Coding unit complexity, e.g. amount of activity or edge presence estimation (H04N19/146 takes precedence)
- H04N 19/159: Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Disclosed are a coding management method and apparatus based on High Efficiency Video Coding (HEVC). The method includes: obtaining a calculated correlation result for a HEVC basic unit before and after division, the correlation result including a spatial correlation result for the basic unit before the division and N basic units generated after the division, and N being an integer greater than 1; and judging whether or not to perform the division on the basic unit according to the calculated correlation result.

## Claims

### Claim 1

A coding management method based on high efficiency video coding (HEVC), comprising:
obtaining a calculated correlation result for a HEVC basic unit before and after division, the correlation result comprising spatial correlation αs between the basic unit before the division and the N basic units generated after the division, and spatial correlation βs between the N basic units generated after the division of the basic unit, and N being an integer greater than 1; and
judging whether or not to perform the division on the basic unit according to the calculated correlation result.

### Claim 2 (depends on 1)

The method of claim 1, wherein:
αs is obtained by the following formula:
α
s
=
N
*
D
⁡
(
X
)
d
D
⁡
(
X
)
1
d
+
1
+
D
⁡
(
X
)
2
d
+
1
+
D
⁡
(
X
)
3
d
+
1
+
…
+
D
⁡
(
X
)
N
d
+
1
;
wherein N denotes a total number of the basic units generated after the division; d denotes a depth before the division of the basic unit; d+1 denotes a depth after the division of the basic unit; D(X)d denotes a spatial correlation degree before the division of the basic unit; and D(X)id+1 denotes a spatial correlation degree of the ith basic unit generated after the division of the basic unit, and i=1, 2, 3, . . . , N; and
βs is obtained by the following formula:
β
s
=
max
⁡
(
D
⁡
(
X
)
1
d
+
1
,
D
⁡
(
X
)
2
d
+
1
,
D
⁡
(
X
)
3
d
+
1
,
…
,
D
⁡
(
X
)
N
d
+
1
)
min
⁡
(
D
⁡
(
X
)
1
d
+
1
,
D
⁡
(
X
)
2
d
+
1
,
D
⁡
(
X
)
3
d
+
1
,
…
,
D
⁡
(
X
)
N
d
+
1
)
;
wherein N denotes a total number of the basic units generated after the division; d denotes a depth before the division of the basic unit; d+1 denotes a depth after the division of the basic unit; D(X)d denotes a spatial correlation degree before the division of the basic unit; and D(X)id+1 denotes a spatial correlation degree of the ith basic unit generated after the division of the basic unit, and i=1, 2, 3, . . . , N.

### Claim 3 (depends on 1)

The method of claim 1, wherein the calculated correlation result further comprises: a temporal correlation result of the basic unit before the division and the N basic units generated after the division.

### Claim 4 (depends on 3)

The method of claim 3, wherein the temporal correlation result comprises at least one of:
temporal correlation αt between the basic unit before the division and the N basic units generated after the division; and
temporal correlation βt between the N basic units generated after the division of the basic unit.

### Claim 5 (depends on 4)

The method of claim 4, wherein:
αt is obtained by the following formula:
α
t
=
N
*
D
⁡
(
Y
)
d
D
⁡
(
Y
)
1
d
+
1
+
D
⁡
(
Y
)
2
d
+
1
+
D
⁡
(
Y
)
3
d
+
1
+
…
+
D
⁡
(
Y
)
N
d
+
1
;
wherein N denotes a total number of the basic units generated after the division; d denotes a depth before the division of the basic unit; d+1 denotes a depth after the division of the basic unit; D(Y)d denotes a temporal correlation degree before the division of the basic unit; and D(Y)id+1 denotes a temporal correlation degree of the ith basic unit generated after the division of the basic unit, and i=1, 2, 3, . . . , N; and
βt is obtained by the following formula:
β
t
=
max
⁡
(
D
⁡
(
Y
)
1
d
+
1
,
D
⁡
(
Y
)
2
d
+
1
,
D
⁡
(
Y
)
3
d
+
1
,
…
,
D
⁡
(
Y
)
N
d
+
1
)
min
⁡
(
D
⁡
(
Y
)
1
d
+
1
,
D
⁡
(
Y
)
2
d
+
1
,
D
⁡
(
Y
)
3
d
+
1
,
…
,
D
⁡
(
Y
)
N
d
+
1
)
;
wherein N denotes a total number of the basic units generated after the division; d denotes a depth before the division of the basic unit; d+1 denotes a depth after the division of the basic unit; and D(Y)d denotes a temporal correlation degree before the division of the basic unit; and D(Y)id+1 denotes a temporal correlation degree of the ith basic unit generated after the division of the basic unit, and i=1, 2, 3, . . . , N.

### Claim 6 (depends on 3)

The method of claim 3, wherein the judging whether or not to perform the division on the basic unit according to the calculated correlation result comprises:
acquiring a video frame type corresponding to the basic unit;
judging whether or not to perform the division on the basic unit according to the calculated correlation result in response to the video frame type corresponding to the basic unit being an intra-frame video frame; and
judging whether or not to perform the division on the basic unit according to the spatial correlation result and the temporal correlation result in response to the video frame type corresponding to the basic unit being an unidirectionally predictively coded frame or a bidirectionally predictively coded frame.

### Claim 7 (depends on 6)

The method of claim 6, wherein the judging whether or not to perform the division on the basic unit according to the calculated correlation result comprises:
judging whether or not to perform the division on the basic unit according to a spatial correlation degree of the basic unit before the division in response to the video frame type corresponding to the basic unit being an intra-frame video frame; and
judging whether or not to perform the division on the basic unit according to the spatial correlation degree and a temporal correlation degree before the division of the basic unit in response to the video frame type corresponding to the basic unit being an unidirectionally predictively coded frame or a bidirectionally predictively coded frame.

### Claim 8 (depends on 7)

The method of claim 7, after the judging whether or not to perform the division on the basic unit according to the calculated correlation result, the method further comprising:
collecting statistics on the correlation result of the basic unit undergoing the division and the correlation result of the basic unit not undergoing the division after a result of judging whether or not to perform the division on the basic unit is obtained; and
determining a threshold used in an execution of a next judgment on whether or not to perform the division on the basic unit according to the correlation result of the basic unit undergoing the division and the correlation result of the basic unit not undergoing division, wherein the threshold comprise at least one of a threshold for performing the division and a threshold for not performing the division.

### Claim 9 (depends on 1)

The method of claim 1, after the judging whether or not to perform the division on the basic unit according to the calculated correlation result, the method further comprising:
calculating residual information of the basic unit after determining not to perform the division on the basic unit; and
performing the division on the basic unit in response to the obtained residual information meeting a preset residual judgment condition.

### Claim 10

A coding management device based on high efficiency video coding (HEVC), comprising a processor and a memory, wherein the memory stores a computer program which, when called by the processor, causes the processor to perform a coding management method based on HEVC comprising:
obtaining a calculated correlation result for a HEVC basic unit before and after division, the correlation result comprising spatial correlation αs between the basic unit before the division and the N basic units generated after the division, and spatial correlation βs between the N basic units generated after the division of the basic unit, and N being an integer greater than 1; and
judging whether or not to perform the division on the basic unit according to the calculated correlation result.

### Claim 11 (depends on 10)

The device of claim 10, wherein:
αs is obtained by the following formula:
α
s
=
N
*
D
⁡
(
X
)
d
D
⁡
(
X
)
1
d
+
1
+
D
⁡
(
X
)
2
d
+
1
+
D
⁡
(
X
)
3
d
+
1
+
…
+
D
⁡
(
X
)
N
d
+
1
;
wherein N denotes a total number of the basic units generated after the division; d denotes a depth before the division of the basic unit; d+1 denotes a depth after the division of the basic unit; D(X)d denotes a spatial correlation degree before the division of the basic unit; and D(X)id+1 denotes a spatial correlation degree of the ith basic unit generated after the division of the basic unit, and i=1, 2, 3, . . . , N; and
βs is obtained by the following formula:
β
s
=
max
⁡
(
D
⁡
(
X
)
1
d
+
1
,
D
⁡
(
X
)
2
d
+
1
,
D
⁡
(
X
)
3
d
+
1
,
…
,
D
⁡
(
X
)
N
d
+
1
)
min
⁡
(
D
⁡
(
X
)
1
d
+
1
,
D
⁡
(
X
)
2
d
+
1
,
D
⁡
(
X
)
3
d
+
1
,
…
,
D
⁡
(
X
)
N
d
+
1
)
;
wherein N denotes a total number of the basic units generated after the division; d denotes a depth before the division of the basic unit; d+1 denotes a depth after the division of the basic unit; D(X)d denotes a spatial correlation degree before the division of the basic unit; and D(X)id+1 denotes a spatial correlation degree of the ith basic unit generated after the division of the basic unit, and i=1, 2, 3, . . . , N.

### Claim 12 (depends on 10)

The device of claim 10, wherein the calculated correlation result further comprises:
a temporal correlation result of the basic unit before the division and the N basic units generated after the division.

### Claim 13 (depends on 12)

The device of claim 12, wherein the temporal correlation result comprises at least one of:
temporal correlation αt between the basic unit before the division and the N basic units generated after the division; and
temporal correlation βt between the N basic units generated after the division of the basic unit.

### Claim 14 (depends on 13)

The device of claim 13, wherein:
αt is obtained by the following formula:
α
t
=
N
*
D
⁡
(
Y
)
d
D
⁡
(
Y
)
1
d
+
1
+
D
⁡
(
Y
)
2
d
+
1
+
D
⁡
(
Y
)
3
d
+
1
+
…
+
D
⁡
(
Y
)
N
d
+
1
;
wherein N denotes a total number of the basic units generated after the division; d denotes a depth before the division of the basic unit; d+1 denotes a depth after the division of the basic unit; and D(Y)d denotes a temporal correlation degree before the division of the basic unit; and D(Y)id+1 denotes a temporal correlation degree of the ith basic unit generated after the division of the basic unit, and i=1, 2, 3, . . . , N; and
βt is obtained by the following formula:
β
t
=
max
⁡
(
D
⁡
(
Y
)
1
d
+
1
,
D
⁡
(
Y
)
2
d
+
1
⁢
D
⁡
(
Y
)
3
d
+
1
,
…
,
D
⁡
(
Y
)
N
d
+
1
)
min
⁡
(
D
⁡
(
Y
)
1
d
+
1
,
D
⁡
(
Y
)
2
d
+
1
,
D
⁡
(
Y
)
3
d
+
1
,
…
,
D
⁡
(
Y
)
N
d
+
1
)
;
wherein N denotes a total number of the basic units generated after denotes a depth after the division of the basic unit; and D(Y)d denotes a temporal correlation degree before the division of the basic unit; and D(Y)id+1 denotes a temporal correlation degree of the ith basic unit generated after the division of the basic unit, and i=1, 2, 3, . . . , N.

### Claim 15 (depends on 12)

The device of claim 12, wherein the judging whether or not to perform the division on the basic unit according to the calculated correlation result comprises:
acquiring a video frame type corresponding to the basic unit;
judging whether or not to perform the division on the basic unit according to the calculated correlation result in response to the video frame type corresponding to the basic unit being an intra-frame video frame; and
judging whether or not to perform the division on the basic unit according to the spatial correlation result and the temporal correlation result in response to the video frame type corresponding to the basic unit being an unidirectionally predictively coded frame or a bidirectionally predictively coded frame.

### Claim 16 (depends on 15)

The device of claim 15, wherein the judging whether or not to perform the division on the basic unit according to the calculated correlation result comprises:
judging whether or not to perform the division on the basic unit according to a spatial correlation degree of the basic unit before the division in response to the video frame type corresponding to the basic unit being an intra-frame video frame; and
judging whether or not to perform the division on the basic unit according to the spatial correlation degree and a temporal correlation degree before the division of the basic unit in response to the video frame type corresponding to the basic unit being an unidirectionally predictively coded frame or a bidirectionally predictively coded frame.

### Claim 17 (depends on 16)

The device of claim 16, after the judging whether or not to perform the division on the basic unit according to the calculated correlation result, the method further comprising:
collecting statistics on the correlation result of the basic unit undergoing the division and the correlation result of the basic unit not undergoing the division after a result of judging whether or not to perform the division on the basic unit is obtained; and
determining a threshold used in an execution of a next judgment on whether or not to perform the division on the basic unit according to the correlation result of the basic unit undergoing the division and the correlation result of the basic unit not undergoing division, wherein the threshold comprise at least one of a threshold for performing the division and a threshold for not performing the division.

### Claim 18 (depends on 10)

The device of claim 10, after the judging whether or not to perform the division on the basic unit according to the calculated correlation result, the method further comprising:
calculating residual information of the basic unit after determining not to perform the division on the basic unit; and
performing the division on the basic unit in response to the obtained residual information meeting a preset residual judgment condition.