# US 9,438,911 B2 · Video processing system with shared/configurable in-loop filter data buffer architecture and related video processing method thereof > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 9,438,911 B2 - Document ID: US9438911B2 - Status: Granted - Kind: B2 - Application number: 13/944,893 - Filed: 2013-07-18 - Published: 2014-02-06 - Granted: 2016-09-06 - Earliest claimed: 2012-08-03 - Assignees: Mediatek Inc. - Applicants: Mediatek Inc. - Inventors: Huei-Min Lin; Ping Chao; Chi-Cheng Ju; Yung-Chang Chang - Web page: https://patentgrep.com/patent/US9438911B2 ## CPC - H04N 19/80: Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation (H04N19/635, H04N19/86 take precedence) - H04N 19/423: characterised by memory arrangements (H04N19/433 takes precedence) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A video processing system includes a data buffer and a storage controller. The data buffer is shared between a plurality of in-loop filters, wherein not all of the in-loop filters comply with a same video standard. The storage controller controls data access of the data buffer, wherein for each in-loop filter granted to access the data buffer, the data buffer stores a partial data of a picture processed by the in-loop filter. Another video processing system includes a storage device and a storage controller. The storage controller adaptively determines a size of a storage space according to a tile partition setting of a picture to be processed by an in-loop filter, and controls the storage device to allocate the storage space to serve as a data buffer for storing data of the in-loop filter. ## Claims ### Claim 1 A video processing system, comprising: a data buffer, shared between a plurality of in-loop filters, wherein not all of the in-loop filters comply with a same video standard; and a storage controller, arranged for controlling data access of the data buffer, wherein for each in-loop filter granted to access the data buffer, the data buffer stores a partial data of a picture processed by the in-loop filter; wherein at least one of the in-loop filters is arranged to store filter-related data into the data buffer when an access right of the data buffer is granted to said at least one of the in-loop filters by the storage controller. ### Claim 2 (depends on 1) The video processing system of claim 1, wherein the in-loop filters include at least one of an H.264 in-loop filter, a high efficiency video coding (HEVC) in-loop filter, and a VP9 in-loop filter. ### Claim 3 (depends on 2) The video processing system of claim 2, wherein the in-loop filters include the HEVC in-loop filter. ### Claim 4 (depends on 3) The video processing system of claim 3, wherein the in-loop filters further include an H.264 de-blocking filter. ### Claim 5 (depends on 4) The video processing system of claim 4, wherein said at least one of the in-loop filters comprises the HEVC in-loop filter and the H.264 de-blocking filter; the HEVC in-loop filter is an HEVC de-blocking filter; the H.264 de-blocking filter is arranged to store a horizontal edge filter data into the data buffer when the access right of the data buffer is granted to the H.264 de-blocking filter by the storage controller; and the HEVC de-blocking filter is arranged to store at least a horizontal edge filter data into the data buffer when the access right of the data buffer is granted to the HEVC de-blocking filter by the storage controller. ### Claim 6 (depends on 5) The video processing system of claim 5, wherein the HEVC de-blocking filter is further arranged to store a vertical edge filter data into the data buffer when the access right of the data buffer is granted to the HEVC de-blocking filter by the storage controller. ### Claim 7 (depends on 4) The video processing system of claim 4, wherein said at least one of the in-loop filters comprises the HEVC in-loop filter and the H.264 de-blocking filter; the HEVC in-loop filter is an HEVC sample adaptive offset (SAO) filter; the H.264 de-blocking filter is arranged to store a horizontal edge filter data into the data buffer when the access right of the data buffer is granted to the H.264 de-blocking filter by the storage controller; and the HEVC SAO filter is arranged to store at least a horizontal neighbor data into the data buffer when the access right of the data buffer is granted to the HEVC SAO filter by the storage controller. ### Claim 8 (depends on 7) The video processing system of claim 7, wherein the HEVC SAO filter is further arranged to store a vertical neighbor data into the data buffer when the access right of the data buffer is granted to the HEVC SAO filter by the storage controller. ### Claim 9 (depends on 3) The video processing system of claim 3, wherein the in-loop filters further include a VP9 in-loop filter. ### Claim 10 (depends on 9) The video processing system of claim 9, wherein said at least one of the in-loop filters comprises the HEVC in-loop filter and the VP9 in-loop filter; the VP9 in-loop filter is a VP9 de-blocking filter; the HEVC in-loop filter is arranged to store partial data of the picture processed by the HEVC in-loop filter into the data buffer when the access right of the data buffer is granted to the HEVC in-loop filter by the storage controller; and the VP9 de-blocking filter is arranged to store partial data of the picture processed by the VP9 de-blocking filter into the data buffer when the access right of the data buffer is granted to the VP9 de-blocking filter by the storage controller. ### Claim 11 (depends on 9) The video processing system of claim 9, wherein said at least one of the in-loop filters comprises the HEVC in-loop filter and the VP9 in-loop filter; the VP9 in-loop filter is a VP9 second stage filter; the HEVC in-loop filter is arranged to store partial data of the picture processed by the HEVC in-loop filter into the data buffer when the access right of the data buffer is granted to the HEVC in-loop filter by the storage controller; and the VP9 second stage filter is arranged to store partial data of the picture processed by the VP9 second stage filter when the access right of the data buffer is granted to the VP9 second stage filter by the storage controller. ### Claim 12 A video processing method, comprising: sharing a data buffer between a plurality of in-loop filters, wherein not all of the in-loop filters comply with a same video standard; and controlling data access of the data buffer, wherein for each in-loop filter granted to access the data buffer, the data buffer stores a partial data of a picture processed by the in-loop filter; wherein at least one of the in-loop filters stores filter-related data into the data buffer when an access right of the data buffer is granted to said at least one of the in-loop filters. ### Claim 13 (depends on 12) The video processing method of claim 12, wherein the in-loop filters include at least one of an H.264 in-loop filter, a high efficiency video coding (HEVC) in-loop filter, and a VP9 in-loop filter. ### Claim 14 (depends on 13) The video processing method of claim 13, wherein the in-loop filters include the HEVC in-loop filter. ### Claim 15 (depends on 14) The video processing method of claim 14, wherein the in-loop filters further include an H.264 de-blocking filter. ### Claim 16 (depends on 15) The video processing method of claim 15, wherein said at least one of the in-loop filters comprises the HEVC in-loop filter and the H.264 de-blocking filter; the HEVC in-loop filter is an HEVC de-blocking filter; the H.264 de-blocking filter stores a horizontal edge filter data into the data buffer when the access right of the data buffer is granted to the H.264 de-blocking filter; and the HEVC de-blocking filter stores at least a horizontal edge filter data into the data buffer when the access right of the data buffer is granted to HEVC de-blocking filter. ### Claim 17 (depends on 16) The video processing method of claim 16, wherein the HEVC de-blocking filter further stores a vertical edge filter data into the data buffer when the access right of the data buffer is granted to the HEVC de-blocking filter. ### Claim 18 (depends on 15) The video processing method of claim 15, wherein said at least one of the in-loop filters comprises the HEVC in-loop filter and the H.264 de-blocking filter; the HEVC in-loop filter is an HEVC sample adaptive offset (SAO) filter; the H.264 de-blocking filter stores a horizontal edge filter data into the data buffer when the access right of the data buffer is granted to the H.264 de-blocking filter; and the HEVC SAO filter stores at least a horizontal neighbor data into the data buffer when the access right of the data buffer is granted to the HEVC SAO filter. ### Claim 19 (depends on 18) The video processing method of claim 18, wherein the HEVC SAO filter further stores a vertical neighbor data into the data buffer when the access right of the data buffer is granted to the HEVC SAO filter. ### Claim 20 (depends on 14) The video processing method of claim 14, wherein the in-loop filters further include a VP9 in-loop filter. ### Claim 21 (depends on 20) The video processing method of claim 20, wherein said at least one of the in-loop filters comprises the HEVC in-loop filter and the VP9 in-loop filter; the VP9 in-loop filter is a VP9 de-blocking filter; the HEVC in-loop filter stores partial data of the picture processed by the HEVC in-loop filter into the data buffer when the access right of the data buffer is granted to the HEVC in-loop filter; and the VP9 de-blocking filter stores partial data of the picture processed by the VP9 de-blocking filter into the data buffer when the access right of the data buffer is granted to the VP9 de-blocking filter. ### Claim 22 (depends on 20) The video processing method of claim 20, wherein said at least one of the in-loop filters comprises the HEVC in-loop filter and the VP9 in-loop filter; the VP9 in-loop filter is a VP9 second stage filter; the HEVC in-loop filter stores partial data of the picture processed by the HEVC in-loop filter into the data buffer when the access right of the data buffer is granted to the HEVC in-loop filter; and the VP9second stage filter stores partial data of the picture processed by the VP9 second stage filter when the access right of the data buffer is granted to the VP9 second stage filter. ### Claim 23 A video processing system, comprising: a data buffer, shared between a plurality of in-loop filters, wherein not all of the in-loop filters comply with a same video standard; and a storage controller, arranged for controlling data access of the data buffer, wherein for each in-loop filter granted to access the data buffer, the data buffer stores a partial data of a picture processed by the in-loop filter; wherein the in-loop filters include a first in-loop filter and a second in-loop filter; the first in-loop filter is arranged to store a filter-related data into the data buffer when an access right of the data buffer is granted to the first in-loop filter by the storage controller; and the second in-loop filter is arranged to store at least a filter-related data into the data buffer when the access right of the data buffer is granted to the second in-loop filter by the storage controller. ### Claim 24 A video processing method, comprising: sharing a data buffer between a plurality of in-loop filters, wherein not all of the in-loop filters comply with a same video standard; and controlling data access of the data buffer, wherein for each in-loop filter granted to access the data buffer, the data buffer stores a partial data of a picture processed by the in-loop filter; wherein the in-loop filters include a first in-loop filter and a second in-loop filter; the first in-loop filter stores a filter-related data into the data buffer when an access right of the data buffer is granted to the first in-loop filter; and the second in-loop filter stores at least one filter-related data into the data buffer when the access right of the data buffer is granted to the second in-loop filter.