# US 2023/0056730 A1 · Systems and methods for controlling high speed video > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2023/0056730 A1 - Document ID: US20230056730A1 - Status: Published application - Kind: A1 - Application number: 17/979,381 - Filed: 2022-11-02 - Published: 2023-02-23 - Earliest claimed: 2021-07-30 - Assignees: Avago Technologies International Sales Pte. Limited - Applicants: Avago Technologies International Sales Pte. Limited - Inventors: Dmitrii Loukianov - Web page: https://patentgrep.com/patent/US20230056730A1 ## CPC - H04L 65/61: for supporting one-way streaming services, e.g. Internet radio - H04L 65/612: for unicast - H04L 1/08: by repeating transmission, e.g. Verdan system {(H04L1/1858 and H04L1/189 take precedence)} - H04L 41/06: Management of faults, events, alarms or notifications - H04L 47/34: ensuring sequence integrity, e.g. using sequence numbers - H04L 49/90: Buffering arrangements - H04L 65/70: Media network packetisation - H04L 65/762: {at the source (reformatting of additional data in video distribution servers H04N21/2355)} - H04L 65/80: Responding to QoS - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) ## Abstract Systems and methods transfer video data to an image processing system from a video source. Pixel data is received in a local buffer of a network interface controller and provided in a video transport packet. The video transport packet includes the pixel data, a media access control header and a video header. The video transport packet is received by another network interface controller that provides the pixel data directly into a video frame buffer of the image processing system. ## Claims ### Claim 1 A device, comprising: a controller; and an accelerator configured to receive a video transport packet from the controller, to extract a video data from the video transport packet and to provide the video data to an interface, wherein the interface is configured to provide the video data to a video frame buffer of an image processing system. ### Claim 2 (depends on 1) The device of claim 1, wherein the interface is configured to provide the video data directly by writing the video data without host processor software recopying or reformatting the the video data. ### Claim 3 (depends on 1) The device of claim 1, wherein the controller is configured for use on a packet network, the packet network being a high speed Ethernet network and the controller is configured to transfer a mix of general purpose data and the video transport packet. ### Claim 4 (depends on 1) The device of claim 1 wherein the video transport packet comprises a sequence identifier field to indicate the sequence number for the video transport packet, and hardware is configured to identify gaps in sequences using the sequence number. ### Claim 5 (depends on 3) The device of claim 3, wherein the accelerator is configured to provide a map of corrupted or missing data blocks in the video frame buffer to facilitate software corrective actions for the corrupted or missing data. ### Claim 6 (depends on 1) The device of claim 1, wherein the accelerator is configured to implementing recovery from errors due to packet corruption and loss by implementing automatic generation of control messages to transmitter party to request retransmission of corrupted pixel data blocks in hardware. ### Claim 7 (depends on 1) The device of claim 1, wherein the accelerator is configured to conceal errors due to packet corruption by preserving previously received data in the video frame buffer or by replicating adjacent scan line contents into corrupted data block. ### Claim 8 (depends on 1) The device of claim 1, wherein the accelerator is configured to conceal errors due to packet by interpolating missing pixels from surrounding valid pixels. ### Claim 9 (depends on 1) The device of claim 1, where the accelerator is configured to receive a data block from the video frame buffer, build a network packet in hardware and providing the network packet to the controller. ### Claim 10 A network interface controller, comprising: a media access controller; a first interface configured to be coupled directly or indirectly through a shared resource to a video source, the video source being configured to store pixel data; and an accelerator configured to receive the pixel data from the first interface and provide a stream of video transport packets containing a sequence of fragments of video primitives associated with the pixel data in payloads and provide the stream to the media access controller. ### Claim 11 (depends on 10) The network interface controller of claim 10, wherein the video transport packets each comprise the pixel data, a media access control header and a video header. ### Claim 12 (depends on 11) The network interface controller of claim 11, wherein the video header comprises a sequence identifier fields indicating a sequence number for the video transport packets for detecting gaps in a sequence of video transport packets. ### Claim 13 (depends on 11) The network interface controller of claim 11, wherein the video header comprises a protocol field and indicating a pixel format, and the pixel format provided by a host processor to the network interface controller. ### Claim 14 (depends on 10) The network interface controller of claim 10, wherein a data rate is reduced by applying in-line lossless or visually lossless compression in transmission, and matching de-compression in reception of data. ### Claim 15 (depends on 10) The network interface controller of claim 10, further comprising a second accelerator configured to receive non-video data and being disposed in parallel with the accelerator configured to receive the pixel data. ### Claim 16 A method of transferring video data to an image processing system from a video source, the method comprising: receiving a video transport packet stream, wherein the video transport packet stream comprises a video transport packet comprising a media access control header, a video streaming protocol header and payload data comprising pixel data; storing the video transport packet in a local buffer of a network interface controller; and providing the pixel data to a video frame buffer of the image processing system. ### Claim 17 (depends on 16) The method of claim 16, wherein the pixel data is provided directly to the video frame buffer from a master agent interface. ### Claim 18 (depends on 16) The method of claim 16, further comprising: implementing recovery from errors due to packet corruption and loss by implementing automatic retransmission of corrupted fragments in hardware using a sequence field in a video header. ### Claim 19 (depends on 16) The method of claim 16, further comprising: concealing errors due to packet corruption by preserving previously received data in the video frame buffer or by interpolating missing pixels from surrounding valid pixels. ### Claim 20 (depends on 16) The method of claim 16, wherein the pixel data is generic binary data for a linear or multidimensional binary buffer, which is fragmented on the transmit side, packetized, transferred as the video transport packet stream and restored in a memory of a receiver without copy operations.