Method and Apparatus for Secure Byte-Level File Transmission Using Weighted Fair Queueing and Block Interposers

A method for secure and efficient byte-level file transmission across a distributed network, comprising:

• segmenting, by a segmentation module on a transmitting system, a file into a plurality of byte-sized units, wherein each byte-sized unit is assigned a unique identifier comprising a string code, a sequence number, and a timestamp to track transmission time;
• scheduling, by a Weighted Fair Queueing (WFQ) module on the transmitting system, the transmission of the byte-sized units based on dynamically adjusted priority weights corresponding to criticality of each byte-sized unit and network conditions, including bandwidth availability and latency;
• transmitting, by a transmitting module on the transmitting system, the byte-sized units to at least one distributed system, wherein the byte-sized units are transmitted in the order determined by the WFQ module;
• validating, by a block interposer on the distributed system, the integrity of each byte-sized unit during transmission, wherein validation includes comparing a hash of the transmitted byte-sized unit with an expected hash value and verifying encryption integrity using a cryptographic key associated with the byte-sized unit;
• retransmitting, by the transmitting module on the distributed system, any byte-sized unit identified as corrupted by the block interposer, through an alternate path determined dynamically based on geographic proximity and network reliability metrics;
• receiving, by a receiving module on a receiving system, the transmitted byte-sized units, wherein each received byte-sized unit is preliminarily validated to discard any byte-sized units from unauthorized sources before being stored in a reassembly buffer;
• validating and reassembling, by a byte collector on the receiving system, the received byte-sized units into their original sequence by referencing the unique identifiers, sequence numbers, and validation results, and correcting any errors in the sequence numbers by referencing a predefined transmission order;
• storing, by the receiving system, a reassembled file in its original format, wherein the reassembly buffer includes a time-based expulsion mechanism to remove unvalidated or incomplete byte-sized units after a predefined time period;
• notifying, by a feedback module on the transmitting system, the WFQ module of retransmission requests to dynamically update scheduling priorities for any affected byte-sized units;
• and
• generating, by the receiving system, a transmission log after reassembly, wherein the log includes metrics such as the number of retransmissions, validation failures, and transmission times for each byte-sized unit to provide insights into transmission performance and reliability.

A system for secure and efficient byte-level file transmission across a distributed network, comprising:

• a segmentation module on a transmitting system configured to segment a file into a plurality of byte-sized units, wherein each byte-sized unit is assigned a unique identifier comprising a string code, a sequence number, and a timestamp to track transmission time;
• a Weighted Fair Queueing (WFQ) module on the transmitting system configured to schedule the transmission of the byte-sized units based on dynamically adjusted priority weights, wherein the adjustment accounts for criticality of each byte-sized unit and network conditions including bandwidth availability and latency;
• a transmitting module on the transmitting system configured to transmit the byte-sized units in the order determined by the WFQ module to at least one distributed system;
• a block interposer on the distributed system configured to validate the integrity of each transmitted byte-sized unit, wherein validation includes comparing a hash of the transmitted byte-sized unit with an expected hash value and verifying encryption integrity using a cryptographic key associated with the byte-sized unit;
• a retransmission module on the distributed system configured to retransmit any byte-sized unit identified as corrupted by the block interposer, through an alternate path dynamically determined based on geographic proximity and network reliability metrics;
• a receiving module on a receiving system configured to receive the transmitted byte-sized units and preliminarily validate them to discard any byte-sized units received from unauthorized sources before storing them in a reassembly buffer;
• a byte collector on the receiving system configured to validate and reassemble the received byte-sized units into their original sequence, wherein the byte collector references the unique identifiers, sequence numbers, and validation results, and corrects errors in the sequence numbers by referencing a predefined transmission order;
• a reassembly buffer on the receiving system configured to temporarily store byte-sized units, wherein the reassembly buffer includes a time-based expulsion mechanism to remove unvalidated or incomplete byte-sized units after a predefined time period;
• a feedback module on the transmitting system configured to notify the WFQ module of retransmission requests to dynamically update scheduling priorities for affected byte-sized units;
• and
• a logging module on the receiving system configured to generate a transmission log after reassembly, wherein the log includes metrics such as the number of retransmissions, validation failures, and transmission times for each byte-sized unit to provide insights into transmission performance and reliability.