A method for registering distributed systems, securely transmitting data at a byte level, and optimizing data transmission in a distributed network using virtual finishing timing and weighted fair queueing, comprising:
- registering, by a registration server, a plurality of distributed systems, wherein each distributed system is associated with system-specific parameters including an Internet Protocol (IP) address, a Media Access Control (MAC) address, and a system identifier;
- generating, by a WSID generation module on the registration server, a unique Whisper System Identifier (WSID) for each distributed system based on a cryptographic hash function that combines the system-specific parameters with a dynamically generated cryptographic salt, wherein the salt is created using a timestamp and a system-specific secret key;
- storing, by a registration pool module on the registration server, the WSIDs and corresponding system-specific parameters in a registration pool, wherein the registration pool is updated periodically with real-time metrics of system availability and resource capacity;
- calculating, by a CPC evaluation module on the registration server, a code processing capacity (CPC) value for each distributed system based on its available memory, processor capabilities, and operational state, wherein the CPC values are periodically updated based on real-time monitoring;
- segmenting, by a segmentation module on a transmitting system, a file into a plurality of byte-sized units, wherein each byte-sized unit is assigned a unique identifier comprising a string code, a sequence number, and a timestamp to track its transmission time;
- scheduling, by a Weighted Fair Queueing (WFQ) module on the transmitting system, the transmission of the byte-sized units based on dynamically adjusted priority weights corresponding to criticality of each byte-sized unit and network conditions, including bandwidth utilization and latency;
- calculating, by a Virtual Finishing Timing (VFT) module on the transmitting system, a virtual finishing time for each byte-sized unit, wherein the calculation is based on the size of the byte-sized unit, its dynamically adjusted priority weight, and current network load;
- transmitting, by a transmitting module on the transmitting system, the byte-sized units to at least one distributed system in the order determined by the WFQ module;
- validating, by a block interposer on the distributed system, the integrity of each transmitted byte-sized unit, wherein validation includes comparing a hash of the transmitted byte-sized unit with an expected hash value and verifying encryption integrity using a cryptographic key associated with the byte-sized unit;
- retransmitting, by the transmitting module on the distributed system, any byte-sized unit identified as corrupted by the block interposer, wherein retransmission is performed through an alternate path dynamically determined based on network reliability metrics, including latency and packet loss rates;
- receiving, by a receiving module on a receiving system, the transmitted byte-sized units, wherein the receiving module preliminarily validates the received byte-sized units to discard units received from unauthorized sources before storing them in a reassembly buffer;
- validating and reassembling, by a byte collector on the receiving system, the received byte-sized units into their original sequence by referencing the unique identifiers, sequence numbers, and validation results, and correcting any errors in the sequence numbers by referencing a predefined transmission order;
- monitoring, by a network monitoring module on the transmitting system, real-time network performance metrics, including bandwidth utilization, latency, and packet delays, to dynamically update the virtual finishing times and priority weights of the remaining byte-sized units;
- providing, by a reporting module on the transmitting system, real-time monitoring data, including WSIDs, CPC values, task assignments, and transmission statuses, to ensure efficient resource allocation and optimized data transmission;
- generating, by the reporting module on the transmitting system, a summary report including aggregated metrics such as transmission times, retransmission counts, validation success rates, and recommendations for optimizing future data transmissions across the network;
- and
- storing, by the receiving system, a reassembled file in its original format, wherein the reassembly buffer includes a time-based expulsion mechanism to remove unvalidated or incomplete byte-sized units after a predefined time period.