Systems and methods for distributed file processing

A system for distributed file processing in a distributed network, comprising:

• a shared file system;
• a store comprising a plurality of files;
• a plurality of distributed hosts in a distributed network, each distributed host comprising at least one computer processor, wherein:
• a first distributed host receives a restore command;
• the first distributed host identifies a plurality of files in the store of a service provider, via a web service interface, to restore to the shared file system in response to the restore command;
• the first distributed host instructs a second distributed host to restore one of the plurality of files to the shared file system;
• and
• the first distributed host and the second distributed host each write the plurality of files and a plurality of file chunks to the shared file system in response to receiving the restore command;
• wherein the first distributed host and the second distributed host have a master-slave relationship, with the first distributed host being the master, and the second distributed host being the slave.