Indexing and relaying data to hot storage

A system for indexing and relaying data in storage devices, comprising:

• a memory;
• one or more processors coupled to the memory and configured to perform:
• indexing, by one or more indexing nodes, a plurality of different portions of a stream of log data to obtain a plurality of indexed portions;
• moving an indexed portion of the plurality of indexed portions from a hot storage system to a cold storage system;
• storing, in an index catalog, a pointer to a location of the indexed portion in the cold storage system;
• receiving, by one or more search nodes, one or more requests for log data,
• the indexing being performed by the one or more indexing nodes independently of the receiving by the one or more search nodes;
• determining that a particular search node of the one or more search nodes cannot process a particular request of the one or more requests based on data stored in one or more hot storage systems associated with the particular search node:
• sending, based on the index catalog, a particular indexed portion from a particular cold storage system to the one or more hot storage systems associated with the particular search node.