Method and apparatus for processing log request, device, and storage medium

An electronic device, applied to a log storage system for processing large-scale log information in cloud services, with an architecture with computing and storage separated, wherein the log storage system comprises a request processing unit and a log storage unit;

• wherein the request processing unit comprises a plurality of log servers for processing log requests;
• and wherein the electronic device comprises:
• a processor, and a memory communicatively connected to the processor;
• wherein the memory stores computer-execution instructions;
• and
• when the processor executes the computer-execution instructions stored in the memory, the processor is configured to:
• receive, from a cloud service system, a write request for log information of each service;
• obtain, from the write request, a service identifier of the service;
• determine, based on the service identifier, a traffic type of the service, wherein the traffic type is used to indicate a write traffic range of the log information of the service within a preset duration;
• determine, based on the service identifier and the traffic type of the service, at least one target log server that processes the write request, and determine, based on the service identifier and the traffic type of the service, storage path information of the log information of the service on the log storage unit;
• and
• write, through the at least one target log server, the log information of the service into the log storage unit based on the storage path information,
• wherein the log storage system further comprises a metadata server;
• and the processor is further configured to:
• for each service, obtain a plurality of storage time periods corresponding to log information of the service and storage path information corresponding to each storage time period;
• and
• establish a correspondence between a service identifier, the storage path information, and the storage time periods, and store the correspondence between the service identifier, the storage path information, and the storage time periods in the metadata server, to query log information of a target service within a query time period from the log storage unit using a correspondence between service identifiers, storage path information, and storage time periods that is stored in the metadata server.

A non-transitory computer-readable storage medium, applied to a log storage system for processing large-scale log information in cloud services, with an architecture with computing and storage separated, wherein the log storage system comprises a request processing unit and a log storage unit, wherein the request processing unit comprises a plurality of log servers for processing log requests, wherein the computer-readable storage medium stores computer-execution instructions, and when the computer-execution instructions are executed by a processor, the following operations are implemented:

• receiving, from a cloud service system, a write request for log information of each service;
• obtaining, from the write request, a service identifier of the service;
• determining, based on the service identifier, a traffic type of the service, wherein the traffic type is used to indicate a write traffic range of the log information of the service within a preset duration;
• determining, based on the service identifier and the traffic type of the service, at least one target log server that processes the write request, and determining, based on the service identifier and the traffic type of the service, storage path information of the log information of the service on the log storage unit;
• and
• writing, through the at least one target log server, the log information of the service into the log storage unit based on the storage path information,
• wherein the log storage system further comprises a metadata server;
• and when the computer-execution instructions are executed by the processor, the following operations are implemented;
• for each service, obtaining a plurality of storage time periods corresponding to log information of the service and storage path information corresponding to each storage time period;
• and
• establishing a correspondence between a service identifier, the storage path information, and the storage time periods, and storing the correspondence between the service identifier, the storage path information, and the storage time periods in the metadata server, to query log information of a target service within a query time period from the log storage unit using a correspondence between service identifiers, storage path information, and storage time periods that is stored in the metadata server.