Tenant-specific quality of service

A non-transitory machine readable medium storing a gateway datapath program for execution by a set of processing cores of a gateway device, the gateway datapath program comprising sets of instructions for:

• providing tenant logical routers for a plurality of different tenant logical networks and process traffic between the tenant logical networks and an external network, the gateway datapath program managing quality of service (QOS) for the plurality of tenant logical networks;
• receiving a data message for a particular tenant logical network at the gateway device;
• executing a set of processing stages to process the data message, the set of processing stages comprising a processing stage for a particular tenant logical router of the particular tenant logical network;
• and
• as part of the processing stage for the particular tenant logical router, using a QoS data structure specific to the particular tenant logical router to determine whether to allow the data message, wherein (i) the QoS data structure specific to the particular tenant logical router is used to determine whether to allow each data message of a plurality of data messages for which the processing stage for the particular tenant logical router is executed, (ii) the gateway device stores at least one separate QoS data structure for each of a set of the tenant logical routers, and (iii) the set of instructions for using the QoS data structure specific to the tenant logical router comprises a set of instructions for comparing a size of the data message to a current token value for the QoS data structure for the particular tenant logical router to determine the remaining amount of data allowed to be processed by the tenant logical router.