Live production interface and response testing

A real-time bidding exchange system for mobile ad placement, comprising:

• a bidding platform that provides integration testing while simultaneously handling live ad placement bidding functions, the bidding platform comprising:
• a first processor,
• a first memory,
• a bid brokering application stored in the first memory that, when executed by the processor:
• receives mobile ad placement bid requests from supply side platforms including a supply side platform testing handling of mobile ad placement bid requests having a new bid request format or a new bid response format in a real-time mobile ad placement bidding exchange under production loading,
• transmits the mobile ad placement bid requests to a plurality of mobile ad placement bidders, wherein the mobile ad placement bid requests comprise test mobile ad placement bid requests with corresponding test parameters and actual mobile ad placement bid requests with corresponding test parameters,
• receives test mobile ad placement bids and actual mobile ad placement bids associated with the mobile ad placement requests from the plurality of mobile ad placement bidders,
• selects winning mobile ad placement bids from among the test mobile ad placement bids and the actual mobile ad placement bids, and
• transmits the winning mobile ad placement bids to the supply side platform that sent the mobile ad placement bid request associated with the winning mobile ad placement bid, and
• a bid accounting application stored in the first memory that, when executed by the processor:
• analyzes winning mobile ad placement bids to determine the value of a test parameter of the winning mobile ad placement bid,
• accumulates winning bid costs to associated accounts of each of the plurality of mobile ad placement bidders for winning mobile ad placement bids that are determined to be actual mobile ad placement bids based on the value of the test parameter of the actual mobile ad placement bids,
• accumulates winning bid costs to a test log for winning mobile ad placement bids that are determined to be test mobile ad placement bids based on the value of the test parameter of the test mobile ad placement bids,
• analyzes winning mobile ad placement bids and mobile ad placement bids determined to be test bids based on the value of the test parameter of the bids,
• generates a test result report based on the analysis and based on evaluating handling of the new bid request format or the new bid response format by the mobile ad placement bidders, and on analyzing a number of data communication connections used by at least one mobile ad placement bidder, and
• provides the test result report to the supply side platform that is associated with mobile ad placement bid requests determined to be test bid requests based on the value of the test parameter of the requests, and
• a simulated ad placement bid request supply side platform comprising:
• a second processor,
• a second memory,
• a test mobile ad placement bid request generator application stored in the second memory that, when executed by the processor:
• tests an increased volume of ad placement bid requests with reduced latency based on data communication connections between the real-time ad placement bidding exchange system and the at least one mobile ad placement bidder by generating and providing the increased volume of ad placement bid requests with reduced latency to the bidding platform for transmission to the at least one ad placement bidder via the data communication connections based on the test result report,
• builds at least some of the test mobile ad placement bid requests for a mobile ad placement bidder engaged in integrating with the real-time mobile ad placement bidding exchange system,
• transmits the at least some of the test mobile ad placement bid requests to the bidding platform,
• receives winning mobile ad placement bids associated with the at least some of the test mobile ad placement bid requests,
• analyzes the winning mobile ad placement bids received by the test mobile ad placement bid request generator application, wherein analyzing the winning mobile ad placement bids received by the test mobile ad placement bid request generator application comprises analyzing the ability of the mobile ad placement bidder engaged in integrating with the real-time mobile ad placement bidding exchange system to support a plurality of concurrent data communication connections to the real-time ad placement bidding exchange,
• determine test metrics based on the analyzed winning mobile ad placement bids received by the test mobile ad placement bid request generator application, and
• determine whether the mobile ad placement bidder engaged in integrating with the real-time mobile ad placement bidding exchange system supports a maximum response latency time based on the test metrics.