0
$\begingroup$

I am trying to come up with a cost function that I could minimize/maximize. This would be a two variables function: number of requests per second and latency in ms. What we observed is that the more requests we serve, the higher the latency. We want to find the right balance.

What would be the formula? Is this simply a linear function?

  • 0
    Second, the latency(RPS) formula depends on your empirical observations. It will probably be simplest to model it as linear, but if the latency response is actually nonlinear, if RPS changes from average too much, your model will no longer describe the situation and you may find that the cost-benefit calculation shifts. (I don't know what is the most realistic model -- a hyperbola?)2012-07-31

0 Answers 0