[erlang-questions] Misultin EOL

[Michael Truog]

I understand that for your own specific use, you would prefer to benchmark the complete stack, which is completely reasonable.  However, the goal is avoiding subjective judgments on complex technological decisions by reducing the testing to smaller components.  The "yaws vs apache" benchmark is probably the oldest benchmark that exists, showing results with an Erlang HTTP server.  The misultin benchmark is the best in the absence of other loadtest results, but I agree it is unfortunate that it wasn't more serious with client machines driving the test with something like Tsung.  If you ignore that, the fact it was able to show relative performance was interesting.

Adding more complexity to the tests, when you bring in other components seems like it would make the test less useful, unless the Erlang components are part of someone's favorite "web framework" bundle.  Then that just becomes a sales-pitch.  I like the idea of having a more objective guide as to which Erlang HTTP server should be used, or how the decisions compare to non-Erlang HTTP servers.  Those results then can help guide development decisions and simulate more innovation.


On 02/16/2012 06:09 PM, Steve Davis wrote:
> For me, the last interesting benchmark that demonstrated anything
> graspably real was "yaws vs apache".
>
> A really interesting benchmark for today's "web server" would be, if
> someone were willing to engage in a non-trivial effort, to make a
> comparison of a full-fledged web application with full session
> management and routing capabilities. Note that this would truly test
> the appropriateness of the server's http APIs as well as the base
> response. That kind of benchmark, for me, would seem more appropriate
> and useful according to the epoch.