[erlang-questions] Re: 20k messages in 4s but want to go faster!

[Joel Reymont]

I won't be posting to this thread for a while as I, basically, ran out  
of ideas.

Here are the results with a histogram, as Dave Smith suggested.

It's interesting to note that my ets traversal time for 20k takes up  
to 2s on the Mac. I wrote about this in a separate message.

	Thanks, Joel

---

MacBook Pro Core2Duo 2.93Ghz with SSD

setup: 15040.77ms, n: 20000, run: 23101.30ms
     1.5010ms | min
   500.0000ms | 579
  1000.0000ms | 3693
  1500.0000ms | 509
  2000.0000ms | 1758
  2500.0000ms | 3922
  3000.0000ms | 2577
  3500.0000ms | 2809
  4000.0000ms | 1657
  4500.0000ms | 2496
  4185.8580ms | max

setup: 14538.21ms, n: 20000, run: 22750.28ms
     2.8300ms | min
   500.0000ms | 400
  1000.0000ms | 1541
  1500.0000ms | 7107
  2000.0000ms | 5402
  2500.0000ms | 4670
  3000.0000ms | 880
  2595.8890ms | max

setup: 15929.55ms, n: 20000, run: 23789.73ms
     1.7730ms | min
   500.0000ms | 1330
  1000.0000ms | 668
  1500.0000ms | 1878
  2000.0000ms | 4109
  2500.0000ms | 4954
  3000.0000ms | 2546
  3500.0000ms | 1259
  4000.0000ms | 3256
  3902.5510ms | max

ec2, 10k, 1 instance for bots and 1 for server

setup: 15463.12ms, n: 10000, run: 19252.67ms
   -15.0700ms | min
   500.0000ms | 1136   - 11.36%
  1000.0000ms | 1934   - 19.34%
  1500.0000ms | 2219   - 22.19%
  2000.0000ms | 2727   - 27.27%
  2500.0000ms | 1984   - 19.84%
  2352.5950ms | max

setup: 13463.51ms, n: 10000, run: 17207.97ms
   -15.7610ms | min
   500.0000ms | 872    - 08.72%
  1000.0000ms | 2146   - 21.46%
  1500.0000ms | 2993   - 29.93%
  2000.0000ms | 2656   - 26.56%
  2500.0000ms | 1333   - 13.33%
  2257.9970ms | max

setup: 33910.54ms, n: 10000, run: 37634.46ms
   -16.9060ms | min
   500.0000ms | 1122   - 11.22%
  1000.0000ms | 2194   - 21.94%
  1500.0000ms | 2570   - 25.70%
  2000.0000ms | 2369   - 23.69%
  2500.0000ms | 1745   - 17.45%
  2335.4170ms | max

ec2, 20k, 1 instance for bots and 1 for server

setup: 47791.69ms, n: 20000, run: 55429.86ms
   -21.7180ms | min
   500.0000ms | 1064   - 05.32%
  1000.0000ms | 828    - 04.14%
  1500.0000ms | 1596   - 07.98%
  2000.0000ms | 2786   - 13.93%
  2500.0000ms | 2272   - 11.36%
  3000.0000ms | 2574   - 12.87%
  3500.0000ms | 2717   - 13.58%
  4000.0000ms | 2418   - 12.09%
  4500.0000ms | 2594   - 12.97%
  5000.0000ms | 1151   - 05.75%
  4679.1540ms | max

setup: 50666.82ms, n: 20000, run: 58361.03ms
   -25.4550ms | min
   500.0000ms | 1330   - 06.65%
  1000.0000ms | 811    - 04.06%
  1500.0000ms | 792    - 03.96%
  2000.0000ms | 2800   - 14.00%
  2500.0000ms | 2484   - 12.42%
  3000.0000ms | 2902   - 14.51%
  3500.0000ms | 2526   - 12.63%
  4000.0000ms | 2861   - 14.31%
  4500.0000ms | 2777   - 13.88%
  5000.0000ms | 717    - 03.58%
  4716.3200ms | max

setup: 42524.39ms, n: 20000, run: 50148.11ms
     6.6660ms | min
   500.0000ms | 1168   - 05.84%
  1000.0000ms | 1016   - 05.08%
  1500.0000ms | 1546   - 07.73%
  2000.0000ms | 2442   - 12.21%
  2500.0000ms | 2713   - 13.56%
  3000.0000ms | 2684   - 13.42%
  3500.0000ms | 2636   - 13.18%
  4000.0000ms | 2363   - 11.82%
  4500.0000ms | 2248   - 11.24%
  5000.0000ms | 1184   - 05.92%
  4680.1510ms | max

---
Mac hacker with a performance bent
http://www.linkedin.com/in/joelreymont