<html>
  <head>
    <meta content="text/html; charset=ISO-8859-1"
      http-equiv="Content-Type">
  </head>
  <body bgcolor="#FFFFFF" text="#000000">
    On 2012-06-01 15:09, Gustav Simonsson wrote:
    <blockquote cite="mid:4FC8BEF5.3000006@erlang.org" type="cite">
      <meta content="text/html; charset=ISO-8859-1"
        http-equiv="Content-Type">
      On 2012-06-01 12:07, Björn-Egil Dahlberg wrote:
      <blockquote cite="mid:460492439358073642@unknownmsgid" type="cite">
        <div><br>
        </div>
        <div>1 jun 2012 kl. 10:46 skrev "José Valim" <<a
            moz-do-not-send="true" href="mailto:jose.valim@gmail.com">jose.valim@gmail.com</a>>:<br>
          <br>
        </div>
        <blockquote type="cite">
          <div>
            <div class="gmail_quote">
              <blockquote class="gmail_quote" style="margin:0 0 0
                .8ex;border-left:1px #ccc solid;padding-left:1ex">
                <div class="im">The '++' operator does not verify that
                  the second argument is a list.</div>
                Therefore, the compiler will rewrite the first
                expression to simply:<br>
                <br>
                [$F,$o,$o|Bar]<br>
              </blockquote>
              <div><br>
              </div>
              <div>Yes, thanks. <span style="">For some weird reason I
                  thought Erlang restricted the right side to be a list
                  in such cases.</span></div>
              <div> </div>
              <blockquote class="gmail_quote" style="margin:0 0 0
                .8ex;border-left:1px #ccc solid;padding-left:1ex"> Have
                you made sure that you run each test in a newly spawned
                process? </blockquote>
              <blockquote class="gmail_quote" style="margin:0 0 0
                .8ex;border-left:1px #ccc solid;padding-left:1ex"> Do
                you run the test for long enough time?<br>
              </blockquote>
              <div><br>
              </div>
              <div>Running in a newly spawned process did the trick, the
                results are now consistent.</div>
              <div>I was already running it 1000 times, here is the code
                (without using spawn):</div>
              <div><br>
              </div>
              <div><a moz-do-not-send="true"
                  href="https://www.refheap.com/paste/2954">https://www.refheap.com/paste/2954</a></div>
              <div><br>
              </div>
              <div>I assume having a "clean" heap (reducing the chance
                of garbage collection) is the reason why it is a good
                idea to run benchmarks in a newly spawned process?</div>
            </div>
          </div>
        </blockquote>
        <div><br>
        </div>
        If you want to vary one parameter in a test, make sure all other
        parameters stays the same otherwise you have no idea what you
        are measuring!
        <div><br>
        </div>
        <div>Code loading, heaps, position of mars .. Everything has to
          be taken into account.<br>
        </div>
      </blockquote>
      <br>
      The effect of Mars magnetic field on that of Earth, even if
      Earth's aphelion and the perihelion of Mars were to <span
        class="hw">coincide and the interplanetary distance were to be
        at its theoretical minimum, is </span>negligible compared to
      the normal variations in Earth's magnetic field. <br>
      <br>
      Therefore it's very unlikely that the relative position of Mars
      would affect the probability of a memory bitflip occurring due to
      cosmic radiation and thus affecting the benchmark.<br>
    </blockquote>
    <br>
    My point, in case you missed it, is that you can't disregard
    something out of hand. You have to be sure. In physics you might be
    familiar to similar topics from dimensional analysis, i.e. how to
    come up with a model and how to disregard useless parameters.<br>
    <br>
    All I'm saying is that you should be sure of what you are measuring.
    =)<br>
    <br>
    <blockquote cite="mid:4FC8BEF5.3000006@erlang.org" type="cite"> <br>
      Regards,<br>
      Gustav Simonsson<br>
      Erlang/OTP team<br>
      <br>
      <blockquote cite="mid:460492439358073642@unknownmsgid" type="cite">
        <div> <br>
          <br>
          <blockquote type="cite">
            <div>
              <div class="gmail_quote">
                <div><br>
                </div>
                <div>Thanks Björn!</div>
              </div>
            </div>
          </blockquote>
          <blockquote type="cite">
            <div><span>_______________________________________________</span><br>
              <span>erlang-questions mailing list</span><br>
              <span><a moz-do-not-send="true"
                  href="mailto:erlang-questions@erlang.org">erlang-questions@erlang.org</a></span><br>
              <span><a moz-do-not-send="true"
                  href="http://erlang.org/mailman/listinfo/erlang-questions">http://erlang.org/mailman/listinfo/erlang-questions</a></span><br>
            </div>
          </blockquote>
        </div>
        <br>
        <fieldset class="mimeAttachmentHeader"></fieldset>
        <br>
        <pre wrap="">_______________________________________________
erlang-questions mailing list
<a moz-do-not-send="true" class="moz-txt-link-abbreviated" href="mailto:erlang-questions@erlang.org">erlang-questions@erlang.org</a>
<a moz-do-not-send="true" class="moz-txt-link-freetext" href="http://erlang.org/mailman/listinfo/erlang-questions">http://erlang.org/mailman/listinfo/erlang-questions</a>
</pre>
      </blockquote>
      <br>
      <br>
      <fieldset class="mimeAttachmentHeader"></fieldset>
      <br>
      <pre wrap="">_______________________________________________
erlang-questions mailing list
<a class="moz-txt-link-abbreviated" href="mailto:erlang-questions@erlang.org">erlang-questions@erlang.org</a>
<a class="moz-txt-link-freetext" href="http://erlang.org/mailman/listinfo/erlang-questions">http://erlang.org/mailman/listinfo/erlang-questions</a>
</pre>
    </blockquote>
    <br>
  </body>
</html>