[erlang-bugs] Test suite status for "master"/R15A?

Scott Lystig Fritchie fritchie@REDACTED
Tue Nov 15 22:01:05 CET 2011


Hi, all.  I'm not quite certain if this is the best forum for this
question, but I'll try anyway.  What should I be expecting the status of
the full Erlang/OTP test suite to be for the "master" branch
a.k.a. R15A?

I just ran a complete set of tests, per the instructions over at
https://github.com/erlang/otp/wiki/Running-tests.  I checked out the
"master" branch of the OTP repo, with this as the last commit:

    # git log | head -6
    commit 9169a0322066614373ef2d602325e02e90ffc597
    Merge: 6acdb64 5fbadf9
    Author: Micael Karlberg <bmk@REDACTED>
    Date:   Mon Nov 14 17:06:17 2011 +0100
    
        Merge branch 'bmk/megaco/r15_integration'

... and built on a 64-bit CentOS 5 machine (well, a virtual machine)
with 2GB of RAM and 2 virtual i686 CPUs.  After about 7 hours of
runtime, I see that test_server/index.html reports:

    OK: 9780
    Failed: 292
    Skipped (User/Auto): 1228 (544/684)
    Missing suites: 12

According to the wiki:

    "There will currently be 15 or so failed test cases in the kernel
    application."

Have I managed to do something bad/stupid with my test environment, or
are the 292 failures about right for the current R15A code?

-Scott



More information about the erlang-bugs mailing list