[erlang-questions] Desperately looking for official Erlang tests results
Thu Mar 2 13:37:31 CET 2017
Did you run Erlang from the git repository/source
tree or did you do "make release" and run it from
A few tests cases will fail if you have not done
"make release". (One example is
xref_SUITE:md/1 in tools.)
I think that the best way for us to help you is
if you can share the names of the failed
test cases in the following test suites:
We should be able to tell you which ones
that are most likely real bugs, and which
ones that fail because of envioronmental
On Thu, Mar 2, 2017 at 12:23 PM, REIX, Tony <tony.reix@REDACTED> wrote:
> In order to understand which Erlang tests and features do not work fine
> within our port of version 19.2 on AIX, we need some "official" Erlang tests
> results for current version (19.2.3).
> However, searching on Erlang web-site, I was unable to find such tests
> So, I have built and tested Erlang on 3 environments: AIX 6.1,
> Fedora25/PPC64, and Fedora25/x86_64.
> I hope I've correctly ran the tests, but I'm not sure.
> In short, using nearly the same procedure (use Fedora .spec file), but
> without HiPE-SMP-Threads for AIX, I've got:
> OK FAIL SKIP TOTAL
> AIX 6.1 10,838 204 2,991 14,033 (no HiPE-SMP-Threads !)
> FC25/PPC64 12,376 193 3,608 16,177
> FC25/x86_64 12,407 288 3,475 16,170
> I am really surprised by:
> - the BIG amount of SKIPped tests on FedoraCore 25 on x86_64 : 23% of all
> tests !!
> - how few failures I have on AIX, comparable to the amount of failures on
> (However: - when trying with SMP and/or HiPE, I had hangs, so I'm
> first building/testing without them
> - we applied several AIX-specific patches)
> - having LESS failures on Fedora25/PPC64 than on Fedora25/x86_64 .
> (However: there are some more SKIPped tests: 133)
> Since result files contains about 600,000 lines, it is very difficult for me
> to understand where/what are the issues.
> I think we have understood that, in many cases, some environment is
> missing/failing and thus the test is skipped.
> I'd like to get some help about:
> - checking that I'm doing the Erlang configuration, build, and tests
> - finding some "official" Erlang tests results on Fedora / x86_64
> - how to analyze these results and find the real issues.
> I have attached to this email the index.html file produced on
> Fedora25/x86_64 :
> Tony Reix
> Bull - ATOS
> IBM Coop Architect & Technical Leader
> Office : +33 (0) 4 76 29 72 67
> 1 rue de Provence - 38432 Échirolles - France
> erlang-questions mailing list
Björn Gustavsson, Erlang/OTP, Ericsson AB
More information about the erlang-questions