[erlang-questions] Desperately looking for official Erlang tests results

[Hans Nilsson R]

Hi,

I looked at the [crypto, public_key, ssh, ssl] group of applications.
It does look very bad indeed, except for public_key.

So let's start from the bottom (i.e. crypto). I need the following:

   1) start your tested Erlang and call
         1> crypto:info_lib().
               -- result 1 ---
         2> crypto:supports().
               -- result 2 ---
         3>

      What are the "result *" you get?

   2) Mail me the crypto test results directory

..../ct_run.test_server@REDACTED/tests.crypto_test.logs

/Hans

On 03/02/2017 12:23 PM, REIX, Tony wrote:
> Hi,
> 
> In order to understand which Erlang tests and features do not work fine
> within our port of version 19.2 on AIX, we need some "official" Erlang
> tests results for current version (19.2.3).
> However, searching on Erlang web-site, I was unable to find such tests
> results.
> 
> So, I have built and tested Erlang on 3 environments: AIX 6.1,
> Fedora25/PPC64, and Fedora25/x86_64.
> I hope I've correctly ran the tests, but I'm not sure.
> 
> In short, using nearly the same procedure (use Fedora .spec file), but
> without HiPE-SMP-Threads for AIX, I've got:
> 
>                  OK  FAIL   SKIP   TOTAL
> ------------------------------------------
> AIX 6.1      10,838   204  2,991  14,033   (no HiPE-SMP-Threads !)
> FC25/PPC64   12,376   193  3,608  16,177
> FC25/x86_64  12,407   288  3,475  16,170
> 
> I am really surprised by:
>   - the BIG amount of SKIPped tests on FedoraCore 25 on x86_64 : 23% of
> all tests !!
>   - how few failures I have on AIX, comparable to the amount of failures
> on FC25/x86_64.
>         (However:   - when trying with SMP and/or HiPE, I had hangs, so
> I'm first building/testing without them
>                             - we applied several AIX-specific patches)
>  - having LESS failures on Fedora25/PPC64 than on Fedora25/x86_64 .
> (However: there are some more SKIPped tests: 133)
> 
> Since result files contains about 600,000 lines, it is very difficult
> for me to understand where/what are the issues.
> I think we have understood that, in many cases, some environment is
> missing/failing and thus the test is skipped.
> 
> I'd like to get some help about:
>   - checking that I'm doing the Erlang configuration, build, and tests
> correctly,
>   - finding some "official" Erlang tests results on Fedora / x86_64
>   - how to analyze these results and find the real issues.
> 
> I have attached to this email the index.html file produced on
> Fedora25/x86_64 :
>        
> /root/rpmbuild/BUILD/otp-OTP-19.2.3/release/tests/test_server/index.html
> 
> Thanks
> 
> Cordialement,
> 
> Tony Reix
> 
> Bull - ATOS
> IBM Coop Architect & Technical Leader
> Office : +33 (0) 4 76 29 72 67
> 1 rue de Provence - 38432 Échirolles - France
> www.atos.net
> 
> 
> 
> _______________________________________________
> erlang-questions mailing list
> erlang-questions@REDACTED
> http://erlang.org/mailman/listinfo/erlang-questions
>