[erlang-questions] Desperately looking for official Erlang tests results

REIX, Tony tony.reix@REDACTED
Thu Mar 2 16:46:58 CET 2017


Hi Hans,

On AIX, I have only 1 test failing:

                OK FAIL SKIP TOTAL
crypto_test:   111    1    3   115

However, on FC25/x86_64, I have 4 more:

                OK FAIL SKIP TOTAL
crypto_test:   107    5    3   115


1) AIX:

1> Testing tests.crypto_test: *** FAILED test case 97 of 115 ***

crypto:strong_rand_mpint failed on line 1417
Reason: low_entropy

# cd otp_src_19.2

# ./bin/erl
/opt/freeware/src/packages/BUILD/otp_src_19.2/bin/powerpc-ibm-aix6.1/erlexec
Erlang/OTP 19 [erts-8.2] [source]

Eshell V8.2  (abort with ^G)
1> crypto:info_lib().
[{<<"OpenSSL">>,268443823,
  <<"OpenSSL 1.0.2j  26 Sep 2016">>}]
2> crypto:supports().
[{hashs,[sha,sha224,sha256,sha384,sha512,md4,md5,ripemd160]},
 {ciphers,[des3_cbc,des_ede3,des3_cbf,des3_cfb,aes_cbc,
           aes_cbc128,aes_cfb8,aes_cfb128,aes_cbc256,aes_ctr,aes_ecb,
           aes_ige256,des_cbc,des_cfb,des_ecb,blowfish_cbc,
           blowfish_cfb64,blowfish_ofb64,blowfish_ecb,rc2_cbc,rc4,
           aes_gcm]},
 {public_keys,[rsa,dss,dh,ec_gf2m,ecdsa,ecdh,srp]}]
3>


2) FC25/x86_64:

1> Testing tests.crypto_test: *** FAILED {crypto_SUITE,init_per_group} ***

1> Testing tests.crypto_test: *** FAILED test case 26 of 115 ***
crypto:ecdh_compute_key_nif failed
Reason: badarg

1> Testing tests.crypto_test: *** FAILED test case 27 of 115 ***
crypto:ec_key_generate failed
Reason: badarg

1> Testing tests.crypto_test: *** FAILED test case 97 of 115 ***          Common with AIX
crypto:strong_rand_mpint failed on line 1417
Reason: low_entropy

1> Testing tests.crypto_test: *** FAILED test case 109 of 115 ***
crypto:ec_key_generate failed
Reason: badarg

1> Testing tests.crypto_test: *** FAILED test case 115 of 115 ***
Error detected: {'EXIT',low_entropy}

# pwd
/root/rpmbuild/BUILD/otp-OTP-19.2.3

#./bin/erl
Erlang/OTP 19 [erts-8.2.2] [source] [64-bit] [smp:3:3] [async-threads:10] [hipe] [kernel-poll:false]

Eshell V8.2.2  (abort with ^G)
1> crypto:info_lib().
[{<<"OpenSSL">>,268443839,
  <<"OpenSSL 1.0.2k-fips  26 Jan 2017">>}]
2> crypto:supports().
[{hashs,[sha,sha224,sha256,sha384,sha512,md4,md5,ripemd160]},
 {ciphers,[des3_cbc,des_ede3,des3_cbf,des3_cfb,aes_cbc,
           aes_cbc128,aes_cfb8,aes_cfb128,aes_cbc256,aes_ctr,aes_ecb,
           aes_ige256,des_cbc,des_cfb,des_ecb,blowfish_cbc,
           blowfish_cfb64,blowfish_ofb64,blowfish_ecb,rc2_cbc,rc4,
           aes_gcm]},
 {public_keys,[rsa,dss,dh,ecdsa,ecdh,srp]}]



Cordialement,

Tony Reix

Bull - ATOS
IBM Coop Architect & Technical Leader
Office : +33 (0) 4 76 29 72 67
1 rue de Provence - 38432 Échirolles - France
www.atos.net

________________________________________
De : Hans Nilsson R [hans.r.nilsson@REDACTED]
Envoyé : jeudi 2 mars 2017 15:39
À : erlang-questions@REDACTED; REIX, Tony
Objet : Re: [erlang-questions] Desperately looking for official Erlang tests results

Hi,

I looked at the [crypto, public_key, ssh, ssl] group of applications.
It does look very bad indeed, except for public_key.

So let's start from the bottom (i.e. crypto). I need the following:

1) start your tested Erlang and call
1> crypto:info_lib().
-- result 1 ---
2> crypto:supports().
-- result 2 ---
3>

What are the "result *" you get?

2) Mail me the crypto test results directory

..../ct_run.test_server@REDACTED/tests.crypto_test.logs

/Hans

On 03/02/2017 12:23 PM, REIX, Tony wrote:
> Hi,
>
> In order to understand which Erlang tests and features do not work fine
> within our port of version 19.2 on AIX, we need some "official" Erlang
> tests results for current version (19.2.3).
> However, searching on Erlang web-site, I was unable to find such tests
> results.
>
> So, I have built and tested Erlang on 3 environments: AIX 6.1,
> Fedora25/PPC64, and Fedora25/x86_64.
> I hope I've correctly ran the tests, but I'm not sure.
>
> In short, using nearly the same procedure (use Fedora .spec file), but
> without HiPE-SMP-Threads for AIX, I've got:
>
> OK FAIL SKIP TOTAL
> ------------------------------------------
> AIX 6.1 10,838 204 2,991 14,033 (no HiPE-SMP-Threads !)
> FC25/PPC64 12,376 193 3,608 16,177
> FC25/x86_64 12,407 288 3,475 16,170
>
> I am really surprised by:
> - the BIG amount of SKIPped tests on FedoraCore 25 on x86_64 : 23% of
> all tests !!
> - how few failures I have on AIX, comparable to the amount of failures
> on FC25/x86_64.
> (However: - when trying with SMP and/or HiPE, I had hangs, so
> I'm first building/testing without them
> - we applied several AIX-specific patches)
> - having LESS failures on Fedora25/PPC64 than on Fedora25/x86_64 .
> (However: there are some more SKIPped tests: 133)
>
> Since result files contains about 600,000 lines, it is very difficult
> for me to understand where/what are the issues.
> I think we have understood that, in many cases, some environment is
> missing/failing and thus the test is skipped.
>
> I'd like to get some help about:
> - checking that I'm doing the Erlang configuration, build, and tests
> correctly,
> - finding some "official" Erlang tests results on Fedora / x86_64
> - how to analyze these results and find the real issues.
>
> I have attached to this email the index.html file produced on
> Fedora25/x86_64 :
>
> /root/rpmbuild/BUILD/otp-OTP-19.2.3/release/tests/test_server/index.html
>
> Thanks
>
> Cordialement,
>
> Tony Reix
>
> Bull - ATOS
> IBM Coop Architect & Technical Leader
> Office : +33 (0) 4 76 29 72 67
> 1 rue de Provence - 38432 Échirolles - France
> www.atos.net
>
>
>
> _______________________________________________
> erlang-questions mailing list
> erlang-questions@REDACTED
> http://erlang.org/mailman/listinfo/erlang-questions
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://erlang.org/pipermail/erlang-questions/attachments/20170302/38aec185/attachment.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Erlang.crypto_tests.FC25.x86_64.tar.xz
Type: octet/stream
Size: 110504 bytes
Desc: Erlang.crypto_tests.FC25.x86_64.tar.xz
URL: <http://erlang.org/pipermail/erlang-questions/attachments/20170302/38aec185/attachment.bin>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Erlang.crypto_tests.AIX.PPC64.tar.xz
Type: octet/stream
Size: 109200 bytes
Desc: Erlang.crypto_tests.AIX.PPC64.tar.xz
URL: <http://erlang.org/pipermail/erlang-questions/attachments/20170302/38aec185/attachment-0001.bin>


More information about the erlang-questions mailing list