[erlang-questions] Desperately looking for official Erlang tests results

[Hans Nilsson R]

Thanks!  This just get weirder and weirder.  Your output from crypto:*
looks good, but the crypto test results made me expect other outputs...

The crypto app has a C-part called via NIF, and the C-part interfaces
libcrypto.so which in you case is OpenSSL 1.0.2j.  It is *very*
important to compile with the same version of .h files as the lib that
is linked later.  I don't say you have that error, but just as a reminder.

Since Björn found some strange things in the NIF/driver/emulator area, I
would suggest to fix that first.  If there then are any errors on
crypto+ssh+ssl+public_key when the more basic emulator parts are error
free, we could start investigating again.

-Hans

On 03/02/2017 06:30 PM, REIX, Tony wrote:
> Hi*
> 
> *Here are the outputs.*
> 
> 
> FC25/x86_64 :*
> 
> 
> # cd otp-OTP-19.2.3/
> # ./bin/erl
> Erlang/OTP 19 [erts-8.2.2] [source] [64-bit] [smp:3:3]
> [async-threads:10] [hipe] [kernel-poll:false]
> 
> Eshell V8.2.2 (abort with ^G)
> 1> crypto:ec_curves().
> [secp112r1,secp112r2,secp128r1,secp128r2,secp160k1,
> secp160r1,secp160r2,secp192r1,secp192k1,secp224k1,secp224r1,
> secp256k1,secp256r1,secp384r1,secp521r1,prime192v1,
> prime192v2,prime192v3,prime239v1,prime239v2,prime239v3,
> prime256v1,wtls6,wtls7,wtls8,wtls9,wtls12,brainpoolP160r1,
> brainpoolP160t1|...]
> 2>
> 
> 
> *AIX:*
> 
> # ./bin/erl
> /opt/freeware/src/packages/BUILD/otp_src_19.2/bin/powerpc-ibm-aix6.1/erlexec
> Erlang/OTP 19 [erts-8.2] [source]
> 
> Eshell V8.2  (abort with ^G)
> 1> crypto:ec_curves().
> [secp112r1,secp112r2,secp128r1,secp128r2,secp160k1,
>  secp160r1,secp160r2,secp192r1,secp192k1,secp224k1,secp224r1,
>  secp256k1,secp256r1,secp384r1,secp521r1,prime192v1,
>  prime192v2,prime192v3,prime239v1,prime239v2,prime239v3,
>  prime256v1,wtls6,wtls7,wtls8,wtls9,wtls12,brainpoolP160r1,
>  brainpoolP160t1|...]
> 2>
> 
> 
> 
> Cordialement,
> 
> Tony Reix
> 
> Bull - ATOS
> IBM Coop Architect & Technical Leader
> Office : +33 (0) 4 76 29 72 67
> 1 rue de Provence - 38432 Échirolles - France
> www.atos.net
> 
> ________________________________________
> De : Hans Nilsson R [hans.r.nilsson@REDACTED]
> Envoyé : jeudi 2 mars 2017 18:05
> À : REIX, Tony; erlang-questions@REDACTED
> Objet : Re: [erlang-questions] Desperately looking for official Erlang
> tests results
> 
> Hi,
> 
> Thanks for the log files. I need another check by you. What does the
> function call
> 
> crypto:ec_curves().
> 
> return on AIX.PPC64 and on .FC25.x86_64 ?
> 
> /Hans
> 
> 
> On 03/02/2017 04:49 PM, REIX, Tony wrote:
>> Resending without the attachments since it is too big.
>> I'll sent the files to Hans directly.
>>
>> Cordialement,
>>
>> Tony Reix
>>
>> Bull - ATOS
>> IBM Coop Architect & Technical Leader
>> Office : +33 (0) 4 76 29 72 67
>> 1 rue de Provence - 38432 Échirolles - France
>> www.atos.net <http://www.atos.net/>
>> ------------------------------------------------------------------------
>> *De :* REIX, Tony
>> *Envoyé :* jeudi 2 mars 2017 16:46
>> *À :* Hans Nilsson R; erlang-questions@REDACTED
>> *Objet :* RE:[erlang-questions] Desperately looking for official Erlang
>> tests results
>>
>> Hi Hans,
>>
>> On AIX, I have only 1 test failing:
>>
>> *OK FAIL SKIP TOTAL*
>> crypto_test: 111 *1* 3 115
>>
>>
>> However, on FC25/x86_64, I have 4 more:
>>
>> *OK FAIL SKIP TOTAL*
>> crypto_test: 107 *5* 3 115
>>
>>
>>
>> *1) AIX:*
>>
>> 1> Testing tests.crypto_test: *** FAILED test case 97 of 115 ***
>>
>> crypto:strong_rand_mpint failed on line 1417
>> Reason: low_entropy
>>
>> # cd otp_src_19.2
>>
>> # ./bin/erl
>> /opt/freeware/src/packages/BUILD/otp_src_19.2/bin/powerpc-ibm-aix6.1/erlexec
>> Erlang/OTP 19 [erts-8.2] [source]
>>
>> Eshell V8.2 (abort with ^G)
>> 1> crypto:info_lib().
>> [{<<"OpenSSL">>,268443823,
>> <<"OpenSSL 1.0.2j 26 Sep 2016">>}]
>> 2> crypto:supports().
>> [{hashs,[sha,sha224,sha256,sha384,sha512,md4,md5,ripemd160]},
>> {ciphers,[des3_cbc,des_ede3,des3_cbf,des3_cfb,aes_cbc,
>> aes_cbc128,aes_cfb8,aes_cfb128,aes_cbc256,aes_ctr,aes_ecb,
>> aes_ige256,des_cbc,des_cfb,des_ecb,blowfish_cbc,
>> blowfish_cfb64,blowfish_ofb64,blowfish_ecb,rc2_cbc,rc4,
>> aes_gcm]},
>> {public_keys,[rsa,dss,dh,ec_gf2m,ecdsa,ecdh,srp]}]
>> 3>
>>
>>
>> *2) FC25/x86_64:*
>>
>> 1> Testing tests.crypto_test: *** FAILED {crypto_SUITE,init_per_group} ***
>>
>> 1> Testing tests.crypto_test: *** FAILED test case 26 of 115 ***
>> crypto:ecdh_compute_key_nif failed
>> Reason: badarg
>>
>> 1> Testing tests.crypto_test: *** FAILED test case 27 of 115 ***
>> crypto:ec_key_generate failed
>> Reason: badarg
>>
>> 1> Testing tests.crypto_test: *** FAILED test case 97 of 115
>> *** Common with AIX
>> crypto:strong_rand_mpint failed on line 1417
>> Reason: low_entropy
>>
>> 1> Testing tests.crypto_test: *** FAILED test case 109 of 115 ***
>> crypto:ec_key_generate failed
>> Reason: badarg
>>
>> 1> Testing tests.crypto_test: *** FAILED test case 115 of 115 ***
>> Error detected: {'EXIT',low_entropy}
>>
>> # pwd
>> /root/rpmbuild/BUILD/otp-OTP-19.2.3
>>
>> #./bin/erl
>> Erlang/OTP 19 [erts-8.2.2] [source] [64-bit] [smp:3:3]
>> [async-threads:10] [hipe] [kernel-poll:false]
>>
>> Eshell V8.2.2 (abort with ^G)
>> 1> crypto:info_lib().
>> [{<<"OpenSSL">>,268443839,
>> <<"OpenSSL 1.0.2k-fips 26 Jan 2017">>}]
>> 2> crypto:supports().
>> [{hashs,[sha,sha224,sha256,sha384,sha512,md4,md5,ripemd160]},
>> {ciphers,[des3_cbc,des_ede3,des3_cbf,des3_cfb,aes_cbc,
>> aes_cbc128,aes_cfb8,aes_cfb128,aes_cbc256,aes_ctr,aes_ecb,
>> aes_ige256,des_cbc,des_cfb,des_ecb,blowfish_cbc,
>> blowfish_cfb64,blowfish_ofb64,blowfish_ecb,rc2_cbc,rc4,
>> aes_gcm]},
>> {public_keys,[rsa,dss,dh,ecdsa,ecdh,srp]}]
>>
>>
>>
>> Cordialement,
>>
>> Tony Reix
>>
>> Bull - ATOS
>> IBM Coop Architect & Technical Leader
>> Office : +33 (0) 4 76 29 72 67
>> 1 rue de Provence - 38432 Échirolles - France
>> www.atos.net
>>
>> ________________________________________
>> De : Hans Nilsson R [hans.r.nilsson@REDACTED]
>> Envoyé : jeudi 2 mars 2017 15:39
>> À : erlang-questions@REDACTED; REIX, Tony
>> Objet : Re: [erlang-questions] Desperately looking for official Erlang
>> tests results
>>
>> Hi,
>>
>> I looked at the [crypto, public_key, ssh, ssl] group of applications.
>> It does look very bad indeed, except for public_key.
>>
>> So let's start from the bottom (i.e. crypto). I need the following:
>>
>> 1) start your tested Erlang and call
>> 1> crypto:info_lib().
>> -- result 1 ---
>> 2> crypto:supports().
>> -- result 2 ---
>> 3>
>>
>> What are the "result *" you get?
>>
>> 2) Mail me the crypto test results directory
>>
>> ..../ct_run.test_server@REDACTED/tests.crypto_test.logs
>>
>> /Hans
>>
>> On 03/02/2017 12:23 PM, REIX, Tony wrote:
>>> Hi,
>>>
>>> In order to understand which Erlang tests and features do not work fine
>>> within our port of version 19.2 on AIX, we need some "official" Erlang
>>> tests results for current version (19.2.3).
>>> However, searching on Erlang web-site, I was unable to find such tests
>>> results.
>>>
>>> So, I have built and tested Erlang on 3 environments: AIX 6.1,
>>> Fedora25/PPC64, and Fedora25/x86_64.
>>> I hope I've correctly ran the tests, but I'm not sure.
>>>
>>> In short, using nearly the same procedure (use Fedora .spec file), but
>>> without HiPE-SMP-Threads for AIX, I've got:
>>>
>>> OK FAIL SKIP TOTAL
>>> ------------------------------------------
>>> AIX 6.1 10,838 204 2,991 14,033 (no HiPE-SMP-Threads !)
>>> FC25/PPC64 12,376 193 3,608 16,177
>>> FC25/x86_64 12,407 288 3,475 16,170
>>>
>>> I am really surprised by:
>>> - the BIG amount of SKIPped tests on FedoraCore 25 on x86_64 : 23% of
>>> all tests !!
>>> - how few failures I have on AIX, comparable to the amount of failures
>>> on FC25/x86_64.
>>> (However: - when trying with SMP and/or HiPE, I had hangs, so
>>> I'm first building/testing without them
>>> - we applied several AIX-specific patches)
>>> - having LESS failures on Fedora25/PPC64 than on Fedora25/x86_64 .
>>> (However: there are some more SKIPped tests: 133)
>>>
>>> Since result files contains about 600,000 lines, it is very difficult
>>> for me to understand where/what are the issues.
>>> I think we have understood that, in many cases, some environment is
>>> missing/failing and thus the test is skipped.
>>>
>>> I'd like to get some help about:
>>> - checking that I'm doing the Erlang configuration, build, and tests
>>> correctly,
>>> - finding some "official" Erlang tests results on Fedora / x86_64
>>> - how to analyze these results and find the real issues.
>>>
>>> I have attached to this email the index.html file produced on
>>> Fedora25/x86_64 :
>>>
>>> /root/rpmbuild/BUILD/otp-OTP-19.2.3/release/tests/test_server/index.html
>>>
>>> Thanks
>>>
>>> Cordialement,
>>>
>>> Tony Reix
>>>
>>> Bull - ATOS
>>> IBM Coop Architect & Technical Leader
>>> Office : +33 (0) 4 76 29 72 67
>>> 1 rue de Provence - 38432 Échirolles - France
>>> www.atos.net
>>>
>>>
>>>
>>> _______________________________________________
>>> erlang-questions mailing list
>>> erlang-questions@REDACTED
>>> http://erlang.org/mailman/listinfo/erlang-questions
>>>
> 

-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 4101 bytes
Desc: S/MIME Cryptographic Signature
URL: <http://erlang.org/pipermail/erlang-questions/attachments/20170303/8d5cfec7/attachment.bin>