<html dir="ltr">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<style id="owaParaStyle" type="text/css">
<!--
p
{margin-top:0;
margin-bottom:0}
-->
P {margin-top:0;margin-bottom:0;}</style>
</head>
<body ocsi="0" fpstyle="1">
<div style="direction: ltr;font-family: Tahoma;color: #000000;font-size: 10pt;">Resending this email WITHOUT the attachment since it is too big to be sent without some approval.<br>
<br>
<div><br>
<div style="font-family:Tahoma; font-size:13px">
<div style="font-family:Tahoma; font-size:13px">
<div style="font-family:Tahoma; font-size:13px">
<div style="font-family:Tahoma; font-size:13px"><span lang="fr"><font color="black" size="2" face="Arial"><span dir="ltr" style="font-size:10pt"><font size="2" face="Times New Roman"><span style="font-size:16px">
<div style="margin:0"><font size="2" face="Calibri,sans-serif"><span style="font-size:11pt"><font size="2" face="Verdana,sans-serif"><span style="font-size:9pt">Cordialement,<br>
<br>
Tony Reix<br>
<br>
Bull - ATOS<br>
IBM Coop Architect & Technical Leader<br>
</span></font></span></font></div>
<div style="margin:0"><font size="2" face="Calibri,sans-serif"><span style="font-size:11pt"><font size="2" face="Verdana,sans-serif"><span style="font-size:9pt">Office : +33 (0) 4 76 29 72 67</span></font></span></font></div>
<div style="margin:0"><font size="2" face="Calibri,sans-serif"><span style="font-size:11pt"><font size="2" face="Verdana,sans-serif"><span style="font-size:9pt">1 rue de Provence - 38432 Échirolles - France</span></font></span></font></div>
<div style="margin:0"><font size="2" face="Calibri,sans-serif"><span style="font-size:11pt"><a href="http://www.atos.net/" target="_blank"><font size="2" face="Verdana,sans-serif"><span style="font-size:9pt">www.atos.net</span></font></a></span></font></div>
</span></font></span></font></span></div>
</div>
</div>
</div>
</div>
<div style="font-family: Times New Roman; color: #000000; font-size: 16px">
<hr tabindex="-1">
<div style="direction: ltr;" id="divRpF564706"><font color="#000000" size="2" face="Tahoma"><b>De :</b> REIX, Tony<br>
<b>Envoyé :</b> jeudi 2 mars 2017 16:19<br>
<b>À :</b> Björn Gustavsson<br>
<b>Cc :</b> erlang-questions@erlang.org; GIRARDET, JEAN<br>
<b>Objet :</b> RE:[erlang-questions] Desperately looking for official Erlang tests results<br>
</font><br>
</div>
<div></div>
<div>Hi Björn<br>
<br>
Compressed test results file from FC25/x86_64 is attached to this email: /tmp/erlang-19.2.3-1.fc25.tests.sh.res2.xz .<br>
<br>
About kernel_test, there are failed tests common to both FC25/x86_64 and AIX, and failed tests specific to each of the 2 OS.<br>
<br>
<b>1)</b> On <b>FC25/x86_64</b> :<br>
<br>
# grep "Testing tests.kernel_test" *tests*res2 | grep FAILED<br>
1> Testing tests.kernel_test: *** FAILED test case 125 of 750 ***<br>
1> Testing tests.kernel_test: *** FAILED test case 157 of 750 ***<br>
1> Testing tests.kernel_test: *** FAILED test case 158 of 750 ***<br>
1> Testing tests.kernel_test: *** FAILED test case 160 of 750 ***<br>
1> Testing tests.kernel_test: *** FAILED test case 161 of 750 ***<br>
1> Testing tests.kernel_test: *** FAILED test case 241 of 750 ***<br>
1> Testing tests.kernel_test: *** FAILED test case 244 of 750 ***<br>
1> Testing tests.kernel_test: *** FAILED test case 259 of 750 ***<br>
1> Testing tests.kernel_test: *** FAILED test case 261 of 750 ***<br>
1> Testing tests.kernel_test: *** FAILED test case 262 of 750 ***<br>
1> Testing tests.kernel_test: *** FAILED test case 294 of 750 *** x86_64 only<br>
1> Testing tests.kernel_test: *** FAILED test case 307 of 750 *** x86_64 only<br>
1> Testing tests.kernel_test: *** FAILED {gen_tcp_api_SUITE,init_per_suite} ***<br>
1> Testing tests.kernel_test: *** FAILED test case 384 of 750 *** x86_64 only<br>
1> Testing tests.kernel_test: *** FAILED test case 417 of 750 ***<br>
1> Testing tests.kernel_test: *** FAILED test case 561 of 750 *** x86_64 only<br>
1> Testing tests.kernel_test: *** FAILED test case 562 of 750 *** x86_64 only<br>
1> Testing tests.kernel_test: *** FAILED test case 606 of 750 ***<br>
1> Testing tests.kernel_test: *** FAILED test case 607 of 750 ***<br>
1> Testing tests.kernel_test: *** FAILED test case 612 of 750 ***<br>
1> Testing tests.kernel_test: *** FAILED test case 613 of 750 ***<br>
1> Testing tests.kernel_test: *** FAILED test case 627 of 750 ***<br>
1> Testing tests.kernel_test: *** FAILED test case 629 of 750 ***<br>
1> Testing tests.kernel_test: *** FAILED test case 630 of 750 ***<br>
1> Testing tests.kernel_test: *** FAILED {seq_trace_SUITE,init_per_suite} ***<br>
<br>
<br>
<br>
Case 125:<br>
disk_log_SUITE:open_overwrite failed on line 1865<br>
Reason: {badmatch,{ok,n}}<br>
<br>
157,158:<br>
erl_boot_server_SUITE:start failed on line 83<br>
Reason: {badmatch,{error,{badarg,["dorado-vm1","gandalf"]}}}<br>
<br>
160:<br>
erl_boot_server_SUITE:add failed on line 153<br>
Reason: {badmatch,{error,nxdomain}}<br>
<br>
161:<br>
erl_boot_server_SUITE:delete failed on line 186<br>
Reason: {badmatch,{error,nxdomain}}<br>
<br>
241:<br>
file_SUITE:test_directory failed on line 1376<br>
Reason: {badmatch,read}<br>
<br>
244:<br>
file_SUITE:file_write_file_info failed on line 1524<br>
Reason: {badmatch,ok}<br>
<br>
259:<br>
file_SUITE:e_delete failed on line 2109<br>
Reason: {badmatch,ok}<br>
<br>
261:<br>
file_SUITE:e_make_dir failed on line 2240<br>
Reason: {badmatch,ok}<br>
<br>
262:<br>
file_SUITE:e_del_dir failed on line 2287<br>
Reason: {badmatch,ok}<br>
<br>
294:<br>
file_name_SUITE:make_icky_dir failed on line 642<br>
Reason: {badmatch,{error,no_translation}}<br>
<br>
307:<br>
gen_sctp_SUITE:ok failed on line 544<br>
Reason: function_clause<br>
<br>
384:<br>
gen_tcp_misc_SUITE:test_prio_fail failed on line 1871<br>
Reason: {badmatch,ok}<br>
<br>
417:<br>
gen_udp_SUITE:implicit_inet6 failed on line 733<br>
Reason: not_ok<br>
<br>
561:<br>
multi_load_SUITE:do_ensure_modules_loaded failed on line 282<br>
Reason: {badmatch,false}<br>
<br>
562:<br>
multi_load_SUITE:make_and_load failed on line 330<br>
Reason: {badmatch,ok}<br>
<br>
606:<br>
prim_file_SUITE:test_directory failed on line 801<br>
Reason: {badmatch,read}<br>
<br>
607:<br>
prim_file_SUITE:test_directory failed on line 801<br>
Reason: {badmatch,read}<br>
<br>
612:<br>
prim_file_SUITE:file_write_file_info failed on line 968<br>
Reason: {badmatch,ok}<br>
<br>
613:<br>
prim_file_SUITE:file_write_file_info failed on line 968<br>
Reason: {badmatch,ok}<br>
<br>
627:<br>
prim_file_SUITE:e_delete failed on line 1455<br>
Reason: {badmatch,ok}<br>
<br>
629:<br>
prim_file_SUITE:e_make_dir failed on line 1591<br>
Reason: {badmatch,ok}<br>
<br>
630:<br>
prim_file_SUITE:e_del_dir failed on line 1641<br>
Reason: {badmatch,ok}<br>
<br>
<br>
<br>
<b>2) On AIX, I have these AIX-specific tests that fail:</b><br>
<br>
1> Testing tests.kernel_test: *** FAILED test case 88 of 750 ****<br>
code_SUITE:big_boot_embedded failed on line 1119<br>
Reason: {badmatch,{error,timeout}}<br>
<br>
1> Testing tests.kernel_test: *** FAILED test case 220 of 750 ***<br>
file_SUITE:expect failed on line 217<br>
Reason: function_clause<br>
<br>
1> Testing tests.kernel_test: *** FAILED test case 284 of 750 ***<br>
erlang:hd failed<br>
Reason: badarg<br>
<br>
1> Testing tests.kernel_test: *** FAILED test case 285 of 750 ***<br>
rlang:hd failed<br>
Reason: badarg<br>
<br>
1> Testing tests.kernel_test: *** FAILED test case 499 of 750 ***<br>
inet_SUITE:do_getif failed on line 952<br>
Reason: {test_case_failed,no_HWAs}<br>
<br>
1> Testing tests.kernel_test: *** FAILED test case 502 of 750 ***<br>
inet_SUITE:getifaddrs failed on line 999<br>
Reason: {test_case_failed,{should_have_hwaddr,{unix,aix}}}<br>
<br>
1> Testing tests.kernel_test: *** FAILED test case 590 of 750 ***<br>
prim_file_SUITE:expect failed on line 157<br>
Reason: function_clause<br>
<br>
1> Testing tests.kernel_test: *** FAILED test case 591 of 750 ***<br>
prim_file_SUITE:expect failed on line 157<br>
Reason: function_clause<br>
<br>
<br>
Cordialement,<br>
<br>
Tony Reix<br>
<br>
Bull - ATOS<br>
IBM Coop Architect & Technical Leader<br>
Office : +33 (0) 4 76 29 72 67<br>
1 rue de Provence - 38432 Échirolles - France<br>
www.atos.net<br>
<br>
________________________________________<br>
De : bgustavsson@gmail.com [bgustavsson@gmail.com] de la part de Björn Gustavsson [bjorn@erlang.org]<br>
Envoyé : jeudi 2 mars 2017 13:37<br>
À : REIX, Tony<br>
Cc : erlang-questions@erlang.org; GIRARDET, JEAN<br>
Objet : Re: [erlang-questions] Desperately looking for official Erlang tests results<br>
<br>
Did you run Erlang from the git repository/source<br>
tree or did you do "make release" and run it from<br>
there?<br>
<br>
A few tests cases will fail if you have not done<br>
"make release". (One example is<br>
xref_SUITE:md/1 in tools.)<br>
<br>
I think that the best way for us to help you is<br>
if you can share the names of the failed<br>
test cases in the following test suites:<br>
<br>
emulator_test<br>
stdlib_test<br>
kernel_test<br>
<br>
We should be able to tell you which ones<br>
that are most likely real bugs, and which<br>
ones that fail because of envioronmental<br>
issues.<br>
<br>
/Björn<br>
<br>
On Thu, Mar 2, 2017 at 12:23 PM, REIX, Tony <tony.reix@atos.net> wrote:<br>
> Hi,<br>
><br>
> In order to understand which Erlang tests and features do not work fine<br>
> within our port of version 19.2 on AIX, we need some "official" Erlang tests<br>
> results for current version (19.2.3).<br>
> However, searching on Erlang web-site, I was unable to find such tests<br>
> results.<br>
><br>
> So, I have built and tested Erlang on 3 environments: AIX 6.1,<br>
> Fedora25/PPC64, and Fedora25/x86_64.<br>
> I hope I've correctly ran the tests, but I'm not sure.<br>
><br>
> In short, using nearly the same procedure (use Fedora .spec file), but<br>
> without HiPE-SMP-Threads for AIX, I've got:<br>
><br>
> OK FAIL SKIP TOTAL<br>
> ------------------------------------------<br>
> AIX 6.1 10,838 204 2,991 14,033 (no HiPE-SMP-Threads !)<br>
> FC25/PPC64 12,376 193 3,608 16,177<br>
> FC25/x86_64 12,407 288 3,475 16,170<br>
><br>
> I am really surprised by:<br>
> - the BIG amount of SKIPped tests on FedoraCore 25 on x86_64 : 23% of all<br>
> tests !!<br>
> - how few failures I have on AIX, comparable to the amount of failures on<br>
> FC25/x86_64.<br>
> (However: - when trying with SMP and/or HiPE, I had hangs, so I'm<br>
> first building/testing without them<br>
> - we applied several AIX-specific patches)<br>
> - having LESS failures on Fedora25/PPC64 than on Fedora25/x86_64 .<br>
> (However: there are some more SKIPped tests: 133)<br>
><br>
> Since result files contains about 600,000 lines, it is very difficult for me<br>
> to understand where/what are the issues.<br>
> I think we have understood that, in many cases, some environment is<br>
> missing/failing and thus the test is skipped.<br>
><br>
> I'd like to get some help about:<br>
> - checking that I'm doing the Erlang configuration, build, and tests<br>
> correctly,<br>
> - finding some "official" Erlang tests results on Fedora / x86_64<br>
> - how to analyze these results and find the real issues.<br>
><br>
> I have attached to this email the index.html file produced on<br>
> Fedora25/x86_64 :<br>
><br>
> /root/rpmbuild/BUILD/otp-OTP-19.2.3/release/tests/test_server/index.html<br>
><br>
> Thanks<br>
><br>
> Cordialement,<br>
><br>
> Tony Reix<br>
><br>
> Bull - ATOS<br>
> IBM Coop Architect & Technical Leader<br>
> Office : +33 (0) 4 76 29 72 67<br>
> 1 rue de Provence - 38432 Échirolles - France<br>
> www.atos.net<br>
><br>
><br>
> _______________________________________________<br>
> erlang-questions mailing list<br>
> erlang-questions@erlang.org<br>
> http://erlang.org/mailman/listinfo/erlang-questions<br>
><br>
<br>
<br>
<br>
--<br>
Björn Gustavsson, Erlang/OTP, Ericsson AB<br>
</div>
</div>
</div>
</body>
</html>