[erlang-questions] erlang 21.3 and erts-10.3 scheduler_4 got stuck

Alexander Petrovsky askjuise@REDACTED
Thu Jun 27 17:23:19 CEST 2019


Hello!

Dear maintainers, during perf test I stumble upon that application freeze,
don't respond to erlang pings, don't accept any new connections and don't
write any logs. Seems like one of the Erlang schedulers got stuck in an
endless loop.

# top -H
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
15977 hbc 20 0 5103668 1.6g 5764 R 99.9 21.5 10:23.40 4_scheduler

The trace from gdb attached. Is any additional information required?

-- 
Петровский Александр / Alexander Petrovsky,

Skype: askjuise
Phone: +7 931 9877991
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://erlang.org/pipermail/erlang-questions/attachments/20190627/9184e09f/attachment.htm>
-------------- next part --------------
Threads:

(gdb) info thread
  Id   Target Id         Frame
  34   Thread 0x7f115b13f700 (LWP 15961) "sys_sig_dispatc" 0x00007f119c5d86fd in read () from /lib64/libpthread.so.0
  33   Thread 0x7f1153bbf700 (LWP 15962) "sys_msg_dispatc" 0x00007f119c5d5965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
  32   Thread 0x7f115b1bc700 (LWP 15963) "async_1" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
  31   Thread 0x7f11533be700 (LWP 15964) "async_2" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
  30   Thread 0x7f115339b700 (LWP 15965) "async_3" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
  29   Thread 0x7f1153378700 (LWP 15966) "async_4" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
  28   Thread 0x7f1153355700 (LWP 15967) "async_5" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
  27   Thread 0x7f1153332700 (LWP 15968) "async_6" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
  26   Thread 0x7f115330f700 (LWP 15969) "async_7" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
  25   Thread 0x7f11532ec700 (LWP 15970) "async_8" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
  24   Thread 0x7f11532c9700 (LWP 15971) "async_9" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
  23   Thread 0x7f11532a6700 (LWP 15972) "async_10" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
  22   Thread 0x7f115313f700 (LWP 15974) "1_scheduler" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
  21   Thread 0x7f115303c700 (LWP 15975) "2_scheduler" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
  20   Thread 0x7f1152d39700 (LWP 15976) "3_scheduler" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
* 19   Thread 0x7f1152f39700 (LWP 15977) "4_scheduler" erts_try_change_runq_proc (rq=<optimized out>, p=0x7f10ac9e1c38) at beam/erl_process.h:2347
  18   Thread 0x7f1152e36700 (LWP 15978) "1_dirty_cpu_sch" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
  17   Thread 0x7f1152de3700 (LWP 15979) "2_dirty_cpu_sch" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
  16   Thread 0x7f1152d90700 (LWP 15980) "3_dirty_cpu_sch" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
  15   Thread 0x7f11529ff700 (LWP 15981) "4_dirty_cpu_sch" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
  14   Thread 0x7f11529ac700 (LWP 15982) "1_dirty_io_sche" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
  13   Thread 0x7f1152959700 (LWP 15983) "2_dirty_io_sche" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
  12   Thread 0x7f1152906700 (LWP 15984) "3_dirty_io_sche" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
  11   Thread 0x7f11528b3700 (LWP 15985) "4_dirty_io_sche" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
  10   Thread 0x7f1152860700 (LWP 15986) "5_dirty_io_sche" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
  9    Thread 0x7f115280d700 (LWP 15987) "6_dirty_io_sche" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
  8    Thread 0x7f11527ba700 (LWP 15988) "7_dirty_io_sche" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
  7    Thread 0x7f1152767700 (LWP 15989) "8_dirty_io_sche" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
  6    Thread 0x7f1152714700 (LWP 15990) "9_dirty_io_sche" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
  5    Thread 0x7f11526c1700 (LWP 15991) "10_dirty_io_sch" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
  4    Thread 0x7f115266e700 (LWP 15992) "aux" 0x00007f119c0e82cf in ppoll () from /lib64/libc.so.6
  3    Thread 0x7f115261b700 (LWP 15993) "0_poller" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
  2    Thread 0x7f10d3fff700 (LWP 15998) "2_scheduler" 0x00007f119c0b9e2d in nanosleep () from /lib64/libc.so.6
  1    Thread 0x7f119d541740 (LWP 15858) "beam.smp" 0x00007f119c0e9f73 in select () from /lib64/libc.so.6

--------------------------------------------------------------------------------
Full backtrace of the thread:

(gdb) backtrace
#0  erts_try_change_runq_proc (rq=<optimized out>, p=0x7f10ac9e1c38) at beam/erl_process.h:2347
#1  select_enqueue_run_queue (state=<optimized out>, p=0x7f10ac9e1c38, enq_prio=2, enqueue=-1) at beam/erl_process.c:6442
#2  add2runq (enqueue=-1, prio=2, proc=0x7f10ac9e1c38, state=<optimized out>, proxy=0x0) at beam/erl_process.c:6618
#3  0x000000000045d1dc in active_sys_enqueue (p=0x7f10ac9e1c38, sys_task=sys_task@REDACTED=0x7f115bec01a8, task_prio=2, enable_flags=1310720, enable_flags@REDACTED=262144, state=<optimized out>,
    fail_state_p=fail_state_p@REDACTED=0x7f1152f38a00) at beam/erl_process.c:6899
#4  0x00000000004678ab in schedule_process_sys_task (p=p@REDACTED=0x7f10ac9e1c38, prio=<optimized out>, st=st@REDACTED=0x7f115bec01a8, fail_state_p=fail_state_p@REDACTED=0x7f1152f38a00) at beam/erl_process.c:6946
#5  0x00000000004679dc in schedule_generic_sys_task (pid=pid@REDACTED=60065118711107, type=type@REDACTED=ERTS_PSTT_PRIO_SIG, prio=prio@REDACTED=2, arg0=arg0@REDACTED=11, arg1=18446744073709551611)
    at beam/erl_process.c:10845
#6  0x0000000000448717 in erts_sig_prio (pid=pid@REDACTED=60065118711107, prio=prio@REDACTED=2) at beam/erl_process.c:10869
#7  0x0000000000512f6c in maybe_elevate_sig_handling_prio (c_p=c_p@REDACTED=0x7f107088dda8, other=other@REDACTED=60065118711107) at beam/erl_proc_sig_queue.c:756
#8  0x0000000000516a4b in erts_proc_sig_send_process_info_request (c_p=c_p@REDACTED=0x7f107088dda8, to=to@REDACTED=60065118711107, item_ix=item_ix@REDACTED=0x7f1152f38b90, len=len@REDACTED=6,
    need_msgq_len=need_msgq_len@REDACTED=8, flags=flags@REDACTED=58, reserve_size=38, ref=ref@REDACTED=139710117906410) at beam/erl_proc_sig_queue.c:1622
#9  0x00000000004b4877 in process_info_bif (c_p=<optimized out>, pid=<optimized out>, opt=<optimized out>, always_wrap=<optimized out>, pi2=<optimized out>) at beam/erl_bif_info.c:1262
#10 0x0000000000451246 in process_main (x_reg_array=0x7f115b90c300, f_reg_array=0x19ac55e42c2e0) at x86_64-unknown-linux-gnu/opt/smp/beam_cold.h:59
#11 0x000000000046570b in sched_thread_func (vesdp=0x7f1154221a80) at beam/erl_process.c:8469
#12 0x000000000067da6f in thr_wrapper (vtwd=<optimized out>) at pthread/ethread.c:118
#13 0x00007f119c5d1dd5 in start_thread () from /lib64/libpthread.so.0
#14 0x00007f119c0f2ead in clone () from /lib64/libc.so.6

(gdb) bt full
#0  ethr_native_atomic64_cmpxchg_mb (old=139712402563008, new=139712402562112, var=0x7f10ac9e1f68) at ../include/internal/x86_64/../i386/atomic.h:97
No locals.
#1  ethr_atomic_cmpxchg (old_val=139712402563008, val=139712402562112, var=0x7f10ac9e1f68) at ../include/internal/ethr_atomics.h:3495
No locals.
#2  erts_try_change_runq_proc (rq=<optimized out>, p=0x7f10ac9e1c38) at beam/erl_process.h:2344
        new_rqint = 139712402562112
#3  select_enqueue_run_queue (state=<optimized out>, p=0x7f10ac9e1c38, enq_prio=2, enqueue=-1) at beam/erl_process.c:6442
        bound = <optimized out>
#4  add2runq (enqueue=-1, prio=2, proc=0x7f10ac9e1c38, state=<optimized out>, proxy=0x0) at beam/erl_process.c:6618
No locals.
#5  0x000000000045d1dc in active_sys_enqueue (p=0x7f10ac9e1c38, sys_task=sys_task@REDACTED=0x7f115bec01a8, task_prio=2, enable_flags=1310720, enable_flags@REDACTED=262144, state=<optimized out>,
    fail_state_p=fail_state_p@REDACTED=0x7f1152f38a00) at beam/erl_process.c:6899
        runnable_procs = <optimized out>
        n = 1852222
        a = <optimized out>
        enq_prio = <optimized out>
        fail_state = <optimized out>
        status_locked = 0
        enqueue = <optimized out>
#6  0x00000000004678ab in schedule_process_sys_task (p=p@REDACTED=0x7f10ac9e1c38, prio=<optimized out>, st=st@REDACTED=0x7f115bec01a8, fail_state_p=fail_state_p@REDACTED=0x7f1152f38a00) at beam/erl_process.c:6946
        fail_state = 1024
        state = <optimized out>
#7  0x00000000004679dc in schedule_generic_sys_task (pid=pid@REDACTED=60065118711107, type=type@REDACTED=ERTS_PSTT_PRIO_SIG, prio=prio@REDACTED=2, arg0=arg0@REDACTED=11, arg1=18446744073709551611)
    at beam/erl_process.c:10845
        st = 0x7f115bec01a8
        st_prio = <optimized out>
        fail_state = 1024
        res = 0
#8  0x0000000000448717 in erts_sig_prio (pid=pid@REDACTED=60065118711107, prio=prio@REDACTED=2) at beam/erl_process.c:10869
No locals.
#9  0x0000000000512f6c in maybe_elevate_sig_handling_prio (c_p=c_p@REDACTED=0x7f107088dda8, other=other@REDACTED=60065118711107) at beam/erl_proc_sig_queue.c:756
        res = -1
        my_prio = 2
#10 0x0000000000516a4b in erts_proc_sig_send_process_info_request (c_p=c_p@REDACTED=0x7f107088dda8, to=to@REDACTED=60065118711107, item_ix=item_ix@REDACTED=0x7f1152f38b90, len=len@REDACTED=6,
    need_msgq_len=need_msgq_len@REDACTED=8, flags=flags@REDACTED=58, reserve_size=38, ref=ref@REDACTED=139710117906410) at beam/erl_proc_sig_queue.c:1622
        size = 164
        res = 1
#11 0x00000000004b4877 in process_info_bif (c_p=<optimized out>, pid=<optimized out>, opt=<optimized out>, always_wrap=<optimized out>, pi2=<optimized out>) at beam/erl_bif_info.c:1262
        ref = 139710117906410
        enqueued = <optimized out>
        need_msgq_len = 8
        hfact = {mode = FACTORY_HALLOC, p = 0x7f1154201fc0, hp_start = 0xa300004, hp = 0x45ea72 <erts_schedule+2018>, hp_end = 0x1, message = 0x7f1154201fc8, heap_frags = 0x0, heap_frags_saved = 0x0,
          heap_frags_saved_used = 17179869184001, off_heap = 0xa300004, off_heap_saved = {first = 0x7f1100008000, overhead = 4292870143}, alloc_type = 1391692720}
        def_arr = {0, 2, 14, 17, 1, 5, 6024601, 0, 59910469, 3840, 1411521432, 32529, 41002, 32528, -2075412328, 32528, 0, 32529, -2075412328, 32528, 2, 0, 5353214, 0, 1604397112, 32528, 3891, 0,
          3145791, 0, 6072834, 0, 42, 0, 0, 0}
        item_ix = 0x7f1152f38b90
        rp = 0x0
        state = 1539880576
        ret = <optimized out>
        reds = 0
        locks = 1
        flags = 58
        reserve_size = <optimized out>
        len = 6
        res = <optimized out>
#12 0x0000000000451246 in process_main (x_reg_array=0x7f115b90c300, f_reg_array=0x19ac55e42c2e0) at x86_64-unknown-linux-gnu/opt/smp/beam_cold.h:59
        bif_nif_arity = 2
        live_hf_end = 0x0
        nif_bif_result = 139712403967904
        init_done = 1
        c_p = 0x7f107088dda8
        reds_used = 4526578
        reg = 0x7f115b90c300
        E = 0x2
        I = 0x7f1154358fa0
        FCALLS = 0
        opcodes = {0x44ef8b <process_main+699>, 0x45039e <process_main+5838>, 0x4537de <process_main+19214>, 0x45075c <process_main+6796>, 0x44f826 <process_main+2902>, 0x450d8f <process_main+8383>,
          0x4511f2 <process_main+9506>, 0x45373c <process_main+19052>, 0x456e99 <process_main+33225>, 0x45995a <process_main+44170>, 0x452827 <process_main+15191>, 0x4513ce <process_main+9982>,
          0x452a74 <process_main+15780>, 0x452b4b <process_main+15995>, 0x45336d <process_main+18077>, 0x4533a6 <process_main+18134>, 0x457e4b <process_main+37243>, 0x4583da <process_main+38666>,
          0x45a325 <process_main+46677>, 0x4533cc <process_main+18172>, 0x4533f4 <process_main+18212>, 0x4528a7 <process_main+15319>, 0x44f994 <process_main+3268>, 0x453d31 <process_main+20577>,
          0x453c9f <process_main+20431>, 0x459978 <process_main+44200>, 0x450ae1 <process_main+7697>, 0x450d61 <process_main+8337>, 0x45934e <process_main+42622>, 0x4571dd <process_main+34061>,
          0x44edd2 <process_main+258>, 0x4571fc <process_main+34092>, 0x453d75 <process_main+20645>, 0x45159a <process_main+10442>, 0x45020e <process_main+5438>, 0x459734 <process_main+43620>,
          0x451672 <process_main+10658>, 0x44ff2e <process_main+4702>, 0x453495 <process_main+18373>, 0x452e3c <process_main+16748>, 0x45a27a <process_main+46506>, 0x44f93c <process_main+3180>,
          0x44f0b4 <process_main+996>, 0x452f31 <process_main+16993>, 0x452143 <process_main+13427>, 0x44f0d9 <process_main+1033>, 0x4524be <process_main+14318>, 0x452028 <process_main+13144>,
          0x45138e <process_main+9918>, 0x452174 <process_main+13476>, 0x4507bf <process_main+6895>, 0x452f60 <process_main+17040>, 0x452fa0 <process_main+17104>, 0x45300c <process_main+17212>,
          0x45a12c <process_main+46172>, 0x450156 <process_main+5254>, 0x452fe2 <process_main+17170>, 0x45304e <process_main+17278>, 0x45a170 <process_main+46240>, 0x457243 <process_main+34163>,
          0x45a1dd <process_main+46349>, 0x45a22a <process_main+46426>, 0x456b1b <process_main+32331>, 0x456bc3 <process_main+32499>, 0x459d3e <process_main+45166>, 0x451f3c <process_main+12908>,
          0x45a422 <process_main+46930>, 0x45a480 <process_main+47024>, 0x4530b9 <process_main+17385>, 0x453110 <process_main+17472>, 0x45a395 <process_main+46789>, 0x451e3a <process_main+12650>,
          0x453077 <process_main+17319>, 0x453af5 <process_main+20005>, 0x451e8c <process_main+12732>, 0x451b23 <process_main+11859>, 0x453f22 <process_main+21074>, 0x453fa8 <process_main+21208>,
          0x4543d4 <process_main+22276>, 0x4532c3 <process_main+17907>, 0x458cb3 <process_main+40931>, 0x458438 <process_main+38760>, 0x4585e7 <process_main+39191>, 0x458487 <process_main+38839>,
          0x453175 <process_main+17573>, 0x45459a <process_main+22730>, 0x45446a <process_main+22426>, 0x454605 <process_main+22837>, 0x458acd <process_main+40445>, 0x459921 <process_main+44113>,
          0x453b9f <process_main+20175>, 0x45881b <process_main+39755>, 0x45a71e <process_main+47694>, 0x45a72c <process_main+47708>, 0x4589cb <process_main+40187>, 0x45965b <process_main+43403>,
          0x454615 <process_main+22853>, 0x45880c <process_main+39740>, 0x4594e0 <process_main+43024>, 0x454553 <process_main+22659>, 0x4534be <process_main+18414>, 0x453549 <process_main+18553>,
          0x458ecc <process_main+41468>, 0x4535b6 <process_main+18662>, 0x4535df <process_main+18703>, 0x454249 <process_main+21881>, 0x4599fb <process_main+44331>, 0x458d36 <process_main+41062>,
          0x45455f <process_main+22671>, 0x454527 <process_main+22615>, 0x45458f <process_main+22719>, 0x458dfe <process_main+41262>, 0x458e4f <process_main+41343>, 0x456d95 <process_main+32965>,
          0x45a5e0 <process_main+47376>, 0x44fc76 <process_main+4006>, 0x44ff56 <process_main+4742>, 0x458b54 <process_main+40580>, 0x44eda3 <process_main+211>, 0x44fb09 <process_main+3641>,
          0x451a18 <process_main+11592>, 0x44fdf0 <process_main+4384>, 0x4512be <process_main+9710>, 0x451ab4 <process_main+11748>, 0x44f6d1 <process_main+2561>, 0x44ee4e <process_main+382>,
          0x457251 <process_main+34177>, 0x44fb78 <process_main+3752>, 0x4540f3 <process_main+21539>, 0x45033d <process_main+5741>, 0x451a55 <process_main+11653>, 0x4540e6 <process_main+21526>,
          0x450edf <process_main+8719>, 0x4510aa <process_main+9178>, 0x45adbb <process_main+49387>, 0x4516bc <process_main+10732>, 0x4531ff <process_main+17711>, 0x45042f <process_main+5983>,
          0x4577f2 <process_main+35618>, 0x459099 <process_main+41929>, 0x456a32 <process_main+32098>, 0x452e66 <process_main+16790>, 0x452ee7 <process_main+16919>, 0x4520c2 <process_main+13298>,
          0x459055 <process_main+41861>, 0x458fa7 <process_main+41687>, 0x458fe8 <process_main+41752>, 0x453ab0 <process_main+19936>, 0x459389 <process_main+42681>, 0x454665 <process_main+22933>,
          0x4593fd <process_main+42797>, 0x4541b8 <process_main+21736>, 0x459554 <process_main+43140>, 0x4546ea <process_main+23066>, 0x459518 <process_main+43080>, 0x452bfd <process_main+16173>,
          0x44f0ff <process_main+1071>, 0x450310 <process_main+5696>, 0x451d5c <process_main+12428>, 0x453c71 <process_main+20385>, 0x450648 <process_main+6520>, 0x4515e6 <process_main+10518>,
          0x4503ed <process_main+5917>, 0x456a95 <process_main+32197>, 0x44ee92 <process_main+450>, 0x4500dc <process_main+5132>, 0x44f496 <process_main+1990>, 0x452b69 <process_main+16025>,
          0x44ffd0 <process_main+4864>, 0x44f08f <process_main+959>, 0x44f704 <process_main+2612>, 0x452e1b <process_main+16715>, 0x451c3d <process_main+12141>, 0x4540a4 <process_main+21460>,
          0x44feb1 <process_main+4577>, 0x4542cb <process_main+22011>, 0x451003 <process_main+9011>, 0x45a2bb <process_main+46571>, 0x451029 <process_main+9049>, 0x45a414 <process_main+46916>,
          0x450985 <process_main+7349>, 0x4596a9 <process_main+43481>, 0x44ef26 <process_main+598>, 0x45a793 <process_main+47811>, 0x45162f <process_main+10591>, 0x4505ba <process_main+6378>,
          0x450906 <process_main+7222>, 0x450d23 <process_main+8275>, 0x453d7a <process_main+20650>, 0x453db7 <process_main+20711>, 0x45a9ba <process_main+48362>, 0x4541fc <process_main+21804>,
          0x45a8d0 <process_main+48128>, 0x45aaff <process_main+48687>, 0x45a943 <process_main+48243>, 0x45920b <process_main+42299>, 0x453609 <process_main+18745>, 0x4529d4 <process_main+15620>,
          0x456fc6 <process_main+33526>, 0x44fa7e <process_main+3502>...}
#13 0x000000000046570b in sched_thread_func (vesdp=0x7f1154221a80) at beam/erl_process.c:8469
        callbacks = {arg = 0x7f11542028c0, wakeup = 0x466450 <thr_prgr_wakeup>, prepare_wait = 0x465000 <thr_prgr_prep_wait>, wait = 0x4657d0 <thr_prgr_wait>,
          finalize_wait = 0x464fe0 <thr_prgr_fin_wait>}
        esdp = 0x7f1154221a80
        no = 4
#14 0x000000000067da6f in thr_wrapper (vtwd=<optimized out>) at pthread/ethread.c:118
        result = 0
        c = 0 '\000'
        res = <optimized out>
        twd = <optimized out>
        thr_func = 0x4655b0 <sched_thread_func>
        arg = 0x7f1154221a80
        tsep = 0x7f115b140100
#15 0x00007f119c5d1dd5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#16 0x00007f119c0f2ead in clone () from /lib64/libc.so.6
No symbol table info available.

--------------------------------------------------------------------------------
Loop steps:

(gdb) ni
0x000000000045cfb7	97	in ../include/internal/x86_64/../i386/atomic.h
(gdb) ni
erts_try_change_runq_proc (rq=<optimized out>, p=0x7f10ac9e1c38) at beam/erl_process.h:2347
2347	beam/erl_process.h: No such file or directory.
(gdb)
0x000000000045cfbf	2347	in beam/erl_process.h
(gdb)
ethr_native_atomic64_cmpxchg_mb (old=139712402563008, new=139712402562112, var=0x7f10ac9e1f68) at ../include/internal/x86_64/../i386/atomic.h:97
97	../include/internal/x86_64/../i386/atomic.h: No such file or directory.
(gdb)
0x000000000045cfb7	97	in ../include/internal/x86_64/../i386/atomic.h
(gdb)
erts_try_change_runq_proc (rq=<optimized out>, p=0x7f10ac9e1c38) at beam/erl_process.h:2347
2347	beam/erl_process.h: No such file or directory.

--------------------------------------------------------------------------------

Variable states:

(gdb)
ethr_native_atomic64_cmpxchg_mb (old=139712402563008, new=139712402562112, var=0x7f10ac9e1f68) at ../include/internal/x86_64/../i386/atomic.h:97
97	../include/internal/x86_64/../i386/atomic.h: No such file or directory.
(gdb) p *var
$1 = {counter = 139712402562112}

Process state:
(gdb) p p
$3 = (Process *) 0x7f10ac9e1c38
(gdb) p *p
$4 = {common = {id = 60065118711107, refc = {atmc = {counter = 2}, sint = 2}, tracer = 18446744073709551611, trace_flags = 0, timer = {counter = 0}, u = {alive = {started_interval = 28353, reg = 0x0,
        links = 0x7f10ac989a20, monitors = 0x7f10ac7d55d8, lt_monitors = 0x7f10aca17880}, release = {later = 28353, func = 0x0, data = 0x7f10ac989a20, next = 0x7f10ac7d55d8}}}, htop = 0x7f1075d6c3d8,
  stop = 0x7f1075d6c3d8, heap = 0x7f1075d6a1b8, hend = 0x7f1075d6c3d8, abandoned_heap = 0x0, heap_sz = 1092, min_heap_size = 233, min_vheap_size = 46422, max_heap_size = 3, fp_exception = 0, hipe = {
    nsp = 0x0, nstack = 0x0, nstend = 0x0, u = {ncallee = 0x0, closure = 0, callee_exp = 0x0}, nstgraylim = 0x0, nstblacklim = 0x0, ngra = 0x0, ncsp = 0x0, narity = 0, float_result = 0}, arity = 3,
  arg_reg = 0x7f10ac9e1d40, max_arg_reg = 6, def_arg_reg = {145163, 305995, 139708673204713, 0, 0, 4000}, cp = 0x9773d8 <beam_apply+8>, i = 0x9773d0 <beam_apply>, catches = 0, fcalls = 3879, rcount = 0,
  schedule_count = 7, reds = 135085, group_leader = 49409303796195, flags = 33562624, fvalue = 18446744073709551611, freason = 10, ftrace = 139708673204729, next = 0x0, sig_qs = {first = 0x0,
    last = 0x7f10ac9e1dd0, save = 0x7f10ac9e1dd0, cont = 0x0, cont_last = 0x7f10ac9e1de8, nmsigs = {next = 0x0, last = 0x0}, saved_last = 0x0, len = 0}, bif_timers = 0x7f10ac256fe8,
  dictionary = 0x7f10ba141e38, seq_trace_clock = 0, seq_trace_lastcnt = 0, seq_trace_token = 18446744073709551611, u = {terminate = 0x2370b, initial = {module = 145163, function = 305739, arity = 5}},
  current = 0x7f1154364338, parent = 51642686791155, static_flags = 0, high_water = 0x7f1075d6c3d8, old_hend = 0x0, old_htop = 0x0, old_heap = 0x0, gen_gcs = 9, max_gen_gcs = 65535, off_heap = {
    first = 0x7f1075d6b838, overhead = 36}, mbuf = 0x0, live_hf_end = 0xfffffffffffffff8, msg_frag = 0x0, mbuf_sz = 0, psd = {counter = 0}, bin_vheap_sz = 46422, bin_old_vheap_sz = 46422,
  bin_old_vheap = 0, sys_task_qs = 0x0, dirty_sys_tasks = 0x0, state = {counter = 319}, dirty_state = {counter = 0}, sig_inq = {first = 0x0, last = 0x7f10ac9e1f00, len = 0, nmsigs = {next = 0x0,
      last = 0x0}}, trace_msg_q = 0x0, lock = {flags = {counter = 0}, queue = {0x0, 0x0, 0x0, 0x0, 0x0}}, scheduler_data = 0x0, run_queue = {counter = 139712402562112}}



More information about the erlang-questions mailing list