[erlang-questions] erlang 21.3 and erts-10.3 scheduler_4 got stuck
Alexander Petrovsky
askjuise@REDACTED
Thu Jun 27 17:23:19 CEST 2019
Hello!
Dear maintainers, during perf test I stumble upon that application freeze,
don't respond to erlang pings, don't accept any new connections and don't
write any logs. Seems like one of the Erlang schedulers got stuck in an
endless loop.
# top -H
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
15977 hbc 20 0 5103668 1.6g 5764 R 99.9 21.5 10:23.40 4_scheduler
The trace from gdb attached. Is any additional information required?
--
Петровский Александр / Alexander Petrovsky,
Skype: askjuise
Phone: +7 931 9877991
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://erlang.org/pipermail/erlang-questions/attachments/20190627/9184e09f/attachment.htm>
-------------- next part --------------
Threads:
(gdb) info thread
Id Target Id Frame
34 Thread 0x7f115b13f700 (LWP 15961) "sys_sig_dispatc" 0x00007f119c5d86fd in read () from /lib64/libpthread.so.0
33 Thread 0x7f1153bbf700 (LWP 15962) "sys_msg_dispatc" 0x00007f119c5d5965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
32 Thread 0x7f115b1bc700 (LWP 15963) "async_1" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
31 Thread 0x7f11533be700 (LWP 15964) "async_2" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
30 Thread 0x7f115339b700 (LWP 15965) "async_3" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
29 Thread 0x7f1153378700 (LWP 15966) "async_4" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
28 Thread 0x7f1153355700 (LWP 15967) "async_5" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
27 Thread 0x7f1153332700 (LWP 15968) "async_6" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
26 Thread 0x7f115330f700 (LWP 15969) "async_7" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
25 Thread 0x7f11532ec700 (LWP 15970) "async_8" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
24 Thread 0x7f11532c9700 (LWP 15971) "async_9" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
23 Thread 0x7f11532a6700 (LWP 15972) "async_10" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
22 Thread 0x7f115313f700 (LWP 15974) "1_scheduler" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
21 Thread 0x7f115303c700 (LWP 15975) "2_scheduler" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
20 Thread 0x7f1152d39700 (LWP 15976) "3_scheduler" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
* 19 Thread 0x7f1152f39700 (LWP 15977) "4_scheduler" erts_try_change_runq_proc (rq=<optimized out>, p=0x7f10ac9e1c38) at beam/erl_process.h:2347
18 Thread 0x7f1152e36700 (LWP 15978) "1_dirty_cpu_sch" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
17 Thread 0x7f1152de3700 (LWP 15979) "2_dirty_cpu_sch" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
16 Thread 0x7f1152d90700 (LWP 15980) "3_dirty_cpu_sch" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
15 Thread 0x7f11529ff700 (LWP 15981) "4_dirty_cpu_sch" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
14 Thread 0x7f11529ac700 (LWP 15982) "1_dirty_io_sche" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
13 Thread 0x7f1152959700 (LWP 15983) "2_dirty_io_sche" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
12 Thread 0x7f1152906700 (LWP 15984) "3_dirty_io_sche" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
11 Thread 0x7f11528b3700 (LWP 15985) "4_dirty_io_sche" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
10 Thread 0x7f1152860700 (LWP 15986) "5_dirty_io_sche" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
9 Thread 0x7f115280d700 (LWP 15987) "6_dirty_io_sche" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
8 Thread 0x7f11527ba700 (LWP 15988) "7_dirty_io_sche" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
7 Thread 0x7f1152767700 (LWP 15989) "8_dirty_io_sche" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
6 Thread 0x7f1152714700 (LWP 15990) "9_dirty_io_sche" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
5 Thread 0x7f11526c1700 (LWP 15991) "10_dirty_io_sch" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
4 Thread 0x7f115266e700 (LWP 15992) "aux" 0x00007f119c0e82cf in ppoll () from /lib64/libc.so.6
3 Thread 0x7f115261b700 (LWP 15993) "0_poller" 0x00007f119c0ed1c9 in syscall () from /lib64/libc.so.6
2 Thread 0x7f10d3fff700 (LWP 15998) "2_scheduler" 0x00007f119c0b9e2d in nanosleep () from /lib64/libc.so.6
1 Thread 0x7f119d541740 (LWP 15858) "beam.smp" 0x00007f119c0e9f73 in select () from /lib64/libc.so.6
--------------------------------------------------------------------------------
Full backtrace of the thread:
(gdb) backtrace
#0 erts_try_change_runq_proc (rq=<optimized out>, p=0x7f10ac9e1c38) at beam/erl_process.h:2347
#1 select_enqueue_run_queue (state=<optimized out>, p=0x7f10ac9e1c38, enq_prio=2, enqueue=-1) at beam/erl_process.c:6442
#2 add2runq (enqueue=-1, prio=2, proc=0x7f10ac9e1c38, state=<optimized out>, proxy=0x0) at beam/erl_process.c:6618
#3 0x000000000045d1dc in active_sys_enqueue (p=0x7f10ac9e1c38, sys_task=sys_task@REDACTED=0x7f115bec01a8, task_prio=2, enable_flags=1310720, enable_flags@REDACTED=262144, state=<optimized out>,
fail_state_p=fail_state_p@REDACTED=0x7f1152f38a00) at beam/erl_process.c:6899
#4 0x00000000004678ab in schedule_process_sys_task (p=p@REDACTED=0x7f10ac9e1c38, prio=<optimized out>, st=st@REDACTED=0x7f115bec01a8, fail_state_p=fail_state_p@REDACTED=0x7f1152f38a00) at beam/erl_process.c:6946
#5 0x00000000004679dc in schedule_generic_sys_task (pid=pid@REDACTED=60065118711107, type=type@REDACTED=ERTS_PSTT_PRIO_SIG, prio=prio@REDACTED=2, arg0=arg0@REDACTED=11, arg1=18446744073709551611)
at beam/erl_process.c:10845
#6 0x0000000000448717 in erts_sig_prio (pid=pid@REDACTED=60065118711107, prio=prio@REDACTED=2) at beam/erl_process.c:10869
#7 0x0000000000512f6c in maybe_elevate_sig_handling_prio (c_p=c_p@REDACTED=0x7f107088dda8, other=other@REDACTED=60065118711107) at beam/erl_proc_sig_queue.c:756
#8 0x0000000000516a4b in erts_proc_sig_send_process_info_request (c_p=c_p@REDACTED=0x7f107088dda8, to=to@REDACTED=60065118711107, item_ix=item_ix@REDACTED=0x7f1152f38b90, len=len@REDACTED=6,
need_msgq_len=need_msgq_len@REDACTED=8, flags=flags@REDACTED=58, reserve_size=38, ref=ref@REDACTED=139710117906410) at beam/erl_proc_sig_queue.c:1622
#9 0x00000000004b4877 in process_info_bif (c_p=<optimized out>, pid=<optimized out>, opt=<optimized out>, always_wrap=<optimized out>, pi2=<optimized out>) at beam/erl_bif_info.c:1262
#10 0x0000000000451246 in process_main (x_reg_array=0x7f115b90c300, f_reg_array=0x19ac55e42c2e0) at x86_64-unknown-linux-gnu/opt/smp/beam_cold.h:59
#11 0x000000000046570b in sched_thread_func (vesdp=0x7f1154221a80) at beam/erl_process.c:8469
#12 0x000000000067da6f in thr_wrapper (vtwd=<optimized out>) at pthread/ethread.c:118
#13 0x00007f119c5d1dd5 in start_thread () from /lib64/libpthread.so.0
#14 0x00007f119c0f2ead in clone () from /lib64/libc.so.6
(gdb) bt full
#0 ethr_native_atomic64_cmpxchg_mb (old=139712402563008, new=139712402562112, var=0x7f10ac9e1f68) at ../include/internal/x86_64/../i386/atomic.h:97
No locals.
#1 ethr_atomic_cmpxchg (old_val=139712402563008, val=139712402562112, var=0x7f10ac9e1f68) at ../include/internal/ethr_atomics.h:3495
No locals.
#2 erts_try_change_runq_proc (rq=<optimized out>, p=0x7f10ac9e1c38) at beam/erl_process.h:2344
new_rqint = 139712402562112
#3 select_enqueue_run_queue (state=<optimized out>, p=0x7f10ac9e1c38, enq_prio=2, enqueue=-1) at beam/erl_process.c:6442
bound = <optimized out>
#4 add2runq (enqueue=-1, prio=2, proc=0x7f10ac9e1c38, state=<optimized out>, proxy=0x0) at beam/erl_process.c:6618
No locals.
#5 0x000000000045d1dc in active_sys_enqueue (p=0x7f10ac9e1c38, sys_task=sys_task@REDACTED=0x7f115bec01a8, task_prio=2, enable_flags=1310720, enable_flags@REDACTED=262144, state=<optimized out>,
fail_state_p=fail_state_p@REDACTED=0x7f1152f38a00) at beam/erl_process.c:6899
runnable_procs = <optimized out>
n = 1852222
a = <optimized out>
enq_prio = <optimized out>
fail_state = <optimized out>
status_locked = 0
enqueue = <optimized out>
#6 0x00000000004678ab in schedule_process_sys_task (p=p@REDACTED=0x7f10ac9e1c38, prio=<optimized out>, st=st@REDACTED=0x7f115bec01a8, fail_state_p=fail_state_p@REDACTED=0x7f1152f38a00) at beam/erl_process.c:6946
fail_state = 1024
state = <optimized out>
#7 0x00000000004679dc in schedule_generic_sys_task (pid=pid@REDACTED=60065118711107, type=type@REDACTED=ERTS_PSTT_PRIO_SIG, prio=prio@REDACTED=2, arg0=arg0@REDACTED=11, arg1=18446744073709551611)
at beam/erl_process.c:10845
st = 0x7f115bec01a8
st_prio = <optimized out>
fail_state = 1024
res = 0
#8 0x0000000000448717 in erts_sig_prio (pid=pid@REDACTED=60065118711107, prio=prio@REDACTED=2) at beam/erl_process.c:10869
No locals.
#9 0x0000000000512f6c in maybe_elevate_sig_handling_prio (c_p=c_p@REDACTED=0x7f107088dda8, other=other@REDACTED=60065118711107) at beam/erl_proc_sig_queue.c:756
res = -1
my_prio = 2
#10 0x0000000000516a4b in erts_proc_sig_send_process_info_request (c_p=c_p@REDACTED=0x7f107088dda8, to=to@REDACTED=60065118711107, item_ix=item_ix@REDACTED=0x7f1152f38b90, len=len@REDACTED=6,
need_msgq_len=need_msgq_len@REDACTED=8, flags=flags@REDACTED=58, reserve_size=38, ref=ref@REDACTED=139710117906410) at beam/erl_proc_sig_queue.c:1622
size = 164
res = 1
#11 0x00000000004b4877 in process_info_bif (c_p=<optimized out>, pid=<optimized out>, opt=<optimized out>, always_wrap=<optimized out>, pi2=<optimized out>) at beam/erl_bif_info.c:1262
ref = 139710117906410
enqueued = <optimized out>
need_msgq_len = 8
hfact = {mode = FACTORY_HALLOC, p = 0x7f1154201fc0, hp_start = 0xa300004, hp = 0x45ea72 <erts_schedule+2018>, hp_end = 0x1, message = 0x7f1154201fc8, heap_frags = 0x0, heap_frags_saved = 0x0,
heap_frags_saved_used = 17179869184001, off_heap = 0xa300004, off_heap_saved = {first = 0x7f1100008000, overhead = 4292870143}, alloc_type = 1391692720}
def_arr = {0, 2, 14, 17, 1, 5, 6024601, 0, 59910469, 3840, 1411521432, 32529, 41002, 32528, -2075412328, 32528, 0, 32529, -2075412328, 32528, 2, 0, 5353214, 0, 1604397112, 32528, 3891, 0,
3145791, 0, 6072834, 0, 42, 0, 0, 0}
item_ix = 0x7f1152f38b90
rp = 0x0
state = 1539880576
ret = <optimized out>
reds = 0
locks = 1
flags = 58
reserve_size = <optimized out>
len = 6
res = <optimized out>
#12 0x0000000000451246 in process_main (x_reg_array=0x7f115b90c300, f_reg_array=0x19ac55e42c2e0) at x86_64-unknown-linux-gnu/opt/smp/beam_cold.h:59
bif_nif_arity = 2
live_hf_end = 0x0
nif_bif_result = 139712403967904
init_done = 1
c_p = 0x7f107088dda8
reds_used = 4526578
reg = 0x7f115b90c300
E = 0x2
I = 0x7f1154358fa0
FCALLS = 0
opcodes = {0x44ef8b <process_main+699>, 0x45039e <process_main+5838>, 0x4537de <process_main+19214>, 0x45075c <process_main+6796>, 0x44f826 <process_main+2902>, 0x450d8f <process_main+8383>,
0x4511f2 <process_main+9506>, 0x45373c <process_main+19052>, 0x456e99 <process_main+33225>, 0x45995a <process_main+44170>, 0x452827 <process_main+15191>, 0x4513ce <process_main+9982>,
0x452a74 <process_main+15780>, 0x452b4b <process_main+15995>, 0x45336d <process_main+18077>, 0x4533a6 <process_main+18134>, 0x457e4b <process_main+37243>, 0x4583da <process_main+38666>,
0x45a325 <process_main+46677>, 0x4533cc <process_main+18172>, 0x4533f4 <process_main+18212>, 0x4528a7 <process_main+15319>, 0x44f994 <process_main+3268>, 0x453d31 <process_main+20577>,
0x453c9f <process_main+20431>, 0x459978 <process_main+44200>, 0x450ae1 <process_main+7697>, 0x450d61 <process_main+8337>, 0x45934e <process_main+42622>, 0x4571dd <process_main+34061>,
0x44edd2 <process_main+258>, 0x4571fc <process_main+34092>, 0x453d75 <process_main+20645>, 0x45159a <process_main+10442>, 0x45020e <process_main+5438>, 0x459734 <process_main+43620>,
0x451672 <process_main+10658>, 0x44ff2e <process_main+4702>, 0x453495 <process_main+18373>, 0x452e3c <process_main+16748>, 0x45a27a <process_main+46506>, 0x44f93c <process_main+3180>,
0x44f0b4 <process_main+996>, 0x452f31 <process_main+16993>, 0x452143 <process_main+13427>, 0x44f0d9 <process_main+1033>, 0x4524be <process_main+14318>, 0x452028 <process_main+13144>,
0x45138e <process_main+9918>, 0x452174 <process_main+13476>, 0x4507bf <process_main+6895>, 0x452f60 <process_main+17040>, 0x452fa0 <process_main+17104>, 0x45300c <process_main+17212>,
0x45a12c <process_main+46172>, 0x450156 <process_main+5254>, 0x452fe2 <process_main+17170>, 0x45304e <process_main+17278>, 0x45a170 <process_main+46240>, 0x457243 <process_main+34163>,
0x45a1dd <process_main+46349>, 0x45a22a <process_main+46426>, 0x456b1b <process_main+32331>, 0x456bc3 <process_main+32499>, 0x459d3e <process_main+45166>, 0x451f3c <process_main+12908>,
0x45a422 <process_main+46930>, 0x45a480 <process_main+47024>, 0x4530b9 <process_main+17385>, 0x453110 <process_main+17472>, 0x45a395 <process_main+46789>, 0x451e3a <process_main+12650>,
0x453077 <process_main+17319>, 0x453af5 <process_main+20005>, 0x451e8c <process_main+12732>, 0x451b23 <process_main+11859>, 0x453f22 <process_main+21074>, 0x453fa8 <process_main+21208>,
0x4543d4 <process_main+22276>, 0x4532c3 <process_main+17907>, 0x458cb3 <process_main+40931>, 0x458438 <process_main+38760>, 0x4585e7 <process_main+39191>, 0x458487 <process_main+38839>,
0x453175 <process_main+17573>, 0x45459a <process_main+22730>, 0x45446a <process_main+22426>, 0x454605 <process_main+22837>, 0x458acd <process_main+40445>, 0x459921 <process_main+44113>,
0x453b9f <process_main+20175>, 0x45881b <process_main+39755>, 0x45a71e <process_main+47694>, 0x45a72c <process_main+47708>, 0x4589cb <process_main+40187>, 0x45965b <process_main+43403>,
0x454615 <process_main+22853>, 0x45880c <process_main+39740>, 0x4594e0 <process_main+43024>, 0x454553 <process_main+22659>, 0x4534be <process_main+18414>, 0x453549 <process_main+18553>,
0x458ecc <process_main+41468>, 0x4535b6 <process_main+18662>, 0x4535df <process_main+18703>, 0x454249 <process_main+21881>, 0x4599fb <process_main+44331>, 0x458d36 <process_main+41062>,
0x45455f <process_main+22671>, 0x454527 <process_main+22615>, 0x45458f <process_main+22719>, 0x458dfe <process_main+41262>, 0x458e4f <process_main+41343>, 0x456d95 <process_main+32965>,
0x45a5e0 <process_main+47376>, 0x44fc76 <process_main+4006>, 0x44ff56 <process_main+4742>, 0x458b54 <process_main+40580>, 0x44eda3 <process_main+211>, 0x44fb09 <process_main+3641>,
0x451a18 <process_main+11592>, 0x44fdf0 <process_main+4384>, 0x4512be <process_main+9710>, 0x451ab4 <process_main+11748>, 0x44f6d1 <process_main+2561>, 0x44ee4e <process_main+382>,
0x457251 <process_main+34177>, 0x44fb78 <process_main+3752>, 0x4540f3 <process_main+21539>, 0x45033d <process_main+5741>, 0x451a55 <process_main+11653>, 0x4540e6 <process_main+21526>,
0x450edf <process_main+8719>, 0x4510aa <process_main+9178>, 0x45adbb <process_main+49387>, 0x4516bc <process_main+10732>, 0x4531ff <process_main+17711>, 0x45042f <process_main+5983>,
0x4577f2 <process_main+35618>, 0x459099 <process_main+41929>, 0x456a32 <process_main+32098>, 0x452e66 <process_main+16790>, 0x452ee7 <process_main+16919>, 0x4520c2 <process_main+13298>,
0x459055 <process_main+41861>, 0x458fa7 <process_main+41687>, 0x458fe8 <process_main+41752>, 0x453ab0 <process_main+19936>, 0x459389 <process_main+42681>, 0x454665 <process_main+22933>,
0x4593fd <process_main+42797>, 0x4541b8 <process_main+21736>, 0x459554 <process_main+43140>, 0x4546ea <process_main+23066>, 0x459518 <process_main+43080>, 0x452bfd <process_main+16173>,
0x44f0ff <process_main+1071>, 0x450310 <process_main+5696>, 0x451d5c <process_main+12428>, 0x453c71 <process_main+20385>, 0x450648 <process_main+6520>, 0x4515e6 <process_main+10518>,
0x4503ed <process_main+5917>, 0x456a95 <process_main+32197>, 0x44ee92 <process_main+450>, 0x4500dc <process_main+5132>, 0x44f496 <process_main+1990>, 0x452b69 <process_main+16025>,
0x44ffd0 <process_main+4864>, 0x44f08f <process_main+959>, 0x44f704 <process_main+2612>, 0x452e1b <process_main+16715>, 0x451c3d <process_main+12141>, 0x4540a4 <process_main+21460>,
0x44feb1 <process_main+4577>, 0x4542cb <process_main+22011>, 0x451003 <process_main+9011>, 0x45a2bb <process_main+46571>, 0x451029 <process_main+9049>, 0x45a414 <process_main+46916>,
0x450985 <process_main+7349>, 0x4596a9 <process_main+43481>, 0x44ef26 <process_main+598>, 0x45a793 <process_main+47811>, 0x45162f <process_main+10591>, 0x4505ba <process_main+6378>,
0x450906 <process_main+7222>, 0x450d23 <process_main+8275>, 0x453d7a <process_main+20650>, 0x453db7 <process_main+20711>, 0x45a9ba <process_main+48362>, 0x4541fc <process_main+21804>,
0x45a8d0 <process_main+48128>, 0x45aaff <process_main+48687>, 0x45a943 <process_main+48243>, 0x45920b <process_main+42299>, 0x453609 <process_main+18745>, 0x4529d4 <process_main+15620>,
0x456fc6 <process_main+33526>, 0x44fa7e <process_main+3502>...}
#13 0x000000000046570b in sched_thread_func (vesdp=0x7f1154221a80) at beam/erl_process.c:8469
callbacks = {arg = 0x7f11542028c0, wakeup = 0x466450 <thr_prgr_wakeup>, prepare_wait = 0x465000 <thr_prgr_prep_wait>, wait = 0x4657d0 <thr_prgr_wait>,
finalize_wait = 0x464fe0 <thr_prgr_fin_wait>}
esdp = 0x7f1154221a80
no = 4
#14 0x000000000067da6f in thr_wrapper (vtwd=<optimized out>) at pthread/ethread.c:118
result = 0
c = 0 '\000'
res = <optimized out>
twd = <optimized out>
thr_func = 0x4655b0 <sched_thread_func>
arg = 0x7f1154221a80
tsep = 0x7f115b140100
#15 0x00007f119c5d1dd5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#16 0x00007f119c0f2ead in clone () from /lib64/libc.so.6
No symbol table info available.
--------------------------------------------------------------------------------
Loop steps:
(gdb) ni
0x000000000045cfb7 97 in ../include/internal/x86_64/../i386/atomic.h
(gdb) ni
erts_try_change_runq_proc (rq=<optimized out>, p=0x7f10ac9e1c38) at beam/erl_process.h:2347
2347 beam/erl_process.h: No such file or directory.
(gdb)
0x000000000045cfbf 2347 in beam/erl_process.h
(gdb)
ethr_native_atomic64_cmpxchg_mb (old=139712402563008, new=139712402562112, var=0x7f10ac9e1f68) at ../include/internal/x86_64/../i386/atomic.h:97
97 ../include/internal/x86_64/../i386/atomic.h: No such file or directory.
(gdb)
0x000000000045cfb7 97 in ../include/internal/x86_64/../i386/atomic.h
(gdb)
erts_try_change_runq_proc (rq=<optimized out>, p=0x7f10ac9e1c38) at beam/erl_process.h:2347
2347 beam/erl_process.h: No such file or directory.
--------------------------------------------------------------------------------
Variable states:
(gdb)
ethr_native_atomic64_cmpxchg_mb (old=139712402563008, new=139712402562112, var=0x7f10ac9e1f68) at ../include/internal/x86_64/../i386/atomic.h:97
97 ../include/internal/x86_64/../i386/atomic.h: No such file or directory.
(gdb) p *var
$1 = {counter = 139712402562112}
Process state:
(gdb) p p
$3 = (Process *) 0x7f10ac9e1c38
(gdb) p *p
$4 = {common = {id = 60065118711107, refc = {atmc = {counter = 2}, sint = 2}, tracer = 18446744073709551611, trace_flags = 0, timer = {counter = 0}, u = {alive = {started_interval = 28353, reg = 0x0,
links = 0x7f10ac989a20, monitors = 0x7f10ac7d55d8, lt_monitors = 0x7f10aca17880}, release = {later = 28353, func = 0x0, data = 0x7f10ac989a20, next = 0x7f10ac7d55d8}}}, htop = 0x7f1075d6c3d8,
stop = 0x7f1075d6c3d8, heap = 0x7f1075d6a1b8, hend = 0x7f1075d6c3d8, abandoned_heap = 0x0, heap_sz = 1092, min_heap_size = 233, min_vheap_size = 46422, max_heap_size = 3, fp_exception = 0, hipe = {
nsp = 0x0, nstack = 0x0, nstend = 0x0, u = {ncallee = 0x0, closure = 0, callee_exp = 0x0}, nstgraylim = 0x0, nstblacklim = 0x0, ngra = 0x0, ncsp = 0x0, narity = 0, float_result = 0}, arity = 3,
arg_reg = 0x7f10ac9e1d40, max_arg_reg = 6, def_arg_reg = {145163, 305995, 139708673204713, 0, 0, 4000}, cp = 0x9773d8 <beam_apply+8>, i = 0x9773d0 <beam_apply>, catches = 0, fcalls = 3879, rcount = 0,
schedule_count = 7, reds = 135085, group_leader = 49409303796195, flags = 33562624, fvalue = 18446744073709551611, freason = 10, ftrace = 139708673204729, next = 0x0, sig_qs = {first = 0x0,
last = 0x7f10ac9e1dd0, save = 0x7f10ac9e1dd0, cont = 0x0, cont_last = 0x7f10ac9e1de8, nmsigs = {next = 0x0, last = 0x0}, saved_last = 0x0, len = 0}, bif_timers = 0x7f10ac256fe8,
dictionary = 0x7f10ba141e38, seq_trace_clock = 0, seq_trace_lastcnt = 0, seq_trace_token = 18446744073709551611, u = {terminate = 0x2370b, initial = {module = 145163, function = 305739, arity = 5}},
current = 0x7f1154364338, parent = 51642686791155, static_flags = 0, high_water = 0x7f1075d6c3d8, old_hend = 0x0, old_htop = 0x0, old_heap = 0x0, gen_gcs = 9, max_gen_gcs = 65535, off_heap = {
first = 0x7f1075d6b838, overhead = 36}, mbuf = 0x0, live_hf_end = 0xfffffffffffffff8, msg_frag = 0x0, mbuf_sz = 0, psd = {counter = 0}, bin_vheap_sz = 46422, bin_old_vheap_sz = 46422,
bin_old_vheap = 0, sys_task_qs = 0x0, dirty_sys_tasks = 0x0, state = {counter = 319}, dirty_state = {counter = 0}, sig_inq = {first = 0x0, last = 0x7f10ac9e1f00, len = 0, nmsigs = {next = 0x0,
last = 0x0}}, trace_msg_q = 0x0, lock = {flags = {counter = 0}, queue = {0x0, 0x0, 0x0, 0x0, 0x0}}, scheduler_data = 0x0, run_queue = {counter = 139712402562112}}
More information about the erlang-questions
mailing list