[erlang-questions] Send VM metrics to Grafana

[Anthony Molinaro]

I haven't done it, but isn't there a gen_event behind the error_logger you can somehow tap into to collect this?

-Anthony

> On Feb 24, 2017, at 9:18 AM, Siraaj Khandkar <siraaj@REDACTED> wrote:
> 
>> On 2/20/17 11:26 PM, Jack Tang wrote:
>> We try to integrate the metrics to our grafana monitoring by adding
>> infuxdb consumer. Thanks Siraaj.
> 
> The pleasure is all mine, Jack. Let me know if you have any problems/questions/ideas.
> 
>> BTW: Did somebody collect the crash metrics, like the count of crashed
>> process, the restart count of the process and etc?
> 
> I haven't come across it before, but it sounds like a great idea.
> 
> Off the top of my head I can't think of a general and direct way to collect that without instrumenting a supervisor (either by patching stdlib or user app).
> 
> Any ideas?
> 
> The only thing that comes to mind right now is snapshotting PIDs at each collection and tracking the duration of each uptime, then we can compute whatever statistical summaries on current uptimes (e.g. if something starts to crash too-often/too-soon it'll reduce the expected/normal min, med, avg, etc.). There're certainly problems with this approach, since it'd be just an approximation, but it doesn't sound terribly unreasonable to me right now.
> 
> More thoughts?
> 
> 
>> On Sat, Feb 11, 2017 at 2:01 AM, Siraaj Khandkar <siraaj@REDACTED
>> <mailto:siraaj@REDACTED>> wrote:
>> 
>>    My biased preference is:
>> 
>>    https://github.com/ibnfirnas/beam_stats
>>    <https://github.com/ibnfirnas/beam_stats>
>> 
>>    It's concern is only with sampling VM metrics and shipping them off
>>    to arbitrary destinations (Folsomite was Graphite-only, the last
>>    time I checked). Graphite and StatsD consumer modules are included.
>>    StatsD is the one we use in prod now.
>> 
>>    It's been running in prod for 1.5 years now, and even though it
>>    wasn't originally the main motivation, my favorite feature
>>    turned-out to be the sampling of individual processes and ETS
>>    tables, which was a life-saver in tracking down multiple memory
>>    leaks in the legacy system I inherited.
>> 
>> 
>> 
>>    On 2/9/17 4:06 AM, Frank Muller wrote:
>> 
>>        Hi everyone,
>> 
>>        Does anyone succeeded to push VM metrics to Grafana
>>        (http://grafana.org/).
>> 
>>        Here I'm looking for a simple integration with minimal
>>        dependencies if
>>        possible.
>> 
>>        Thank you.
>>        /Frank
>> 
>>    _______________________________________________
>>    erlang-questions mailing list
>>    erlang-questions@REDACTED <mailto:erlang-questions@REDACTED>
>>    http://erlang.org/mailman/listinfo/erlang-questions
>>    <http://erlang.org/mailman/listinfo/erlang-questions>
>> 
>> 
>> 
>> 
>> --
>> Jack Tang
>> 
>> 
>> http://www.linkedin.com/in/jacktang
> _______________________________________________
> erlang-questions mailing list
> erlang-questions@REDACTED
> http://erlang.org/mailman/listinfo/erlang-questions