[erlang-questions] gen_tcp receive extremely high CPU

[Dmitry Belyaev]

Hi, Anita.

Could you tell us the value of CLIENTHEARTBEATSIZE macro? And why do you set the buffer socket option?

-- 
Dmitry Belyaev


On 12.10.2012, at 11:48, Anita Wong wrote:

> Hi All,
> 
> Sorry that I'm an Erlang newbie and may make stupid question. But please help me to solve the issue.
> 
> I have written an Erlang server to replace the one I'm using with Node.js, which ate all my memory and I'm praying that Erlang could be a way out.
> The server works properly under unit test and internal testing, but face a high CPU usage in stress test.
> 
> After trimming down, I found that the CPU burst was due to the TCP receive from clients.
> receiveClientPacket(Sock) ->
>   inet:setopts(Sock, [{active, once}, {buffer, ?CLIENTHEARTBEATSIZE}]),
>   receive
>     {tcp, Sock, Data} ->
>       {ok, Data};
>     {tcp_closed, Sock} ->
>       {error, closed}
>     after ?CLIENTRECCEIVETIMEOUT ->
>       {error, timeout}
>   end.
> 
> I tried making the process sleep for 10 hours at the beginning of the function (to prevent it from calling receive), the CPU didn't burst at all.
> Therefore I conclude that the burst of CPU is due to TCP receive. (Please correct me if I made any mistake)
> 
> Here are information about my stress test:
> start the Erlang server with:
> erl +zdbbl 2097151 -K true +A 128 +P 5000000
> connect 5000 clients to the Erlang server
> each connected client sends a 2 byte data to the server every 1 min
> after all the connections is done, (i.e. only the 2 byte data per min are performing), the CPU burst to ~30%sy (from "top")
> 
> I'm using an Amazon Linux AMI (large instance, 64-bit) for the Erlang server. Is the burst due to the linux? As I have no idea how the system will use up the CPU. Or is it my poor code's problem? (I believe so...)
> 
> In real situation, our servers don't only receive ping pong, but also messages, which is a lot more loading... This is only the first step...
> 
> Millions of thanks to anyone who can save me.
> 
> Anita~*
> 
> ~~~~~~~~~~~~~~~~~~~~~~~
> 
> Information about large instance (for reference):
> 7.5 GB memory
> 4 EC2 Compute Units (2 virtual cores with 2 EC2 Compute Units each)
> 850 GB instance storage
> 64-bit platform
> I/O Performance: High
> _______________________________________________
> erlang-questions mailing list
> erlang-questions@REDACTED
> http://erlang.org/mailman/listinfo/erlang-questions

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://erlang.org/pipermail/erlang-questions/attachments/20121012/c45a7b5e/attachment.htm>