[erlang-questions] FIFO queue

[Richard Jonas]

Hi Roberto,

when we needed to implement something like that I stole the idea from Joe's
repo (fast term storage), which is simply a raw (processless) binary file
with buffer.
https://github.com/joearms/elib1/blob/master/src/elib1_fast_write.erl
So you can implement something custom if you like. Also there is a good
opportunity for using quickcheck. :)

For enterprise ready solutions consider integrate bitcask:
https://github.com/basho/bitcask
I have never done that, but it is proven solution.

Richard


On Wed, Jun 8, 2016 at 5:59 PM, <dmkolesnikov@REDACTED> wrote:

> Hello,
>
> You can look on my project, see branch on-disk-overflow. This is most
> recent best effort queue I am using in prod (optimized for read/write)
>
> https://github.com/fogfish/esq
>
> -Dmitry
> Sent from my iPhone
>
> On 08 Jun 2016, at 18:19, Roberto Ostinelli <roberto@REDACTED> wrote:
>
> To be a little more extensive: I'm familiar with the queue module, but
> it'd need an additional layer to write stuff to disk.
>
> Therefore, I'm currently considering using an ordered_set mnesia table,
> with os:timestamp() values as the primary key.
>
> Just wanted to avoid reinventing the wheel, so if something is out
> there... please let me know.
>
> Best,
> r.
>
>
>
> On Wed, Jun 8, 2016 at 5:15 PM, Roberto Ostinelli <roberto@REDACTED>
> wrote:
>
>> Dear list,
>> I need to use a FIFO queue in Erlang, disk-backed.
>>
>> Additions to the queue can be quite heavy (3000 / sec), so it's a write
>> intensive operation.
>>
>> Any ideas on best practices?
>>
>> Thank you ^^_
>> r.
>>
>
> _______________________________________________
> erlang-questions mailing list
> erlang-questions@REDACTED
> http://erlang.org/mailman/listinfo/erlang-questions
>
>
> _______________________________________________
> erlang-questions mailing list
> erlang-questions@REDACTED
> http://erlang.org/mailman/listinfo/erlang-questions
>
>


-- 
Richard Jonas
Erlang Solutions Hungary Kft

Address:
  Riverpark Office K.32
  Közraktár street 32. 3/1.
  1093 Budapest
  Hungary
Phone/fax:
  +36-1-7000-654
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://erlang.org/pipermail/erlang-questions/attachments/20160609/595e5e20/attachment.htm>