[erlang-questions] Amazon S3 and SQS implemenation in Erlang

ERLANG <>
Tue Aug 12 14:15:45 CEST 2008


Le 12 août 08 à 13:38, Jan Lehnardt a écrit :

>
> On Aug 12, 2008, at 13:32 , ERLANG wrote:
>
>> Hi Jan,
>>
>> Like CouchDB's introduction pointed, it's not a reliable DB like S3.
>
> Reliable is a bendable term. You can certainly make CouchDB reliable  
> with not
> too much effort.
>

By reliable, I mean performant storage engine which offers data  
replication, and distribution on
multiple nodes as S3 supports.

Our data are important, and very expensive to re-compute, so we can't  
use anything "unreliable"
to save them. Actually, we want to move from S3 to something free and  
well designed.


>> What I'm looking after is a free, simple, and reliable (with  
>> replication suport) library to store large
>> number (thousands to million) of very big files (>1gb per file) on  
>> secondary storage.
>
> CouchDB does have replication and it can store large numbers of big  
> files.
>
> Feel free to send more questions along my way. If it turns out that  
> CouchDB
> doesn't solve your problem, I don't want to push it onto you :)
>

I'll have a deeper look to CouchDB.

Thanks for all guys.

cheers
Y.

>
>> Scalaris project is a right candidate but too big in my opinion.
>> I'm simply looking for something simple.
>
> The not-yet available permanent storage would rule out Scalaris for  
> me. I just
> don't have that much RAM (just teasing, I love Scalaris :)
>
> Cheers
> Jan
> --
>
>
>>
>>
>> Anyway, many thanks.
>>
>> cheers
>> Y.
>>
>> Le 12 août 08 à 13:16, Jan Lehnardt a écrit :
>>
>>>
>>> On Aug 12, 2008, at 12:38 , ERLANG wrote:
>>>> RappidMQ will do the job for SQS.
>>>> I've to find something like S3 now ;-)
>>>
>>> How about CouchDB (http://couchdb.org/) as an	 approximation?
>>>
>>> Cheers
>>> Jan
>>> --
>>>
>>>>
>>>>
>>>> N.B: I don't need exact clones and anything similar will be OK  
>>>> for the
>>>> task I've to implement
>>>>
>>>> cheers
>>>> Y.
>>>>
>>>> Le 12 août 08 à 12:20, Tim Fletcher a écrit :
>>>>
>>>>>> Thanks for the pointer. Unfortunatly, I'm not interested by a  
>>>>>> client
>>>>>> interfaces but by a real implementation of Amazon's SQS and S3
>>>>>> concepts in Erlang.
>>>>>
>>>>> Sorry :) AFAIK there is nothing like that yet. Would RabbitMQ do  
>>>>> what
>>>>> you need (instead of SQS), or are you looking for an *exact*  
>>>>> clone of
>>>>> the Amazon API?
>>>>> _______________________________________________
>>>>> erlang-questions mailing list
>>>>> 
>>>>> http://www.erlang.org/mailman/listinfo/erlang-questions
>>>>
>>>> _______________________________________________
>>>> erlang-questions mailing list
>>>> 
>>>> http://www.erlang.org/mailman/listinfo/erlang-questions
>>>>
>>>
>>
>>
>




More information about the erlang-questions mailing list