[erlang-questions] What database can I use with erlang to store 100M records and select single one in 0.1s

[Scott Zhang]

Thanks. Sergej.

I think you're right. As the question turn into a database optimization
question, I found, at last, the complex/dirty work left database and reply
on our programmers again.  I am doing research at the meanwhile.

Thanks for your suggestion.

Regards.

Scott

2009/2/18 Rapsey <rapsey@REDACTED>

> I hope this does not sound too rude, but what you're asking is a database
> optimization question that does not really have much to do with Erlang. I'm
> sure there is a ton of information out there on how to efficiently save a
> large amount of data in a DB. Figure that out first, then bother with
> Erlang.
>
>
> Sergej
>
> 2009/2/17 Scott Zhang <getyourcontacts@REDACTED>
>
>> Hi.
>>
>> I opened a question about mnesia days ago. Now I am facing another
>> question.
>>
>> I am going to scrape large amount of data and put them into database.
>> Previously, my program was written in .NET/C# and saved the records into
>> SqlServer, after 10 days running, I have 63M records in database which make
>> SqlServer really slow, select single record need more than 1 minute which is
>> unacceptable.
>>
>> And days ago, I tried to save 7M records in mnesia with table type=
>> disc_only_copies. I tested , select single one from that talbe need more
>> than 20 seconds which is unacceptable too. ( I don't want to conclude
>> mnesia's performance is worse than SqlServer.)
>>
>> Lenz suggested me to use couchDB, just checked, couchDB depends on too
>> much things and these depends make it hard to configure on window system.
>>
>> So here, does anyone has a good suggestion for a database can fit 63M(this
>> time may get 2billion) and select one node within 1 sec?
>>
>> Thanks.
>>
>> Regards.
>>
>> Scott
>>
>> _______________________________________________
>> erlang-questions mailing list
>> erlang-questions@REDACTED
>> http://www.erlang.org/mailman/listinfo/erlang-questions
>>
>
>
> _______________________________________________
> erlang-questions mailing list
> erlang-questions@REDACTED
> http://www.erlang.org/mailman/listinfo/erlang-questions
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://erlang.org/pipermail/erlang-questions/attachments/20090218/8e93a6ff/attachment.htm>