<html><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">I'm not sure what's "non-standard" about what the OP is trying to do. A select on a properly indexed key should be quite fast on any database system you choose. I have to assume that he doesn't have his schema set up properly.<div><br></div><div><br></div><div>-k</div><div><br></div><div><br><div><div>On Feb 17, 2009, at 1:27 PM, lenz wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite"><span class="Apple-style-span" style="border-collapse: collapse; font-family: verdana; ">hi,<div style="font-family: verdana, geneva, kalimati, sans-serif !important; "><br style="font-family: verdana, geneva, kalimati, sans-serif !important; "> </div><div style="font-family: verdana, geneva, kalimati, sans-serif !important; ">searching for solutions to this type of problem is a challenge and there are many ways to solve it. give this site (<a href="http://highscalability.com" target="_blank" style="font-family: verdana, geneva, kalimati, sans-serif !important; color: rgb(42, 93, 176); ">http://highscalability.com</a>) a thorough read and you might find something.</div> <div style="font-family: verdana, geneva, kalimati, sans-serif !important; ">again, i am with jan, try CouchDB and it might pay off to use a unix based machine for stuff like that. i think you are trying to trick your OS to do things it is not meant for. not going into flame wars about windows here but a basic linux setup is really done in no time and gives you way more control for an application that is "non standard" :-)</div> <div style="font-family: verdana, geneva, kalimati, sans-serif !important; "><br style="font-family: verdana, geneva, kalimati, sans-serif !important; "></div><div style="font-family: verdana, geneva, kalimati, sans-serif !important; "> cheers</div><div style="font-family: verdana, geneva, kalimati, sans-serif !important; ">lenz</div></span><br><div class="gmail_quote">On Wed, Feb 18, 2009 at 10:26 AM, lenz <span dir="ltr"><<a href="mailto:norbu09@googlemail.com">norbu09@googlemail.com</a>></span> wrote:<br> <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;">hi,<div><br></div><div>searching for solutions to this type of problem is a challenge and there are many ways to solve it. give this site (<a href="http://highscalability.com" target="_blank">http://highscalability.com</a>) a thorough read and you might find something.</div> <div>again, i am with jan, try CouchDB and it might pay off to use a unix based machine for stuff like that. i think you are trying to trick your OS to do things it is not meant for. not going into flame wars about windows here but a basic linux setup is really done in no time and gives you way more control for an application that is "non standard" :-)</div> <div><br></div><div>cheers</div><div>lenz</div><div><div><div></div><div class="Wj3C7c"><br><div class="gmail_quote">On Wed, Feb 18, 2009 at 7:42 AM, Joe Armstrong <span dir="ltr"><<a href="mailto:erlang@gmail.com" target="_blank">erlang@gmail.com</a>></span> wrote:<br> <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">What are the types of the keys and records? Is there are systematic structure in<br> the keys? are the records fixed or variable lengths? How about using a SSD?<br> <br> /Joe Armstrong<br> <br> <br> 2009/2/17 Scott Zhang <<a href="mailto:getyourcontacts@gmail.com" target="_blank">getyourcontacts@gmail.com</a>>:<br> <div><div></div><div>> Hi.<br> ><br> > I opened a question about mnesia days ago. Now I am facing another question.<br> ><br> > I am going to scrape large amount of data and put them into database.<br> > Previously, my program was written in .NET/C# and saved the records into<br> > SqlServer, after 10 days running, I have 63M records in database which make<br> > SqlServer really slow, select single record need more than 1 minute which is<br> > unacceptable.<br> ><br> > And days ago, I tried to save 7M records in mnesia with table type=<br> > disc_only_copies. I tested , select single one from that talbe need more<br> > than 20 seconds which is unacceptable too. ( I don't want to conclude<br> > mnesia's performance is worse than SqlServer.)<br> ><br> > Lenz suggested me to use couchDB, just checked, couchDB depends on too much<br> > things and these depends make it hard to configure on window system.<br> ><br> > So here, does anyone has a good suggestion for a database can fit 63M(this<br> > time may get 2billion) and select one node within 1 sec?<br> ><br> > Thanks.<br> ><br> > Regards.<br> ><br> > Scott<br> ><br> </div></div><div><div></div><div>> _______________________________________________<br> > erlang-questions mailing list<br> > <a href="mailto:erlang-questions@erlang.org" target="_blank">erlang-questions@erlang.org</a><br> > <a href="http://www.erlang.org/mailman/listinfo/erlang-questions" target="_blank">http://www.erlang.org/mailman/listinfo/erlang-questions</a><br> ><br> _______________________________________________<br> erlang-questions mailing list<br> <a href="mailto:erlang-questions@erlang.org" target="_blank">erlang-questions@erlang.org</a><br> <a href="http://www.erlang.org/mailman/listinfo/erlang-questions" target="_blank">http://www.erlang.org/mailman/listinfo/erlang-questions</a><br> </div></div></blockquote></div><br><br clear="all"><br></div></div>-- <br>iWantMyName.com<br>painless domain registration (finally)<br> </div> </blockquote></div><br><br clear="all"><br>-- <br>iWantMyName.com<br>painless domain registration (finally)<br> _______________________________________________<br>erlang-questions mailing list<br><a href="mailto:erlang-questions@erlang.org">erlang-questions@erlang.org</a><br>http://www.erlang.org/mailman/listinfo/erlang-questions</blockquote></div><br></div></body></html>