Billion-triple store

Leif Johansson leifj@REDACTED
Fri May 12 21:59:59 CEST 2006


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1


> I have done a couple of experiments with a totally brain-dead (probably)
> schema on a single node with {n_fragments, 1000}. I can insert ~250k
> statements at a sustained rate of ~2300 statements per second using
> disk-copies of everything and a transaction per statement. The resulting
> mnesia disk db is ~55M from a 25M n3 file turned into erlang statements
> using perl :-)
> 
> Stay tuned...
> 
> 	Cheers Leif

I created a new schema which reduces the database size at the price of
a ~40-50% reduction in insertion speed. I have only tried small graphs
of about 100k - 1M triples. At these sizes I get ~1500 insertions per
second sustained on my P4 mobile laptop. The resulting mnesia db using
100 frags for the two tables is ~ 110M in size.

I am going to setup a bigger test now...

	Cheers Leif
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.2 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQFEZOk/8Jx8FtbMZncRAreyAKCvlH2boOM7Z8JEku9rn5gIA2c09gCfVwoV
NjmuROk1toViWSS02jCAr/I=
=mbJT
-----END PGP SIGNATURE-----



More information about the erlang-questions mailing list