Billion-triple store

[Claes Wikstrom]

Hakan Mattsson wrote:

> 
> Storing a billion records in a single dets file does
> not feel so appealing. The repair time of such a file
> would probably be loooooong.
>

Yes, but so would the corresponding disaster recovery
be for other databases as well. Unless beam coredumps,
there is a kernel panic or power failure, the dets file
should never have to be repaired. Even then, the dets file
mau very well be closed due to the autoclosing code in dets.

The real limit is that that the size of dets files is limited.
dets internally use 32 bit offsets, thus limiting the filesize
to 4G (or possibly less ??)
The obvious remedy is to hack dets to use 64 bit offsets instead.
Easy.

B.t.w, what is the time to repair a max size dets file ? anyone
knows ?

/klacke

-- 
Claes Wikstrom                        -- Caps lock is nowhere and
http://www.hyber.org                  -- everything is under control
cellphone: +46 70 2097763