[erlang-questions] disk merging

Dale Harvey <>
Thu Oct 25 23:28:16 CEST 2007


Actually

http://blog.diginux.net/2007/04/03/writing-a-duplicate-file-finder-in-erlang/

would be a better link, it has the source attached

On 25/10/2007, Dale Harvey <> wrote:
>
> I actually read a recent article on planet erlang about locating duplicate
> files
> that has some information that might help
>
>
> http://planeterlang.org/story.php?title=Writing_a_duplicate_file_finder_in_Erlang
>
> On 25/10/2007, Linan Wang < > wrote:
> >
> > Interesting problem.
> > It appears to me like a svn/cvs/git related problem. I think the core
> > is to merge indices. Have a look at git, in my memory it has such kind
> > of function.
> > Hopefully Time Machine will solve this kind of problems.
> >
> > On 25/10/2007, Joe Armstrong < > wrote:
> > > I have an interesting? problem.
> > >
> > > Over the last ? years (> 10) I have been upgrading my home system
> > > this usually involved buying a bigger disk and copying most (or all)
> > > of the files
> > > from the old disk to the new disk or disks.
> > >
> > > I've also been backing up the family photos etc on USB disks.
> > >
> > > Now I have > 1 Tera bytes of files spread over c. 10 computers and
> > > 3 pluggable USB disks. Having made a "backup" both the original and
> > the
> > > copy live lives of their own.
> > >
> > > Does anybody know of a good algorithm to consolidate/merge all this
> > > data or do I have
> > > to write my own? One immediate thought is to compute the MD5 sums of
> > > all files on all
> > > disk and thus find all duplicates - then create a master copy of all
> > > unique files
> > > but the file names will be wrong and this might result in a big mess.
> > >
> > > This cannot be an uncommon problem - any ideas how to solve it?
> > >
> > > /Joe
> > > _______________________________________________
> > > erlang-questions mailing list
> > > 
> > > http://www.erlang.org/mailman/listinfo/erlang-questions
> > >
> >
> >
> > --
> > Best regards
> >
> > Linan Wang
> > _______________________________________________
> > erlang-questions mailing list
> > 
> > http://www.erlang.org/mailman/listinfo/erlang-questions
> >
>
>
>
> --
> http://arandomurl.com/
> http://www.flickr.com/photos/daleharvey/




-- 
http://arandomurl.com/
http://www.flickr.com/photos/daleharvey/
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://erlang.org/pipermail/erlang-questions/attachments/20071025/b7ddbd03/attachment.html>


More information about the erlang-questions mailing list