From: duchier@ps•uni-sb.de
To: Tom Lord <lord@emf•net>
Cc: gnu-arch-users@gnu•org, gnu-arch-dev@lists•seyza.com,
talli@museatech•net, git@vger•kernel.org, torvalds@osdi•org
Subject: Re: [ANNOUNCEMENT] /Arch/ embraces `git'
Date: Wed, 20 Apr 2005 19:15:55 +0200 [thread overview]
Message-ID: <877jixfjxw.fsf@star.lifl.fr> (raw)
In-Reply-To: <200504201000.DAA04988@emf.net> (Tom Lord's message of "Wed, 20 Apr 2005 03:00:36 -0700 (PDT)")
Hi Tom,
just as a datapoint, here is an experiment I carried out. I wanted to evaluate
how much overhead is incurred by using several levels of directories to
implement a discrimating index. I used the key format you specified:
SHA1,SIZE
As data, I used my /usr/src/linux which uses 301M and contains 20753 files and
1389 directories. To compute the key for a directory, I considered that its
contents were a mapping from names to keys.
When constructing the indexed archive, I actually stored empty files instead of
blobs because I am only interested in overhead.
Using your suggested indexing method that uses [0:4] as the 1st level key and
[4:8] as the 2nd level key, I obtain an indexed archive that occupies 159M,
where the top level contains 18665 1st level keys, the largest first level dir
contains 5 entries, and all 2nd level dirs contain exactly 1 entry.
Using Linus suggested 1 level [0:2] indexing, I obtain an indexed archive that
occupies 1.8M, where the top level contains 256 1st level keys, and where the
largest 1st level dir contains 110 entries.
This experiment was performed on an ext3 file system.
Cheers,
--Denys
next prev parent reply other threads:[~2005-04-20 17:13 UTC|newest]
Thread overview: 24+ messages / expand[flat|nested] mbox.gz Atom feed top
2005-04-20 10:00 [ANNOUNCEMENT] /Arch/ embraces `git' Tom Lord
2005-04-20 10:19 ` Miles Bader
2005-04-20 17:15 ` duchier [this message]
2005-04-20 22:40 ` [Gnu-arch-users] Re: [GNU-arch-dev] " Tomas Mraz
2005-04-21 9:09 ` Denys Duchier
2005-04-21 10:21 ` Tomas Mraz
2005-04-21 11:46 ` [Gnu-arch-users] " duchier
2005-04-20 22:51 ` Tomas Mraz
2005-04-21 19:04 ` Tom Lord
2005-04-21 20:35 ` [Gnu-arch-users] Re: [GNU-arch-dev] " Tom Lord
2005-04-20 23:04 ` Tom Lord
2005-04-21 0:05 ` [Gnu-arch-users] Re: [GNU-arch-dev] " Denys Duchier
2005-04-21 20:39 ` [Gnu-arch-users] " Tom Lord
2005-04-21 7:49 ` Tomas Mraz
2005-04-21 21:51 ` [Gnu-arch-users] Re: [GNU-arch-dev] " Tom Lord
2005-04-21 21:52 ` Tom Lord
2005-04-22 16:13 ` Linus Torvalds
2005-04-22 17:39 ` Edésio Costa e Silva
2005-04-20 21:31 ` Petr Baudis
2005-04-20 21:55 ` C. Scott Ananian
2005-04-20 22:22 ` chunking (Re: [ANNOUNCEMENT] /Arch/ embraces `git') Linus Torvalds
2005-04-20 23:42 ` C. Scott Ananian
2005-04-22 21:02 ` blowing chunks (quick update) C. Scott Ananian
-- strict thread matches above, loose matches on Subject: below --
2005-04-20 9:58 [ANNOUNCEMENT] /Arch/ embraces `git' Tom Lord
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=877jixfjxw.fsf@star.lifl.fr \
--to=duchier@ps$(echo .)uni-sb.de \
--cc=git@vger$(echo .)kernel.org \
--cc=gnu-arch-dev@lists$(echo .)seyza.com \
--cc=gnu-arch-users@gnu$(echo .)org \
--cc=lord@emf$(echo .)net \
--cc=talli@museatech$(echo .)net \
--cc=torvalds@osdi$(echo .)org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox