public inbox for git@vger.kernel.org 
 help / color / mirror / Atom feed
From: Eric Wong <normalperson@yhbt•net>
To: Hin-Tak Leung <htl10@users•sourceforge.net>
Cc: git@vger•kernel.org, Jakob Stoklund Olesen <stoklund@2pi•dk>,
	Sam Vilain <sam@vilain•net>,
	Steven Walter <stevenrwalter@gmail•com>,
	Peter Baumann <waste.manager@gmx•de>,
	Andrew Myrick <amyrick@apple•com>
Subject: Re: git svn's performance issue and strange pauses, and other thing
Date: Fri, 19 Sep 2014 08:25:29 +0000	[thread overview]
Message-ID: <20140919082529.GA32459@dcvr.yhbt.net> (raw)
In-Reply-To: <1411025993.80693.YahooMailBasic@web172304.mail.ir2.yahoo.com>

Hin-Tak Leung <htl10@users•sourceforge.net> wrote:
> (I am not on the list - please CC)

Done, it is standard practice for git :)

> Thanks for git-svn - I use it instead of subversion itself for many years now.
> 
> Just thought I'd ask/report a few issues I noticed for some time
> now, of tracking development of a particular subversion-based
> development project. Broadly speaking, I think there are 3 problems,
> especially noticeable against a particular repository, but 
> to a lesser extent with some others too.
> 
> - just doing "git svn fetch --all" seems to consume a lot of memory,
> for very little actual fetched changes. (in the 2GB+ region, sometimes).
> 
> - "git svn fetch --all" also seems to take a long time too, for certain
> fetched changes. (in the minutes region).

Jakob sent some patches a few months ago which seem to address the
issue.  Unfortunately we forgot about them :x

Can you take a look at the following two "mergeinfo-speedups"
in my repo?  (git://bogomips.org/git-svn)

Jakob Stoklund Olesen (2):
      git-svn: only look at the new parts of svn:mergeinfo
      git-svn: only look at the root path for svn:mergeinfo

Also downloadable here:

http://bogomips.org/git-svn.git/patch?id=9b258e721b30785357535
http://bogomips.org/git-svn.git/patch?id=73409a2145e93b436d74a

Can you please give them a try?

> -  I know I can probably just "read the source", but I'd like to know
> why .git/svn/.caches is even larger than .git/objects (which supposedly
> contains everything that's of interest)? I hope this can be documented
> towards the end of the man-page, for example, of important parts
> of .git/svn (and what not to do with them...), without needing to
> 'read the source'. Here is part of "du" from a couple of days ago:
> 
> 254816	.git/objects
> 307056	.git/svn/.caches
> 332452	.git/svn
> 588064	.git
> 
> The actual .git/config is here - this should be sufficient info for
> somebody looking into experiencing the issues I mentioned above.

IIRC, the caching is unique to mergeinfo, so perhaps Jakob's patches
help, there, too.

Sorry I don't understand the mergeinfo stuff more, I've never worked on
a project which uses it.

> --------
> $ more .git/config 
> [core]
> 	repositoryformatversion = 0
> 	filemode = true
> 	bare = false
> 	logallrefupdates = true
> [svn-remote "svn"]
> 	url = https://svn.r-project.org/R
> 	fetch = trunk:refs/remotes/trunk
> 	branches = branches/*:refs/remotes/*
> 	tags = tags/*:refs/remotes/tags/*
> [pack]
> 	threads = 1
> ------------

  reply	other threads:[~2014-09-19  8:25 UTC|newest]

Thread overview: 10+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2014-09-18  7:39 git svn's performance issue and strange pauses, and other thing Hin-Tak Leung
2014-09-19  8:25 ` Eric Wong [this message]
2014-09-19 13:44   ` Jakob Stoklund Olesen
2014-10-05  1:02   ` Eric Wong
  -- strict thread matches above, loose matches on Subject: below --
2014-10-06 23:51 Hin-Tak Leung
2014-10-07 18:20 Hin-Tak Leung
2014-10-19  4:12 ` Eric Wong
2014-10-19 14:41   ` Jakob Stoklund Olesen
2014-10-19 14:04 Hin-Tak Leung
2014-10-19 14:22 Hin-Tak Leung

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20140919082529.GA32459@dcvr.yhbt.net \
    --to=normalperson@yhbt$(echo .)net \
    --cc=amyrick@apple$(echo .)com \
    --cc=git@vger$(echo .)kernel.org \
    --cc=htl10@users$(echo .)sourceforge.net \
    --cc=sam@vilain$(echo .)net \
    --cc=stevenrwalter@gmail$(echo .)com \
    --cc=stoklund@2pi$(echo .)dk \
    --cc=waste.manager@gmx$(echo .)de \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox