unofficial mirror of emacs-devel@gnu.org 
 help / color / mirror / code / Atom feed
From: Eli Zaretskii <eliz@gnu.org>
To: Angelo Graziosi <angelo.graziosi@alice.it>
Cc: emacs-devel@gnu.org
Subject: Re: Move to git is imminent - awaiting Stefan's approval
Date: Thu, 09 Jan 2014 21:44:41 +0200	[thread overview]
Message-ID: <83ob3lc53q.fsf@gnu.org> (raw)
In-Reply-To: <52CDC949.6090107@alice.it>

> Date: Wed, 08 Jan 2014 22:55:21 +0100
> From: Angelo Graziosi <angelo.graziosi@alice.it>
> CC: schwab@suse.de, stephen.berman@gmx.net, sven.axelsson@gmail.com, 
>  emacs-devel@gnu.org
> 
> Il 08/01/2014 18.32, Eli Zaretskii ha scritto:
> >> Date: Tue, 07 Jan 2014 21:08:51 +0100
> >> From: Angelo Graziosi <angelo.graziosi@alice.it>
> >> CC: stephen.berman@gmx.net, sven.axelsson@gmail.com, emacs-devel@gnu.org
> >>
> >> $ cd emacs.git/
> >> $ git gc --aggressive
> >> Counting objects: 735546, done.
> >> Delta compression using up to 2 threads.
> >> Compressing objects: 100% (734446/734446), done.
> >> Writing objects: 100% (735546/735546), done.
> >> Total 735546 (delta 589814), reused 143177 (delta 0)
> >> Checking connectivity: 735546, done.
> >>
> >> which took almost 3 hours to be completed.
> >>
> >> And the size is:
> >>
> >> $ cd ..
> >>
> >> $ du -s emacs.git/
> >> 327M	emacs.git/
> >>
> >> which seems very good!
> >
> > I guess this was on Windows 7, right?  I succeeded to do this on a
> 
> NO!! It is on Win XP 32 bit (SP3) with AMD Athlon 64 X2 Dual Core 
> Processor 3800+ and 1.7GiB of RAM.

The secret that unlocked this mystery was this:

> >> Delta compression using up to 2 threads.
                                   ^^^^^^^^^
On my machine, which is a Core i7, this originally said "8 threads".
So I did this: 

  git config --global pack.threads "2"

then ran "git gc --aggressive" again.  That again ran out of memory,
but much later in the process.  The next step was obvious:

  git config --global pack.threads "1"

With that, "git gc --aggressive" churned away for a little bit more
than an hour, and brought me to this:

  $ du -sh .
  323M    .

> > 64-bit Windows 7 as well, and it took about 2 hours.  And now I
> > understand why git ran out of memory on Windows XP: the memory
> > footprint of git-pack-objects goes up to 3GB, whereas Windows XP has
> > only 3GB address space for all the applications.
> 
> Here, on XP, Task Manager shows a memory usage under 1500 MiB (about 1.4 
> GiB)

With 1 thread, it never goes above 850MB.



  reply	other threads:[~2014-01-09 19:44 UTC|newest]

Thread overview: 101+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2014-01-06 22:14 Move to git is imminent - awaiting Stefan's approval Angelo Graziosi
2014-01-06 22:57 ` David Kastrup
2014-01-11 22:34   ` Nix
2014-01-06 23:01 ` Andreas Schwab
2014-01-07 10:24   ` Angelo Graziosi
2014-01-07 10:37     ` Git tips for Emacs development (was Re: Move to git is imminent - awaiting Stefan's approval) Nic Ferrier
2014-01-07 16:05       ` Eli Zaretskii
2014-01-07 12:27     ` Move to git is imminent - awaiting Stefan's approval Sven Axelsson
2014-01-07 14:41       ` Stephen Berman
2014-01-07 14:57         ` Andreas Schwab
2014-01-07 15:05           ` Stephen Berman
2014-01-07 16:25           ` Eli Zaretskii
2014-01-07 16:35             ` Andreas Schwab
2014-01-07 16:37               ` Angelo Graziosi
2014-01-07 16:41                 ` Andreas Schwab
2014-01-07 17:08                   ` Eli Zaretskii
2014-01-07 17:23                     ` Óscar Fuentes
2014-01-07 17:56                       ` Eli Zaretskii
2014-01-07 17:24                     ` Stephen J. Turnbull
2014-01-07 18:05                       ` Eli Zaretskii
2014-01-07 18:17                         ` Sven Axelsson
2014-01-07 18:49                           ` Stephen J. Turnbull
2014-01-07 19:06                             ` Eli Zaretskii
2014-01-08  3:47                               ` Stephen J. Turnbull
2014-01-08 15:23                                 ` Eli Zaretskii
2014-01-07 18:02                     ` Thien-Thi Nguyen
2014-01-07 18:06                       ` Sven Axelsson
2014-01-07 18:47                         ` Andreas Schwab
2014-01-07 19:07                           ` Sven Axelsson
2014-01-07 19:16                             ` Eli Zaretskii
2014-01-08  3:52                               ` Stephen J. Turnbull
2014-01-07 20:08                     ` Angelo Graziosi
2014-01-08 17:32                       ` Eli Zaretskii
2014-01-08 18:34                         ` Andreas Schwab
2014-01-08 18:42                           ` Eli Zaretskii
2014-01-08 21:59                             ` Angelo Graziosi
2014-01-09  0:05                               ` Stefan Monnier
2014-01-09  6:35                                 ` Eli Zaretskii
2014-01-12  6:27                           ` Bob Proulx
2014-01-12 10:11                             ` Andreas Schwab
2014-01-12 16:11                               ` Eli Zaretskii
2014-01-12 17:09                                 ` Andreas Schwab
2014-01-12 17:41                                   ` Eli Zaretskii
2014-01-12 21:13                               ` Bob Proulx
2014-01-12 21:24                                 ` Andreas Schwab
2014-01-13  3:07                                   ` Bob Proulx
2014-01-15  5:15                                 ` Bob Proulx
2014-01-12 10:29                             ` Achim Gratz
2014-01-12 21:29                               ` Bob Proulx
2014-01-12 16:07                             ` Eli Zaretskii
2014-01-08 21:55                         ` Angelo Graziosi
2014-01-09 19:44                           ` Eli Zaretskii [this message]
2014-01-07 15:00         ` Angelo Graziosi
2014-01-07 16:17       ` Eli Zaretskii
2014-01-10  6:40       ` Antonio Nikishaev
2014-01-07 12:29     ` David Kastrup
2014-01-07 16:11     ` Eli Zaretskii
2014-01-07 13:37   ` Angelo Graziosi
2014-01-07 14:24     ` Andreas Schwab
2014-01-09 12:18       ` Angelo Graziosi
2014-01-07 16:14   ` Eli Zaretskii
2014-01-07 17:38     ` Rüdiger Sonderfeld
     [not found] <<20140106165108.B6BF4380865@snark.thyrsus.com>
     [not found] ` <<83zjn9rpaz.fsf@gnu.org>
2014-01-06 17:41   ` Drew Adams
2014-01-06 17:46     ` Eli Zaretskii
  -- strict thread matches above, loose matches on Subject: below --
2014-01-06 16:51 Eric S. Raymond
2014-01-06 17:20 ` Jay Belanger
2014-01-06 19:40   ` Eric S. Raymond
2014-01-07 15:57     ` Jay Belanger
2014-01-07 11:20   ` Stephen J. Turnbull
2014-01-07 11:26     ` Eric S. Raymond
2014-01-06 17:30 ` Eli Zaretskii
2014-01-06 21:09   ` Stefan Monnier
2014-01-06 21:29     ` Óscar Fuentes
2014-01-06 23:57       ` Stefan Monnier
2014-01-07  0:17     ` Leo Liu
2014-01-07  5:24     ` Thierry Volpiatto
2014-01-07 13:45       ` Stefan Monnier
2014-01-07 16:22         ` Eli Zaretskii
2014-01-08 21:12     ` Barry Warsaw
2014-01-09  0:04       ` Stefan Monnier
2014-01-09  6:32         ` Eli Zaretskii
2014-01-09  7:32           ` David Engster
2014-01-09  9:46           ` Juanma Barranquero
2014-01-06 17:40 ` Juanma Barranquero
2014-01-06 18:42   ` Bastien
2014-01-06 19:06     ` Jarek Czekalski
2014-01-06 19:37   ` Drew Adams
2014-01-06 19:42   ` Eric S. Raymond
2014-01-06 19:51     ` Drew Adams
2014-01-06 20:25       ` Eric S. Raymond
2014-01-06 20:28     ` Juanma Barranquero
2014-01-07 11:24     ` Stephen J. Turnbull
2014-01-07  2:48 ` joakim
2014-01-07 10:03   ` Andreas Schwab
2014-01-07 10:08     ` joakim
2014-01-15 17:23 ` Martin Geisler
2014-01-15 18:39   ` Stefan Monnier
2014-01-15 22:57     ` Martin Geisler
2014-01-15 23:53       ` Stefan Monnier
2014-01-16 12:25       ` Rüdiger Sonderfeld
2014-01-16  1:40   ` Yuri Khan

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

  List information: https://www.gnu.org/software/emacs/

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=83ob3lc53q.fsf@gnu.org \
    --to=eliz@gnu.org \
    --cc=angelo.graziosi@alice.it \
    --cc=emacs-devel@gnu.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
Code repositories for project(s) associated with this public inbox

	https://git.savannah.gnu.org/cgit/emacs.git

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).