From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.org!not-for-mail From: Bob Proulx Newsgroups: gmane.emacs.devel Subject: Re: Move to git is imminent - awaiting Stefan's approval Date: Tue, 14 Jan 2014 22:15:23 -0700 Message-ID: <20140115051523.GA31866@hysteria.proulx.com> References: <52CC2D45.1000908@alice.it> <83a9f7sosr.fsf@gnu.org> <52CC5ED3.2000903@alice.it> <83d2k2fkg1.fsf@gnu.org> <87txdenwz3.fsf@igel.home> <20140112062722.GA15615@hysteria.proulx.com> <20140112211328.GA2537@hysteria.proulx.com> NNTP-Posting-Host: plane.gmane.org Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Trace: ger.gmane.org 1389762936 27365 80.91.229.3 (15 Jan 2014 05:15:36 GMT) X-Complaints-To: usenet@ger.gmane.org NNTP-Posting-Date: Wed, 15 Jan 2014 05:15:36 +0000 (UTC) To: emacs-devel@gnu.org Original-X-From: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Wed Jan 15 06:15:43 2014 Return-path: Envelope-to: ged-emacs-devel@m.gmane.org Original-Received: from lists.gnu.org ([208.118.235.17]) by plane.gmane.org with esmtp (Exim 4.69) (envelope-from ) id 1W3IpL-00043W-4o for ged-emacs-devel@m.gmane.org; Wed, 15 Jan 2014 06:15:43 +0100 Original-Received: from localhost ([::1]:52174 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1W3IpK-0002tn-Lg for ged-emacs-devel@m.gmane.org; Wed, 15 Jan 2014 00:15:42 -0500 Original-Received: from eggs.gnu.org ([2001:4830:134:3::10]:48763) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1W3IpC-0002so-Td for emacs-devel@gnu.org; Wed, 15 Jan 2014 00:15:40 -0500 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1W3Ip4-0005ju-7Y for emacs-devel@gnu.org; Wed, 15 Jan 2014 00:15:34 -0500 Original-Received: from joseki.proulx.com ([216.17.153.58]:41907) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1W3Ip3-0005jb-5P for emacs-devel@gnu.org; Wed, 15 Jan 2014 00:15:26 -0500 Original-Received: from hysteria.proulx.com (hysteria.proulx.com [192.168.230.119]) by joseki.proulx.com (Postfix) with ESMTP id B7FEA21227 for ; Tue, 14 Jan 2014 22:15:23 -0700 (MST) Original-Received: by hysteria.proulx.com (Postfix, from userid 1000) id A2EB02DCD4; Tue, 14 Jan 2014 22:15:23 -0700 (MST) Mail-Followup-To: emacs-devel@gnu.org Content-Disposition: inline In-Reply-To: <20140112211328.GA2537@hysteria.proulx.com> User-Agent: Mutt/1.5.21 (2010-09-15) X-detected-operating-system: by eggs.gnu.org: GNU/Linux 3.x X-Received-From: 216.17.153.58 X-BeenThere: emacs-devel@gnu.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Emacs development discussions." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Original-Sender: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Xref: news.gmane.org gmane.emacs.devel:168430 Archived-At: Bob Proulx wrote: > It sounds like I should schedule a full agressive repack once. Once > being the operative word. > > git repack -a -d -f --window=250 --depth=250 This has been done and the repository is now down to 285M. I set the number of pack.threads=2 and it ran for 104 minutes to completion. (I had experimented letting it use all available 7-cores but that ran 94 minutes and ran out of memory at the 3G 32-bit limit. The progress indicator took 15 minutes to get to 90% and then spent the next 80 minutes getting no further than 92%.) > > Another option is to touch a .keep file for the largest pack so > > that it is never touched again. New objects will then be added to a > > separate pack even after git gc. If that large pack is already well > > packed this should save some processing time. > > That seems like a useful additional tweak for a large stage such as > this. If nothing else it will help out the backup since that file > won't be changing on a routine basis and will remain static for the > purposes of backup transfer. This could be applied to several of the > large repositories. > > It seems that on the client side after a new clone that this tweak is > not propagated. It seems that if there are multiple packs on the > server side that they are combined into a single pack file. But > without being repacked. Therefore downstream clients that wish this > would need to do it manually after a clone. I also touched the .keep file for the resulting pack file so that it would remain static. I checked out a local clone and the size was 329M. Bob P.S. I saw the other discussion thread talking about possibly redoing the repository. If that happens let me know and I will repack just as above again.