From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp0.migadu.com ([2001:41d0:303:e16b::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms1.migadu.com with LMTPS id MA0JMku/J2bxXwEAqHPOHw:P1 (envelope-from ) for ; Tue, 23 Apr 2024 16:01:47 +0200 Received: from aspmx1.migadu.com ([2001:41d0:303:e16b::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp0.migadu.com with LMTPS id MA0JMku/J2bxXwEAqHPOHw (envelope-from ) for ; Tue, 23 Apr 2024 16:01:47 +0200 X-Envelope-To: larch@yhetil.org Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=famulari.name header.s=mesmtp header.b=o2xSbbQK; dkim=pass header.d=messagingengine.com header.s=fm3 header.b=BhzznVT9; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org"; dmarc=none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1713880907; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:mime-version:mime-version: content-type:content-type:in-reply-to:in-reply-to: references:references:list-id:list-help:list-unsubscribe: list-subscribe:list-post:dkim-signature; bh=bIt6cynEUJAgn3LNh5JmgrKKuC2px0HlX0AL6qmisO0=; b=dMfCkXjGQTM02+AITSdzGZtxlc9GQQLO8NaX+M1ghN85HZzL7b3BzvYuUUHcdRJ0MOyO8h RvdmmaAo52QnqUEwbtk+vazK48LkiZrVyh/2xn2I+mHG8jtGZnyLHU6y/TvYlVUHfOwQlp 2iDYVKz4LRqD01mHwMQQBHmaTjPYOnpkWJw4nib3fNZZEAyftPfyKQIEmAgh+Dnl3N2l0J llHFisLfnh/zRknF5xE4fMOUoUTHsdm7jrmx7fKkSUROBsGx7jIMew/2mZulXLzFXsiO6g o8A4jIBTh4huJfNBbE6mb+PYgeC3zRroLzEgNKcN+Eayg5LYylncg4YxvZ518g== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1713880907; a=rsa-sha256; cv=none; b=ILeTa7Rd23m5/URvBjy2bjXBNep1p+BDqLEtTtetHygypDzOJ+5OL0JTYnkK488Ezrpx60 naCntJNSY2JLWrbr5CbMZmxIDQ4jLV71reJXXors/UBeMqMsc17gZuR2SZwxkheP2uDtcW aXZPRkmdeyazp1LN/rdxpFx/yoCbSeZjKhgFmq7j/d4oUVBt9BMxA1xXchxRMShyAeAW4f m0og+zgDKZi1H0CeichfJZ3upjB03lXa37/1xfOrIYbM+cfSPtIdL6xobeBoo8SzpxdlOD Qn7DRqCI8haU+gMoMoCJtyca4D7336T1G+/L13Wak3T3AMaiJYDfmIxBXKZkoQ== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=pass header.d=famulari.name header.s=mesmtp header.b=o2xSbbQK; dkim=pass header.d=messagingengine.com header.s=fm3 header.b=BhzznVT9; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org"; dmarc=none Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id AF6286A449 for ; Tue, 23 Apr 2024 16:01:46 +0200 (CEST) Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1rzGhf-000570-Pi; Tue, 23 Apr 2024 10:00:59 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1rzGhb-00055d-5s for guix-devel@gnu.org; Tue, 23 Apr 2024 10:00:55 -0400 Received: from fhigh7-smtp.messagingengine.com ([103.168.172.158]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1rzGhZ-0003gX-1l for guix-devel@gnu.org; Tue, 23 Apr 2024 10:00:54 -0400 Received: from compute5.internal (compute5.nyi.internal [10.202.2.45]) by mailfhigh.nyi.internal (Postfix) with ESMTP id D64E21140186; Tue, 23 Apr 2024 10:00:50 -0400 (EDT) Received: from imap48 ([10.202.2.98]) by compute5.internal (MEProxy); Tue, 23 Apr 2024 10:00:50 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=famulari.name; h=cc:content-type:content-type:date:date:from:from:in-reply-to :in-reply-to:message-id:mime-version:references:reply-to:subject :subject:to:to; s=mesmtp; t=1713880850; x=1713967250; bh=bIt6cyn EUJAgn3LNh5JmgrKKuC2px0HlX0AL6qmisO0=; b=o2xSbbQKok1qKkWVufW8FSR WhlGUodv5IB5lU32AhNxfO+etFmSoWuc2aOW/Ar1+6wBA7Ar8BF8HZFEWxDkGiFr PunCzr7K2rSgHjCBiiQHxEJGj2CO7MPbC5BxZ5njZ57NpfiZx/Bsj3AjPRbrJ1n6 ckXGsXC1pCjI80KBJRiY= DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:content-type:date:date :feedback-id:feedback-id:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:subject:subject:to :to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s= fm3; t=1713880850; x=1713967250; bh=bIt6cynEUJAgn3LNh5JmgrKKuC2p x0HlX0AL6qmisO0=; b=BhzznVT9Zg9Xm5gdIOWBzQqUvg7zjUmZ1CLRWFISAdRq rkrmBOP4zjphq6aqIVvbuY1vGwxOYpSxDzlT62LfAsyODIEp3gML6ulSJuLP+DB7 Me2NQ3aKU1pnrnxj8nvsViNFz6gv+lNp9xzqh6JoZHiTDqnTXW7EJlNKE2YRhK2e Vqiz5LBruIJLBlCIdv9EhddzszNqWNq7kSnExwozyHdaH6OGfGFUDUl/qWtQrjR1 ESoqviQWnH5wUenrnBWEpLT4+Wyj0hdYF/BTlyVQUz4LT4fCeESb0mFpfhjOkkFC nyyt3u9zd1Z6+shG3yMa/IoorQOZ+Uk9Hf15PqjQBQ== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvledrudeluddgjedvucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucesvcftvggtihhpihgvnhhtshculddquddttddmne cujfgurhepofgfggfkjghffffhvffutgesrgdtreerreertdenucfhrhhomhepfdfnvgho ucfhrghmuhhlrghrihdfuceolhgvohesfhgrmhhulhgrrhhirdhnrghmvgeqnecuggftrf grthhtvghrnhepvedtudehhfdtvdetkeevffdvhfetkedvgeeihfdvjeettdeuudehvdfg udelgedunecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhhomh eplhgvohesfhgrmhhulhgrrhhirdhnrghmvg X-ME-Proxy: Feedback-ID: i819c4023:Fastmail Received: by mailuser.nyi.internal (Postfix, from userid 501) id 7C03131A0065; Tue, 23 Apr 2024 10:00:50 -0400 (EDT) X-Mailer: MessagingEngine.com Webmail Interface User-Agent: Cyrus-JMAP/3.11.0-alpha0-386-g4cb8e397f9-fm-20240415.001-g4cb8e397 MIME-Version: 1.0 Message-Id: <594fad0c-ec83-4003-b30f-e3ed1e62dc7b@app.fastmail.com> In-Reply-To: References: Date: Tue, 23 Apr 2024 10:00:29 -0400 From: "Leo Famulari" To: Adam , "Christopher Baines via Development of GNU Guix and the GNU System distribution." Subject: Re: Is git the best tool for pulling packages? Content-Type: multipart/alternative; boundary=34553b45a1104cfa972a6570b859aacf Received-SPF: pass client-ip=103.168.172.158; envelope-from=leo@famulari.name; helo=fhigh7-smtp.messagingengine.com X-Spam_score_int: -27 X-Spam_score: -2.8 X-Spam_bar: -- X-Spam_report: (-2.8 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, T_KAM_HTML_FONT_INVALID=0.01 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: guix-devel-bounces+larch=yhetil.org@gnu.org X-Migadu-Country: US X-Migadu-Flow: FLOW_IN X-Migadu-Spam-Score: -9.07 X-Spam-Score: -9.07 X-Migadu-Queue-Id: AF6286A449 X-Migadu-Scanner: mx13.migadu.com X-TUID: 4tFWn9v26GUN --34553b45a1104cfa972a6570b859aacf Content-Type: text/plain >From a computational perspective, downloading tarballs is much simpler than fetching from Git. But Git offers so many advantages, and computing has become so inexpensive, that it's become very common to use Git instead. Recent Git implementations have optimized serving of specific Git commits, as compared to fetching the entire Git history. That means that you can fetch a single revision of a huge repo, using a small amount of bandwidth. For the specific case of `guix pull`, the Git server is hosted at Savannah, which does not use one of these optimized Git implementations, so it is relatively slow and expensive to fetch. Additionally, Guix's authentication mechanism requires fetching many Git revisions in order to verify the chain of trusted revisions (Git commits). This requirement to fetch many Git revisions, combined with the unoptimized Got server on Savannah, means that `guix pull` may be slower than comparable actions on other distros, especially the first time, and if you haven't pulled in a while On Sun, Apr 21, 2024, at 18:31, Adam wrote: > Hi guix! > Recently I used nixos on one of my machines. And I noticed people there use tar balls for fetching package definitions. And It worked much faster for me. > That was surprising and I decided to write this letter. > Is git the right tool for getting new package definitions? What if git commits history will become enormous? > As I see, first guix pull running too long for a lot of people. > Probably there are ways to cache all of this. > Anyway, I'm just curious about it. If there are already answers for my question, I would like to read them. --34553b45a1104cfa972a6570b859aacf Content-Type: text/html Content-Transfer-Encoding: quoted-printable
From a computat= ional perspective, downloading tarballs is much simpler than fetching fr= om Git.

But Git offers so many advantages, = and computing has become so inexpensive, that it's become very common to= use Git instead.

Recent Git implementation= s have optimized serving of specific Git commits, as compared to fetchin= g the entire Git history. That means that you can fetch a single revisio= n of a huge repo, using a small amount of bandwidth.

<= /div>
For the specific case of `guix pull`, the Git server is hosted= at Savannah, which does not use one of these optimized Git implementati= ons, so it is relatively slow and expensive to fetch.

=
Additionally, Guix's authentication mechanism requires fetchi= ng many Git revisions in order to verify the chain of trusted revisions = (Git commits).

This requirement to fetch many Git revisions, combine= d with the unoptimized Got server on Savannah, means that `guix pull` ma= y be slower than comparable actions on other distros, especially the fir= st time, and if you haven't pulled in a while 

On Sun, Apr 21, 2024, at 18:31, Adam wrote:
Hi gu= ix!
Recently I used nixos on one of my machin= es. And I noticed people there use tar balls for fetching package defini= tions. And It worked much faster for me.
That= was surprising and I decided to write this letter.
Is git the right tool for getting new package definitions? What i= f git commits history will become enormous? 
As I see, first guix pull running too long for a lot of people.
=
Probably there are ways to cache all of this.
Anyway,  I'm just curious about it. If the= re are already answers for my question, I would like to read them.

--34553b45a1104cfa972a6570b859aacf--