Re: Preservation of Guix Report 2021-10-31

Re: Preservation of Guix Report 2021-10-31

[zimoun]

Hi,

I am not able to find in guix-devel archives this email with the
Message-ID 874k8xrn49.fsf@ngyro.com.  Below the complete header.

Do I miss something?


Cheers,
simon


On Sun, 31 Oct 2021 at 15:49, Timothy Sample <samplet@ngyro.com> wrote:
> Hi all!
>
> Here’s a new version of the Preservation of Guix Report:
>
>     <https://ngyro.com/pog-reports/2021-10-31/>
>
> (I hope to publish one every Sunday or so.)
>
> This version has a breakdown by different origin types.  The good news
> is that Git origins are doing very well.  We’ve confirmed that 97.2% of
> the 9,272 Git origins that we’re tracking are in the SWH archive.  Most
> of the progress there is due to zimoun wading through the missing
> packages and telling SWH to store them – thanks, zimoun!
>
> Looking at gzipped tarballs, things are not nearly as nice.  There are
> quite a few old ones that are missing, and quite a few that I haven’t
> been able to identify so far (either because I’m not getting the tarball
> or because Disarchive can’t process it).  There’s a “secret” graph that
> shows that many of these problems are for older commits:
>
>     <https://ngyro.com/pog-reports/2021-10-31/tar-gz-abs-hist.svg>
>
> There’s also an “other” type, which covers everything else.  So far, we
> don’t know anything about these 8,830 fixed-output derivations (they are
> all “unknown”).  There’s a few shortcuts I could take to get information
> on these, and I’m tempted to do so.  I’ve also started working on XZ
> support in Disarchive, which should cover about 2,000 of these.
>
> For the 236 “unknown” Git sources, 132 of them are because of recursive
> checkouts.  Currently, my tools don’t support this, and I believe Guix
> can’t use SWH as a fallback for a recursive checkout (yet).  However,
> the other 104 are little things that could probably be solved directly.
> The problem is that my automated tools can’t find the SWHID.  This is
> either because of things like upstream going down or changing a tag.
> Usually one can find the SWHID manually using the SWH interface.  I’m
> not sure what to do about this at the moment, but it’s a tantalizingly
> small number of sources to fix either by hand or by clever use of
> ‘(guix swh)’.  :)  Here’s a query to list the 104 non-recursive
> “unknown” Git sources:
>
> SELECT *
> FROM fods
>     JOIN fod_references USING (fod_id)
> WHERE is_in_swh IS NULL
>     AND EXISTS (
>             SELECT 1
>             FROM fod_references
>             WHERE fod_references.fod_id = fods.fod_id
>                 AND reference LIKE '(git-reference%')
>     AND reference LIKE '%(recursive? #t)%'
>
>
> -- Tim

--8<---------------cut here---------------start------------->8---
Delivered-To: zimon.toutoune@gmail.com
Received: by 2002:a37:9104:0:0:0:0:0 with SMTP id t4csp2336196qkd;
        Sun, 31 Oct 2021 12:49:12 -0700 (PDT)
X-Google-Smtp-Source: ABdhPJzvgHaZlE0R1aK1e39YCqs4LCseCqnnKMlMHIqF0dzcBg/agNqloTgH8G85ChAzYlU84aYx
X-Received: by 2002:a05:622a:11c5:: with SMTP id n5mr25262930qtk.232.1635709752565;
        Sun, 31 Oct 2021 12:49:12 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; t=1635709752; cv=none;
        d=google.com; s=arc-20160816;
        b=Vxtvs1jxLqypvXF/A/PPrd5lHi4jJpp5NI2iyg59Afj2Ata/8WPjiTRqCQggN5PntS
         wspttVKuSApI4fcp2ekmv9IhrqdIjulMh31HgiO1zZjnGWidxVueIuPwVKqGitgvI1kJ
         LQYojHPkVkBPjZ6LVxdkdwoAxWBUn/rWx9vkJFtYMbOPrZnTUU5z3AblDRtdU4Rc++g/
         GqmdcIOFDIt+jy/xJjoX41oGQ1dprsC2xiclCMWwi8k8x8/v1C8aYedIuiaYVfEDf/EX
         hW9sMdhipAsdFXZr6a8mQAp6fWCtFWKXDeepWwuKG78oi/S2hyBZhKx8/Nmu5kwg3PZP
         Q/Nw==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816;
        h=mime-version:user-agent:message-id:date:subject:cc:to:from
         :dkim-signature;
        bh=pYjq3HKbfv/iQhPEJethmChOBafhu6PDpTlamtcwHEE=;
        b=Zg4MOyFeOEulfXueHJhg6jTj6AmfKFnXDWORQaWpafO0aj52acZXmb+ezdh7bhYLPz
         Rbm2W69S3rZiQa4dLcV60rpay07FFzzANCWN/phv7NN6sM6h1Urh0DCJ/Ytaj8xKfYJ1
         1W561tUl3rfegVPZcVb+1waY0mhtPpmxLLmKGqAwOWiQPQOdaxxK3AQuI8Zo69I3TAa0
         AXrc6xCXyJsl+2bWgD28iHmKK3Rz8neHVZv5hlR9Pb9mclRbcrfI7nGs8wVYerJSmfuM
         yyOR4bwlcEDGPrJo8zR3x6GhqNP3LeIVUlHnV5XHNNi5aJ39oqn9xhKH09Vk1a9PaHqT
         QAsw==
ARC-Authentication-Results: i=1; mx.google.com;
       dkim=pass header.i=@messagingengine.com header.s=fm1 header.b=BSaf5eJA;
       spf=pass (google.com: domain of samplet@ngyro.com designates 66.111.4.25 as permitted sender) smtp.mailfrom=samplet@ngyro.com
Return-Path: <samplet@ngyro.com>
Received: from out1-smtp.messagingengine.com (out1-smtp.messagingengine.com. [66.111.4.25])
        by mx.google.com with ESMTPS id az10si10887225qkb.65.2021.10.31.12.49.12
        for <zimon.toutoune@gmail.com>
        (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);
        Sun, 31 Oct 2021 12:49:12 -0700 (PDT)
Received-SPF: pass (google.com: domain of samplet@ngyro.com designates 66.111.4.25 as permitted sender) client-ip=66.111.4.25;
Authentication-Results: mx.google.com;
       dkim=pass header.i=@messagingengine.com header.s=fm1 header.b=BSaf5eJA;
       spf=pass (google.com: domain of samplet@ngyro.com designates 66.111.4.25 as permitted sender) smtp.mailfrom=samplet@ngyro.com
Received: from compute4.internal (compute4.nyi.internal [10.202.2.44])
	by mailout.nyi.internal (Postfix) with ESMTP id 045F95C013B;
	Sun, 31 Oct 2021 15:49:12 -0400 (EDT)
Received: from mailfrontend2 ([10.202.2.163])
  by compute4.internal (MEProxy); Sun, 31 Oct 2021 15:49:12 -0400
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=
	messagingengine.com; h=cc:content-type:date:from:message-id
	:mime-version:subject:to:x-me-proxy:x-me-proxy:x-me-sender
	:x-me-sender:x-sasl-enc; s=fm1; bh=pYjq3HKbfv/iQhPEJethmChOBafhu
	6PDpTlamtcwHEE=; b=BSaf5eJAWk7bca9pQXqEIlYX3Z7b78g7qBO40E4hAbk8l
	SQf+b/xtD6Vtd0HgjilbM+3tqRSkL9UM9g4MFUJFR2xUkBUG36vITethY9C7dhxz
	ZOcVym1vkCOAeigX62j57nER4CVdp7mkC2tka4J24A2OBkF6dPPIx6dzLR7fF9g1
	EdnWOZUgu6S3lXL9nzNb30AcdhSvWJcLxVLaepbcnuKVZuVsI6RUwrcJ+i1wkzRb
	wKn5xzL5UBlXdM3v9FXH6gVN84NPFRWxQW83G36FVMr+4OhP9Innw/nCRvo9j5T7
	aMr1FqBpZ17j07bbhc19/O+l8rcOJmkk4k+g4foWg==
X-ME-Sender: <xms:N_N-YS5CF6UK6-tZ4YYwZ7uk6b6AyHRVQnk7yeQEh7pjnby2axPspQ>
    <xme:N_N-Yb6dul5P3ud0XVqz0teBoQzSP_FVZsw-p7pAZxh-aIpgG5MGfzBZz_yfbb2d5
    HsFMESK9xSIW27OEA>
X-ME-Received: <xmr:N_N-YRc2tiUVV0fnh8u07IduDSEMoQ_eH8-F5py4xh3oP-U0cpmlYGC6Vcv-oD5_w1n-pfrWkYaxps8Zmjxoqw>
X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvtddrvdehtddguddviecutefuodetggdotefrod
    ftvfcurfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfgh
    necuuegrihhlohhuthemuceftddtnecunecujfgurhephffvufffkfgfgggtsehmtderre
    dtreejnecuhfhrohhmpefvihhmohhthhihucfurghmphhlvgcuoehsrghmphhlvghtsehn
    ghihrhhordgtohhmqeenucggtffrrghtthgvrhhnpedtheeitefgjeduffevhffgkeevff
    fgjeelveduueelkedttefhfeeuudelffejgeenucffohhmrghinhepnhhghihrohdrtgho
    mhenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhmpehsrg
    hmphhlvghtsehnghihrhhordgtohhm
X-ME-Proxy: <xmx:N_N-YfIdRdc-f70GkJDVxWgDvT_BkZZVSJ8iPd0CsIqkE7jMWEi89w>
    <xmx:N_N-YWLwsHQkdL-1i17VDOFXh18HD4y45O2QXSkEJbqeWq0TTMCz5w>
    <xmx:N_N-YQwCjb5GJ1RGYBuylFbVkm3NEDz91mxj79dyezqjcs4BXOfxpA>
    <xmx:OPN-YQxftUp7GE2iYQbe1nmemJLomBYXlYzRqlVGg-KP3C_8OgNFPg>
Received: by mail.messagingengine.com (Postfix) with ESMTPA; Sun,
 31 Oct 2021 15:49:11 -0400 (EDT)
From: Timothy Sample <samplet@ngyro.com>
To: guix-devel@gnu.org
Cc: zimoun <zimon.toutoune@gmail.com>
Subject: Preservation of Guix Report 2021-10-31
Date: Sun, 31 Oct 2021 15:49:10 -0400
Message-ID: <874k8xrn49.fsf@ngyro.com>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.2 (gnu/linux)
MIME-Version: 1.0
Content-Type: multipart/mixed; boundary="=-=-="
X-TUID: Wxp4aTcz+voG
--8<---------------cut here---------------end--------------->8---