From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp2 ([2001:41d0:8:6d80::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id 8H2eKuWOr2EcaAAAgWs5BA (envelope-from ) for ; Tue, 07 Dec 2021 17:42:13 +0100 Received: from aspmx1.migadu.com ([2001:41d0:8:6d80::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp2 with LMTPS id +NRNJuWOr2GPGQAAB5/wlQ (envelope-from ) for ; Tue, 07 Dec 2021 16:42:13 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 7C37129E7E for ; Tue, 7 Dec 2021 17:42:10 +0100 (CET) Received: from localhost ([::1]:47296 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1mudXd-0007mC-8t for larch@yhetil.org; Tue, 07 Dec 2021 11:42:09 -0500 Received: from eggs.gnu.org ([209.51.188.92]:35342) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mudXR-0007m3-Sj for guix-devel@gnu.org; Tue, 07 Dec 2021 11:41:57 -0500 Received: from [2001:470:142:3::e] (port=48044 helo=fencepost.gnu.org) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mudXR-00055V-Dk; Tue, 07 Dec 2021 11:41:57 -0500 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-Version:In-Reply-To:Date:References:Subject:To: From; bh=yz8QP5owdGO2jNrc9HUnzd/H7loNRBQIIeQssXY2who=; b=H1c4CKhraNm0jLYVA6XO 2zCSGiJqWFikIXtNqZ5hppLdcZmNhoZeKkq9hQfXplgAFWUTIDEWvueqFp04P2FbqmJpXvF6wP1oD o0lE9NvKE6kS0mIbE8hfkCVkuyX7XtI4aZkU2FZhRHL0ZYqe1m4OEHbVwVcLb5yvcVohrSVuIQ/Ch 6XTIUiEc37ajC1TXBYX5zOXNSTIk6KL4kc050MxJ5RB89apsa2e3Rketf1LTXty5824Cut/vdhbsd UFJKJDR1HbaGzCesk1nRwrNDOGC7kBmiK0NumStzoqdmrnxnAxwlnQTGRpQHrLopvtEAtLNR0zJud aKLG8WzaMvq2ZQ==; Received: from [2001:660:6102:320:e120:2c8f:8909:cdfe] (port=43396 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mudXR-0001ts-Au; Tue, 07 Dec 2021 11:41:57 -0500 From: =?utf-8?Q?Ludovic_Court=C3=A8s?= To: Timothy Sample Subject: Re: Preservation of Guix Report 2021-12-06 References: <87o85to67b.fsf@ngyro.com> X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 17 Frimaire an 230 de la =?utf-8?Q?R=C3=A9volution?= X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu Date: Tue, 07 Dec 2021 17:41:54 +0100 In-Reply-To: <87o85to67b.fsf@ngyro.com> (Timothy Sample's message of "Mon, 06 Dec 2021 14:59:20 -0500") Message-ID: <87fsr4icz1.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: guix-devel@gnu.org Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: "Guix-devel" X-Migadu-Flow: FLOW_IN X-Migadu-Country: US ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1638895330; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-unsubscribe:list-subscribe:list-post:dkim-signature; bh=yz8QP5owdGO2jNrc9HUnzd/H7loNRBQIIeQssXY2who=; b=jfu8RnFXOwCQk/CldwRBK9sdelGIpJB7rEXmHeBoGH9+0GhywwC5TU1D7teqI1sRRx+24c ZQc54EfolmAfe0bIQx2yS6bnhV/WKMWQvOOVfevPmIuLi3cob+nYECJrJM8go4b3BFk3uC cmJxZMgzCMFgKJPoCGLHEoc3L1Rn4eYXLpCz8fv71SreC0b2ChivHvlwFxEAYxW7hsX5t0 8dAfelAgsSjB1JFjbY5uVEByeBb+FjlpSgBNjE9xh/ug21Lt5wNmiR0VB9e5qZmvTblna8 CFHYqxtyeifWaqyXwzwbAOb4X+dbzhK13TO4X8qv0WoyeB0m6+86t2Otinp+Eg== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1638895330; a=rsa-sha256; cv=none; b=u+cpEJ1D99bzTeEtzpk9pSUpRZkAJj23UBhcEL+h+HXsUuwCYE29DPKdl4fykv1O61gAGb GIEZ+RBDuBP3GGHUXZpxX3NN69xMvt8VEihC7gbm3xHmBGCl2bVEFAVBRwa2YuVJjOWxfe rfDevDuqQfbZhzE5foijlUFO2IdtAKTtM66iKeWDSVfV4lTmoWLQC7O28IpvkbKcZsvW5C qb1N1+GbhtRYNkkW1y0ObNoCHv4F5VtSRtNtXm+laX0mXx5yHJAmCq7VZP5gDV4mJtqqrD badqARZaBLVU9a7tTNwtrGJEoKN2AqQvqOdy0RnvgyehXK4o0lVr8EKNKCpkRg== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=pass header.d=gnu.org header.s=fencepost-gnu-org header.b=H1c4CKhr; dmarc=pass (policy=none) header.from=gnu.org; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" X-Migadu-Spam-Score: -7.84 Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=gnu.org header.s=fencepost-gnu-org header.b=H1c4CKhr; dmarc=pass (policy=none) header.from=gnu.org; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" X-Migadu-Queue-Id: 7C37129E7E X-Spam-Score: -7.84 X-Migadu-Scanner: scn0.migadu.com X-TUID: KJv26hHIBiM3 Hello, Timothy Sample skribis: > > > Since the last report, I added many more reference categories and moved > them to the database. The new categories are 'hg', 'svn', 'cvs', 'bzr', > 'tar-bz2', 'tar', 'zip', and 'text'. Of these, only 'tar' and 'text' > are being processed. The rest are currently unsupported by my scripts. > Moving the categories to the database allows me to make manual > corrections when needed. It also encouraged me to look through the > references a bit more carefully to track down some of the weirder 'text' > sources (like Bash patches) and fix up some other ones (in the style of > =E2=80=9C/tar_gz?download=3Dyes=E2=80=9D). Good to see these additional details. The SWH folks told me that plain files (like .el or .patch files) that appear in =E2=80=98sources.json=E2=80=99 are currently not archived, but th= at this could change. So seeing 86% of them are archived is good news. > I also made the fetching code more tenacious. Now it uses the > content-addressed mirrors from Guix and Nix to find regular files, and > will recover =E2=80=9Ceasy=E2=80=9D Git references from SWH (=E2=80=9Ceas= y=E2=80=9D means the commit is > specified). I suppose the scripts could use =E2=80=98url-fetch=E2=80=99, or even build = the fixed-output tarballs, to benefit from Guix=E2=80=99s fallback methods. (Apologies if I=E2=80=99m stating the obvious.) > The =E2=80=9Cdisarchive=E2=80=9D category is all the tarballs Disarchive = failed to > process. An interesting thing here is that most of them are from Cargo. > Long story short: older versions of Cargo used the =E2=80=9Cminiz=E2=80=9D > implementation of DEFLATE (rewritten in Rust) to compress tarballs. > Disarchive doesn=E2=80=99t support this (yet...?). There are 686 > old-Cargo-produced tarballs in the =E2=80=9Cdisarchive=E2=80=9D category. Ah, I don=E2=80=99t want to hear about Rust! ;-) > One last thing to add is that the SWH folks were very quick to fix the > loading error, so the increase in missing sources for recent commits is > now gone. Awesome. Thanks for the update! Ludo=E2=80=99.