From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp12.migadu.com ([2001:41d0:8:6d80::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id EH6HMEEd52G06QAAgWs5BA (envelope-from ) for ; Tue, 18 Jan 2022 21:04:17 +0100 Received: from aspmx1.migadu.com ([2001:41d0:8:6d80::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp12.migadu.com with LMTPS id +DxmLUEd52FsAgAAauVa8A (envelope-from ) for ; Tue, 18 Jan 2022 21:04:17 +0100 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 759F21A636 for ; Tue, 18 Jan 2022 21:04:17 +0100 (CET) Received: from localhost ([::1]:48652 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1n9uiG-00074U-NM for larch@yhetil.org; Tue, 18 Jan 2022 15:04:16 -0500 Received: from eggs.gnu.org ([209.51.188.92]:59080) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1n9uJq-00046W-Cs for guix-devel@gnu.org; Tue, 18 Jan 2022 14:39:02 -0500 Received: from out5-smtp.messagingengine.com ([66.111.4.29]:45719) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1n9uJo-0001s0-Fw for guix-devel@gnu.org; Tue, 18 Jan 2022 14:39:02 -0500 Received: from compute3.internal (compute3.nyi.internal [10.202.2.43]) by mailout.nyi.internal (Postfix) with ESMTP id 93F6E5C055F; Tue, 18 Jan 2022 14:38:57 -0500 (EST) Received: from mailfrontend2 ([10.202.2.163]) by compute3.internal (MEProxy); Tue, 18 Jan 2022 14:38:57 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-transfer-encoding:content-type :date:from:in-reply-to:message-id:mime-version:references :subject:to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender :x-sasl-enc; s=fm1; bh=XMsuG32Yc9mZ82SVtf3SSIWfEJqrP/M3dtwX428ZZ Gs=; b=KWLBTHvx8Nn42cybotU3B9r0Ge0TriTVq+GkK+byR7tOkyMX1k24E0ZUE yo9UyojHZyJlyhJjIPM7nxBO79u/ImFcm9UnNkPYWsQJ6+YurUMSdBl7WuBP2itQ NJQ/SQWlKuQYEyvrCjD4+vejzSdXVMrHE+AdjVpPDi88uOIg/dB4ZPeKjmg0+PyH PUfvEOgdjPZka6kcN57WQ90EjDv7fUzBNmKoaTHtXO5z16/1C9SARI2d7bqQ6731 bsSv4l4y0R8zZJqaLU+r8sMmat00KB0jANOBa48QK99eBvY/+QljRVDxOi/zsjHd /ZFbQMaxmjwxX8KZlfuZoBFKHhK9A== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvvddrudefgdduvdekucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucesvcftvggtihhpihgvnhhtshculddquddttddmne cujfgurhephffvufhfffgjkfgfgggtgfesthhqredttderjeenucfhrhhomhepvfhimhho thhhhicuufgrmhhplhgvuceoshgrmhhplhgvthesnhhghihrohdrtghomheqnecuggftrf grthhtvghrnheptdehheeiledugfduleekvddtfeffjefhtdevkeelgfeihffghedvieej jeehvdefnecuffhomhgrihhnpehsohhfthifrghrvghhvghrihhtrghgvgdrohhrghenuc evlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhmpehsrghmphhl vghtsehnghihrhhordgtohhm X-ME-Proxy: Received: by mail.messagingengine.com (Postfix) with ESMTPA; Tue, 18 Jan 2022 14:38:57 -0500 (EST) From: Timothy Sample To: Vagrant Cascadian Subject: Re: Preservation of Guix report 2022-01-16 References: <87y23fwjb8.fsf@ngyro.com> <874k61f4hp.fsf@gnu.org> <87wniwc3k4.fsf@yucca> Date: Tue, 18 Jan 2022 14:38:56 -0500 In-Reply-To: <87wniwc3k4.fsf@yucca> (Vagrant Cascadian's message of "Tue, 18 Jan 2022 10:16:27 -0800") Message-ID: <875yqg96lr.fsf@ngyro.com> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Received-SPF: pass client-ip=66.111.4.29; envelope-from=samplet@ngyro.com; helo=out5-smtp.messagingengine.com X-Spam_score_int: -25 X-Spam_score: -2.6 X-Spam_bar: -- X-Spam_report: (-2.6 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: guix-devel@gnu.org, Ludovic =?utf-8?Q?Court=C3=A8s?= Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: "Guix-devel" X-Migadu-Flow: FLOW_IN X-Migadu-Country: US ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1642536257; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-unsubscribe:list-subscribe:list-post:dkim-signature; bh=XMsuG32Yc9mZ82SVtf3SSIWfEJqrP/M3dtwX428ZZGs=; b=fk4JWlgEc1L/tPPoFo9xQ3mC/w6TlrLZ7i2p6RDcRJ0n4sNh0qSS90q9qhrpVGUD1F0lRP /+Bw8I1kZisHiCpCZ70Zb0BqtdWon7vZBwricv18NwN79h4QEC5DDzc1535loiC2lEBQxa f7zwfK1o4gJchVJNfendyT9R3I9Qk4nfHCk7a/sNWVAPdFxVssMkQDI7FSVD59e7PxjEiC tSH1P5Cz8MGkLnUO1ravzaw88K7fHkpi+DjIdSWcC1lz7FqGrCcJsWfPVHmcw51UhpqcAw ZFKeWF8YjGjDXRNipPQxso0eBvDohUBPlA85Z5Ts89vRiDV3zNtL/5sA6jxOtA== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1642536257; a=rsa-sha256; cv=none; b=imAAhjjWBLCYgeBj/tb0FkNiEtWKHpJn+wwCmS2fi0DMXljc1tM5OyiRZYbTcYlp0lgENS 7ti07SWU8ksAUEJh7tfrDZisiFtdJEvPUcPAplfKFn5Im1IixlukjdB/qBKDP2iY8vR6+Z lB2cZ+36RxTjMl0FbnI7owO4rLnUX2yOrza8PNFrzIwKIDnc2YB3MZ6bp9PAPkK1Nf0SBQ JA1Nm+0J5Prg/PQIprf7jd6A0vDCOY/hGgwlctc1rAjWqwwyH8GgbhqXZgIVxIQSEJIi8u Od6C8aIN1Rsh6hyBOv4te7wG9Sqd650D6B/TwOBYXBVlcxo05LnjlTQr0wKRSw== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=fail ("headers rsa verify failed") header.d=messagingengine.com header.s=fm1 header.b=KWLBTHvx; dmarc=none; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" X-Migadu-Spam-Score: -2.22 Authentication-Results: aspmx1.migadu.com; dkim=fail ("headers rsa verify failed") header.d=messagingengine.com header.s=fm1 header.b=KWLBTHvx; dmarc=none; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" X-Migadu-Queue-Id: 759F21A636 X-Spam-Score: -2.22 X-Migadu-Scanner: scn1.migadu.com X-TUID: 3ZVpcZTkhc0q Hi, Vagrant Cascadian writes: > On 2022-01-18, Ludovic Court=C3=A8s wrote: >> Timothy Sample skribis: >>> A really important thing to do at this point is to verify that some >>> reasonable looking computation is covered by what we are doing already. >>> For instance, is every source used to build Guile (or Python or R) >>> preserved? This will ensure that key sources are not missing, which is >>> a real possibility given that everything so far has been purely a >>> numbers game! >> >> I wonder if we could have something similar to =E2=80=98guix weather -c= =E2=80=99, which >> would highlight missing sources with many dependents. Definitely. The simplest way to do that is to use the PoG database as-is, and just write a script that traverses the derivation graph checking for coverage. It=E2=80=99s a bit trickier to integrate into Guix itself, since we would have to make the data available. It=E2=80=99s a goo= d job for the Data Service, but I feel like it=E2=80=99s a long road from here to there. >> TeX Live is a big concern: it=E2=80=99s all Subversion, and everything d= epends >> on those packages. IIRC, SWH does not support Subversion yet; and when >> it does, we=E2=80=99ll have to adjust our code so it can actually fetch >> Subversion checkouts from SWH. One issue is partial checkouts: all >> these =E2=80=98texlive-=E2=80=99 packages refer to partial checkouts of = the big TeX Live >> repo. > > Maintain a git mirror of texlive SVN using git-svn or similar, and have > guix packages use that, and make sure SWH ingests it? Is it difficult > because of the size of TeX Live? > > A little ugly, sure, but maybe only include the revisions that guix is > interested in for starters... Fortunately, SWH does support Subversion, so we can avoid this. They haven=E2=80=99t visited the TeX Live sources yet, but I=E2=80=99m sure they= will eventually. How to actually match up what we want with what they have is a big question! I imagine they do quite a number to make the SVN repos fit their Git-inspired data model. It=E2=80=99s not clear to me how it works. = I=E2=80=99ll have to look over the loader sometime: https://forge.softwareheritage.org/source/swh-loader-svn/repository/master/ One way to handle things like partial checkouts is to revisit storing SWHIDs with our origins. If you have the directory ID, you can just download the directory from SWH without worrying about SVN at all. It would also give us an easy way to handle Bazaar and CVS (which are under development at SWH). -- Tim