From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp0 ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id eD+yIm/Ep2GGjwAAgWs5BA (envelope-from ) for ; Wed, 01 Dec 2021 19:52:31 +0100 Received: from aspmx1.migadu.com ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp0 with LMTPS id +FJpHm/Ep2HiPQAA1q6Kng (envelope-from ) for ; Wed, 01 Dec 2021 18:52:31 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 49C1A2E114 for ; Wed, 1 Dec 2021 19:52:31 +0100 (CET) Received: from localhost ([::1]:45496 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1msUiU-0001yR-EJ for larch@yhetil.org; Wed, 01 Dec 2021 13:52:30 -0500 Received: from eggs.gnu.org ([209.51.188.92]:55054) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1msUeY-0005EA-Nn for guix-devel@gnu.org; Wed, 01 Dec 2021 13:48:27 -0500 Received: from out2-smtp.messagingengine.com ([66.111.4.26]:54905) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1msUeV-000267-Sc for guix-devel@gnu.org; Wed, 01 Dec 2021 13:48:26 -0500 Received: from compute6.internal (compute6.nyi.internal [10.202.2.46]) by mailout.nyi.internal (Postfix) with ESMTP id 06BAF5C018D for ; Wed, 1 Dec 2021 13:48:23 -0500 (EST) Received: from mailfrontend2 ([10.202.2.163]) by compute6.internal (MEProxy); Wed, 01 Dec 2021 13:48:23 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-transfer-encoding:content-type :date:from:message-id:mime-version:subject:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm1; bh=d4Uv2Q gkCdTbqqysnxBiJitk6DV/FrSXNb54gsFsUW0=; b=FAOw5g5fq71o3SxZuL41Lh vxO1RrermlLk7oRItiJ17IullOd5DZLltbKLm5R6el1PAcC3VGdWIDehjWnvBRku V3Jloo6Xsz3NkvfGlbAnKh/eKLYNdcT5FndEJcxTeYmKJihmuxh0mimKGoCGyBwz ZoSw8KyU2GUBgd5RRnWfpcVn9v7IzjaWKZbzx31UUnkMHVWUOMH100Aa91ragPPN nRgd95338IlOwVX9NX9YWhg6ZBnRz6vv2tVRLKK3OqtZqxjyN2+DNhwmXOjc37DS tqNdmavtFAq1dFp04lgSMwcMqYtoO0gZ+zRKjC7jGVH+pv9kcgRhLMqGn39JjVVg == X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvuddrieefgdduudeiucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpefhvffufffkfgggtgfgsehtqhertd dtreejnecuhfhrohhmpefvihhmohhthhihucfurghmphhlvgcuoehsrghmphhlvghtsehn ghihrhhordgtohhmqeenucggtffrrghtthgvrhhnpeegieetgfeugfeiudejhfeltdduve efgfegkeefhedujeekteeikeduhfeileefteenucffohhmrghinhepnhhghihrohdrtgho mhdpshhofhhtfigrrhgvhhgvrhhithgrghgvrdhorhhgpdhgnhhurdhorhhgnecuvehluh hsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhhomhepshgrmhhplhgvthes nhhghihrohdrtghomh X-ME-Proxy: Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Wed, 1 Dec 2021 13:48:22 -0500 (EST) From: Timothy Sample To: guix-devel@gnu.org Subject: Preservation of Guix Report 2021-11-30 Date: Wed, 01 Dec 2021 13:48:21 -0500 Message-ID: <87k0gogo0a.fsf@ngyro.com> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Received-SPF: pass client-ip=66.111.4.26; envelope-from=samplet@ngyro.com; helo=out2-smtp.messagingengine.com X-Spam_score_int: -25 X-Spam_score: -2.6 X-Spam_bar: -- X-Spam_report: (-2.6 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: "Guix-devel" X-Migadu-Flow: FLOW_IN X-Migadu-Country: US ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1638384751; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding:list-id:list-help: list-unsubscribe:list-subscribe:list-post:dkim-signature; bh=d4Uv2QgkCdTbqqysnxBiJitk6DV/FrSXNb54gsFsUW0=; b=Hw7a8w9d9rsD/o4pbc6FjKQRIQAUJKlX0Zilj2sO54bY7nRFiHAP9twKznrISn5bFGQVfs KuHo3hFH5APqXuQsADBPYysgQfGuToHuD6XeBu0EHz6D3Xn7Z4p0uAP5bFi/aHSK7fgF/3 cdy2rRlWqJPtfrsHJNYF3vXG5zI0YoTwXlf8nh91VyGVFCn7bmZgHMLU3DwLYxHYfJHJ0s yn9EkdJgfcO4yOU5eDpT1TQGhUiALuRr8R0W2O0VrezAMLnwP/9KQ6UYcsxxUiR2l37v90 qznFxEApUf06qaTh0jOAyvKWzdFMXaPWRrn2kr3ZA6ADPFjaFAyBfivmosQzsA== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1638384751; a=rsa-sha256; cv=none; b=atYVWWpA9PCaavGjxOvUioJx4A05/9Qp/X57y2azW1miSawd/fygQdJUaXh66SfSlCqzUO uSJtroyCsmQhwALvytXpdr2XSgXr8DtaD9ybDBaLeeGiuUhDv5FwCImX4OqUnU5r/i/Y2Y 384Drfa2+mKaKiYiYtKVQU+MRu0k3K1PMqBeAWCMrKQ1DUo/dliD09eL3qRrDHm4/kRX+y zF6rNRXPJoHJC16LXMakDodcg8OH3+6adPkeqKb2RN1kIf+ghP8dJm2O9i0E2YaWTZj3ds M+/XTQ+1lZaT1rY1JJKjllbpkxvO0q3Blu9pAdux6Q6HQ60Kq6u80y2oq8pswQ== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=pass header.d=messagingengine.com header.s=fm1 header.b=FAOw5g5f; dmarc=none; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" X-Migadu-Spam-Score: -4.72 Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=messagingengine.com header.s=fm1 header.b=FAOw5g5f; dmarc=none; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" X-Migadu-Queue-Id: 49C1A2E114 X-Spam-Score: -4.72 X-Migadu-Scanner: scn0.migadu.com X-TUID: jOcmit3RZZXr Hi Guix! Here=E2=80=99s a new version of the Preservation of Guix Report: I actually made one a month ago but my message about it never made it to the list somehow. The most important part of that message was to highlight how well we are doing for Git sources. Here=E2=80=99s what I wrote: > This version has a breakdown by different origin types. The good > news is that Git origins are doing very well. We=E2=80=99ve confirmed t= hat > 97.2% of the 9,272 Git origins that we=E2=80=99re tracking are in the SWH > archive. Most of the progress there is due to zimoun wading through > the missing packages and telling SWH to store them =E2=80=93 thanks, zim= oun! That=E2=80=99s still basically true this month, but we have a few more miss= ing Git sources. Actually, we are starting to lose sources! If you look at the graph of commits, you can see a sharp increase in missing sources for recent commits. It looks like a problem on the SWH side. Visiting [1] and selecting =E2=80=9CShow all visits=E2=80=9D, you can see that the n= ixguix loader has been having trouble loading our =E2=80=9Csources.json=E2=80=9D recently. [1] I will try and get in touch with SWH about this. While it=E2=80=99s troubl= ing, it certainly is a good confirmation that doing some basic monitoring is important! That=E2=80=99s the bad news. The good news is I=E2=80=99ve added support f= or XZ to Disarchive (to be officially released in Disarchive soon). That means that we have information about 4K more sources. We now know the status of 80% of our sources. Unfortunately, 40% of the XZ sources are missing! Most of them are old, as can be seen in this (secret) graph: (The filename format is =E2=80=9C{tar-gz,tar-xz,git}-{rel,abs}-hist.svg=E2= =80=9D if you want to see all the secret graphs.) Lastly, if you scroll to the bottom of the report and select =E2=80=9CView Schema=E2=80=9D, I=E2=80=99ve added some example queries that generate list= s of interesting sources. For example =E2=80=93 if you=E2=80=99re so inclined = =E2=80=93 you could look at the 128 =E2=80=9Cunknown=E2=80=9D, non-recursive Git sources that w= e should know about and figure out what=E2=80=99s going on. ;) -- Tim