From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp1 ([2001:41d0:8:6d80::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id uAYPD97/qGGAnQAAgWs5BA (envelope-from ) for ; Thu, 02 Dec 2021 18:18:22 +0100 Received: from aspmx1.migadu.com ([2001:41d0:8:6d80::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp1 with LMTPS id 2EOYCt7/qGExXwAAbx9fmQ (envelope-from ) for ; Thu, 02 Dec 2021 17:18:22 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id DCE9625A90 for ; Thu, 2 Dec 2021 18:18:21 +0100 (CET) Received: from localhost ([::1]:54988 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1mspiu-0007Xy-J0 for larch@yhetil.org; Thu, 02 Dec 2021 12:18:20 -0500 Received: from eggs.gnu.org ([209.51.188.92]:37702) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mspgs-0006Fj-VE for guix-devel@gnu.org; Thu, 02 Dec 2021 12:16:15 -0500 Received: from [2607:f8b0:4864:20::134] (port=39819 helo=mail-il1-x134.google.com) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1mspgm-0004qm-5u for guix-devel@gnu.org; Thu, 02 Dec 2021 12:16:14 -0500 Received: by mail-il1-x134.google.com with SMTP id a11so72445ilj.6 for ; Thu, 02 Dec 2021 09:16:05 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=B8eWRA42WXEeAQkwE3bj6eqo//J1AQgrR6ApInxhE/c=; b=MAtv02jjeIxD93FaX+09tvJPFKOZXPXz1AxGZugQn/kVE4gMbNYDBQpxHwhK5oOVC2 yml17rLbcvHcrRe4mSImezLuoFdah4jverTO6t7itlI77jXClCY3/6aEY8oej6kl2+gM 1SI5IJ5KHAsQlb0KLuzD90U3xak1dyj6fpQz2ngQbWIsZ8e8A3g2mqv0DoJl6YhnDlfZ XJEJyQ2GYVvhXaLwYcstLnZYqzojupFGurVaqA/XZeKG6jXNotYpcMfnV+rp5B5K/pFp WylAbFmKsbTI555vnC6daTaFRvdNz7sMiDYeUquemQjWfEItqxMjeFr02TsFowQCBllF +xLw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=B8eWRA42WXEeAQkwE3bj6eqo//J1AQgrR6ApInxhE/c=; b=0LP3rT1Hh/a1tR6IrDZccxMJY8sESnEcpji0n27mpfyPn8MiyVYhtNmLKjInU/74zq /6tFSWs9hBhVsjKbV9sUzBePQuhTulJvtY8Hp7OIh60DwWg/bW7sAL2wN/7E9AdytqqE vxgjnxUqVe7+jqUHuXgx6YWR55w+XwSkBMcv/4yuyiZPDNP2w/I+A68ZwiqndXXG+BrE yEGOj3zKm+v/oo2A6DuMwzUFfdxJ6OIYatANBo5wTHdsuSi+Agck8B5O/vNno//tIFsb y/DDs74XN+nsjQ854oZsV/e42GkA/a39I+lLGtrMhpyNF42xSFgaQC5mHf67ybNcGw0s 9OSQ== X-Gm-Message-State: AOAM533fb3DpHWDYcTGpGRk8tFKCE8V+TfoLFOrkm7QXl2npvIu67hpb wCYUTX0QFXwdkDpoZKULEr+88uTk0Kyc94ny7q1q1+JLkQM= X-Google-Smtp-Source: ABdhPJwzLTwfyboVqdGYlVtHRfByK1LXQEEY2eYf3lStrpbuA+kMCc9yqb8BSJTSLEqHhfOyW5SH8A8A9H15RCZa/xA= X-Received: by 2002:a05:6e02:1090:: with SMTP id r16mr16521436ilj.208.1638465364841; Thu, 02 Dec 2021 09:16:04 -0800 (PST) MIME-Version: 1.0 References: <87k0gogo0a.fsf@ngyro.com> In-Reply-To: <87k0gogo0a.fsf@ngyro.com> From: zimoun Date: Thu, 2 Dec 2021 18:15:53 +0100 Message-ID: Subject: Re: Preservation of Guix Report 2021-11-30 To: Timothy Sample Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Host-Lookup-Failed: Reverse DNS lookup failed for 2607:f8b0:4864:20::134 (failed) Received-SPF: pass client-ip=2607:f8b0:4864:20::134; envelope-from=zimon.toutoune@gmail.com; helo=mail-il1-x134.google.com X-Spam_score_int: -11 X-Spam_score: -1.2 X-Spam_bar: - X-Spam_report: (-1.2 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, PDS_HP_HELO_NORDNS=0.001, RCVD_IN_DNSWL_NONE=-0.0001, RDNS_NONE=0.793, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_SBL_A=0.1 autolearn=no autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Guix Devel Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: "Guix-devel" X-Migadu-Flow: FLOW_IN X-Migadu-Country: US ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1638465502; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-unsubscribe:list-subscribe:list-post:dkim-signature; bh=B8eWRA42WXEeAQkwE3bj6eqo//J1AQgrR6ApInxhE/c=; b=aASyeQ6T0QKjSlEMZRG+sc0ifzj5IegDmQubvkPu0yLRCYjH2F1H7uSkICxYH+lsO60hw6 LMc8ZsHPCwbXBhAoAg5ul3zPc7pRQsqdYQURFUtuKGuhqgOBqvl68xGznDlZWcgGtvIhOq lPX2aOGpJpNVfTPSZt+pC921YhvJERaas6fCI22o296nAFi12hDcXWGgilngLI/YkeGO1p OL0fgjy2e8vgR9uOpP4wwMuES4A3HPD9uW+83Dj7OWmyJ/FYEVshea4rKgHaYziqqdRwCb wWy+DzQZzYSCC866/xcbXxfdNrw4E4eXVDzeOx/Idu3t30RfWmyf0U3IcMAyzA== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1638465502; a=rsa-sha256; cv=none; b=OydieaSo8Tx7bgTLPVP9IAqPACQ+AX7ZclSi+7c7OHVhCTitgnw+h7F2MdurNqHcRw1HXa KbFpjcC+wQGJhOBL9bUvbzrc5tChN7QGxGCqum6eXs4aIX30ZSjuPRQIDSnUz37RVkCfqR gTDuhLc8jPSwev5wSQ4KBZQifQIEMHMdvxM5ngdTxBw/7wRftczWwYw3FVCLLdMeH/m01F /Pw/25qRV5UVEsFzaVQOngDhrFv3fEyMGaICst/8WIrh0YU5zbiVoPIR93OQv4pPgs/2wB gfdBEer+TIS88bQGgYtHyXg/vMeVF09g3qKTlJp2Mw6izP0DKNvChO4PinyQPQ== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=pass header.d=gmail.com header.s=20210112 header.b=MAtv02jj; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" X-Migadu-Spam-Score: -4.12 Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=gmail.com header.s=20210112 header.b=MAtv02jj; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" X-Migadu-Queue-Id: DCE9625A90 X-Spam-Score: -4.12 X-Migadu-Scanner: scn0.migadu.com X-TUID: +Hs1avs77S24 Hi, On Wed, 1 Dec 2021 at 19:52, Timothy Sample wrote: > Here=E2=80=99s a new version of the Preservation of Guix Report: > > Cool! > That=E2=80=99s still basically true this month, but we have a few more mi= ssing > Git sources. Well, we need more tools to explore the data (do not hold your breath :-)). Using the database, some Emacs macros, a quick Guix scripts and a patient review of SWH, the results about missing vs unknown Git sources (type:git) looks more or less like that: 1. Guix is not able to reach but SWH schedules and processes with success 2. SWH processes but fails Some sources are lost from upstream (and the package removed from Guix long time ago). For instance, mumimu removed 2 years ago. For now, I count 3. It should easily fixable, IMHO. I will give a look later. The '?' means that SWH is still processing. Well, I bet the ingestion will fail. On Guix side, the package to tackle are 'R'. It means the way Guix uses the API does not get the correct information. For instance djvu3 is saved by SWH [1], but "guix lint -c archival emacs-djvu3" always schedules for archiving. This list is not complete because I found more as pointed here [2] and Ludo found at least one thing incorrect [3]. Where I am surprised is that PoG does not return 'python-scikit-learn' when= : --8<---------------cut here---------------start------------->8--- $ guix lint -c archival python-scikit-learn gnu/packages/machine-learning.scm:946:5: python-scikit-learn@0.24.2: scheduled Software Heritage archival --8<---------------cut here---------------end--------------->8--- Anyway. :-) Last, the number 35 (missing) or 240 (unknown) is a bit inflated because many version / tag / commit refers to one URL, and thus if a failure happens on this URL, all is reported as failing. Therefore, if we fix the list below (which is much less than 35+340 ;-)), we should be almost done for 100% coverage of Git source. It's some work on the plate. ;-) Cheers, simon 1: 2: 3: F: SWH failure R: SWH says succeed but Guix does not find it H: hidden package, not checked >: Duplicate I: Duplicate but in d: Disappeared Missing =3D=3D=3D=3D=3D=3D=3D d "https://code.divoplade.fr/mkdir-p.git" R "https://github.com/dalanicolai/djvu3" > "https://github.com/halostatue/minitar.git" R "https://github.com/halostatue/minitar" R "https://github.com/stardiviner/org-contacts.el" F "https://github.com/adobe-fonts/source-han-sans" > "https://github.com/adobe-fonts/source-han-sans.git" F "git://pumpa.branchable.com/" F "https://git.mfiano.net/mfiano/pngload.git" F "https://gitlab.com/sequoia-pgp/sequoia.git" H "https://github.com/desktop-app/tg_owt.git" Unknown =3D=3D=3D=3D=3D=3D=3D d "https://source.atlas.engineer/public/next" d "https://git.elephly.net/software/mumimu.git" R "https://chromium.googlesource.com/webm/libvpx" R "https://framagit.org/contrapunctus/chronometrist.git" R "https://git.savannah.gnu.org/git/emacsy.git" R "https://git.savannah.gnu.org/git/hurd/incubator.git" R "https://git.savannah.gnu.org/git/nomad.git/" R "https://git.sr.ht/~pkal/autocrypt" R "https://git.sr.ht/~zge/bang" R "https://git.zx2c4.com/wireguard-go/" R "https://github.com/MaskRay/ccls" R "https://github.com/OpenCPN/OpenCPN" R "https://github.com/ProtonVPN/linux-cli" R "https://github.com/aureliojargas/clitest" R "https://github.com/boostorg/signals2.git" R "https://github.com/cdown/clipmenu.git" R "https://github.com/cdown/clipnotify.git" R "https://github.com/emacsattic/relative-buffers" R "https://github.com/emacsmirror/cl-print" R "https://github.com/jurplel/qView.git" R "https://github.com/kr/pretty.git" R "https://github.com/parallaxinc/propgcc" R "https://github.com/sekrit-twc/zimg.git" R "https://github.com/tlaplus/tlaplus" R "https://inqlab.net/git/eris.git" R "https://inqlab.net/git/guile-sodium.git" F "https://git.joeyh.name/filters" I "git://git.joeyh.name/filters" F "git://git.tuxfamily.org/gitroot/non/non.git" F "https://anonscm.debian.org/cgit/users/kaction-guest/retired/dev.guile-ba= sh.git" F "https://bitbucket.org/eeeickythump/cl-abstract-classes" F "https://framagit.org/a-guile-mind/guile-wiredtiger.git" F "https://github.com/LLNL/hypre.git" F "https://github.com/PacificBiosciences/cDNA_primer" F "https://github.com/atomnuker/wlstream" F "https://github.com/biod/undeaD.git" F "https://github.com/fdik/libetpan" F "https://github.com/jujudusud/caps-lv2" F "https://github.com/mattn/runewidth" F "https://github.com/powertab/rtmidi.git" F "https://github.com/proofit404/edbi-sqlite" F "https://github.com/syohex/git-gutter-fringe" F "https://github.com/tgvaughan/elpher" F "https://gitlab.com/kavalogic-inc/inspekt3d.git" F "https://gitlab.savoirfairelinux.com/sflphone/libiax2.git" F "https://go.googlesource.com/x/mod" ? "git://anongit.kde.org/kdenlive.git" ? "git://dthompson.us/guile-websocket.git" ? "http://dr-qubit.org/git/undo-tree.git" ? "http://git.fuzzle.org/mloop" ? "http://www.foldr.org/~michaelw/projects/redshank.git" ? "https://framagit.org/contrapunctus/chronometrist.git" ? "https://git.gnome.org/browse/byzanz" ? "https://git.savannah.gnu.org/git/emacs.git/" ? "https://git.zapb.de/libjaylink.git" ? "https://github.com/emacsorphanage/git-gutter-fringe" ? "https://github.com/erlang/otp" ? "https://github.com/golang/mod" ? "https://github.com/libretro/RetroArch.git" ? "https://github.com/parallaxinc/propgcc.git" ? "https://github.com/scour-project/scour"