From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp12.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id sGbTGjm/7mGr2AAAgWs5BA (envelope-from ) for ; Mon, 24 Jan 2022 16:01:13 +0100 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp12.migadu.com with LMTPS id WH02Fzm/7mFoDwEAauVa8A (envelope-from ) for ; Mon, 24 Jan 2022 16:01:13 +0100 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id EF3773A18B for ; Mon, 24 Jan 2022 16:01:12 +0100 (CET) Received: from localhost ([::1]:56840 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1nC0qF-0000Be-HD for larch@yhetil.org; Mon, 24 Jan 2022 10:01:12 -0500 Received: from eggs.gnu.org ([209.51.188.92]:52144) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nC0pd-0000Az-1w for guix-devel@gnu.org; Mon, 24 Jan 2022 10:00:33 -0500 Received: from [2a0c:e300::1] (port=49406 helo=hera.aquilenet.fr) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nC0pa-0003gE-T7 for guix-devel@gnu.org; Mon, 24 Jan 2022 10:00:32 -0500 Received: from localhost (localhost [127.0.0.1]) by hera.aquilenet.fr (Postfix) with ESMTP id 3504D123; Mon, 24 Jan 2022 16:00:27 +0100 (CET) X-Virus-Scanned: Debian amavisd-new at aquilenet.fr Received: from hera.aquilenet.fr ([127.0.0.1]) by localhost (hera.aquilenet.fr [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id qxmdcICKIb1d; Mon, 24 Jan 2022 16:00:26 +0100 (CET) Received: from ribbon (91-160-117-201.subs.proxad.net [91.160.117.201]) by hera.aquilenet.fr (Postfix) with ESMTPSA id AE342F8; Mon, 24 Jan 2022 16:00:25 +0100 (CET) From: =?utf-8?Q?Ludovic_Court=C3=A8s?= To: Timothy Sample Subject: Re: ImageMagick from 2020? References: <87tuebwlrc.fsf@gmail.com> <87k0f71ndv.fsf@ngyro.com> <03cbf268883ae93ae45b20e9ab8dee49ca5e7dd0.camel@telenet.be> <87a6ftglbx.fsf@gnu.org> <87k0ewau6y.fsf@gnu.org> <87pmoj7m3y.fsf@ngyro.com> X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 5 =?utf-8?Q?Pluvi=C3=B4se?= an 230 de la =?utf-8?Q?R?= =?utf-8?Q?=C3=A9volution?= X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu Date: Mon, 24 Jan 2022 16:00:25 +0100 In-Reply-To: <87pmoj7m3y.fsf@ngyro.com> (Timothy Sample's message of "Sat, 22 Jan 2022 11:48:17 -0500") Message-ID: <87a6fltbzq.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spamd-Bar: +++ X-Rspamd-Server: hera X-Rspamd-Queue-Id: 3504D123 X-Spamd-Result: default: False [3.23 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; FREEMAIL_CC(0.00)[gmail.com,telenet.be,gnu.org]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; FREEMAIL_ENVRCPT(0.00)[gmail.com]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TAGGED_RCPT(0.00)[]; MIME_GOOD(-0.10)[text/plain]; R_MIXED_CHARSET(0.83)[subject]; TO_DN_ALL(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; SUBJECT_ENDS_QUESTION(1.00)[]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; SUSPICIOUS_RECIPS(1.50)[] X-Host-Lookup-Failed: Reverse DNS lookup failed for 2a0c:e300::1 (failed) Received-SPF: softfail client-ip=2a0c:e300::1; envelope-from=ludo@gnu.org; helo=hera.aquilenet.fr X-Spam_score_int: -3 X-Spam_score: -0.4 X-Spam_bar: / X-Spam_report: (-0.4 / 5.0 requ) BAYES_00=-1.9, RDNS_NONE=0.793, SPF_HELO_PASS=-0.001, SPF_SOFTFAIL=0.665 autolearn=no autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Guix Devel , zimoun Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: "Guix-devel" X-Migadu-Flow: FLOW_IN X-Migadu-Country: US ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1643036473; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-unsubscribe:list-subscribe:list-post; bh=5NCQEdaZfTYkhLClsYuGFRZlAvat8w9B7f9dBlfRR3g=; b=lS9sxy5cYompGNToHtL9tlMxUhGe3pcDa5RqUeLCNomLy6jUvsHOtj5GJ7HAJpKwhtw9dT 1mOl+w1ksYdTc8VbhC03RChLzbD8yOjUbm/hp1gWhW1bnw18U+OL1jVF/dcGYuIB29aCfp HBNMLoiAF5CAV72C6rrh+8LUsUKyqMgBpIQj6UNV0mYbZA4CpzdP0tw2g42iXhYyz0/9wi nASQMEddD+aelqlY8W6mKBHMDcGhWMqLq8sxVCj9nwfQp6EGHebyTWL0C2ETpVWRuOR04+ zXr590YdHMutSAKTUfmgz7KxPGNrBwRMIMTeRiB6qBLyaE4lvDIAmFaDWwEBsw== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1643036473; a=rsa-sha256; cv=none; b=nyzfi0tJFSVv02z+uCcv8QgfHQpy5AqF+8jIb7ONY0vUzkOux1AMRezkUv2pHwfkuDNskO w4n6VXjJvlLn8WILcZ44digPsk6U/K7MrBZG+sQKxp6iStvPjxCAhx72OmbcsqoahGcIVB 1XvEQkNBvcwGQNqd7RKBaqDmG5GM344BKShBf9VGhGT7Ver7gCY2F98G6hYzbIaETiFWJO i1WfZ3VvhmO9OUgpZVCjwv1eboW55pDCw0PRFxDvEJiptxz45yZZWyla1E3wzTXzHeMAox 2bHSJJEKaDgORn+95rVMNaUkcXHuKwv/bKQAx06h4tmK+0AWEBMC/xY6OfdVKQ== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=none; dmarc=pass (policy=none) header.from=gnu.org; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" X-Migadu-Spam-Score: -2.63 Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=pass (policy=none) header.from=gnu.org; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" X-Migadu-Queue-Id: EF3773A18B X-Spam-Score: -2.63 X-Migadu-Scanner: scn1.migadu.com X-TUID: GRVMsESAffi6 Hi! Timothy Sample skribis: > I also played around with it and came up with > > https://ngyro.com/pog-reports/2022-01-16/missing-sources.json > > This is a =E2=80=9Csources.json=E2=80=9D that only lists the =E2=80=9Cmis= sing=E2=80=9D and =E2=80=9Cunknown=E2=80=9D > sources from the PoG report. It lists sources across all commits (since > 1.0.0). This might be the easiest thing for SWH to handle, since it > omits nearly 20k sources that they definitely already have. Since they > don=E2=80=99t have the tarball hashes, they have no way to skip downloadi= ng and > processing tarballs that they already have by hash. Hence, filtering it > with the extra data we have through the PoG projects should be something > that they welcome! > > If they want, they could point a loader task at > > https://ngyro.com/pog-reports/latest/missing-sources.json > > and I could publish updates when I publish new PoG reports. Sounds great! Could you ask them whether they could do that? It may be that it=E2=80=99s going to be a one-time thing, if everything goes well. > There=E2=80=99s one other thing to think about. Some of our sources are > arguably unsuitable for SWH. For instance, our bootstrap binaries. I > bet we have a bunch of other borderline things, too, like game assets. > Of course, if they are indiscriminately ingesting Github, I=E2=80=99m sure > they=E2=80=99ve loaded plenty of garbage. Mostly, I think about these th= ings > because I believe it=E2=80=99s important to maintain the Guix-SWH relatio= nship. Right, it would be nice to filter them out somehow, even though it=E2=80=99= s a drop in the ocean of binaries that SWH ingests routinely (for instance that=E2=80=99s the reason why we find some tarballs, as is, via =E2=80=98lookup-content=E2=80=99). Thanks, Ludo=E2=80=99.