From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp1 ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id EAN1LKw4aGGFFAEAgWs5BA (envelope-from ) for ; Thu, 14 Oct 2021 16:03:24 +0200 Received: from aspmx1.migadu.com ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp1 with LMTPS id 2CT+J6w4aGFLJAAAbx9fmQ (envelope-from ) for ; Thu, 14 Oct 2021 14:03:24 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 61F9114C29 for ; Thu, 14 Oct 2021 16:03:24 +0200 (CEST) Received: from localhost ([::1]:55834 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1mb1KN-0005zG-Ir for larch@yhetil.org; Thu, 14 Oct 2021 10:03:23 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:45458) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mb1K0-0005yv-FR for guix-devel@gnu.org; Thu, 14 Oct 2021 10:03:03 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]:48526) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1mb1K0-0003Fa-6y; Thu, 14 Oct 2021 10:03:00 -0400 Received: from 91-160-117-201.subs.proxad.net ([91.160.117.201]:60647 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mb1Jv-0006Mw-RG; Thu, 14 Oct 2021 10:02:59 -0400 From: =?utf-8?Q?Ludovic_Court=C3=A8s?= To: zimoun Subject: Re: Disarchive update References: <87r1cu1pj5.fsf@inria.fr> <86r1cqmwh5.fsf@gmail.com> X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 23 =?utf-8?Q?Vend=C3=A9miaire?= an 230 de la =?utf-8?Q?R=C3=A9volution?= X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu Date: Thu, 14 Oct 2021 16:02:53 +0200 In-Reply-To: <86r1cqmwh5.fsf@gmail.com> (zimoun's message of "Tue, 12 Oct 2021 11:19:18 +0200") Message-ID: <87ilxzpuuq.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: guix-devel@gnu.org Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: "Guix-devel" X-Migadu-Flow: FLOW_IN ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1634220204; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-unsubscribe:list-subscribe:list-post; bh=gL/ERiTcIAcm6BozBcghPTSdeC/cl0IQE9MK9mHeawo=; b=A5nwDUfwvSH4rBgOLZ5TDlnfxdHtF0k0VJKpjTPoimgcmUyMo8inSzMXuJHJLvlipb1MS7 gAzjNZ66gwCad/1U6aLEWFA68r6QAuWDHrBHY/ps5DqlEDtOxJxsZWXax9ifraDr+ejlh1 ZjO0CptTqssi4N/99Ug3d/eL6pVgvUPByA7SGrvULIrcSEyLDCcTHanEFOFoQ90dnDzDVU m9CFCHnUHvm7g+Bs6E2l8Z2+lys7zczVLka02UP0iHGR+hQ+36rYAQscSjsgWJRXoApERg 0xJVJ2iOGyzunxVy7aJbvyY+A4sPMsR4JYguhSfECw4/WCOCnU6w/e0iSdaX3w== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1634220204; a=rsa-sha256; cv=none; b=CSeMul7+cj2M1+TX01b7QVKMNj/js6SSRMJPkGRXCVmth0mPjtfcNrxFaIdtCAFs2ah39M SmXcyW4R+mvJFtx5b/R/OZz6oEwwRfzbFB2DB0ekKLnbsxyNxPVmgiMT1q2mjrOnJqonfN cmQiaDJlhteMBN+elaxEt09oQG4UD3tyILcT/3ZONmVjEWIih7MvHxtqLYnK4pcpl/trzk 8BXfsFqiIA+HpvPkdSIDgBPiEoiWepQM97kwhwIFeNw22v+NkKzXVTSRooe+TFWrf1dBOK NsB8LavcwDxsOXltZcc9rAREogw6eD7B+jywKX5Nqy3iYRt6gtwSHR9NXGBsKw== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=none; dmarc=pass (policy=none) header.from=gnu.org; spf=pass (aspmx1.migadu.com: domain of guix-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-devel-bounces@gnu.org X-Migadu-Spam-Score: -2.91 Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=pass (policy=none) header.from=gnu.org; spf=pass (aspmx1.migadu.com: domain of guix-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-devel-bounces@gnu.org X-Migadu-Queue-Id: 61F9114C29 X-Spam-Score: -2.91 X-Migadu-Scanner: scn0.migadu.com X-TUID: xEe2ezumQN78 Hey! zimoun skribis: > Timothy made this table months ago: > > tar+gz 9090 52.0% > git 5294 30.3% > tar+xz 1184 06.8% > tar+bz2 775 04.4% > tar 393 02.2% > zip 273 01.6% > svn-multi 175 01.0% > svn 125 00.7% > file 51 00.3% > computed 38 00.2% > hg 36 00.2% > unknown-uri 20 00.1% > tar+gz? 15 00.1% > tar+lz 13 00.1% > tar+Z 4 00.0% > cvs 3 00.0% > bzr 3 00.0% > tar+lzma 2 00.0% > total 17494 100.0% > > What is really missing is XZ and Bzip2 support in Disarchive, I guess. Definitely, we know what to work on next! > Timothy was working on feeding the database using each release. Well, > you can give a look at: > > Ah nice! I had completely overlooked this. [...] >> A plan we can already deploy would be: >> >> 1. Add the disarchive.guix.gnu.org DNS entry, pointing to berlin. >> >> 2. On berlin, add an mcron job that periodically copies the output of >> the latest =E2=80=9Cdisarchive-collection=E2=80=9D build to a direc= tory, say >> /srv/disarchive. Thus, the database would accumulate tarball >> metadata over time. >> >> 3. Add an nginx route so that /srv/disarchive is served at >> https://disarchive.guix.gnu.org. >> >> 4. Add disarchive.guix.gnu.org to (guix download). > > To replace (or add to) the current =E2=80=99%disarchive-mirrors=E2=80=99 = right? Exactly. > Going this road (use Cuirass), why not generating the sources.json > similarly? Instead of the hack using the website builder. I guess that would also work, indeed. Then we could make /source.json redirect to ci.guix.gnu.org/whatever/latest. > On my side, I will try to resume what I started months ago: knowing the > SWH coverage. For instance, on this ~92% of tarballs, how many are > currently stored into SWH? Well, do not take your breath and I would be > happy if someone beats me. ;-) Yup, we definitely need that kind of info now! Ludo=E2=80=99.