From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp0 ([2001:41d0:8:6d80::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id OGq/AqppYWGBsQAAgWs5BA (envelope-from ) for ; Sat, 09 Oct 2021 12:06:34 +0200 Received: from aspmx1.migadu.com ([2001:41d0:8:6d80::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp0 with LMTPS id wLAuOKlpYWHJGwAA1q6Kng (envelope-from ) for ; Sat, 09 Oct 2021 10:06:33 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 9ECEE13958 for ; Sat, 9 Oct 2021 12:06:33 +0200 (CEST) Received: from localhost ([::1]:33310 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1mZ9FQ-0000y8-OL for larch@yhetil.org; Sat, 09 Oct 2021 06:06:32 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:59804) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mZ9Et-0000xu-PK for guix-devel@gnu.org; Sat, 09 Oct 2021 06:06:01 -0400 Received: from mail3-relais-sop.national.inria.fr ([192.134.164.104]:61384) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mZ9Er-0006FR-8v for guix-devel@gnu.org; Sat, 09 Oct 2021 06:05:59 -0400 IronPort-HdrOrdr: =?us-ascii?q?A9a23=3AX3sbWKvcnDcyvBcIM9MfGPRC7skDhtV00zEX?= =?us-ascii?q?/kB9WHVpm6uj5rmTdZUgpHnJYVkqKRMdcLy7U5VoIkmskqKdg7NhWItKNTOO0F?= =?us-ascii?q?dAR7sO0WKN+Vfd8mHFh4pg/JYlVZIWMqySMXFKyf/V2U2WE9EvzMKf66CumI7l?= =?us-ascii?q?r0tFfEVSRZglzQtoYzz7LmRGADBpPN4aGIrZxucvnVSdUEVSVcilAHwYQujEoN?= =?us-ascii?q?XRhNbKaQMLbiRJ1CC+yQ+SzdfBfySl4g=3D=3D?= X-IronPort-AV: E=Sophos;i="5.84,326,1620684000"; d="scan'208";a="395386458" Received: from 91-160-117-201.subs.proxad.net (HELO ribbon) ([91.160.117.201]) by mail3-relais-sop.national.inria.fr with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 09 Oct 2021 12:05:51 +0200 From: =?utf-8?Q?Ludovic_Court=C3=A8s?= To: Subject: Disarchive update X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 18 =?utf-8?Q?Vend=C3=A9miaire?= an 230 de la =?utf-8?Q?R=C3=A9volution?= X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu Date: Sat, 09 Oct 2021 12:05:50 +0200 Message-ID: <87r1cu1pj5.fsf@inria.fr> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Received-SPF: pass client-ip=192.134.164.104; envelope-from=ludovic.courtes@inria.fr; helo=mail3-relais-sop.national.inria.fr X-Spam_score_int: -41 X-Spam_score: -4.2 X-Spam_bar: ---- X-Spam_report: (-4.2 / 5.0 requ) BAYES_00=-1.9, RCVD_IN_DNSWL_MED=-2.3, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: "Guix-devel" X-Migadu-Flow: FLOW_IN ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1633773993; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding:list-id:list-help: list-unsubscribe:list-subscribe:list-post; bh=YA3ZG9otsQCMK0pDaUpOM1WLi1EYG1Jaj7fw0eUsYJc=; b=SYbTVU+enlNeO7rSXMDSRg4o6OD76YqLUUEYVJZ23/sJ04LjIwA7pL5IExxm2EZ9wTM/Xd pWX3Uazy2SBgDJlBT23nGymGcfuh1mtqrlh+OiESzpVoKF5Aa7xqeZf9l8x2PVcE+tMT0C BHVnONQr7VYOEhe1wEFSULwYiyZx+19arFAlY32qAaKAKMD3wVzKoO86egtWJgr2kMHHmS mlQ2trt6M0rhl0E1khSh/tQ4+bVr9XokmvEHwpfGWfKeUozG4jd1RAiB0Zps+8JxTvJCh8 Q+wJCbzFm7zQSgiaMQdqwYIHy0CSmp/gPDyJm6tNB+hdr1HFSqsRKckzcOCbhA== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1633773993; a=rsa-sha256; cv=none; b=sFLurH+T8YG6h+93rz5UcY3UClhOp5P5a8WgqI/BokBDRkVyk6I2etnxIAc/HG4R9o33EZ QGH9k867JiTl9Ox3yG7DiVyB0K/dANlGDNzwOU5OZiIGvSqpupbudS98RYVjEug10Vkqd4 qEbJo6QR+ID//ca0dtW2yVbrM+AnVF8ylxGExi7ROAqMmUkJwX57in0UMPXDqnKDXhgf9Z x+RmtFIFzfw7Mf8NpNbXcwqgmPm6Nggn0hQHrL/P4O/eyv8kAasSb6E+GRAtydYs0Wy6ce dkfEdmhtP5m5kkeK/NKFuZhz50KqLmFXDknnQEHr4SlFQ7emBYNecwBrZPnnpQ== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of guix-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-devel-bounces@gnu.org X-Migadu-Spam-Score: -2.41 Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of guix-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-devel-bounces@gnu.org X-Migadu-Queue-Id: 9ECEE13958 X-Spam-Score: -2.41 X-Migadu-Scanner: scn0.migadu.com X-TUID: fjan9Ni4H9Y3 Hello Guix! This job is disassembling all the .tar.gz files packages refer to, using the recently-added =E2=80=98etc/disarchive-manifest.scm=E2=80=99 file: https://ci.guix.gnu.org/jobset/disarchive It has just succeeded for the first time. :-) https://ci.guix.gnu.org/eval/29213?status=3Dsucceeded If you run: guix build /gnu/store/nnl67m8c2x9rwqbnych1agc6p7g5473g-disarchive-collect= ion.drv or: guix build -m etc/disarchive-manifest.scm and if you=E2=80=99re patient :-), you eventually get a 579=C2=A0MB directo= ry containing Disarchive metadata for 8,413 tarballs out of 9,113 (the missing tarballs are those that =E2=80=9Cdisarchive disassemble=E2=80=9D fa= ils to handle, for instance because it couldn=E2=80=99t guess what compression met= hod is being used.) Where to go from here? Timothy Sample had already set up a Disarchive database at , which (guix download) uses as a fallback; I=E2=80=99m not sure exactly how it=E2=80=99s populated. Th= e goal here would be for the Guix project to set up infrastructure populating a database automatically and creating backups, possibly via SWH (we=E2=80=99ll have to discuss it with them). A plan we can already deploy would be: 1. Add the disarchive.guix.gnu.org DNS entry, pointing to berlin. 2. On berlin, add an mcron job that periodically copies the output of the latest =E2=80=9Cdisarchive-collection=E2=80=9D build to a director= y, say /srv/disarchive. Thus, the database would accumulate tarball metadata over time. 3. Add an nginx route so that /srv/disarchive is served at https://disarchive.guix.gnu.org. 4. Add disarchive.guix.gnu.org to (guix download). How does that sound? Thoughts? Ludo=E2=80=99.