From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp10.migadu.com ([2001:41d0:8:6d80::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms9.migadu.com with LMTPS id oPoPMgGZEGRySAEASxT56A (envelope-from ) for ; Tue, 14 Mar 2023 16:55:45 +0100 Received: from aspmx1.migadu.com ([2001:41d0:8:6d80::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp10.migadu.com with LMTPS id kKdGMQGZEGRTXwAAG6o9tA (envelope-from ) for ; Tue, 14 Mar 2023 16:55:45 +0100 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 53038A929 for ; Tue, 14 Mar 2023 16:55:45 +0100 (CET) Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=inria.fr header.s=dc header.b=U71ey4aw; dmarc=pass (policy=none) header.from=inria.fr; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1678809345; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:list-id:list-help:list-unsubscribe: list-subscribe:list-post:dkim-signature; bh=3bkl+J90WCDQ/+w6PiRXe8pVNJs9J2PojdBHR6SQK6I=; b=MGxTWbsBckiiJhhfYiB26FBhhgGcb/2Wtx91v6TTdbIR8I/t9lJLRItnkJ7aN66i+Eva5D EFFuEhtsiQ9Zy/rVf4TampBDdyMoad4cX8V4W4NUiElCYuWWspBwMRekTV1kgVnz4L1JfP EPJS8a1OvWmGays7gtEylLvrAWCNgdx5q8io3Z/zC6ukYACSbx/dlyXLcjoquRHfDdsB6v 3oBb8PnBR+18TFOwhnYSI9nEkVCtwJbQwJRzNPr1XHMQqnNkYdHe6TKzjyrUXjtAMkqnxx H67Ltk7Z8XizikciJ0EkB3KyCngC9qFOixY6V28/JtoZu8ZbcH1LSaBHh9h+eQ== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=pass header.d=inria.fr header.s=dc header.b=U71ey4aw; dmarc=pass (policy=none) header.from=inria.fr; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" ARC-Seal: i=1; s=key1; d=yhetil.org; t=1678809345; a=rsa-sha256; cv=none; b=nIk81xPy2Iv0vpL/u6U1GqOhJoHEZ5Y8Ul+IpTg54P9e/z1+Qtpp+Qlj5SjAjuvMmVa3ZX Wh21lzXZe4p3ShB5EKyEKcsaQyDllsTQ8STCnL5r4akmhGD5ulubR71aooVYFYwX/VvRXE AGo4TweYty7o1eT+v3AZ9KYVZqHOO0htUgWWTFoGdaTi3pemY12JvPtp+V4VkpJR7/RRAI cqLk0c4+im0m2O3bgg+ie9DkI4xmd2eOUJzpCDCXyXtb053u9/G1bNHZM5exOHl4iO3DDC HRMazcSWb1nD4+qTQnzE7QAwnsaWeinxB8RgSycNdUIgtF/PlVpHnGUHPc6Krg== Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1pc6zo-0007gV-Ro; Tue, 14 Mar 2023 11:55:28 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1pc6zk-0007eb-Aq; Tue, 14 Mar 2023 11:55:24 -0400 Received: from mail3-relais-sop.national.inria.fr ([192.134.164.104]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1pc6zh-00022G-4T; Tue, 14 Mar 2023 11:55:23 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inria.fr; s=dc; h=from:to:subject:cc:date:message-id:mime-version; bh=3bkl+J90WCDQ/+w6PiRXe8pVNJs9J2PojdBHR6SQK6I=; b=U71ey4awmhyyb8K/IqXK/zkCnzTQemMGqmV0FOArei0ltQ0aeFRP3YqP RHdgKvj524MZi9YLVS9MdQLD1PbLzuU7b124G57W19ovKqVwmPK6Lt2LQ ZguRNq0Cn5bjrNdVWHQLJ2iRXrU+Je1bqa31nEjcceuRowjtT+HI7MqfI E=; X-IronPort-AV: E=Sophos;i="5.98,260,1673910000"; d="asc'?scan'208";a="50166186" Received: from unknown (HELO ribbon) ([193.50.110.253]) by mail3-relais-sop.national.inria.fr with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 14 Mar 2023 16:55:12 +0100 From: =?utf-8?Q?Ludovic_Court=C3=A8s?= To: guix-devel Subject: Disarchive database synchronization CC: guix-sysadmin@gnu.org, Timothy Sample , Simon Tournier X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: Quartidi 24 =?utf-8?Q?Vent=C3=B4se?= an 231 de la =?utf-8?Q?R=C3=A9volution=2C?= jour de la =?utf-8?Q?P=C3=A2querette?= X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu Date: Tue, 14 Mar 2023 16:55:07 +0100 Message-ID: <877cvj2uqs.fsf@inria.fr> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.2 (gnu/linux) MIME-Version: 1.0 Content-Type: multipart/signed; boundary="==-=-="; micalg=pgp-sha512; protocol="application/pgp-signature" Received-SPF: pass client-ip=192.134.164.104; envelope-from=ludovic.courtes@inria.fr; helo=mail3-relais-sop.national.inria.fr X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: X-Migadu-Queue-Id: 53038A929 X-Spam-Score: -13.92 X-Migadu-Spam-Score: -13.92 X-Migadu-Scanner: scn0.migadu.com List-Subscribe: , Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: guix-devel-bounces+larch=yhetil.org@gnu.org X-Migadu-Country: US X-Migadu-Flow: FLOW_IN X-TUID: v66KIHsHyCjU --==-=-= Content-Type: multipart/mixed; boundary="=-=-=" --=-=-= Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Hello Guix! As you may know, there are currently two different Disarchive databases: the one at that Timothy Sample set up a few years back, and the one at that we set up later, with a continuous integration job to populate it=C2=B9. The database at ngyro.com has more historical metadata (metadata about tarballs that older Guix revisions referred to) because Timothy worked hard to populate it with tarballs from all the packages Guix refers to starting from 1.0=E2=80=94which is crucial for long-term reproducibility. Thanks to Timothy, I have now copied over things from disarchive.ngyro.com to disarchive.guix.gnu.org. The stats are as follows: disarchive.ngyro.com had 28,396 entries 12,905 (45%) entries were missing from disarchive.guix.gnu.org 15,491 (the rest: 55%) entries were present in both yet different. 3,444 entries of disarchive.guix were missing from disarchive.ngyro=C2=B2 I copied over the 12K entries that were missing from disarchive.guix.gnu.org. (Note that there are currently only two copies of the database: one at/in [bB]erlin, and one at/in [Bb]ordeaux.) disarchive.guix.gnu.org now weighs in at 1.8=C2=A0GiB for 31,839 entries. For the remaining entries, it=E2=80=99s trickier. Sometimes it=E2=80=99s j= ust the gzip compression parameters that differ, which could be addressed with a little bit more work: =2D-8<---------------cut here---------------start------------->8--- $ file ffdc77f5e5cb2390b9309de63eb7be68d9fe631e898f4da6c04a8159daefc2c0.gz = ../../disarchive/sha256/ffdc77f5e5cb2390b9309de63eb7be68d9fe631e898f4da6c04= a8159daefc2c0.gz ffdc77f5e5cb2390b9309de63eb7be68d9fe631e898f4da6c04a8159daefc2c0.gz: = gzip compressed data, max compression, from Unix, origina= l size modulo 2^32 446731 ../../disarchive/sha256/ffdc77f5e5cb2390b9309de63eb7be68d9fe631e898f4da6c04= a8159daefc2c0.gz: gzip compressed data, max speed, from Unix, original size= modulo 2^32 446731 =2D-8<---------------cut here---------------end--------------->8--- Sometimes it=E2=80=99s trickier: --=-=-= Content-Type: text/x-patch Content-Disposition: inline # diff -u <(gunzip -d < 0001f025c1425ffe36270a81cb091eade87dd8d29ac773735ae47e1a8c8066c9.gz) <(gunzip -d < ../../disarchive/sha256/0001f025c1425ffe36270a81cb091eade87dd8d29ac773735ae47e1a8c8066c9.gz) --- /dev/fd/63 2023-03-14 16:13:21.635733426 +0100 +++ /dev/fd/62 2023-03-14 16:13:21.635733426 +0100 @@ -1,7 +1,7 @@ (disarchive (version 0) (gzip-member - (name "webview-sys-0.6.2.tar.gz") + (name "rust-webview-sys-0.6.2.tar.gz") (digest (sha256 "0001f025c1425ffe36270a81cb091eade87dd8d29ac773735ae47e1a8c8066c9")) @@ -13,7 +13,7 @@ (footer (crc 1807070134) (isize 121344)) (compressor zlib-best) (input (tarball - (name "webview-sys-0.6.2.tar") + (name "rust-webview-sys-0.6.2.tar") (digest (sha256 "4fb18f3206838e11f7f8caba6fad9e0f796109428b502793b9f2f0613fe0f275")) @@ -78,7 +78,7 @@ (padding 0) (input (directory-ref (version 0) - (name "webview-sys-0.6.2") + (name "rust-webview-sys-0.6.2") (addresses (swhid "swh:1:dir:fa41df38bf639ada28c900b0915661e787fe6d15")) (digest --=-=-= Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable As Tim pointed out, Disarchive disassembly is not fully deterministic and/or might change a bit over time as Disarchive evolves, and that=E2=80= =99s prolly what we=E2=80=99re seeing here. The admins among us can see the remaining files in /gnu/disarchive.ngyro.com on berlin. That directory also contains two files: =E2=80=98files-present-in-both-yet-different.txt=E2=80=99 and =E2=80=98files-that-were-missing.txt=E2=80=99. Kudos to Timothy for making it possible. Feedback welcome! Ludo=E2=80=99. =C2=B9 https://lists.gnu.org/archive/html/guix-devel/2021-10/msg00060.html =C2=B2 Some of these showed up at disarchive.ngyro.com since I copied the database ~16h ago. Example missing entry is =E2=80=9Csamplv1-0.9.24.tar.= gz=E2=80=9D: . --=-=-=-- --==-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQJNBAEBCgA3FiEEPORkVYqE/cadtAz7CQsRmT2a67UFAmQQmNsZHGx1ZG92aWMu Y291cnRlc0BpbnJpYS5mcgAKCRAJCxGZPZrrtSxkD/9Y/lJUfh7uMsqWKghlq6Yj NT0SZb4hCjeCMCwDF7Svq9073JjkzaEghF/tZUXUK5/m5WYXZcSy4cldRmp6yIcc S0RKV6zXH4ks+xff5daMahC3FdAu7b9+f7jirnuq5/di3sl/Xw7owLjcIwIj4xqo FskEkrcxwC42FSjQ7M5Umk027Iz3zLLblIKngNeeMD57mpQ/FPMGvgEDaX+TcyDB z1WhLlt2hxujSHzlSpL7ruTKuPWAro2gZg3hUqt5jxywPBJlSjDZ9pDTOZBZB/vx u68tRljPUaZg7Chd+R3S7hiBcY35jE8R+Wz7HuuG4izol56rzvUZo0SqU4X3oo5E iheMBk0nf5wlADKtLUayoidCznGPVXQugg2soTbxSFc2v9lKsF4hr3M90mCXYRC/ wJllT1VOqd5h0THUt/B/5lvKLhl+M1UoHeRZgxDITGU/2bE6HiKRWhAf63OP3m3g rMg/QsDOKWWbmZGptdjYIH1QN1hEegAlTInAwxqtlc6ZhswJ1J8xJrkE3AmLrJi1 J87unHZW6bPiwhcdeMZtEidyW9hbq0X7vZpYPLdJsgeAmTQDwntGyEtu6y9q+JvN FR5dJ/I43VoP8ezMr6W93yHww4YOGdL/PqAfyuqcbzzSAHyK5XrhF8rKD32PKpch 0XiEAXrT7SybckRhKtEnSA== =+84y -----END PGP SIGNATURE----- --==-=-=--