From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp2 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms11 with LMTPS id L9teHHQHnl/rBgAA0tVLHw (envelope-from ) for ; Sun, 01 Nov 2020 00:55:16 +0000 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp2 with LMTPS id EN/4F3QHnl97JgAAB5/wlQ (envelope-from ) for ; Sun, 01 Nov 2020 00:55:16 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 05A139404C5 for ; Sun, 1 Nov 2020 00:55:16 +0000 (UTC) Received: from localhost ([::1]:60224 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kZ1eM-000881-1F for larch@yhetil.org; Sat, 31 Oct 2020 20:55:14 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:34474) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1kZ0ti-0005Xk-Ed for guix-patches@gnu.org; Sat, 31 Oct 2020 20:07:02 -0400 Received: from debbugs.gnu.org ([209.51.188.43]:51614) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1kZ0ti-0007RZ-5R for guix-patches@gnu.org; Sat, 31 Oct 2020 20:07:02 -0400 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1kZ0ti-0004yo-18 for guix-patches@gnu.org; Sat, 31 Oct 2020 20:07:02 -0400 X-Loop: help-debbugs@gnu.org Subject: [bug#44199] [PATCH 0/1] An origin method for GNUnet FS URI's Resent-From: Maxime Devos Original-Sender: "Debbugs-submit" Resent-CC: guix-patches@gnu.org Resent-Date: Sun, 01 Nov 2020 00:07:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 44199 X-GNU-PR-Package: guix-patches X-GNU-PR-Keywords: patch To: zimoun , 44199@debbugs.gnu.org Cc: Timothy Sample , gnunet-developers@gnu.org Received: via spool by 44199-submit@debbugs.gnu.org id=B44199.160418919119102 (code B ref 44199); Sun, 01 Nov 2020 00:07:01 +0000 Received: (at 44199) by debbugs.gnu.org; 1 Nov 2020 00:06:31 +0000 Received: from localhost ([127.0.0.1]:34927 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kZ0tC-0004y1-Qk for submit@debbugs.gnu.org; Sat, 31 Oct 2020 20:06:31 -0400 Received: from rhcavuit02.kulnet.kuleuven.be ([134.58.240.130]:50581) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kZ0tA-0004xs-RJ for 44199@debbugs.gnu.org; Sat, 31 Oct 2020 20:06:30 -0400 X-KULeuven-Envelope-From: maxime.devos@student.kuleuven.be X-KULeuven-Scanned: Found to be clean X-KULeuven-ID: AEEDA120334.AD6B1 X-KULeuven-Information: Katholieke Universiteit Leuven Received: from icts-p-smtps-2.cc.kuleuven.be (icts-p-smtps-2e.kulnet.kuleuven.be [134.58.240.34]) by rhcavuit02.kulnet.kuleuven.be (Postfix) with ESMTP id AEEDA120334 for <44199@debbugs.gnu.org>; Sun, 1 Nov 2020 01:06:18 +0100 (CET) Received: from butterfly.local (178-119-10-153.access.telenet.be [178.119.10.153]) (using TLSv1.2 with cipher AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by icts-p-smtps-2.cc.kuleuven.be (Postfix) with ESMTPSA id 71874200A1; Sun, 1 Nov 2020 01:06:18 +0100 (CET) Message-ID: <05677842bc60336461f8fe77ebd3526b2b23efb9.camel@student.kuleuven.be> X-Kuleuven: This mail passed the K.U.Leuven mailcluster From: Maxime Devos Date: Sun, 01 Nov 2020 01:05:53 +0100 In-Reply-To: <86blgn4wk5.fsf@gmail.com> References: <5c72bcb9c86934deda97d952eb5cd459e615b313.camel@student.kuleuven.be> <86blgn4wk5.fsf@gmail.com> Content-Type: multipart/signed; micalg="pgp-sha256"; protocol="application/pgp-signature"; boundary="=-vSR/W3DbdPOXXxy8xdKE" User-Agent: Evolution 3.34.2 MIME-Version: 1.0 X-Spam-Score: -2.3 (--) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-Spam-Score: -3.3 (---) X-Mailman-Approved-At: Sat, 31 Oct 2020 20:55:01 -0400 X-BeenThere: guix-patches@gnu.org List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-patches-bounces+larch=yhetil.org@gnu.org Sender: "Guix-patches" X-Scanner: ns3122888.ip-94-23-21.eu Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of guix-patches-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-patches-bounces@gnu.org X-Spam-Score: -1.61 X-TUID: s2c7ZzvIDHHe --=-vSR/W3DbdPOXXxy8xdKE Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable [CC'd to Timothy Sample because of discussion of defining a new format for disarchive, and to gnunet-developers because of obvious reasons] A small status update! zimoun schreef op di 27-10-2020 om 14:39 [+0100]: > [...] >=20 > The story about archives as tarball is a bit more complicated. The > main > issue =E2=80=93as I understand it=E2=80=93 can be summarized as: Guix kno= ws the URL, > the > integrity checksum and only at package time the content of the > tarball. > Later in time, it is difficult to lookup because of this very > address; > and some are around: nar, swh-id, ipfs, gnunet, etc. >=20 > Bridges to reassemble the content are currently discussed, e.g., >=20 > > >=20 > Well, today the fallback of tarball archive to SWH is not reliable. >=20 >=20 > What is your question? ;-) I looked a bit into the GNUnet FS code and disarchive discussions. The part about tarballs seemed particularily relevant, as well as some older discussion on preserving the executable bit when using IPFS. Some issues with using GNUnet's directory format in GNUnet for Guix substitutes to address: * directory entries are not placed in any particular order. Solution: sort by file-name * there is no executable bit. Solution: define a new metadata property (*). This should only take a small patch to libextractor. (*) Not sure about the correct terminology * GNUnet sometimes inlines small files in directories, but strictly speaking when to do so is left up to the implementation. Solution: pick a fixed reference implementation. * By default, when publishing, gnunet-publish uses libextractor to figure out some meta-data (e.g. title, mime-type, album name), which may return different meta-data depending on the implementation. Solution: disable the use of libextractor, at least when GNUnet is used by Guix. I'm currently porting the directory creation code of GNUnet to Scheme (but not any other GNUnet code), to be used by Guix (for publishing substitutes) and disarchive (for reconstructing GNUnet directories). After addressing these issues, I believe I will end up with a fairly well-defined archive format. --=-vSR/W3DbdPOXXxy8xdKE Content-Type: application/pgp-signature; name="signature.asc" Content-Description: This is a digitally signed message part Content-Transfer-Encoding: 7bit -----BEGIN PGP SIGNATURE----- iJcEABYIAD8WIQTB8z7iDFKP233XAR9J4+4iGRcl7gUCX5374iEcbWF4aW1lLmRl dm9zQHN0dWRlbnQua3VsZXV2ZW4uYmUACgkQSePuIhkXJe6L+wEAvGIuqyOhZ8aM oiGQhaGINoV46XAmJ4JDx4vVpxON4zgBAK1wrsyGrBu5TmQbXdSPW9IdrmvSOR6P S2XBUHs04mcL =LVUJ -----END PGP SIGNATURE----- --=-vSR/W3DbdPOXXxy8xdKE--