From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp0.migadu.com ([2001:41d0:303:5f26::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms8.migadu.com with LMTPS id qJehN/iLoWX/bAAAkFu2QA (envelope-from ) for ; Fri, 12 Jan 2024 19:59:04 +0100 Received: from aspmx1.migadu.com ([2001:41d0:303:e224::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp0.migadu.com with LMTPS id AIJTNPiLoWUU5AAAqHPOHw (envelope-from ) for ; Fri, 12 Jan 2024 19:59:04 +0100 X-Envelope-To: larch@yhetil.org Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1705085944; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-unsubscribe:list-subscribe:list-post; bh=sipTm2ebCn0VDfyLYzrwlWHaGWjDlD5wLtqC1Pg4pHg=; b=DPlmgQqpdlLWZ/KMQmkx7sO9lIrDWImM6rH6/4Go7Wqn6ZC/sL9gQLZlFlDRtgjuOHL32A 8jj31kBT1S9pWOrv7McCmHhXd6hoITBp5mGesDO8oewq0lp3uUNzEkv7kbNvnSxbsqJk24 B0/MQwEVtnFst4HeO+o+OgMbEgtmpdrRCF2p54pDsjTCLxwrBHonQ6sJduuqtQqwMAIe+x rXNPKZVj3N0iHgaEiESo+BOng2nUSu40KxB8ByVWIMPh0CzyIcpFbSBtAbebBHKiS3ji/A UzXIKCVHO9Qs/gMySenQbIsEFev8pvpZIs4WZ9xxNT5DTZRcTMq6eApCMuFfeg== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" ARC-Seal: i=1; s=key1; d=yhetil.org; t=1705085944; a=rsa-sha256; cv=none; b=ZMvGxOi0fTLEwXDwkclCq9vG1Imptp50OFlq/J2vVWT8wbedoaX8pbLJIwH/Ljn1vmzfQm V3EW+23Jk7riYkG4APdeFCuZAqy6SSRmL16pxonHaP3h8KS/rpzdS8bkz/wYpRO6SUllgh fFD8hgXhOqwxJd9yah4ApwFrvG8iiXHFCYW1SbWMmRHGb+KHGaPYuCtOKslciO1XZKoMJJ bnWLQGSTSpxyPO9Kva7ZyoJqQS4SQsTWGZFHEGAU4pXCBRJqEkv2FkFAyrQByWKEjWq9/T m5S5hofXX7zFMtHwi7uaCXw+QqpavvTJ0FYbamKto7hfNAz1wPGwBEVal8NIOg== Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id BF8D8615C5 for ; Fri, 12 Jan 2024 19:59:04 +0100 (CET) Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1rOMjh-0005sN-JJ; Fri, 12 Jan 2024 13:58:33 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1rOMjf-0005sF-1O for guix-devel@gnu.org; Fri, 12 Jan 2024 13:58:31 -0500 Received: from ins-par6-b11-fml1.inserm.fr ([195.15.132.67] helo=INS-MLY-A317-FML1.inserm.fr) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1rOMjc-0001Ax-Nh for guix-devel@gnu.org; Fri, 12 Jan 2024 13:58:30 -0500 Received: from mail.inserm.fr ([172.31.200.105]) by INS-MLY-A317-FML1.inserm.fr with ESMTP id 40CIgAFj025379-40CIgAFl025379 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Fri, 12 Jan 2024 19:42:10 +0100 Received: from PAR6-SRV-EX05.adn.inserm.fr (172.31.200.105) by PAR6-SRV-EX05.adn.inserm.fr (172.31.200.105) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.1118.30; Fri, 12 Jan 2024 19:42:10 +0100 Received: from PAR6-SRV-EX05.adn.inserm.fr ([fe80::34d5:c6f6:809d:ef3c]) by PAR6-SRV-EX05.adn.inserm.fr ([fe80::34d5:c6f6:809d:ef3c%20]) with mapi id 15.02.1118.030; Fri, 12 Jan 2024 19:42:04 +0100 From: Simon TOURNIER To: "swh-devel@inria.fr" , "community@nixos.org" , "guix-devel@gnu.org" CC: ludovic.courtes Subject: RE: [swh-devel] Call for public review - SWH Nix/GNU Guix stack Thread-Topic: [swh-devel] Call for public review - SWH Nix/GNU Guix stack Thread-Index: AQHaQp/384IGKA767EiU2ZRkiBEM+bDWhyYR Date: Fri, 12 Jan 2024 18:42:04 +0000 Message-ID: References: In-Reply-To: Accept-Language: fr-FR, en-US Content-Language: fr-FR X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [172.31.51.3] Content-Type: text/plain; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-FE-Policy-ID: 1:3:2:SYSTEM Received-SPF: none client-ip=195.15.132.67; envelope-from=simon.tournier@inserm.fr; helo=INS-MLY-A317-FML1.inserm.fr X-Spam_score_int: -18 X-Spam_score: -1.9 X-Spam_bar: - X-Spam_report: (-1.9 / 5.0 requ) BAYES_00=-1.9, KHOP_HELO_FCRDNS=0.001, SPF_HELO_NONE=0.001, SPF_NONE=0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=unavailable autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: guix-devel-bounces+larch=yhetil.org@gnu.org X-Migadu-Flow: FLOW_IN X-Migadu-Country: US X-Migadu-Spam-Score: -6.70 X-Spam-Score: -6.70 X-Migadu-Queue-Id: BF8D8615C5 X-Migadu-Scanner: mx12.migadu.com X-TUID: mZAm+1Kfqc74 Hi, > The initial NixGuix loader (currently in production) lists and loads > origins from a manifest, ignoring the specific origins mentioned above. T= he > new stack will be able to ingest those origins. It will also optionally > associate, if present, a NAR hash (specific intrinsic identifier to Nix a= nd > Guix) to what=92s called an ExtID (SWH side). Cool! Thank you. > Regarding the SWH API reading side of the ExtID though is a work to be do= ne. In short, currently Guix relies on SWH API for resolving from =93something=94 to SWHID, where =93something=94 can be: + Git label tag + url + Git commit hash + plain url Well, the situation is in good shape IMHO =96 I do not have recent numbers, say all is fine for 75% of all Guix packages and for 90% of Guix packages coming from some Git repositories =96 but still, we have examples where =93Git label tag + url=94 fails. For one instance, see [1] pointed by [2]. The information =96 history of history =96 is there in SWH but it would require on Guix side to parse the snapshot information and extract as best as possible; trying several SWH snapshots until a match. Something like that. Chance of success until completion? Weak. :-) Moreover, what about the missing 25%? They are Guix packages coming from Mercurial repositories or from Subversion repositories or some others. Back on October 2020, we had discussion [3] for sending a save request for packages using SVN checkouts but at the time we did not have a clear path for retrieving. Then on March 2023, maybe an path for retrieving with this discussion [4]=85 but still many hacks are required [5]. Again, the information is there in SWH but it would require on Guix side to parse the snapshot information and extract as best as possible; trying several SWH snapshots until a match. Something like that. Chance of success until completion? Weak. :-) If only one source is missing, all the castle potentially falls down. Some= how, a dictionary from ExtID as nar hash to SWHID would help to have the castle more robust. :-) The SWH archive coverage of Guix packages would not be 75% because we, on Guix side, are not able to know or retrieve these missing 25%. Such dictio= nary could reinforce the bridge between reproducible computational environment=20 and archiving, IMHO. So yeah, we are looking forward to some ExtID interface. :-) Cheers, simon 1: https://issues.guix.gnu.org/66015#0-lineno53 2: https://gitlab.softwareheritage.org/swh/devel/swh-loader-git/-/issues/47= 51#note_148587 3: https://issues.guix.gnu.org/43442#9 4: https://sympa.inria.fr/sympa/arc/swh-devel/2023-03/msg00009.html 5: https://issues.guix.gnu.org/43442#13