From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp0.migadu.com ([2001:41d0:303:5f26::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms8.migadu.com with LMTPS id OGOLOPffn2XBWQEAkFu2QA (envelope-from ) for ; Thu, 11 Jan 2024 13:32:55 +0100 Received: from aspmx1.migadu.com ([2001:41d0:403:58f0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp0.migadu.com with LMTPS id gCIaNPffn2W/EAAAqHPOHw (envelope-from ) for ; Thu, 11 Jan 2024 13:32:55 +0100 X-Envelope-To: larch@yhetil.org Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=inria.fr header.s=dc header.b=LLmhoYK9; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org"; dmarc=pass (policy=none) header.from=inria.fr ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1704976375; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-unsubscribe:list-subscribe:list-post:dkim-signature; bh=5widMNZRctm/flDsIFCt2ksGSQ6buO75336ezwePNUo=; b=I5rXEZrUUU2lDTt6JhzeTKUWPjC4zYERjvwl+ChZp7wJqE7qy+fewz0LHT2f3kxoEey2us KgutmTJMx5jzJYJgCWoIPYdi4CW08yZ2PO1WGOp+4PGmsragZLVCqQ/YylMBr6pX3thd8D 5MWwxCxZD1YmFweDQMKqN0NQ7/BOpKgwN6i5wzr1lxzOm+fpf/5jvSTTVjnoko8fcdCosN nlDLQ6jnnVhWU2rPoBmFYagx8M/olSs8NHx0/cwhj6X7YmnnU3SkvxlMBFLJIZe7ahvPWs 6UyxGCNqdOaiuExq2EYg+5UmTFmR+UKeMhSyLnYofSc6qvXr61ZlJ46zOyE08g== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=pass header.d=inria.fr header.s=dc header.b=LLmhoYK9; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org"; dmarc=pass (policy=none) header.from=inria.fr ARC-Seal: i=1; s=key1; d=yhetil.org; t=1704976375; a=rsa-sha256; cv=none; b=dBYDwWcCnSPDy8/HH8OgXAyj9jmkk01+IZg85GR6y6RNVjPm36uu74dLF+eWrwuyEyrKyL o25YhgAMIM+icIjAl/AOrxoflShkpoAfouRGGbBXIEUPc4YWmbX5NIuT33kut4UcnGNsi9 V9HSN2Pj2RrUzjswzHQ7I7O04GLeA7YOf+spbFplhxTxukYh11E76Jlkf7eR2O3ctqKJum 5lXELoIF3KGyjaqwqVtgrnArUuGX252fW1FE+eGN1pPsccGiTT31xHTuHP0o2oys4v2fVU S6X3S3MEKbf/pT2qzOrbKtza3J7Xc8ibb28oeSAlqp1LhouHnSAcjkbe5+3Mnw== Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 9F648396C8 for ; Thu, 11 Jan 2024 13:32:55 +0100 (CET) Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1rNuES-0003KG-94; Thu, 11 Jan 2024 07:32:24 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1rNuEQ-0003K6-4N for guix-devel@gnu.org; Thu, 11 Jan 2024 07:32:22 -0500 Received: from mail2-relais-roc.national.inria.fr ([192.134.164.83]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1rNuEN-0005WU-7j for guix-devel@gnu.org; Thu, 11 Jan 2024 07:32:21 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inria.fr; s=dc; h=from:to:cc:subject:in-reply-to:references:date: message-id:mime-version:content-transfer-encoding; bh=5widMNZRctm/flDsIFCt2ksGSQ6buO75336ezwePNUo=; b=LLmhoYK9V490ofEo2ZY+4hW4xFn2tI/EoolIcnW2lxGlLwWhoUlDkri/ MAp6FY2p9vim6WG256POHJTAO33ni7XaGnZ03dD96ZlRxhvRcm2Gq3k5V J2FgXLxOCrxq6nlBN9r4TJBRBp7sTsHBBtDMb50qthm1F1qnYuOHiyRDd 8=; X-IronPort-AV: E=Sophos;i="6.04,186,1695679200"; d="scan'208";a="146089937" Received: from unknown (HELO ribbon) ([193.50.110.52]) by mail2-relais-roc.national.inria.fr with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 11 Jan 2024 13:32:15 +0100 From: =?utf-8?Q?Ludovic_Court=C3=A8s?= To: Benoit Chauvet Cc: swh-devel@inria.fr, community@nixos.org, guix-devel@gnu.org, "Simon Tournier" Subject: Re: [swh-devel] Call for public review - SWH Nix/GNU Guix stack In-Reply-To: (Benoit Chauvet's message of "Tue, 9 Jan 2024 03:02:39 +0100") References: X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: Duodi 22 =?utf-8?Q?Niv=C3=B4se?= an 232 de la =?utf-8?Q?R=C3=A9volution=2C?= jour du Sel X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu Date: Thu, 11 Jan 2024 13:32:14 +0100 Message-ID: <87bk9soxtd.fsf@inria.fr> User-Agent: Gnus/5.13 (Gnus v5.13) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Received-SPF: pass client-ip=192.134.164.83; envelope-from=ludovic.courtes@inria.fr; helo=mail2-relais-roc.national.inria.fr X-Spam_score_int: -43 X-Spam_score: -4.4 X-Spam_bar: ---- X-Spam_report: (-4.4 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_MED=-2.3, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: guix-devel-bounces+larch=yhetil.org@gnu.org X-Migadu-Flow: FLOW_IN X-Migadu-Country: US X-Migadu-Spam-Score: -10.64 X-Spam-Score: -10.64 X-Migadu-Queue-Id: 9F648396C8 X-Migadu-Scanner: mx11.migadu.com X-TUID: +5Aavwdc3dEj Hi Benoit and all! (Cc: guix-devel rather than gnu-system-discuss.) Benoit Chauvet skribis: > Regarding the Nix/GNU Guix stack, Software Heritage will soon be ready to > support the > ingestion of specific versioned files, tarballs, git, hg, svn source code > listed in their respective manifests [1] (as origins). The new lister (and > extra loaders, namely > {Content|Directory|GitCheckout|SvnExport|HgCheckout}Loader) have been > deployed in our staging infrastructure [2]. Excellent! I believe this addresses a problem we recently reported regarding tarballs published with our own content-addressed URLs, which look like: https://bordeaux.guix.gnu.org/file/BiocNeighbors_1.20.0.tar.gz/sha256/0a5= wg099fgwjbzd6r3mr4l02rcmjqlkdcz1w97qzwx1mir41fmas My understanding is that so far these URLs were ignored by the lister/loader because they didn=E2=80=99t end in *.tar.*.=E2=81=B0 > The initial NixGuix loader (currently in production) lists and loads > origins from a manifest, ignoring the specific origins mentioned above. T= he > new stack will be able to ingest those origins. It will also optionally > associate, if present, a NAR hash (specific intrinsic identifier to Nix a= nd > Guix) to what=E2=80=99s called an ExtID (SWH side). > Regarding the SWH API reading side of the ExtID though is a work to be do= ne. > > On staging, we have currently ingested origins that were listed from the > GNU Guix manifest [3]. > > We have already improved the implementations after discussing multiple > limitations encountered along the way with the Guix community [4]. I=E2=80=99m sure Simon Tournier (Cc=E2=80=99d) already discussed with other= s at SWH how crucial it is for us to be able to query content by nar hash. Essentially, it would fill the gap that currently prevents us from retrieving Subversion checkouts from SWH=C2=B9 and more generally complicat= es retrieval of anything not referenced by a Git hash. So obviously, we=E2=80= =99re looking forward to that ExtID interface for SWH. Thanks for sharing this status update, these are all exciting news and perspectives! Ludo=E2=80=99. =E2=81=B0 https://issues.guix.gnu.org/39885#15-lineno60 =C2=B9 https://issues.guix.gnu.org/43442#13-lineno37