From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp1 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id aNR6NFdPOWFPiQAAgWs5BA (envelope-from ) for ; Thu, 09 Sep 2021 02:03:35 +0200 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp1 with LMTPS id YFp1L1dPOWE3RAAAbx9fmQ (envelope-from ) for ; Thu, 09 Sep 2021 00:03:35 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 259E478BF for ; Thu, 9 Sep 2021 02:03:35 +0200 (CEST) Received: from localhost ([::1]:59096 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1mO7XS-00016O-6P for larch@yhetil.org; Wed, 08 Sep 2021 20:03:34 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:41172) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mO7Wb-0000jI-UF for guix-devel@gnu.org; Wed, 08 Sep 2021 20:02:43 -0400 Received: from mail-wm1-x32a.google.com ([2a00:1450:4864:20::32a]:54826) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1mO7Wa-0005Rm-0U; Wed, 08 Sep 2021 20:02:41 -0400 Received: by mail-wm1-x32a.google.com with SMTP id s24so51426wmh.4; Wed, 08 Sep 2021 17:02:39 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=from:to:cc:subject:in-reply-to:references:date:message-id :mime-version:content-transfer-encoding; bh=bDvwrMYWDGcWGc32uuK/ACDw5TWM7CsuKCfiUc8Q4Wc=; b=A5QGCnTxdW2t8Aolvg+6tSRILuEyMZCQcYgqoXfha+EPxAA/1OEiz4DqJQLdJG/W3b TgfOS7pHlYHdVlxe8Mjahf/FoapAdvewqXCUibFHIVXfN/xADuEpXcNVbVI2b1fR06Po zTV7VlH6rtPttVoUDmE5Gah/bXbOzLOu92B6NR1ggTBw8h/ZHSEhGj1fRYpvxbk5YQoH ul5OQj91Zuvn848cRXGLBOR1+r8hoDAz4FsuZkqGHulaQxELEpjzu1Gye8/lbaSQLQAT zs/nENiTyxkwQYzIy5eAfe8gif0xG0V3Mynog5mytR5J0e/Wv166wqm3wgSXQ9BvQ0WE KFXg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:from:to:cc:subject:in-reply-to:references:date :message-id:mime-version:content-transfer-encoding; bh=bDvwrMYWDGcWGc32uuK/ACDw5TWM7CsuKCfiUc8Q4Wc=; b=XEHlF7L9T1VitWUVO0Ol1oh/56YIeYLTWcqgq+7HBd9AMdKyPbMYlkJruTgkkYGLui U3vhtdZlRLTSPB5rh18PTc03JlkNnB4if2Ja/NGejnxi24IsoOc3hsShGaZYjc6X+Ukk od8jyo26xvr+TimhckaHgugq6UcyMyOeAhB2L5o5T2P8rj7uSEv9lRzO/rRuQG3cK0Lt rzYt7A6BLGv/qrLvcRN2CaszjjNWhc5tgIUFGf5JyNDqJUAEd1Mji93ZZ4NQRO0cJsi2 +dZgAdcVNTVmyiyphPaE2BTtnYXVtXiEswvtyKdlCwiSTj/ZeBM/HRODTHPccM+zy9eL nhwQ== X-Gm-Message-State: AOAM531HZbSIKuo86IPBZ61gnxH82+WAIFD+YT3RMiv0FM1KXTjhQT0a CwR2RI9+t7ucMVCa26rf+NMT+E3MsSs= X-Google-Smtp-Source: ABdhPJyzlxVKXfHG/V6x/RsX2qjkzDFdT2+Jz9Qh58VJifUFUVOf41J+7wH+4nncRSe8yHUJoiGX1A== X-Received: by 2002:a7b:c745:: with SMTP id w5mr61262wmk.17.1631145757844; Wed, 08 Sep 2021 17:02:37 -0700 (PDT) Received: from lili ([2a01:e0a:59b:9120:65d2:2476:f637:db1e]) by smtp.gmail.com with ESMTPSA id g3sm82740wrh.94.2021.09.08.17.02.37 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 08 Sep 2021 17:02:37 -0700 (PDT) From: zimoun To: Ludovic =?utf-8?Q?Court=C3=A8s?= , Leo Famulari Subject: Why linux-libre source code is not in sources.json In-Reply-To: <877dfqhgny.fsf@gnu.org> References: <877dfqhgny.fsf@gnu.org> Date: Thu, 09 Sep 2021 01:46:16 +0200 Message-ID: <86tuiu8wc7.fsf@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Received-SPF: pass client-ip=2a00:1450:4864:20::32a; envelope-from=zimon.toutoune@gmail.com; helo=mail-wm1-x32a.google.com X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: guix-devel@gnu.org Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: "Guix-devel" X-Migadu-Flow: FLOW_IN ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1631145815; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-unsubscribe:list-subscribe:list-post:dkim-signature; bh=bDvwrMYWDGcWGc32uuK/ACDw5TWM7CsuKCfiUc8Q4Wc=; b=dCGQGWtq90JNmsKlzOW9kyulsVarcN5yC923XNxKyqqHf/7wnuIEFuCpExvShfYIYYU+Dq W7vOrdjX9Rrf4aeiNgqHyHfZp+macKGKc+sy7WuRA2pONtlCmO3wRkQmFzgnxdYT4x+zcn aWrFoCpqnZSSx0XIV65Z/9SZ/3ZcNHYsZzg9//eat4QiWFxRXf/WjOS/uSHNpflzEIpQaP +2s9HFpwPpv4gYwfewtuMaYak+xAvcNXIThsh/GdjTNNZknw89Caz2tXQRV766+S1wkGgo jWNVa74gUXtzHMxmEgdG2pjXaMvM2O9b0bTW11S8+usGpMDbC5n+XyBboGReWg== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1631145815; a=rsa-sha256; cv=none; b=b9eWE1+dVxmd+cgAUFRK31SOjZwVad8CcTH/V6DOwAT4bWkITBDEJ7lu6RppCVogWAxKnQ 00lj1JZyv9LPKM+Xo1PN05guYqL4wjKQ7AeNPUmgpAVnOaJZnYdHv07mdpOsV4Ss0d2uYE s0ChxEahYf+MgGPuv815OR4okrd254i7srvAcXmfVQTduZ8pwweSIOo6TfKGvZsgrxCMGI wQoMJFdwzocjF5ow+QX5/Db5LaHsX7z5JScUV50r2u6YKQkAoUEKRPF+yWEeqkesKD3opf 51HAs3nIVqNbTqZDYtRBq5SKFP6QXDupzp931AfVRmkqtp3uzCJcCBbeMcpM3A== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=pass header.d=gmail.com header.s=20210112 header.b=A5QGCnTx; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (aspmx1.migadu.com: domain of guix-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-devel-bounces@gnu.org X-Migadu-Spam-Score: -3.11 Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=gmail.com header.s=20210112 header.b=A5QGCnTx; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (aspmx1.migadu.com: domain of guix-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-devel-bounces@gnu.org X-Migadu-Queue-Id: 259E478BF X-Spam-Score: -3.11 X-Migadu-Scanner: scn0.migadu.com X-TUID: LaA7QSb+YYwY Hi, On Thu, 09 Sep 2021 at 00:00, Ludovic Court=C3=A8s wrote: > Now we have to see what=E2=80=99s available on berlin & co., and the exte= nt to > which SWH can help with this situation. So far I=E2=80=99m not sure abou= t the > tarball contents, but the repo seems to be archived: As we know, the issue with tarball on SWH is that we cannot guarantee the map between the information stored at package time and the information SWH serves at fetch time. Metadata, etc. so SWH cooking can return a tarball having the checksum Guix that expects or something different. We (at least me :-)) need to invest energy into Disarchive. Definitively!=20 > For some reason, we seem to be exporting only one tarball in > sources.json currently (the file that SWH periodically reads): > > --8<---------------cut here---------------start------------->8--- > $ wget -qO - https://guix.gnu.org/sources.json|jq |grep linux-libre.fsfla= .org > "https://linux-libre.fsfla.org/pub/linux-libre/releases/5.4.20-gn= u/linux-libre-5.4.20-gnu.tar.xz", > "https://linux-libre.fsfla.org/pub/linux-libre/releases/5.4.20-gn= u/linux-libre-5.4.20-gnu.tar.xz", > --8<---------------cut here---------------end--------------->8--- > > We should check why we=E2=80=99re not providing all the URLs and fix it. Interesting=E2=80=A6 :-) The file =E2=80=99https://guix.gnu.org/sources.json=E2=80=99 is basically b= uilt using =E2=80=99fold-packages=E2=80=99 (see =E2=80=99all-packages=E2=80=99 in guix-artwork/website/apps/packages/data.scm) and =E2=80=99package-source=E2= =80=99 (see =E2=80=99sources-json-builder=E2=80=99 in guix-artwork/website/apps/packages/builder.scm). And indeed, =E2=80=99linux-libre=E2=80=99 is missing. Let consider this snippet as =E2=80=99/tmp/foo.scm=E2=80=99 mimicking the b= uilder of JSON files: --8<---------------cut here---------------start------------->8--- (use-modules (guix packages) (gnu packages)) (define all-packages (sort (fold-packages (lambda (package lst) (if (or (package-superseded package) (package-replacement package)) lst (cons package lst))) '()) (lambda (p1 p2) (string8--- Then indeed, only 5.4.20 is seen. --8<---------------cut here---------------start------------->8--- $ guix repl /tmp/foo.scm | grep 'linux-libre.fsfla' # () 7faf439cfba0> # () 7faf439cfba0> --8<---------------cut here---------------end--------------->8--- The difference is that this package =E2=80=99linux-libre-headers-5.4.20=E2= =80=99 is created with =E2=80=99make-linux-libre-headers=E2=80=99 and the others with =E2=80=99make-linux-libre-headers*=E2=80=99. Subtle. ;-) In other words, --8<---------------cut here---------------start------------->8--- $ guix repl scheme@(guix-user)> ,use(guix packages) scheme@(guix-user)> ,use(gnu packages linux) scheme@(guix-user)> (package-source linux-libre-headers-5.4.20) $1 =3D # () 7f881c1ec4e0> scheme@(guix-user)> (package-source linux-libre-headers-5.13) $2 =3D #> # (# () 7f881c1ec840> # () 7f881c1ec7e0> "/g= nu/store/yrqr7syxbm4pddzlgc4pwn9wixmpy9xh-guix-module-union/share/guile/sit= e/3.0/gnu/packages/patches/linux-libre-arm64-generic-pinebook-lcd.patch") 7= f881c1ec780> --8<---------------cut here---------------end--------------->8--- Therefore, the builder of JSON (mainly =E2=80=99origin->json=E2=80=99) does= not consider such cases and assume that =E2=80=99origin-uri=E2=80=99 can be applied. We= ll, I will try to improve the situation if no one beats me. :-) Cheers, simon