From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp0 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id eHZAMPIZs2C3jwAAgWs5BA (envelope-from ) for ; Sun, 30 May 2021 06:52:02 +0200 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp0 with LMTPS id MAbGK/IZs2B/UAAA1q6Kng (envelope-from ) for ; Sun, 30 May 2021 04:52:02 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 2CCCA21709 for ; Sun, 30 May 2021 06:52:02 +0200 (CEST) Received: from localhost ([::1]:49340 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1lnDQe-0006EU-2K for larch@yhetil.org; Sun, 30 May 2021 00:52:01 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:46908) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1lnDQ1-0006EM-Am for guix-devel@gnu.org; Sun, 30 May 2021 00:51:21 -0400 Received: from cascadia.aikidev.net ([173.255.214.101]:47382) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1lnDPy-0006bG-J3 for guix-devel@gnu.org; Sun, 30 May 2021 00:51:21 -0400 Received: from localhost (unknown [IPv6:2600:3c01:e000:21:21:21:0:100b]) (Authenticated sender: vagrant@cascadia.debian.net) by cascadia.aikidev.net (Postfix) with ESMTPSA id 6BCAB1A904; Sat, 29 May 2021 21:50:42 -0700 (PDT) From: Vagrant Cascadian To: guix-devel Subject: Re: linux-libre source tarballs In-Reply-To: References: <87lf8xvrgj.fsf@yucca> Date: Sat, 29 May 2021 21:50:36 -0700 Message-ID: <87k0ngg6zn.fsf@yucca> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha512; protocol="application/pgp-signature" Received-SPF: none client-ip=173.255.214.101; envelope-from=vagrant@debian.org; helo=cascadia.aikidev.net X-Spam_score_int: -18 X-Spam_score: -1.9 X-Spam_bar: - X-Spam_report: (-1.9 / 5.0 requ) BAYES_00=-1.9, SPF_HELO_NONE=0.001, SPF_NONE=0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: "Guix-devel" X-Migadu-Flow: FLOW_IN ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1622350322; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:mime-version:mime-version: content-type:content-type:in-reply-to:in-reply-to: references:references:list-id:list-help:list-unsubscribe: list-subscribe:list-post; bh=HdQBxx+XdYVAp8jpapVVGlpIKd8MmRk9rhiTrUhMcs0=; b=M/Hq0MYrvwcwFRWXQi/5pxJwu5LdA7YQ8xPoUCiIwNk4uLfrXVIqxJ7xiGBQBgo63d4F6J QL/Jj9kzx+dE5th7F2zO5L9nOpc9G3RTsnl9yDJyZpV4Cf9QnSdFOZTChM5mzgXhuMzI4f dWvT/6fSx5s+eBpp3nTrHM18on/rgZl1ahgk+p9xcCkqZDMFcBCGhLg+9KTqW+btsD5N+A r06Ne7AWtCTpkGCBBp3kKpipVipJC3E//lmOewyI+sIe9iX5UfzmODZpZil8Rtwm8R02Ak isNFTFXZzLbBTvk2UjXbUiMZrvZurHxzvqXt8GS61D3ypa8esprnP9Sv0YtdXA== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1622350322; a=rsa-sha256; cv=none; b=PtguhUWkgNTKHuOsVv2oScu9+lJcDtmBN7o/qhMambvD98yLcIBQnrzG6n+U4CN53rKI1V e3OxOSx4dFgK6RfDrVVyTUlAGs26Vctsf7DoHIKmpT8KJBH1cMncRos+dWMzTKd0IX4vx0 8IIRVY6MvCpY3RBlxUr3d4Wme1gc88Nge7jTx/JIrt7uQAciyyrvHayGkr3gTozu28C2Hi rxBwKWBV7VP0LOdvEXBgWxhbBMyHffVtGqqkZ7/EMg6FWSHfzzSxFkCo9CIQbtQJpP6g97 rm5GKK/VVar1/H0yJ7oKmoljQadexaQZtgWdEq2bZGkwAE0XzDVsj3HiTXYwJQ== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of guix-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-devel-bounces@gnu.org X-Migadu-Spam-Score: -1.53 Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of guix-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-devel-bounces@gnu.org X-Migadu-Queue-Id: 2CCCA21709 X-Spam-Score: -1.53 X-Migadu-Scanner: scn0.migadu.com X-TUID: wptAe+tkrMxb --=-=-= Content-Type: text/plain Content-Transfer-Encoding: quoted-printable On 2021-05-01, Leo Famulari wrote: > On Sat, May 01, 2021 at 06:45:32PM -0700, Vagrant Cascadian wrote: >> Pragmatically speaking, on slower platforms this is a huge resource >> overhead. So much so that ci.guix.gnu.org *usually* times out when >> generating the linux-libre aarch64 tarballs: >>=20 >> https://ci.guix.gnu.org/search?query=3Dsystem%3Aaarch64-linux+linux-li= bre-arm64-generic > > Thanks for letting me know. I didn't know this was happening. > > The immediate solution is for me to make sure the tarballs have built > before committing the updates. I already do this for x86_64 and I can > start doing it for aarch64 too. This has definitely helped sometimes, thanks! I even saw a substitute of linux-libre for aarch64 earlier today! :) Still, I'm noticing another problem with the way way the tarballs are generated on ci.guix.gnu.org ... When it generates a tarball, all the various packages independently try to recreate the source tarball; so you have at least fours jobs ("linux-libre", "linux-libre-arm64-generic", "linux-libre-headers", "linux-libre-bpf") all concurrently trying to build the very same very-slow-to-build tarball on ci.guix.gnu.org. Sometimes one of them might succeed, but the others may not, and even though one of them succeeded, none of the failing ones retry... Not knowing exactly how ci.guix.gnu.org works, would it make sense to create a tarball package instead of the ... computed origin(?) tarball, so it could be better represented in the package dependency graph, and the various linux-libre-* packages can wait till it is available rather than all trying to recreate the same thing? That still requires the tarball generation to not time out in the first place, but maybe it would help with the resource limitations a bit to only build the source tarball once per architecture? live well, vagrant --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iHUEARYKAB0WIQRlgHNhO/zFx+LkXUXcUY/If5cWqgUCYLMZnAAKCRDcUY/If5cW qoToAP488UfhW/hvdJSzp1W3s1JUmTU7/X+G8QDLCqLJ7uTBBQEAk0HsdoBIZmeF G1Lhwy1fRl/Z5UVTko/62iAKyAvfyAs= =n3eS -----END PGP SIGNATURE----- --=-=-=--