From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp1.migadu.com ([2001:41d0:303:e224::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms13.migadu.com with LMTPS id kC5LN5Szj2YrRAAA62LTzQ:P1 (envelope-from ) for ; Thu, 11 Jul 2024 10:27:33 +0000 Received: from aspmx1.migadu.com ([2001:41d0:303:e224::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp1.migadu.com with LMTPS id kC5LN5Szj2YrRAAA62LTzQ (envelope-from ) for ; Thu, 11 Jul 2024 12:27:33 +0200 X-Envelope-To: larch@yhetil.org Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=gnu.org header.s=fencepost-gnu-org header.b=ZhovdXCS; dmarc=pass (policy=none) header.from=gnu.org; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1720693652; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding:list-id:list-help: list-unsubscribe:list-subscribe:list-post:dkim-signature; bh=vLxV3DptSlLuUNaZq/tXekvQMeR7smO//DV0eo/rUAU=; b=aAEi5yqSOHgH7+A2+mLDqmWaft0VNc6hGDmY6o6T9I2myYwABxx2WyBNVhd9TXDMgekwNU 6uoybnwmqqfwEgL7xYn6MX528/Dvj3faQUtdLPSnBS3OM6kpwJZ4W/8xz5VNxpB7vYLbjN dHIOqQ/GKOH4qNKIa3RaoDqcQlM1jYJI9OG2eXpnuGIp51HXg8+BwzhgB4c3bB7z7hB4gj nWQqcrV4UW5Qf5OB9TLOvcjxHPSSoEGbqEfrqeTYGKIwGC+AyBHJtyc7UxbK9mUnH5gFnc ZUi9VzR4ffM0qMZxAKRAVStImNtZ6pRtf3PKdGoXiw5qNHY22JTCNEJoySbktw== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1720693652; a=rsa-sha256; cv=none; b=lpiF08iROt1Kw2Z6r63HKiCAAgmBLzGsza9tf5fk8MjyKO61CnpWoU+2l8k4xMalW88WGW PSGVV4Ke7cIam7gOEImejhiV4JGQPSXNUKFjCN5qyMpJA3HJL5ZC5pAfRxC4mFgmNIMXia Ws0WPbIwoNq5C7etpV+xnrXYAtOBL06gKNjYHyCVOx21wYMCs0SinxCG8HKwq5wW8JwbxT q5+Hvh+8tGVuvTC+0k5a7tWzSMt8gyoPXkg/6T6EgOavLxoucCbjNlj9dTiZ3mQ3kdNvlB apFM5LYCP7KOK5nGlS/TViglNBH3E6GP84XQ1Hr5TU2R7lpNzWZiCaMUZ9+SAg== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=pass header.d=gnu.org header.s=fencepost-gnu-org header.b=ZhovdXCS; dmarc=pass (policy=none) header.from=gnu.org; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id CA2AF60FEA for ; Thu, 11 Jul 2024 12:27:32 +0200 (CEST) Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1sRr0t-0006zG-KE; Thu, 11 Jul 2024 06:26:59 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1sRr0s-0006yH-6y for guix-devel@gnu.org; Thu, 11 Jul 2024 06:26:58 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1sRr0p-0000Fd-LW for guix-devel@gnu.org; Thu, 11 Jul 2024 06:26:57 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-Version:Date:Subject:To:From:in-reply-to: references; bh=vLxV3DptSlLuUNaZq/tXekvQMeR7smO//DV0eo/rUAU=; b=ZhovdXCSXAyqxQ ftG5/6aPSV+SD5KEZ1tr0WvhkLvFNWZjuwmlfOq8w5ougHfD9liZ+9orNxyYrGxOYcpWeuA/jii7s M+GNz/txgt64qI+PwphiRskRNxYAPGBKDHqHorhdwnlenIbGeuYzwZNZC7JW5CQKSw5Lm0hgDChvA Oh5oznGQpe3w0VT2pD0yEqH3p96nwHf/novg4DQtsJQYjFGikhAFA/ri40h+McjRplGvznBIj0LOF uGNuU+NGiLUA6/ni0iubTlD/7tMlwPaztNYNtFONmgEWC+M9oR7EHrwOhe5S2SVH/0uEL1SspZx1q BwFto7rb2UlmL012FGFQ==; From: =?utf-8?Q?Ludovic_Court=C3=A8s?= To: Guix Devel Subject: ci.guix.gnu.org is getting back to life X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: Quartidi 24 Messidor an 232 de la =?utf-8?Q?R=C3=A9v?= =?utf-8?Q?olution=2C?= jour de =?utf-8?Q?l'Orcan=C3=A8te?= X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu Date: Thu, 11 Jul 2024 12:26:13 +0200 Message-ID: <87le281ayi.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: guix-devel-bounces+larch=yhetil.org@gnu.org X-Migadu-Flow: FLOW_IN X-Migadu-Country: US X-Migadu-Queue-Id: CA2AF60FEA X-Migadu-Scanner: mx12.migadu.com X-Migadu-Spam-Score: -11.15 X-Spam-Score: -11.15 X-TUID: WseKUIGa2txQ Hello! Last month, we discussed=C2=B9 slow progress with builds (and =E2=80=98core= -updates=E2=80=99 in particular) on ci.guix, especially on AArch64 and POWER9. Those turned out to be mostly due to scalability issues in Cuirass. Likewise, the front page at https://ci.guix.gnu.org was timing out for almost two weeks=C2=B2. I=E2=80=99m happy to report that the first class of problems is mostly fixe= d, and timeouts are not entirely gone with they=E2=80=99re less frequent. Some details about the work done: =E2=80=A2 I learned a lot from Chris about all things PostgreSQL (I even = learn that phrases like =E2=80=9Cdatabase administrator=E2=80=9D are a thing)= . Chris provided invaluable suggestions to optimize SQL queries that were taking too long, as was the case on the front page, and to tweak PostgreSQL configuration. https://git.savannah.gnu.org/cgit/guix/guix-cuirass.git/commit/?id=3D= f60e73b7b1e906349d2355d37807514c6e667f0c https://git.savannah.gnu.org/cgit/guix/maintenance.git/commit/?id=3Dd= 98e1f76501d368e67a8e57455195590880283f8 =E2=80=A2 The infamous =E2=80=9Cmissing derivation=E2=80=9D issue that ha= s been causing spurious build failures may be coming to an end: as suggested by Chris, =E2=80=98cuirass remote-worker=E2=80=99 now has an explicit step= to substitute .drv store items and it keeps retrying for a while when that fails: https://git.savannah.gnu.org/cgit/guix/guix-cuirass.git/commit/?id=3D= 2365ba786c805477fcbae6eaeb358b0dd0501598 =E2=80=A2 =E2=80=98cuirass remote-server=E2=80=99 doesn=E2=80=99t use the= database anymore to store transient worker information (=E2=80=9Clast seen=E2=80=9D time), which = reduces pressure on the database and increases throughput: https://git.savannah.gnu.org/cgit/guix/guix-cuirass.git/commit/?id=3D= e9f83e43f066cdc8bb4bec6ba221ade4ef7cab7b =E2=80=A2 A bunch of corner cases (stuck builds, etc.) are now better han= dled by restarting, rescheduling, or canceling as makes most sense. =E2=80=A2 We upgraded the Honeycombs (AArch64) and POWER9 build machines.= At this stage 3 AArch64 and 2 POWER9 build machines are fully operational behind ci.guix: https://ci.guix.gnu.org/workers Another Honeycomb, grunewald, is undergoing maintenance at the MDC and should be back soon. Substitute available is back to 94% for x86_64 for =E2=80=98core-updates=E2= =80=99; other architectures are still lacking but that=E2=80=99ll hopefully improve over = the coming days: https://qa.guix.gnu.org/branch/core-updates These things require constant attention. If you notice anything suspicious, feel free to bring it up here or on IRC! Ludo=E2=80=99. =C2=B9 https://lists.gnu.org/archive/html/guix-devel/2024-06/msg00149.html =C2=B2 https://lists.gnu.org/archive/html/guix-devel/2024-06/msg00312.html