From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp0.migadu.com ([2001:41d0:403:58f0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms13.migadu.com with LMTPS id wF0bOlL1bmYRuQAAqHPOHw:P1 (envelope-from ) for ; Sun, 16 Jun 2024 14:23:15 +0000 Received: from aspmx1.migadu.com ([2001:41d0:403:58f0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp0.migadu.com with LMTPS id wF0bOlL1bmYRuQAAqHPOHw (envelope-from ) for ; Sun, 16 Jun 2024 16:23:15 +0200 X-Envelope-To: larch@yhetil.org Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=philipmcgrath.com header.s=fm1 header.b="a4NMfS/h"; dkim=pass header.d=messagingengine.com header.s=fm1 header.b="C vApqi6"; dmarc=none; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1718547794; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-unsubscribe:list-subscribe:list-post:dkim-signature; bh=k1+XCd05UVIXvlAR97EJ8lFWejI+l6bZmFy+4Xa+wWg=; b=pfPNDqzzlVdJP9XFdHM/8AXx//YRKJfHYGDfhiNeK7v/HnF9ykjDI+4P3Q0z+QozqCIs7X Yrx3r/N2ErX1fmVi0AtgNcwKfZf4rWYUw+U+AbVd7kDyoB6jFBbhcythkloaKRZSxjPLKd zJRnvTP+wu88EqotK6ZRv0gvH09hh3bZoV3fxdfTFX6x2O+8uDMZ1cSVX5Rmf5EExGUPkt QIOTHNjS7m6Z8AX1l7oSsy8ByopqQtzhxu9MUVFyOrJrXT9uNX3xwojII3HnUXEJcyeRrA Xxgd2zUbHxSOskyUXyoDG9eCCRNZw2Ay84BLH22c78RUjvtmwnVeO9RM6L531A== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1718547794; a=rsa-sha256; cv=none; b=hCyk5dvIoQsAgq70QjBkzR26E8TD2WMq8fEQHRURtaENridPSBvPH6wXGLZRCrh4aHGo3Q YL5ZRlyUZfeb1ej1vzqMbHtLM4BI3PqgnGz+BtqG8645dnztyp6bIM9bqOvw7FhAYbNLQV mdVWOXAjZO2bjMXiX29SEHy/Fok4ZgSOKfKAroOS8wjRCVjrp5ZZQfMNH40YL16FflK0Co bmF83EiVu1HsZ0s5NNl23O/wX6Sa/f1r5SgY/z+OxMW8CvrU4LNjW1lqh40CzvHKvjX1Cq I+nA/9OqbsM3L+DusaYqcP0gF1+qkKV4EkmxE8EU6FVeSSWH5U7ge7JwzIPbkg== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=pass header.d=philipmcgrath.com header.s=fm1 header.b="a4NMfS/h"; dkim=pass header.d=messagingengine.com header.s=fm1 header.b="C vApqi6"; dmarc=none; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id B96B17DF1A for ; Sun, 16 Jun 2024 16:23:13 +0200 (CEST) Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1sIqmF-0003oV-39; Sun, 16 Jun 2024 10:22:39 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1sIqmD-0003o7-Jj for guix-devel@gnu.org; Sun, 16 Jun 2024 10:22:37 -0400 Received: from fout4-smtp.messagingengine.com ([103.168.172.147]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1sIqmB-0003lk-EV; Sun, 16 Jun 2024 10:22:37 -0400 Received: from compute1.internal (compute1.nyi.internal [10.202.2.41]) by mailfout.nyi.internal (Postfix) with ESMTP id 6799F13800EE; Sun, 16 Jun 2024 10:22:31 -0400 (EDT) Received: from imap52 ([10.202.2.102]) by compute1.internal (MEProxy); Sun, 16 Jun 2024 10:22:31 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= philipmcgrath.com; h=cc:cc:content-transfer-encoding :content-type:content-type:date:date:from:from:in-reply-to :in-reply-to:message-id:mime-version:references:reply-to:subject :subject:to:to; s=fm1; t=1718547751; x=1718634151; bh=k1+XCd05UV IXvlAR97EJ8lFWejI+l6bZmFy+4Xa+wWg=; b=a4NMfS/hpWhmqpGKrdPldWuIQo YnR2lrS4PIkLay+KKZbuUlSYv2VuCRptH3dRzjwLOCI4KZi4UxEs/fVHFLS5MqnF dWtd0UeqY4ZQ6Um/eBbH05ZDWnIxDaEVXOdVGu7BVlz65K6KY4xINiDEINbRVuf5 PARPhc6/1OMGGVnuEv45mzkyzCqPeHyi6+KyfsOFFowuZQkBQObubD/dURixaHRm a3x7izJeWtJNs/RhWbPOx2F6akgL0hVwXE2gqHDxs/ilQFLZGq1TDFVmr7YjTASs 0KZl00grvwv8fOMwqZoW0gcq+6O1aEqHiB0/70Fz/MjGJHbkYKwUCmjyfUaQ== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:cc:content-transfer-encoding :content-type:content-type:date:date:feedback-id:feedback-id :from:from:in-reply-to:in-reply-to:message-id:mime-version :references:reply-to:subject:subject:to:to:x-me-proxy:x-me-proxy :x-me-sender:x-me-sender:x-sasl-enc; s=fm1; t=1718547751; x= 1718634151; bh=k1+XCd05UVIXvlAR97EJ8lFWejI+l6bZmFy+4Xa+wWg=; b=C vApqi6oEm8c1+FbwgzopJPI3c95BJYs/4hxm5IlNoxeNMYbOese/lWqIf4xUP9A+ v28o1cB0Ute2KOAYD1CJky2OvH8to/LquuV5BCpL1LbNINTn+ZgVu0KlWLVhkNCM fn9+rFvN2/kGDc53t3zJs6nzv2vZki7MALXIda1BakeJ4oSkCTAwAnEVaa9cMW4E /7MclFdt8bxm+W6ohrxuWTDdJgmehgzl6rUVT0dq5L6HvRlXaBKjXkUiFyoenqVa adfi9lpv3DKPcz+ynROh8ZIrXLEZJQUZbtAWQ7dj3fY7fGtu93EQmueYyq8RlGNK NoadYB7yjr5+fXOrH5yag== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvledrfedvfedgjeeiucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucesvcftvggtihhpihgvnhhtshculddquddttddmne cujfgurhepofgfggfkjghffffhvfevufgtgfesthhqredtreerjeenucfhrhhomhepfdfr hhhilhhiphcuofgtifhrrghthhdfuceophhhihhlihhpsehphhhilhhiphhmtghgrhgrth hhrdgtohhmqeenucggtffrrghtthgvrhhnpeduieejgedtueduheekleejfeeutdeggedt vefhgfdtleefteeivdevvedtleeuvdenucffohhmrghinhepghhnuhdrohhrghenucevlh hushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhmpehphhhilhhiphes phhhihhlihhpmhgtghhrrghthhdrtghomh X-ME-Proxy: Feedback-ID: i2b1146f3:Fastmail Received: by mailuser.nyi.internal (Postfix, from userid 501) id B1DBCC60097; Sun, 16 Jun 2024 10:22:30 -0400 (EDT) X-Mailer: MessagingEngine.com Webmail Interface User-Agent: Cyrus-JMAP/3.11.0-alpha0-515-g87b2bad5a-fm-20240604.001-g87b2bad5 MIME-Version: 1.0 Message-Id: <86bbccff-26c1-4a20-b8df-1faaacdd69be@app.fastmail.com> In-Reply-To: <87ed9a3ydf.fsf@gnu.org> References: <87y17on4ao.fsf@gnu.org> <87bk4jjbdu.fsf@gnu.org> <87ed9a3ydf.fsf@gnu.org> Date: Sun, 16 Jun 2024 10:22:06 -0400 From: "Philip McGrath" To: =?UTF-8?Q?Ludovic_Court=C3=A8s?= , "Lars-Dominik Braun" Cc: "Brian Cully" Subject: Re: CI is not processing jobs Content-Type: text/plain;charset=utf-8 Content-Transfer-Encoding: quoted-printable Received-SPF: pass client-ip=103.168.172.147; envelope-from=philip@philipmcgrath.com; helo=fout4-smtp.messagingengine.com X-Spam_score_int: -27 X-Spam_score: -2.8 X-Spam_bar: -- X-Spam_report: (-2.8 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_LOW=-0.7, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: guix-devel-bounces+larch=yhetil.org@gnu.org X-Migadu-Flow: FLOW_IN X-Migadu-Country: US X-Migadu-Spam-Score: -6.47 X-Spam-Score: -6.47 X-Migadu-Queue-Id: B96B17DF1A X-Migadu-Scanner: mx11.migadu.com X-TUID: o5lsO6ljfyF0 Hi, On Thu, Jun 6, 2024, at 11:05 AM, Ludovic Court=C3=A8s wrote: > Hi Guix! > > Ludovic Court=C3=A8s skribis: > >> Ludovic Court=C3=A8s skribis: >> >>> The longer story is that Ricardo noticed that the build backlog had = been >>> growing for a couple of months (see =E2=80=9CPending builds=E2=80=9D= ): >>> >>> https://ci.guix.gnu.org/metrics >>> >>> We discussed this on guix-sysadmin and found that this was due to the >>> poor performance of a SQL query at the core of =E2=80=98cuirass remo= te-server=E2=80=99 >>> that was roughly linear in the number of packages in the database. = With >>> help from Chris Baines, this is now fixed: >>> >>> https://git.savannah.gnu.org/cgit/guix/guix-cuirass.git/commit/?id= =3D17338588d4862b04e9e405c1244a2ea703b50d98 >> >> This is now deployed on ci.guix.gnu.org. > > This has been running for ~4 days now; the number of pending builds has > significantly decreased (in particular, you=E2=80=99ll be delighted to= get > substitutes for =E2=80=98core-updates=E2=80=99!): > > https://ci.guix.gnu.org/metrics > > Almost all the x86 builds have been consumed: > > ... > > The =E2=80=9CPending builds=E2=80=9D plot above shows we=E2=80=99re re= aching a plateau: this is > because the 382,000+ remaining builds are non-x86_64 and we lack > resources for these platforms (Arm in particular). > > We should probably investigate and cancel builds that correspond to old > evaluations or now-irrelevant jobsets. > For some reason QA still doesn't seem to be working for https://issues.g= uix.gnu.org/71203 (a Racket update I sent on May 26), which I suspect ma= y be related to this. Could someone take a look? The page at https://qa.guix.gnu.org/issue/71203 says "Issue not found: T= his could mean the issue does not exist, it has no patches or has been c= losed." The page at https://data.qa.guix.gnu.org/repository/1/branch/iss= ue-71203 does recognize the branch, but says "No information yet". The l= inked commit page at https://data.qa.guix.gnu.org/revision/2805bc613df06= a726035ba19e9b60762487963ef has one entry in the "Jobs" table, "created = 2024-05-26 06:07:51.458233". I have only surface-level familiarity with the QA system, so sorry if I'= m missing something! Thanks, Philip