From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp12.migadu.com ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms5.migadu.com with LMTPS id CDiTBOmKgmLsegEAbAwnHQ (envelope-from ) for ; Mon, 16 May 2022 19:33:29 +0200 Received: from aspmx1.migadu.com ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp12.migadu.com with LMTPS id iDxzBOmKgmLpJQAAauVa8A (envelope-from ) for ; Mon, 16 May 2022 19:33:29 +0200 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 8B90413414 for ; Mon, 16 May 2022 19:33:28 +0200 (CEST) Received: from localhost ([::1]:53450 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1nqeb1-0004IF-Lm for larch@yhetil.org; Mon, 16 May 2022 13:33:27 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:38094) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nqeac-0004DG-6m for bug-guix@gnu.org; Mon, 16 May 2022 13:33:02 -0400 Received: from debbugs.gnu.org ([209.51.188.43]:32844) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1nqeab-0003vO-UD for bug-guix@gnu.org; Mon, 16 May 2022 13:33:01 -0400 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1nqeab-0000Ko-Oy for bug-guix@gnu.org; Mon, 16 May 2022 13:33:01 -0400 X-Loop: help-debbugs@gnu.org Subject: bug#55441: [cuirass] hang in "In progress..."; runs out of pgsql connections Resent-From: Maxim Cournoyer Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Mon, 16 May 2022 17:33:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 55441 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: Ludovic =?UTF-8?Q?Court=C3=A8s?= Cc: 55441@debbugs.gnu.org, Mathieu Othacehe Received: via spool by 55441-submit@debbugs.gnu.org id=B55441.16527223561253 (code B ref 55441); Mon, 16 May 2022 17:33:01 +0000 Received: (at 55441) by debbugs.gnu.org; 16 May 2022 17:32:36 +0000 Received: from localhost ([127.0.0.1]:54974 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nqeaB-0000K8-QY for submit@debbugs.gnu.org; Mon, 16 May 2022 13:32:36 -0400 Received: from mail-qv1-f53.google.com ([209.85.219.53]:38721) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nqeaA-0000Jv-Bs for 55441@debbugs.gnu.org; Mon, 16 May 2022 13:32:34 -0400 Received: by mail-qv1-f53.google.com with SMTP id n10so12639618qvi.5 for <55441@debbugs.gnu.org>; Mon, 16 May 2022 10:32:34 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=from:to:cc:subject:references:date:in-reply-to:message-id :user-agent:mime-version:content-transfer-encoding; bh=AyDulEWULlZfb/9I8wOv1T8PzgKap1nzqvShncYRotQ=; b=c18Ch8TbFdQItk46MvQIOvka0CxeJvl4obbX1IV2QjgeKNIeT443pv7Mx58O/ZXYhs VLf0ifIdDeKfI18iNyyv3swsFIByvUKVv2Hfiuk1gPkfvn0Bl49PBhob3AalPrU5LTsa h/XSwQ791hbO0H0As1cHst5MtsBxln7eNSnG9ADYQrUggoUrp3HbupQ4LsFJr5p2iGD0 H2RGUzYYhrv9TBApd3FwrwpmI3xvQ9ra1GrmzghrjIdQviuZe65PtdA3YoqU/c4lydoQ n6PX9lwP7LV1z/8m7SM7BTXE3HIjggzWXpnuBdMyf7TYJ+90X0Eh/YWYw2lIoCTUTRIG qInQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:from:to:cc:subject:references:date:in-reply-to :message-id:user-agent:mime-version:content-transfer-encoding; bh=AyDulEWULlZfb/9I8wOv1T8PzgKap1nzqvShncYRotQ=; b=KqfIe51h5jZXVH0SxLWgSLbq/MywIzcakUnKml/0h97fApNFBquSm23R9/UQKxWL3K ohknE9CfpaUzNgZaHxsS8wD56kwjeTi71fPZ30U5gmsl9T/0TlWsvi4DU9j7rRz87Pns x8nME5RJVfPrAJwcTuinlywErD/dMn+bHvfODRpE1izJvu0Yo3q1SNBUzW8lytdxYgGB rIwhxQv95YQLF/3n5u3rVDrVUTZ3qhJ8icCsFgFK8BNrIGA5y48tmBAcUgCtRg4h+N+g 5b/u60OyS7PXrLprOuon73t2p/oWDrdGm/7icWoqrTk5r4P87IPERlf5U0oY2f4yuL9w EmPg== X-Gm-Message-State: AOAM533L1nr3PwKDNmM8C2zOghy6scZvw4PiEJWpu8U9lOffEgFXOdwl UMq5wREmQVDZAuzyNqX2WV1Lsn6LAfi79A== X-Google-Smtp-Source: ABdhPJzW6cnl7kIXnF7thKJdwkXK/f2AJIB5f27yKh6egJsAhqZ0aAK7d49gfsVap7zvnFo7IGB6wQ== X-Received: by 2002:a05:6214:410c:b0:45a:7a94:ee04 with SMTP id kc12-20020a056214410c00b0045a7a94ee04mr16353863qvb.63.1652722348407; Mon, 16 May 2022 10:32:28 -0700 (PDT) Received: from hurd (dsl-10-136-209.b2b2c.ca. [72.10.136.209]) by smtp.gmail.com with ESMTPSA id l2-20020a37bb02000000b0069fc13ce21esm5972708qkf.79.2022.05.16.10.32.27 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 16 May 2022 10:32:28 -0700 (PDT) From: Maxim Cournoyer References: <87fslcaznn.fsf@gmail.com> <87mtfj174l.fsf@gnu.org> <878rr2kug6.fsf_-_@gmail.com> <87pmke6ig4.fsf@gnu.org> <87o7zxalhu.fsf@gnu.org> <87k0alahug.fsf@gnu.org> <87fsl9acuw.fsf@gnu.org> Date: Mon, 16 May 2022 13:32:26 -0400 In-Reply-To: <87fsl9acuw.fsf@gnu.org> ("Ludovic =?UTF-8?Q?Court=C3=A8s?="'s message of "Mon, 16 May 2022 14:19:51 +0200") Message-ID: <878rr1jsd1.fsf@gmail.com> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-BeenThere: bug-guix@gnu.org List-Id: Bug reports for GNU Guix List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-guix-bounces+larch=yhetil.org@gnu.org Sender: "bug-Guix" X-Migadu-Flow: FLOW_IN X-Migadu-To: larch@yhetil.org X-Migadu-Country: US ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1652722408; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding:resent-cc: resent-from:resent-sender:resent-message-id:in-reply-to:in-reply-to: references:references:list-id:list-help:list-unsubscribe: list-subscribe:list-post:dkim-signature; bh=AyDulEWULlZfb/9I8wOv1T8PzgKap1nzqvShncYRotQ=; b=b+iatxUX4RSYQG3oUztIFZFOv3Ks7vnZ5krglr9lEhr46tEzJGGfkdArS4mzGOaIhhL8iZ tcp82tv8H4k3zHYX0NpeWmTs1i2EM5kv06J88wRNR2ae5eubTLcB4/fNGcbWrGBY5w0KVZ jX3srgNiMBT5ubBaqIfI67LQC+TVWkQGgLhVkQCpwIagCrqnsO/VUG2YfUFpk1DRx/mgdR ToXSXdfx0aaQfkc1L4qvnoX1RrbvnASDw/U8yspSADIDu49lAOonc2vnbMxM+AlR4n+c0g 55EQvKZpA1WIptS1jpaFkTDYwPGOsjpiBaexRs+UevJZemv5Ch6U+xW617aeCw== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1652722408; a=rsa-sha256; cv=none; b=Ekc4J4o4osfhVq34qwjt3MGLUhv1wRSrAq5peq/jnqDlco2mOrVuB+ygu5TOIYgZUpQWko o/ZKmHzZxibbOV+R4jgnn6Q8nHdrOAq16l7zkQ3kR93MEttkLamRB+0ZRUH0ukhJ9D2r/Y lEn6ml2J7/4gT5UDuekrva517Ob+9qcdCmT/dfwUe44rk2QO1os4LIU9F9KSETVd3REj9L cRNfYONMm9zYa0mm0BCSgzCJp4MJV2C0DHWlHg4KlI9Yp6Xsr8QB0vLfcsTVZfwkDzUj2L CDJ85mWPZpOVSL67xZ6EeHSqW8ZRW71275gw0eNPlHdOm5FqgSxT8q88HRo8Jw== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=fail ("headers rsa verify failed") header.d=gmail.com header.s=20210112 header.b=c18Ch8Tb; dmarc=fail reason="SPF not aligned (relaxed)" header.from=gmail.com (policy=none); spf=pass (aspmx1.migadu.com: domain of "bug-guix-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="bug-guix-bounces+larch=yhetil.org@gnu.org" X-Migadu-Spam-Score: 5.37 Authentication-Results: aspmx1.migadu.com; dkim=fail ("headers rsa verify failed") header.d=gmail.com header.s=20210112 header.b=c18Ch8Tb; dmarc=fail reason="SPF not aligned (relaxed)" header.from=gmail.com (policy=none); spf=pass (aspmx1.migadu.com: domain of "bug-guix-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="bug-guix-bounces+larch=yhetil.org@gnu.org" X-Migadu-Queue-Id: 8B90413414 X-Spam-Score: 5.37 X-Migadu-Scanner: scn0.migadu.com X-TUID: /gwkwfKwiSX7 Hello, Ludovic Court=C3=A8s writes: > Ludovic Court=C3=A8s skribis: > >> I=E2=80=99ve added a missing call to =E2=80=98close-inferior=E2=80=99. = It=E2=80=99s a good idea, though >> I=E2=80=99m not entirely convinced yet it=E2=80=99ll solve the problem: >> >> https://git.savannah.gnu.org/cgit/guix/guix-cuirass.git/commit/?id=3Df= 087aaf685dbc7cc18f0254895f4a4b0dfaba631 > > I tested it like this and it ran to completion without hanging: > > ludo@berlin ~$ guix build cuirass --with-branch=3Dcuirass=3Dmaster > [=E2=80=A6] > /gnu/store/sqsf2q3qf9d485mcw6lm14abwr54na01-cuirass-git.master > ludo@berlin ~$ sudo su - cuirass -s /bin/sh -c "/gnu/store/sqsf2q3qf9d48= 5mcw6lm14abwr54na01-cuirass-git.master/bin/cuirass evaluate dbname=3Dcuiras= s 323183" > Password: > Computing Guix derivation for 'x86_64-linux'... \ > 2022-05-16T12:39:18 Registering builds for evaluation 323183. > 2022-05-16T12:40:34 Registering builds for evaluation 323183. > GC Warning: Repeated allocation of very large block (appr. size 14385152): > May lead to memory leak and poor performance > 2022-05-16T12:41:25 Registering builds for evaluation 323183. > 2022-05-16T12:44:35 Registering builds for evaluation 323183. > > Should we try and deploy this commit on berlin? > > Maxim, how can we proceed? Berlin was reconfigured with this commit of Cuirass, and is now running the derivations with it, but so far still "In progress..." after more than 100 minutes [0] [0] https://ci.guix.gnu.org/eval/325592 Looking in /var/log/cuirass.log, I can see: --8<---------------cut here---------------start------------->8--- 2022-05-16 15:57:41 2022-05-16T15:57:41 next evaluation in 300 seconds 2022-05-16 15:59:02 Uncaught exception in fiber ##f: 2022-05-16 15:59:02 In cuirass/base.scm: 2022-05-16 15:59:02 726:13 3 (_) 2022-05-16 15:59:02 In ice-9/boot-9.scm: 2022-05-16 15:59:02 1752:10 2 (with-exception-handler _ _ #:unwind? _ # = _) 2022-05-16 15:59:02 1685:16 1 (raise-exception _ #:continuable? _) 2022-05-16 15:59:02 1683:16 0 (raise-exception _ #:continuable? _) 2022-05-16 15:59:02 ice-9/boot-9.scm:1683:16: In procedure raise-exception: 2022-05-16 15:59:02 ERROR: 2022-05-16 15:59:02 1. &evaluation-error: 2022-05-16 15:59:02 name: "core" 2022-05-16 15:59:02 id: 325375 2022-05-16 16:02:41 2022-05-16T16:02:41 Fetching channels for spec 'core'. --8<---------------cut here---------------end--------------->8--- But it seems it should only affect another job specification ('core') ? Before, there was also: --8<---------------cut here---------------start------------->8--- 2022-05-16 15:41:34 Uncaught exception in fiber ##f: 2022-05-16 15:41:34 In cuirass/base.scm: 2022-05-16 15:41:34 726:13 3 (_) 2022-05-16 15:41:34 In ice-9/boot-9.scm: 2022-05-16 15:41:34 1752:10 2 (with-exception-handler _ _ #:unwind? _ # = _) 2022-05-16 15:41:34 1685:16 1 (raise-exception _ #:continuable? _) 2022-05-16 15:41:34 1683:16 0 (raise-exception _ #:continuable? _) 2022-05-16 15:41:34 ice-9/boot-9.scm:1683:16: In procedure raise-exception: 2022-05-16 15:41:34 ERROR: 2022-05-16 15:41:34 1. &evaluation-error: 2022-05-16 15:41:34 name: "purge-python2-packages" 2022-05-16 15:41:34 id: 325332 --8<---------------cut here---------------end--------------->8--- and --8<---------------cut here---------------start------------->8--- 2022-05-16 15:05:27 Uncaught exception in fiber ##f: 2022-05-16 15:05:27 In cuirass/base.scm: 2022-05-16 15:05:27 726:13 3 (_) 2022-05-16 15:05:27 In ice-9/boot-9.scm: 2022-05-16 15:05:27 1752:10 2 (with-exception-handler _ _ #:unwind? _ # = _) 2022-05-16 15:05:27 1685:16 1 (raise-exception _ #:continuable? _) 2022-05-16 15:05:27 1683:16 0 (raise-exception _ #:continuable? _) 2022-05-16 15:05:27 ice-9/boot-9.scm:1683:16: In procedure raise-exception: 2022-05-16 15:05:27 ERROR: 2022-05-16 15:05:27 1. &evaluation-error: 2022-05-16 15:05:27 name: "master" 2022-05-16 15:05:27 id: 324938 --8<---------------cut here---------------end--------------->8--- and --8<---------------cut here---------------start------------->8--- 2022-05-16 13:02:07 Uncaught exception in fiber ##f: 2022-05-16 13:02:07 In cuirass/base.scm: 2022-05-16 13:02:07 726:13 3 (_) 2022-05-16 13:02:07 In ice-9/boot-9.scm: 2022-05-16 13:02:07 1752:10 2 (with-exception-handler _ _ #:unwind? _ # = _) 2022-05-16 13:02:07 1685:16 1 (raise-exception _ #:continuable? _) 2022-05-16 13:02:07 1683:16 0 (raise-exception _ #:continuable? _) 2022-05-16 13:02:07 ice-9/boot-9.scm:1683:16: In procedure raise-exception: 2022-05-16 13:02:07 ERROR: 2022-05-16 13:02:07 1. &evaluation-error: 2022-05-16 13:02:07 name: "guix" 2022-05-16 13:02:07 id: 324937 --8<---------------cut here---------------end--------------->8--- I don't know if these are related or not; probably not, as their timestamps are older by more than 3 hours, while the last derivations were started less than 1h30 ago. Thanks, Maxim