From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp2 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms11 with LMTPS id 6GozBoTGFl/8TQAA0tVLHw (envelope-from ) for ; Tue, 21 Jul 2020 10:42:12 +0000 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp2 with LMTPS id aAD/AYTGFl9HBwAAB5/wlQ (envelope-from ) for ; Tue, 21 Jul 2020 10:42:12 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 64CE69403AD for ; Tue, 21 Jul 2020 10:42:11 +0000 (UTC) Received: from localhost ([::1]:60004 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1jxpiq-0005XI-Md for larch@yhetil.org; Tue, 21 Jul 2020 06:42:08 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:33594) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1jxpik-0005XB-2w for bug-guix@gnu.org; Tue, 21 Jul 2020 06:42:02 -0400 Received: from debbugs.gnu.org ([209.51.188.43]:54965) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1jxpij-0005Q8-Q2 for bug-guix@gnu.org; Tue, 21 Jul 2020 06:42:01 -0400 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1jxpij-0006KZ-NQ for bug-guix@gnu.org; Tue, 21 Jul 2020 06:42:01 -0400 X-Loop: help-debbugs@gnu.org Subject: bug#42371: Grafts max out build slots without being queued Resent-From: zimoun Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Tue, 21 Jul 2020 10:42:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 42371 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: Maxim Cournoyer Received: via spool by 42371-submit@debbugs.gnu.org id=B42371.159532807024268 (code B ref 42371); Tue, 21 Jul 2020 10:42:01 +0000 Received: (at 42371) by debbugs.gnu.org; 21 Jul 2020 10:41:10 +0000 Received: from localhost ([127.0.0.1]:38278 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1jxpht-0006JM-Pl for submit@debbugs.gnu.org; Tue, 21 Jul 2020 06:41:10 -0400 Received: from mail-wm1-f53.google.com ([209.85.128.53]:38692) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1jxphr-0006J6-Jz for 42371@debbugs.gnu.org; Tue, 21 Jul 2020 06:41:08 -0400 Received: by mail-wm1-f53.google.com with SMTP id f18so2368415wml.3 for <42371@debbugs.gnu.org>; Tue, 21 Jul 2020 03:41:07 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:in-reply-to:references:date:message-id :mime-version:content-transfer-encoding; bh=Kr9nngn4sb/+8vSqd+/yp3nDGNjUDX4oa6bLRssyT3k=; b=V35/X6al7WP3oJ3y20WmK8dQpRj/tMk0M2iwAQ3p7vaaaFU5WpoReOTItjFtBhYVpM +5sca+smgFCnA7ygsGjHqJMylp6cVBNr92ZyCvc0t43HPbcrzKIZBMulJmvavYWRqXWx aW5PoTlciOeaMQmhYgLk0RyXjAdIrqh/DEC4jufUptdP1GJ5p03yGzf4KdI4aiDTp0bk bobbdy6hezY7RKwqUZ3NZcQJFy5t9yRXxXMHXoQ1pNCBzQowvWxTxKo+arXruf438Xdu ofrQg9NXGbQk1rvHcpQ32qxoDVdJOmDezQ9RTN/n9txFxMvFBP/Y4kxrKJv5dXG1p847 84NA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:in-reply-to:references:date :message-id:mime-version:content-transfer-encoding; bh=Kr9nngn4sb/+8vSqd+/yp3nDGNjUDX4oa6bLRssyT3k=; b=LyrRNTn/HcsBu2XH3cE8179tU6LYqcCsMYdHpADuQPys1X7FyldRgTQFnOMvxgl0iS zKU86wsWEJh7G8r7V+eddvB4sa24HiYp9zW+Q7+dUr3rLcEpGEQRP+0ykxbHPPbdbfoj 4pON0n6iAG/ioC4+AlSsypcvKfvedHfvVWOqj6gVgPASZzA6jrKdQfQRqO2i9KDlVW21 Ywh3tvG9y12oXRGvxDTj41cjPotVwdVI9ihFlhGZV1+6uU8QCvELgxjeUrRpnb03V2Rb 0sf8OHW7iNK4imj56vK2tS87D+Kb4aIYuG3bT/Lu3kQEo59SYLhSvbN2fsPO1zCrZpvV Y0PA== X-Gm-Message-State: AOAM530ECvPB3MHEAfXu5P1+fhoZNDcKQJ4xs+gNz+PikMkzFrpttFjQ 7u3hIPxisd8PlYJSApD1Rlg= X-Google-Smtp-Source: ABdhPJzzhfOAOdyvsjSzDC28YMbKRrKGILVxWULXyPDLk0cJbAftTiMfTushSMjzittu35KuaVgEZA== X-Received: by 2002:a1c:e008:: with SMTP id x8mr1865650wmg.129.1595328061673; Tue, 21 Jul 2020 03:41:01 -0700 (PDT) Received: from lili ([2a01:e0a:59b:9120:65d2:2476:f637:db1e]) by smtp.gmail.com with ESMTPSA id u20sm2851617wmm.15.2020.07.21.03.41.00 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 21 Jul 2020 03:41:01 -0700 (PDT) From: zimoun In-Reply-To: <87zh7yhmbi.fsf@gmail.com> References: <878sfkkb8m.fsf@gmail.com> <86365rzpol.fsf@gmail.com> <87zh7yhmbi.fsf@gmail.com> Date: Tue, 21 Jul 2020 12:40:59 +0200 Message-ID: <86365ldubo.fsf@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: 0.0 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-Spam-Score: -1.0 (-) X-BeenThere: bug-guix@gnu.org List-Id: Bug reports for GNU Guix List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: 42371@debbugs.gnu.org Errors-To: bug-guix-bounces+larch=yhetil.org@gnu.org Sender: "bug-Guix" X-Scanner: scn0 Authentication-Results: aspmx1.migadu.com; dkim=fail (rsa verify failed) header.d=gmail.com header.s=20161025 header.b=V35/X6al; dmarc=fail reason="SPF not aligned (relaxed)" header.from=gmail.com (policy=none); spf=pass (aspmx1.migadu.com: domain of bug-guix-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=bug-guix-bounces@gnu.org X-Spam-Score: 1.59 X-TUID: oAgE0MNjPZyE Dear, On my laptop and my desktop, both =E2=80=9Ccat /proc/cpuinfo |grep processo= r|wc -l=E2=80=9D returning 4, and with 10 guixbuild users, I get these results. On Thu, 16 Jul 2020 at 23:06, Maxim Cournoyer w= rote: > --8<---------------cut here---------------start------------->8--- > guix build --quiet --check $(guix package -A | head -n 11 | cut -f1) [=E2=80=A6] guix build: error: derivation `/gnu/store/=E2=80=A6-4ti2-1.6.9.drv' may not= be determin\ istic: output `/gnu/store/=E2=80=A6-4ti2-1.6.9' differs=20 > --8<---------------cut here---------------end--------------->8--- Then, I run this tiny script fixing --max-jobs and --cores on my desktop machine only: --8<---------------cut here---------------start------------->8--- for npkg in 4 5 6 7 8 9 10 11 12=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20 do=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20 for JOBS in 1 2 3 4=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20 do=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20 for CORES in 1 2 4 8 16 32=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20 do=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20 echo "# num.of pkg=3D$npkg"=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20 echo "# --max-jobs=3D$JOBS"=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20 echo "# --cores=3D$CORES"=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20 guix build --quiet --check -k \=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20 --max-jobs=3D$JOBS \=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20 --cores=3D$CORES \=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20 $(guix package -A | head -n $npkg | cut -f1)=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20 echo " "=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20 sleep 2=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20 done=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20 done=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20 done --8<---------------cut here---------------end--------------->8--- And it hits the non-deterministic error for all the cases until the case num.of pkg=3D11 --max-jobs=3D2 --cores=3D1 where it errors "all build users are currently in use; consider creating additional users and adding them to the `guixbuild' group". Then npkg=3D11 --max-jobs=3D2 --cores=3D2 fails with non-deterministic. (I reproduce on my laptop the result for npkg=3D11 max-jobs=3D2 cores=3D1,2= .) The next case, npkg=3D11 --max-jobs=3D2 --cores=3D4 does not seem reproduci= ble on my machine; similarly for cores=3D8,16,32. Then I have not checked the reproducibility of the cases below. Interestingly, npkg=3D11 --max-jobs=3D3 --cores=3D1,2,4,8,16 fails with not enough builders. But not for --cores=3D32 which fails with non-deterministic. All the values for cores fails with not enough builder for npkg=3D11 and --max-jobs=3D4. Another surprise, npkg=3D12 --max-jobs=3D1 --cores=3D1,2,4,8,16,32 fails wi= th non-deterministic. And npkg=3D12 --max-jobs=3D2 --cores=3D2,4,8,16,32 too. All the best, simon