unofficial mirror of bug-guix@gnu.org 
 help / color / mirror / code / Atom feed
From: zimoun <zimon.toutoune@gmail.com>
To: Maxim Cournoyer <maxim.cournoyer@gmail.com>
Cc: 42371@debbugs.gnu.org
Subject: bug#42371: Grafts max out build slots without being queued
Date: Tue, 21 Jul 2020 12:40:59 +0200	[thread overview]
Message-ID: <86365ldubo.fsf@gmail.com> (raw)
In-Reply-To: <87zh7yhmbi.fsf@gmail.com>

Dear,

On my laptop and my desktop, both “cat /proc/cpuinfo |grep processor|wc
-l” returning 4, and with 10 guixbuild users, I get these results.

On Thu, 16 Jul 2020 at 23:06, Maxim Cournoyer <maxim.cournoyer@gmail.com> wrote:

> --8<---------------cut here---------------start------------->8---
> guix build --quiet --check $(guix package -A | head -n 11 | cut -f1)
[…]
guix build: error: derivation `/gnu/store/…-4ti2-1.6.9.drv' may not be determin\
istic: output `/gnu/store/…-4ti2-1.6.9' differs 
> --8<---------------cut here---------------end--------------->8---

Then, I run this tiny script fixing --max-jobs and --cores on my desktop
machine only:

--8<---------------cut here---------------start------------->8---
for npkg in 4 5 6 7 8 9 10 11 12                                                
do                                                                              
    for JOBS in 1 2 3 4                                                         
    do                                                                          
        for CORES in 1 2 4 8 16 32                                              
        do                                                                      
            echo "# num.of pkg=$npkg"                                           
            echo "# --max-jobs=$JOBS"                                           
            echo "#    --cores=$CORES"                                          
            guix build --quiet --check -k \                                     
                 --max-jobs=$JOBS          \                                    
                 --cores=$CORES           \                                     
                 $(guix package -A | head -n $npkg | cut -f1)                   
            echo " "                                                            
            sleep 2                                                             
        done                                                                    
    done                                                                        
done
--8<---------------cut here---------------end--------------->8---

And it hits the non-deterministic error for all the cases until the case
num.of pkg=11 --max-jobs=2 --cores=1 where it errors "all build users
are currently in use; consider creating additional users and adding them
to the `guixbuild' group".

Then npkg=11 --max-jobs=2 --cores=2 fails with non-deterministic.

(I reproduce on my laptop the result for npkg=11 max-jobs=2 cores=1,2.)

The next case, npkg=11 --max-jobs=2 --cores=4 does not seem reproducible
on my machine; similarly for cores=8,16,32.

Then I have not checked the reproducibility of the cases below.

Interestingly, npkg=11 --max-jobs=3 --cores=1,2,4,8,16 fails with not
enough builders.  But not for --cores=32 which fails with
non-deterministic.

All the values for cores fails with not enough builder for npkg=11 and
--max-jobs=4.

Another surprise, npkg=12 --max-jobs=1 --cores=1,2,4,8,16,32 fails with
non-deterministic.  And npkg=12 --max-jobs=2 --cores=2,4,8,16,32 too.


All the best,
simon




  parent reply	other threads:[~2020-07-21 10:42 UTC|newest]

Thread overview: 11+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2020-07-15 16:13 bug#42371: Grafts max out build slots without being queued Maxim Cournoyer
2020-07-15 17:13 ` Maxim Cournoyer
2020-07-16 10:18 ` Ludovic Courtès
2020-07-16 11:09   ` zimoun
2020-07-16 22:06   ` Maxim Cournoyer
2020-07-16 11:04 ` zimoun
2020-07-17  2:38   ` Maxim Cournoyer
2020-07-17  3:06   ` Maxim Cournoyer
2020-07-17  9:23     ` zimoun
2020-07-21 10:40     ` zimoun [this message]
2020-12-04 14:18 ` zimoun

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

  List information: https://guix.gnu.org/

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=86365ldubo.fsf@gmail.com \
    --to=zimon.toutoune@gmail.com \
    --cc=42371@debbugs.gnu.org \
    --cc=maxim.cournoyer@gmail.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
Code repositories for project(s) associated with this public inbox

	https://git.savannah.gnu.org/cgit/guix.git

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).