From mboxrd@z Thu Jan 1 00:00:00 1970 From: Efraim Flashner Subject: bug#30644: Cuirass runs out of build users Date: Fri, 2 Mar 2018 16:08:33 +0200 Message-ID: <20180302140833.GB3213@macbook41> References: <20180228090714.GA1845@jurong> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="8NvZYKFJsRX2Djef" Return-path: Received: from eggs.gnu.org ([2001:4830:134:3::10]:34644) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1erlMx-0004LF-Rv for bug-guix@gnu.org; Fri, 02 Mar 2018 09:09:09 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1erlMs-0000aM-SJ for bug-guix@gnu.org; Fri, 02 Mar 2018 09:09:07 -0500 Received: from debbugs.gnu.org ([208.118.235.43]:60644) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1erlMs-0000aE-NS for bug-guix@gnu.org; Fri, 02 Mar 2018 09:09:02 -0500 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1erlMs-0001LC-I1 for bug-guix@gnu.org; Fri, 02 Mar 2018 09:09:02 -0500 Sender: "Debbugs-submit" Resent-Message-ID: Content-Disposition: inline In-Reply-To: <20180228090714.GA1845@jurong> List-Id: Bug reports for GNU Guix List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-guix-bounces+gcggb-bug-guix=m.gmane.org@gnu.org Sender: "bug-Guix" To: Andreas Enge Cc: 30644@debbugs.gnu.org --8NvZYKFJsRX2Djef Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, Feb 28, 2018 at 10:07:14AM +0100, Andreas Enge wrote: > Hello, >=20 > in trying out the new bayfront machine, I raised the number of concurrent > build jobs to 10; the number of build accounts is programmatically set to > twice this number. >=20 > Looking at the build directories in /tmp, 9 build jobs were started on > February 26 at around 21:50, a 10th one at 22:24. >=20 > Later, I have been getting messages such as these: > 2018-02-27T18:31:13 building 14491 derivations in batches of 200 > 2018-02-27T18:31:13 building batch of 200 jobs (0/14491) > 2018-02-27T18:31:13 build failed: '/gnu/store/3qy3s1dy3nnb108ifz9yiscs687= g0xkh-gfortran-5.5.0.drv' > 2018-02-27T18:31:13 build failed: '/gnu/store/1zdxbjmcw1qnmzh2qcbafsrbr8i= 2j1x3-glib-2.54.2.drv' > 2018-02-27T18:31:14 build failed: '/gnu/store/w56wpx4jar88hfabipvf6gd6hz8= 1p6wk-python2-gevent-1.2.2.drv' > 2018-02-27T18:31:14 build failed: '/gnu/store/i2zmgbsi599pxskqh15s38fpms3= 59jp7-gcc-cross-sans-libc-arm-linux-gnueabihf-5.5.0.drv' > 2018-02-27T18:31:14 build failed: '/gnu/store/qd59gqza3ly4rk2xjf40q2539rj= gzh5r-gcc-cross-sans-libc-powerpc-linux-gnu-5.5.0.drv' > 2018-02-27T18:31:14 build failed: '/gnu/store/3qy3s1dy3nnb108ifz9yiscs687= g0xkh-gfortran-5.5.0.drv' > 2018-02-27T18:31:14 build failed: '/gnu/store/1zdxbjmcw1qnmzh2qcbafsrbr8i= 2j1x3-glib-2.54.2.drv' > 2018-02-27T18:31:15 build started: '/gnu/store/08pjxws1pd04syqf28d3hhsfrb= 946bpc-dzen-0.9.5-1.488ab66.drv' > 2018-02-27T18:31:15 build failed: '/gnu/store/3qy3s1dy3nnb108ifz9yiscs687= g0xkh-gfortran-5.5.0.drv' > 2018-02-27T18:31:15 build failed: '/gnu/store/1zdxbjmcw1qnmzh2qcbafsrbr8i= 2j1x3-glib-2.54.2.drv' > 2018-02-27T18:31:15 build started: '/gnu/store/01r4xm1nqixcxjbbn6xakpg3m5= wkr12v-po4a-0.47.drv' > 2018-02-27T18:31:15 build failed: '/gnu/store/d545d4jzw0mfa61d9ml3vygchr9= 3xp51-python-gevent-1.2.2.drv' > 2018-02-27T18:31:15 build started: '/gnu/store/02chd3k5qc8p8fc46j4w955cfl= d77cw1-spinsim-0.75-1.66915a7ad.drv' > 2018-02-27T18:31:15 build started: '/gnu/store/81b2340psschvvk7ybhnz6nx9j= kpdlwa-Net-SMTP-SSL-1.04.tar.gz.drv' > 2018-02-27T18:31:15 build started: '/gnu/store/rkkacywdj7yya3wf51i141x5kh= zld4zl-clx-0.0.0-1.tar.xz.drv' > 2018-02-27T18:31:16 build started: '/gnu/store/286gkv0z6g9fb4frcx6yp2fg9v= 6iwk3b-ecl-alexandria-0.0.0-1.926a066.drv' > 2018-02-27T18:31:16 build started: '/gnu/store/hmy3ds71gbv1mspc9p5yvvhz5p= ibs8wl-elixir-1.5.3.tar.xz.drv' > 2018-02-27T18:31:16 build failed: '/gnu/store/1zdxbjmcw1qnmzh2qcbafsrbr8i= 2j1x3-glib-2.54.2.drv' > 2018-02-27T18:31:16 build started: '/gnu/store/y0p2myl0al8x3rlbxphgyjk83z= l3kmb5-idris-mode-0.9.19.tar.drv' > 2018-02-27T18:31:16 batch of builds (partially) failed:all build users ar= e currently in use; consider creating additional users and adding them to t= he `guixbuild' group (status: 1) >=20 > So it looks as if build jobs get stalled, but somehow do not free their > build users. >=20 > Hm, the directories in /tmp are created by guixbuilder01 to guixbuilder10. > 10 is the default value, but it should have been overwritten. >=20 > And in /etc/passwd, I see 20 users. But apparently, they are not used! >=20 > Andreas >=20 When I use a shell script to build all the packages, if a package hangs and gets eaten by the timout-limit then it holds the build user and space in /tmp until all 10 builders are taken and building stops or all the builds finish and then it releases them. --=20 Efraim Flashner =D7=90=D7=A4=D7=A8=D7=99=D7=9D = =D7=A4=D7=9C=D7=A9=D7=A0=D7=A8 GPG key =3D A28B F40C 3E55 1372 662D 14F7 41AA E7DC CA3D 8351 Confidentiality cannot be guaranteed on emails sent or received unencrypted --8NvZYKFJsRX2Djef Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAEBCgAdFiEEoov0DD5VE3JmLRT3Qarn3Mo9g1EFAlqZWuEACgkQQarn3Mo9 g1Gx3w//aDK7ncgEDjVA2yljOjGVNKmK9Fb4yn/jVxwArN4AsfIe9wOobGZOKy3Q c2F4rhmCpy7uUKmz7qfkLqbkiurcQ2X/tuZ6f4Rfmu8BCGUyg2IqAqcFC08CpaVQ VyalkG1NOqF96rUcGvnqL+O1kYs0b37JKZLFxx+VYrSiy4KO0dflVXVhegwDNpoy nQNeD3EdxEgG+pBmxoqtY6PeLEw1zuzmcB8ieJCfDdFNz5DXSWF6iwAHrEWCuNup DPktozvp5XQZd4BkZfWYBY7RQ6VT5xHdFANwCh5bYAgSFff+NJWZ1YeIeEXj3W2i lGLyaaiSPjV+xfvWEMZKn0AmWhNOOQ032ABz6lWXGjDJbRzw3DpIofMpITMI2cm/ TmQVjE4ElsVTSPvKN76+CXk5RC/XFUTOp/Yln0wTUnzG+8TOU97CkcggoGfu2973 G0OZjP8dNS2haqyI8rpuuErKJPT5CnWv40oGPpYxC4jLnDSQz5Kjr0I6BftzNkhZ +7gULzhvH211yKB1DZe1kP7WtMKPHkbNlLuS0wTokecrCx75vfLW9VUorEExkZwd APayq08z1a8fb8YNQESztz58rBGLabYKNcYnOX3dvTXzZZtDW/l75tRePlgBABHz MpQ6onf80o28uugtHFvdEhP3sDSvWt5fEjgUOgY87TaTMNmqf0k= =vgq9 -----END PGP SIGNATURE----- --8NvZYKFJsRX2Djef--