From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp1 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms11 with LMTPS id 4NqnEHCCql9OdgAA0tVLHw (envelope-from ) for ; Tue, 10 Nov 2020 12:07:12 +0000 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp1 with LMTPS id yNmrDHCCql9PMgAAbx9fmQ (envelope-from ) for ; Tue, 10 Nov 2020 12:07:12 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id A9B39940118 for ; Tue, 10 Nov 2020 12:07:11 +0000 (UTC) Received: from localhost ([::1]:43480 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kcSQX-000672-AT for larch@yhetil.org; Tue, 10 Nov 2020 07:07:09 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:57190) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1kcSQQ-00066i-Rs for bug-guix@gnu.org; Tue, 10 Nov 2020 07:07:02 -0500 Received: from debbugs.gnu.org ([209.51.188.43]:53325) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1kcSQQ-00063v-HW for bug-guix@gnu.org; Tue, 10 Nov 2020 07:07:02 -0500 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1kcSQQ-0002O6-D5 for bug-guix@gnu.org; Tue, 10 Nov 2020 07:07:02 -0500 X-Loop: help-debbugs@gnu.org Subject: bug#44551: Clients can trigger daemon file descriptor exhaustion Resent-From: Ludovic =?UTF-8?Q?Court=C3=A8s?= Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Tue, 10 Nov 2020 12:07:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: report 44551 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: 44551@debbugs.gnu.org X-Debbugs-Original-To: Received: via spool by submit@debbugs.gnu.org id=B.16050099999144 (code B ref -1); Tue, 10 Nov 2020 12:07:02 +0000 Received: (at submit) by debbugs.gnu.org; 10 Nov 2020 12:06:39 +0000 Received: from localhost ([127.0.0.1]:36638 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kcSQ2-0002NQ-VV for submit@debbugs.gnu.org; Tue, 10 Nov 2020 07:06:39 -0500 Received: from lists.gnu.org ([209.51.188.17]:60342) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kcSQ2-0002NJ-2P for submit@debbugs.gnu.org; Tue, 10 Nov 2020 07:06:38 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:57140) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1kcSQ1-00062v-Ul for bug-guix@gnu.org; Tue, 10 Nov 2020 07:06:37 -0500 Received: from fencepost.gnu.org ([2001:470:142:3::e]:59442) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kcSQ0-0005vJ-6F for bug-guix@gnu.org; Tue, 10 Nov 2020 07:06:37 -0500 Received: from [2a01:e0a:1d:7270:af76:b9b:ca24:c465] (port=43518 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1kcSPy-0000VM-Ql for bug-guix@gnu.org; Tue, 10 Nov 2020 07:06:35 -0500 From: Ludovic =?UTF-8?Q?Court=C3=A8s?= X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 20 Brumaire an 229 de la =?UTF-8?Q?R=C3=A9volution?= X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu Date: Tue, 10 Nov 2020 13:06:32 +0100 Message-ID: <87r1p1pgaf.fsf@inria.fr> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -2.1 (--) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-Spam-Score: -3.1 (---) X-BeenThere: bug-guix@gnu.org List-Id: Bug reports for GNU Guix List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-guix-bounces+larch=yhetil.org@gnu.org Sender: "bug-Guix" X-Scanner: ns3122888.ip-94-23-21.eu Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=pass (policy=none) header.from=gnu.org; spf=pass (aspmx1.migadu.com: domain of bug-guix-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=bug-guix-bounces@gnu.org X-Spam-Score: -1.51 X-TUID: cAVBeGrERt// Hi! --8<---------------cut here---------------start------------->8--- $ guix time-machine --branch=3Dversion-1.2.0 -- package -A '^r-' | wc -l [...] 1488 $ r_packages=3D"`guix time-machine --branch=3Dversion-1.2.0 -- package -A '= ^r-' | cut -f1`" $ guix time-machine --branch=3Dversion-1.2.0 -- build --no-grafts $r_packag= es --max-jobs=3D20 --keep-going process 61621 acquired build slot '/var/guix/offload/141.80.167.178:22/1' normalized load on machine '141.80.167.177' is 0.03 building /gnu/store/ix9x8qzdy3cf0435b7a8p1gl77vcn82c-r-shinycssloaders-1.0.= 0.drv... process 61683 acquired build slot '/var/guix/offload/141.80.167.178:22/1' process 61683 acquired build slot '/var/guix/offload/141.80.167.172:22/1' [...] normalized load on machine '141.80.167.178' is 0.01 building /gnu/store/7ws1c6nkxkgkb86qdcgy9lq483jz5rf4-r-shinydashboard-0.7.1= .drv... process 61725 acquired build slot '/var/guix/offload/141.80.167.171:22/4' process 61725 acquired build slot '/var/guix/offload/141.80.167.159:22/2' [...] normalized load on machine '141.80.167.171' is 0.16 building /gnu/store/j6walvqfdbavr56ymlnivnrc1z07yjfp-r-shinyfiles-0.8.0.drv= ... guix build: error: creating pipe: Too many open files --8<---------------cut here---------------end--------------->8--- On closer inspection, it seems that the guix-daemon for that session opens each .drv file along with the corresponding .lock file, and spawns one =E2=80=98guix offload=E2=80=99 process for each (?) and creates one pip= e per offload process: --8<---------------cut here---------------start------------->8--- $ sudo guix processes| recsel -e 'ClientCommand ~ "r-biasedurn"' SessionPID: 3412 ClientPID: 3343 ClientCommand: /gnu/store/b7rixb64yp00znz0d5rwd5zzklwzlzmv-guile-wrapper/bi= n/guile --no-auto-compile /home/ludo/.cache/guix/inferiors/pnxkhd7va5d3u5ja= s4mwsbic4vrkcbyv2too7sd74xd5vjyz54pq/bin/guix build --no-grafts r-a3 r-a4 r= -a4base r-a4classif r-a4core r-a4preproc r-a4reporting r-aasea r-abacus r-a= badata r-abaenrichment r-abbyyr r-abc r-abc-data r-abc-rap r-abcadm r-abcan= alysis r-abcdefba r-abcoptim r-abcp2 r-abcrf r-abcrlda r-abctools r-abd r-a= be r-abemus r-abf2 r-abhgenotyper r-abind r-abjutils r-abn r-abnormality r-= abodoutlier r-abps r-abseqr r-absfiltergsea r-absim r-abstractr r-abtest r-= abundant r-ac3net r-aca r-acc r-accelerometry r-accelmissing r-accept r-acc= eptancesampling r-acclma r-accrual r-accrued r-accsda r-acd r-acdm r-ace2fa= stq r-acebayes r-acepack r-acet r-acfmperiod r-acid r-acm4r r-acmeeqtl r-ac= mer r-acnr r-acopula r-acousticndlcoder r-acp r-acrm [=E2=80=A6] LockHeld: /gnu/store/mi6ydc4w47nrsw2ycsyssc2hlpl5jvlb-r-biclust-2.0.2.lock LockHeld: /gnu/store/zypp435ii1sd256p1bapgvk06p2kc6rq-r-bifet-1.8.0.lock LockHeld: /gnu/store/x316v7js7rj0wjhvynf3mn3ppxqqnghg-r-bigpint-1.4.0.lock LockHeld: /gnu/store/jxs6h5f1cvlz7dmmifr3qf3skzziklwa-r-bigrquery-1.3.2.lock LockHeld: /gnu/store/sw55r4wj1bgj2aqkl1gyqifk077iyvlc-r-aasea-1.1.0.lock LockHeld: /gnu/store/r4331w4h693zl3596i9cnb0z7437aghp-r-bisquerna-1.0.4.lock LockHeld: /gnu/store/13jggpxjxzjpbvwfx5vwdscvz5z5md88-r-cdm-7.5-15.lock LockHeld: /gnu/store/bfvfb4wk1q9idfj3gdi1j7zhp5kj21kw-r-chemminer-3.40.0.lo= ck LockHeld: /gnu/store/2q0pibjmqd51dx331l4iz1xby868y7d3-r-chipkernels-1.1-1.c= 9cfcacb6.lock LockHeld: /gnu/store/f195yyipwhhz1cdyvvwvcwd9n93bbgxk-r-chippeakanno-3.22.4= .lock LockHeld: /gnu/store/2igc78ipanbr0cgj508jxq94pqldirlx-r-circus-0.1.5.lock LockHeld: /gnu/store/sr3h7hxzkjq8kh17f4clb27d5w6li34j-r-citr-0.3.2.lock LockHeld: /gnu/store/cz7iffxh03mqf0651vxg6669aq31f039-r-cssam-1.4-1.9ec58c9= .lock LockHeld: /gnu/store/6xlx6mbvi6mz44kyps36vlw05r085k9s-r-ddrtree-0.1.5.lock LockHeld: /gnu/store/6d0j0a5i8vz966w66b76w5gpb9xdpc2m-r-dnabarcodes-1.18.0.= lock LockHeld: /gnu/store/d6c5i3f41hfz4sacgmjc64x78rfk4f1p-r-abstractr-0.1.0.lock LockHeld: /gnu/store/2kzzqdglrja1fr34jcp51vk8hw6ajk3i-r-dorng-1.8.2.lock LockHeld: /gnu/store/5rvg6vaa5h5bxqxcw3nd7hl5695m64dz-r-dvmisc-1.1.4.lock [=E2=80=A6] ChildProcess: 10012: ChildProcess: 10056: ChildProcess: 10156: ChildProcess: 10228: ChildProcess: 10275: ChildProcess: 10331: /gnu/store/ah16zr8mmfkqy23rr7jy5a842ca1q9h1-guile-3.0.= 4/bin/guile \ /gnu/store/c6y2fijkw5v0b6jm336h7pvvzd2wm0yd-guix-1.1.0-30.875= c01f/bin/.guix-real offload x86_64-linux 3600 1 21600 ChildProcess: 10384: ChildProcess: 10440: ChildProcess: 10485: ChildProcess: 10545: ChildProcess: 10603: [=E2=80=A6] $ sudo ls -l /proc/3412/fd = total 0 lr-x------ 1 root root 64 Nov 10 13:02 0 -> /dev/null l-wx------ 1 root root 64 Nov 10 13:02 1 -> /var/log/guix-daemon.log lr-x------ 1 root root 64 Nov 10 13:02 10 -> 'pipe:[1555282836]' l-wx------ 1 root root 64 Nov 10 13:02 100 -> 'pipe:[1555302732]' l-wx------ 1 root root 64 Nov 10 13:02 101 -> /var/log/guix/drvs/ph/3347q47= fzm7p7xqxrg2yaczq32yhry-r-biasedurn-1.07.drv.gz lrwx------ 1 root root 64 Nov 10 13:02 102 -> /gnu/store/mi6ydc4w47nrsw2ycs= yssc2hlpl5jvlb-r-biclust-2.0.2.lock lr-x------ 1 root root 64 Nov 10 13:02 103 -> 'pipe:[1555309592]' lr-x------ 1 root root 64 Nov 10 13:02 104 -> 'pipe:[1554900787]' l-wx------ 1 root root 64 Nov 10 13:02 105 -> 'pipe:[1554900787]' l-wx------ 1 root root 64 Nov 10 13:02 106 -> /var/log/guix/drvs/cy/d6a29xc= j8mpz2d2wwr74qz0wls25sh-r-biclust-2.0.2.drv.gz lrwx------ 1 root root 64 Nov 10 13:02 107 -> /gnu/store/zypp435ii1sd256p1b= apgvk06p2kc6rq-r-bifet-1.8.0.lock lr-x------ 1 root root 64 Nov 10 13:02 108 -> 'pipe:[1555297615]' lr-x------ 1 root root 64 Nov 10 13:02 109 -> 'pipe:[1555309594]' l-wx------ 1 root root 64 Nov 10 13:02 11 -> /var/log/guix/drvs/my/p71npacp= g71brl7cnjs5235kxvvvmk-r-a4base-1.36.0.drv.gz l-wx------ 1 root root 64 Nov 10 13:02 110 -> 'pipe:[1555309594]' l-wx------ 1 root root 64 Nov 10 13:02 111 -> /var/log/guix/drvs/n8/kr70pvr= 00zvssfmdqwx0jwk7yrmynj-r-bifet-1.8.0.drv.gz lrwx------ 1 root root 64 Nov 10 13:02 112 -> /gnu/store/x316v7js7rj0wjhvyn= f3mn3ppxqqnghg-r-bigpint-1.4.0.lock lr-x------ 1 root root 64 Nov 10 13:02 113 -> 'pipe:[1555310888]' lr-x------ 1 root root 64 Nov 10 13:02 114 -> 'pipe:[1555297617]' l-wx------ 1 root root 64 Nov 10 13:02 115 -> 'pipe:[1555297617]' l-wx------ 1 root root 64 Nov 10 13:02 116 -> /var/log/guix/drvs/8c/hs0dfim= v9jmr99825860x32wfhifva-r-bigpint-1.4.0.drv.gz lrwx------ 1 root root 64 Nov 10 13:02 117 -> /gnu/store/jxs6h5f1cvlz7dmmif= r3qf3skzziklwa-r-bigrquery-1.3.2.lock lr-x------ 1 root root 64 Nov 10 13:02 118 -> 'pipe:[1555299601]' lr-x------ 1 root root 64 Nov 10 13:02 119 -> 'pipe:[1555310890]' lrwx------ 1 root root 64 Nov 10 13:02 12 -> /gnu/store/sw55r4wj1bgj2aqkl1g= yqifk077iyvlc-r-aasea-1.1.0.lock l-wx------ 1 root root 64 Nov 10 13:02 120 -> 'pipe:[1555310890]' l-wx------ 1 root root 64 Nov 10 13:02 121 -> /var/log/guix/drvs/lg/0b9ip4f= g2ar1qjbz6v8xrc9iyfgjma-r-bigrquery-1.3.2.drv.gz [=E2=80=A6] --8<---------------cut here---------------end--------------->8--- Ludo=E2=80=99.