From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp2 ([2001:41d0:2:4a6f::]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id 6GhKHgOGZWC5HAAAgWs5BA (envelope-from ) for ; Thu, 01 Apr 2021 10:36:19 +0200 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp2 with LMTPS id GAQ/GAOGZWDJYAAAB5/wlQ (envelope-from ) for ; Thu, 01 Apr 2021 08:36:19 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id D1AF8C6F6 for ; Thu, 1 Apr 2021 10:36:18 +0200 (CEST) Received: from localhost ([::1]:60284 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1lRsoM-0003w5-0g for larch@yhetil.org; Thu, 01 Apr 2021 04:36:18 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:40446) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1lRsnv-0003vS-HC for guix-science@gnu.org; Thu, 01 Apr 2021 04:35:51 -0400 Received: from mail2-relais-roc.national.inria.fr ([192.134.164.83]:11414) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1lRsni-00045x-Et for guix-science@gnu.org; Thu, 01 Apr 2021 04:35:50 -0400 IronPort-HdrOrdr: =?us-ascii?q?A9a23=3AO0EL7KGyzxOqKMajpLqECseALOonbusQ8zAX?= =?us-ascii?q?/mp2TgFYddHdqtC2kJ0gtSPcpT4NVBgb8+yoF7KHRRrnmKJdxak0EfOcUBL9uG?= =?us-ascii?q?2uRbsC0aLHzyf7EyPzss5xvJ0OT4FEBNf9DUd3gK/BiWHSL/8b3NKF/Kq07N2x?= =?us-ascii?q?815RTBpnY6wlzwB1BhfzKDwSeCB6BIE0HJfZ28xfpzDIQwVyUu2HABA+M9Trlp?= =?us-ascii?q?nunJLibQVuPW9E1CC+yRWy6LD7FBCE3hARFxN3qI1SklT4rw=3D=3D?= X-IronPort-AV: E=Sophos;i="5.81,296,1610406000"; d="scan'208";a="501061986" Received: from 91-160-117-201.subs.proxad.net (HELO ribbon) ([91.160.117.201]) by mail2-relais-roc.national.inria.fr with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 01 Apr 2021 10:35:32 +0200 From: =?utf-8?Q?Ludovic_Court=C3=A8s?= To: =?utf-8?Q?S=C3=A9bastien?= Lerique Cc: guix-science@gnu.org, zimoun Subject: Re: Introducing Guix to HPC at my institution References: <878s6pds9t.fsf@eauchat.org> <87zgz3c17o.fsf@eauchat.org> <8735wva2p9.fsf@gnu.org> <87r1kdci49.fsf@eauchat.org> <877dlucsur.fsf@eauchat.org> <87k0pqrwub.fsf@inria.fr> <87blb1wgna.fsf@eauchat.org> <87o8f1jee2.fsf@inria.fr> <87ft0bvqv5.fsf@eauchat.org> X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 12 Germinal an 229 de la =?utf-8?Q?R=C3=A9volution?= X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu Date: Thu, 01 Apr 2021 10:35:32 +0200 In-Reply-To: <87ft0bvqv5.fsf@eauchat.org> (=?utf-8?Q?=22S=C3=A9bastien?= Lerique"'s message of "Wed, 31 Mar 2021 14:23:10 +0900") Message-ID: <87mtui1jxn.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Received-SPF: pass client-ip=192.134.164.83; envelope-from=ludovic.courtes@inria.fr; helo=mail2-relais-roc.national.inria.fr X-Spam_score_int: -41 X-Spam_score: -4.2 X-Spam_bar: ---- X-Spam_report: (-4.2 / 5.0 requ) BAYES_00=-1.9, RCVD_IN_DNSWL_MED=-2.3, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-science@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-science-bounces+larch=yhetil.org@gnu.org Sender: "Guix-Science" X-Migadu-Flow: FLOW_IN ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1617266178; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-unsubscribe:list-subscribe:list-post; bh=iYuIMho2xK54f7u1hUP2Kq0neBDCSuTTNZSTekT/hjs=; b=h+QML8LdYr4R8+5mH0Ug+ao5U6urB+cvZRdh1I/W3AL8bcryACZpHeWpxB21++HLa/0nfx 6IrqVQhKnz5SUTPypv/EjXwfHqw47GZi4/gMpbYjoOgDwRcvQsDfnLGND76Le10bEKmmv1 QpmW5e4S0wKavXSFn2KwuMMdzImHm5i8VMd490pz1hXwDTpC1hb3KhwNih3V3s3uHU3CU/ tJdLgqo1ZWjK5jgUcSJ4/UlI2KYWgikefmlGUQMkVVylgPw2aOIu5KDtgL2hpgZUsjLWXP fvPWbIG/0uj0yXiZAcso8cX41gsB20j3hc752r2dJKJ+qzaVPPAYm/2WrDDffA== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1617266178; a=rsa-sha256; cv=none; b=R1tkwGm6XHim7wbIRAhtpPZ2vVnu08ZcGLh+ItDNP0MXGExFpVi57c6AjQY2eAmj1fQ61v FKuVDVAVHYQ4KoLprY4m/uWwLp7sfa+kN41zFrmqFEINlGuTRtx6dsENQdnFvm1YbcRQ0y c1vkseTtcBXm6VjYMkJt5PTZ7pRLWs88ja8MqGvYeQkG74u8W4qBzVovsXpv7/UvE54v81 j5yjQN6u5rDpdT4r+CL1dUF8bt2p9+8/vHcWBwhfS57R8TsWSee2QmIdYUiEAHfpYMXd8b KQgfHN1ZAyav6U+dYjOibcNkpqIGUDXjx+NnLSR3CC+ybcCtCKbXQ5x0xoGYNg== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=none; spf=pass (aspmx1.migadu.com: domain of guix-science-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-science-bounces@gnu.org X-Migadu-Spam-Score: -0.93 Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of guix-science-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-science-bounces@gnu.org X-Migadu-Queue-Id: D1AF8C6F6 X-Spam-Score: -0.93 X-Migadu-Scanner: scn0.migadu.com X-TUID: njREVDACiAlc Howdy! S=C3=A9bastien Lerique skribis: > Case 1: with substitutes, on a local (non-NFS) folder > ----------------------------------------------------- > > $ guix archive --authorize < bin/../share/guix/ci.guix.gnu.org.pub > $ guix-daemon --disable-chroot & > $ guix install hello > [... dowloading ...] > unexpected substituter message 'defining `GUIX_LOCPATH', along > these lines: > > guix install glibc-utf8-locales > export GUIX_LOCPATH=3D"$HOME/.guix-profile/lib/locale" > > See the "Application Setup" section in the manual, for more info. > ' > > I think this is https://issues.guix.gnu.org/45166. > > Using instead `guix pack -R -S /bin=3Dbin -S /etc=3Detc -S /lib=3Dlib guix > bash glibc-utf8-locales`, and: > > $ export GUIX_LOCPATH=3D$(pwd)/lib/locale > $ ls $GUIX_LOCPATH/ > 2.31 > > seems to start working, but then `guix install hello` fails with the > same error, and: > > $ ls $GUIX_LOCPATH/ > ls: cannot access '/tmp/sebastien-lerique/guix/lib/locale/': No > such file or directory > > Is it possible that glibc-utf8-locales gets garbage-collected? Can you run guix-daemon like so? LC_ALL=3Den_US.utf8 guix-daemon --disable-chroot & The =E2=80=9Cunexpected substitute message=E2=80=9D thing is a bug: it turn= s out that stderr of =E2=80=98guix substitute=E2=80=99 is consumed directly by the dae= mon at this point, which it shouldn=E2=80=99t (similar to the issue fixed by ee3226e9d54891c7e696912245e4904435be191c). > Case 2: from source (no substitutes), on a local (non-NFS) folder > ----------------------------------------------------------------- > > No need for the locale fix here (another bug appears before that): > > $ guix-daemon --disable-chroot & > # --no-offload works around the missing nscd problem; up to now > this > # doesn't seem necessary when using substitutes > $ guix install hello --no-offload > [... builds for a while ...] > build of > /gnu/store/pkn1w1q3xkn273kpmggc4dnq6n6hr9jy-bzip2-mesboot-1.0.8.drv=20 > failed > > The build log for bzip2-mesboot ends with: > > tcc -ar cq libbz2.a blocksort.o huffman.o crctable.o randtable.o > compress.o decompress.o bzlib.o > ranlib libbz2.a > /gnu/store/prkqai3zwh3shlqpll6xyncmmqpj49dd-gash-boot-0.2.0/bin/sh: > ranlib: Command not found. > make: *** [libbz2.a] Error 127 > command "make" "CC=3Dtcc -I ." "AR=3Dtcc -ar" "bzip2" > "PREFIX=3D/gnu/store/s94hyrv1vgllxir5niiyzfc9g80l5kcd-bzip2-mesboot-1.0.= 8"=20 > failed with status 2 > > Is this new and should be reported as a bug? Should binutils-mesboot0 > be part of bzip2-mesboot's inputs? (I haven't learned about the > boostrapping mechanism yet.) The problem is that =E2=80=98--disable-chroot=E2=80=99 is a bit of the wild= west: build processes can access the whole file system and what you do as a user can interfere with them. It could be that the bzip2 build failure above is just that: the build process picks something from /usr/lib or /usr/bin, and that breaks everything. I think =E2=80=98--disable-chroot=E2=80=99 is OK if you=E2=80=99re going to= use substitutes for almost everything. Otherwise, it=E2=80=99s not good. Your use case calls = for built-in support; that way, the daemon could take still advantage of user namespaces to set up a chroot and all. > Case 3: with substitutes, on an NFS share > ----------------------------------------- > > Again no need for the locale fix (another bug appears before that): > > $ guix archive --authorize < bin/../share/guix/ci.guix.gnu.org.pub > $ guix-daemon --disable-chroot & > $ guix install hello > [... downloading ...] > guix install: error: cannot unlink > `/gnu/store/fa6wj5bxkj5ll1d7292a70knmyl7a0cr-glibc-2.31/lib':=20 > Directory not empty > > so checking: > > $ ls -lA /gnu/store/fa6wj5bxkj5ll1d7292a70knmyl7a0cr-glibc-2.31/lib > total 3840 > -r-xr-xr-x 1 sebastien-lerique froeseuni 64832 Jan 1 1970 > .nfs000000000172caa5000054bd > [... more .nfs files ...] Ah yes, that=E2=80=99s a known issue with NFS. I=E2=80=99m not aware of an= y workaround. Thanks, Ludo=E2=80=99.