From mboxrd@z Thu Jan 1 00:00:00 1970 From: Giovanni Biscuolo Subject: Re: MPI cluster and container Date: Wed, 13 Feb 2019 11:42:18 +0100 Message-ID: <87h8d8dl6d.fsf@roquette.mug.biscuolo.net> References: Mime-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha512; protocol="application/pgp-signature" Return-path: Received: from eggs.gnu.org ([209.51.188.92]:47081) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1gtrzq-0002sS-Le for help-guix@gnu.org; Wed, 13 Feb 2019 05:42:31 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1gtrzo-00082N-K2 for help-guix@gnu.org; Wed, 13 Feb 2019 05:42:30 -0500 Received: from ns13.heimat.it ([46.4.214.66]:52098) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1gtrzm-0007zR-Ho for help-guix@gnu.org; Wed, 13 Feb 2019 05:42:28 -0500 In-Reply-To: List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: help-guix-bounces+gcggh-help-guix=m.gmane.org@gnu.org Sender: "Help-Guix" To: zimoun , help-guix --=-=-= Content-Type: text/plain Content-Transfer-Encoding: quoted-printable Hello zimoun, zimoun writes: [...] > Concerning the 1-, I mean the package manager part of Guix on a > cluster with MPI configured. *already having* a set of nodes you'd like to share the store on, Ludovic wrote a nice article on how to do it: https://guix-hpc.bordeaux.inria.fr/blog/2017/11/installing-guix-on-a-cluste= r/ it explains well what does it mean to "install Guix for system-wide use" in a (possibly faked) cluster environment Ricardo also wrote this https://guix.mdc-berlin.de/documentation.html#sec-2 with less details (but the rest of the document is interesting as HPC environment reference) I've adapted Ludovic instructions to share the store with an LXC container [1] via bind mounts (instead of NFS exports) of /gnu/store (ro) and /var/guix (rw)... and it works [2] for this to work I have to share both users (I do it via NIS) and their homes with the container, in order to have the same user profiles on both host and container a similar approach should also work for QEMU/KVM VMs and other virtualization software please consider that nowadays we can avoid starting the guix-daemon in TCP listening mode and use the default daemon setup: listen on the shared socket on /var/guix/daemon-socket/socket on the "master node"/host a= nd use GUIX_DAEMON_SOCKET variable [3] on the "computing nodes"/guests, by default (hardcoded?) pointing to the same socket ...aka you can skip the guix-daemon.service tweaks on host and GUIX_DAEMON_SOCKET settings on guest [...] > Well, the idea is to create a fake MPI cluster with controlled > containers. Does someone play around? not for MPI but I'm starting to create a network of containers to test networked services, but I'm still at early stages IMHO - in our use case - a much more effective alternative is to use a cluster of "guix system container"s [4] and/or "guix system vm"s HTH! Giovanni [1] both host and LXC container are foreign distros, Debian 9 in my case [2] sometimes I'm experiencing some GPU-related problems with GUIs but it almost for sure depends on my "strange" environment: the LXC container is also a LTSP server I'm using via a LTSP terminal... but that's another story [3] https://www.gnu.org/software/guix/manual/en/html_node/The-Store.html#in= dex-GUIX_005fDAEMON_005fSOCKET [4] please consider this non-blocking bug: https://debbugs.gnu.org/cgi/bugr= eport.cgi?bug=3D34211 =2D-=20 Giovanni Biscuolo Xelera IT Infrastructures --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAEBCgAdFiEERcxjuFJYydVfNLI5030Op87MORIFAlxj9IsACgkQ030Op87M ORK36g//W3GRGTpsEqbJVRcwsf6QsAXd3m0hR7ZcxiN7ParSnXXLks3VBVAWrPhK ojlWxEZA6XANO3onebrF9Opufn/wHFXq5z+QYGpzMhzJAyUzjXWVx8GkWBcJHxRG MoiNhzxFt9QtzXbY5w3Pnw7s1XmVIgKigRBb3IK9gQM1FdcnTZ1wxSBKyVkOr4AD cHF1cUqW0K8wO90JUF+BWc/61hTNtic0XizB8xgNVFkHiZaqOJFxGselu19DwM3k ZLi2ML9CZgTqhXHcKPKJuRcsp9gv4Vu5cxzJ7Vm10qb8nEV6FwelT9Z1e3JjS5qp QjKfbhbJ0A2KnhQNPsfEEDlodEIMYpZJWo6SOd3AlDvBgHl8UWxfvkG7XlBSZpay tvMOO3aHK8/TlnxW4RbtrIAHJjbMfEk7TC0I4vPskRE5rYR8gLvEfrkHtTpSlZzL 3o9Vw/9wNNQNBkGXh66EECnVLFYIYUvTos6k4nCf9e6Krqj1HpSHHJ3o2De/XxJI M6XMf7sExfQ8Lt/J/k94VWnyKqErCTnbVnF/mxISED/vgBfpAqeaKVSwUxlklA4y pq1d8NjdchpQYlwZRRyZHRDsUPAUVEIw0ztik8GFyj1PKRdsKf1jcC7vAT1RBwmY tA6uhqH+iOsDfwBReF67IallaK/dotkbomrcUPGYdELbMQekz3s= =lpfz -----END PGP SIGNATURE----- --=-=-=--