From: ludo@gnu.org (Ludovic Courtès)
To: Guix-devel <guix-devel@gnu.org>
Subject: Guix on clusters and in HPC
Date: Tue, 18 Oct 2016 16:20:43 +0200 [thread overview]
Message-ID: <87r37divr8.fsf@gnu.org> (raw)
[-- Attachment #1: Type: text/plain, Size: 887 bytes --]
Hello,
I’m trying to gather a “wish list” of things to be done to facilitate
the use of Guix on clusters and for high-performance computing (HPC).
Ricardo and I wrote about the advantages, shortcomings, and perspectives
before:
http://elephly.net/posts/2015-04-17-gnu-guix.html
https://hal.inria.fr/hal-01161771/en
I know that Pjotr, Roel, Ben, Eric and maybe others also have experience
and ideas on what should be done (and maybe even code? :-)).
So I’ve come up with an initial list of work items going from the
immediate needs to crazy ideas (batch scheduler integration!) that
hopefully make sense to cluster/HPC people. I’d be happy to get
feedback, suggestions, etc. from whoever is interested!
(The reason I’m asking is that I’m considering submitting a proposal at
Inria to work on some of these things.)
TIA! :-)
Ludo’.
[-- Attachment #2: Type: text/x-org, Size: 3077 bytes --]
- non-root usage
+ file system virtualization needed
* map ~/.local/gnu/store to /gnu/store
* user name spaces?
* [[https://github.com/proot-me/PRoot/][PRoot]]? but performance problems?
* common interface, like “guix enter” spawns a shell where
/gnu/store is available
+ daemon functionality as a library
* client no longer connects to the daemon, does everything
locally, including direct store accesses
* can use substitutes
+ or plain ’guix-daemon --disable-root’?
+ see [[http://lists.gnu.org/archive/html/help-guix/2016-06/msg00079.html][discussion with Ben Woodcroft and Roel]]
- central daemon usage (like at MDC, but improved)
+ describe/define appropriate setup, like:
* daemon runs on front-end node
* clients can connect to daemon from compute nodes, and perform
any operation
* use of distributed file systems: anything to pay attention to?
* how should the front-end offload to compute nodes?
+ technical issues
* daemon needs to be able to listen for connections elsewhere
* client needs to be able to [[http://debbugs.gnu.org/cgi/bugreport.cgi?bug=20381][connect remotely]] instead of using
[[http://debbugs.gnu.org/cgi/bugreport.cgi?bug=20381#5][‘socat’ hack]]
* how do we share localstatedir? how do we share /gnu/store?
* how do we share the profile directory?
+ admin/social issues
* daemon runs as root
* daemon needs Internet access
* Ricardo mentions lack of nscd and problems caused by the use of
NSS plugins like [[https://fedoraproject.org/wiki/Features/SSSD][SSSD]] in this context
+ batch scheduler integration?
* allow users to offload right from their machine to the cluster?
- package variants, experimentation
+ for experiments, as in Section 4.2 of [[https://hal.inria.fr/hal-01161771/en][the RepPar paper]]
* in the meantime we added [[https://www.gnu.org/software/guix/manual/html_node/Package-Transformation-Options.html][--with-input et al.]]; need more?
+ for [[https://lists.gnu.org/archive/html/guix-devel/2016-10/msg00005.html][CPU-specific optimizations]]
+ somehow support -mtune=native (and even profile-guided
optimizations?)
+ simplify the API to switch compilers, libcs, etc.
- workflow, reproducible science
+ implement [[http://debbugs.gnu.org/cgi/bugreport.cgi?bug=22629][channels]]
+ provide a way to see which Guix commit is used, like “guix channel
describe”
+ simple ways to [[https://lists.gnu.org/archive/html/guix-devel/2016-10/msg00701.html][test the dependents of a package]] (see also
discussion between E. Agullo & A. Enge)
* new transformation options: --with-graft, --with-source
recursive
+ support [[https://lists.gnu.org/archive/html/guix-devel/2016-05/msg00380.html][workflows and pipelines]]?
+ add [[https://github.com/galaxyproject/galaxy/issues/2778][Guix support in Galaxy]]?
next reply other threads:[~2016-10-18 14:20 UTC|newest]
Thread overview: 30+ messages / expand[flat|nested] mbox.gz Atom feed top
2016-10-18 14:20 Ludovic Courtès [this message]
2016-10-18 14:55 ` Guix on clusters and in HPC Christopher Allan Webber
2016-10-18 16:04 ` Ludovic Courtès
2016-10-18 16:47 ` Roel Janssen
2016-10-19 11:11 ` Ricardo Wurmus
2016-10-21 12:11 ` Roel Janssen
2016-10-20 14:08 ` Ludovic Courtès
2016-10-21 9:32 ` Ricardo Wurmus
2016-10-26 11:51 ` Ludovic Courtès
2016-11-01 23:25 ` Ben Woodcroft
2016-11-02 16:03 ` Pjotr Prins
2016-11-04 22:05 ` Pjotr Prins
2016-11-05 2:17 ` Chris Marusich
2016-11-05 16:15 ` Roel Janssen
2016-11-08 12:39 ` Ludovic Courtès
2016-11-03 13:47 ` Ludovic Courtès
2016-10-19 7:17 ` Thomas Danckaert
2016-10-20 14:17 ` Ludovic Courtès
2016-10-25 2:56 ` myglc2
2016-10-26 12:00 ` Ludovic Courtès
2016-11-01 0:11 ` myglc2
2016-10-26 12:08 ` Ricardo Wurmus
2016-10-31 22:01 ` myglc2
2016-11-01 7:15 ` Ricardo Wurmus
2016-11-01 12:03 ` Ben Woodcroft
2016-11-03 13:44 ` Ludovic Courtès
2016-11-19 6:18 ` Ben Woodcroft
2016-11-21 14:07 ` Ludovic Courtès
2016-10-26 15:43 ` Eric Bavier
2016-10-26 16:31 ` Ludovic Courtès
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=87r37divr8.fsf@gnu.org \
--to=ludo@gnu.org \
--cc=guix-devel@gnu.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
Code repositories for project(s) associated with this external index
https://git.savannah.gnu.org/cgit/guix.git
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.