all messages for Guix-related lists mirrored at yhetil.org
 help / color / mirror / code / Atom feed
* [bug#73818] [PATCH 0/2] Reduce size of openmpi@5 closure
@ 2024-10-15 12:42 Ludovic Courtès
  2024-10-15 12:45 ` [bug#73818] [PATCH 1/2] gnu: openmpi@5: Remove reference to GCC and other build tools Ludovic Courtès
                   ` (2 more replies)
  0 siblings, 3 replies; 4+ messages in thread
From: Ludovic Courtès @ 2024-10-15 12:42 UTC (permalink / raw)
  To: 73818; +Cc: Ludovic Courtès, romain.garbage

Hello!

This patch set reduces the closure size of openmpi@5 from
605 MiB to 249 MiB.  It also removes potentially misleading
argument inheritance from openmpi@4 to openmpi@5.

Thoughts?

Ludo'.

Ludovic Courtès (2):
  gnu: openmpi@5: Remove reference to GCC and other build tools.
  gnu: prrte: Remove reference to GCC and other build tools.

 gnu/packages/mpi.scm      | 59 ++++++++++++++++++++++-----------------
 gnu/packages/parallel.scm | 22 +++++++++++++--
 2 files changed, 53 insertions(+), 28 deletions(-)


base-commit: 6757bfdfc0b22a1e23a3d33566155550182244fc
-- 
2.46.0





^ permalink raw reply	[flat|nested] 4+ messages in thread

* [bug#73818] [PATCH 1/2] gnu: openmpi@5: Remove reference to GCC and other build tools.
  2024-10-15 12:42 [bug#73818] [PATCH 0/2] Reduce size of openmpi@5 closure Ludovic Courtès
@ 2024-10-15 12:45 ` Ludovic Courtès
  2024-10-15 12:45 ` [bug#73818] [PATCH 2/2] gnu: prrte: " Ludovic Courtès
  2024-10-25 10:38 ` bug#73818: [PATCH 0/2] Reduce size of openmpi@5 closure Ludovic Courtès
  2 siblings, 0 replies; 4+ messages in thread
From: Ludovic Courtès @ 2024-10-15 12:45 UTC (permalink / raw)
  To: 73818; +Cc: Ludovic Courtès

From: Ludovic Courtès <ludovic.courtes@inria.fr>

This removes GCC from the direct references of openmpi@5.

* gnu/packages/mpi.scm (openmpi-5)[arguments]: Replace arguments
entirely instead of using ‘substitute-keyword-arguments’.  Reintroduce
‘remove-absolute’ phase.  Remove ‘find-opensm-headers’ and ‘remove-logs’
phases, which are no longer needed.

Change-Id: Ia3b25230488ca13310cd5bb2ae45f6990e906fa5
---
 gnu/packages/mpi.scm | 59 +++++++++++++++++++++++++-------------------
 1 file changed, 34 insertions(+), 25 deletions(-)

diff --git a/gnu/packages/mpi.scm b/gnu/packages/mpi.scm
index 75cfd4af66..6e1f972eb8 100644
--- a/gnu/packages/mpi.scm
+++ b/gnu/packages/mpi.scm
@@ -339,37 +339,46 @@ (define-public openmpi-5
 
     (outputs '("out" "debug"))
     (arguments
-     (substitute-keyword-arguments (package-arguments openmpi)
-       ((#:configure-flags _)
-        #~(list "--enable-mpi-ext=affinity" ;cr doesn't work
-                "--with-sge"
+     (list #:configure-flags
+           #~(list "--enable-mpi-ext=affinity"         ;cr doesn't work
+                   "--with-sge"
 
-                #$@(if (package? (this-package-input "valgrind"))
-                       #~("--enable-memchecker"
-                          "--with-valgrind")
-                       #~("--without-valgrind"))
+                   #$@(if (package? (this-package-input "valgrind"))
+                          #~("--enable-memchecker"
+                             "--with-valgrind")
+                          #~("--without-valgrind"))
 
-                "--with-hwloc=external"
-                "--with-libevent"
+                   "--with-hwloc=external"
+                   "--with-libevent"
 
-                ;; This replaces --enable-mpirun-prefix-by-default wich is deprecated
-                ;; since 5.x.
-                "--enable-prte-prefix-by-default"
+                   ;; This replaces --enable-mpirun-prefix-by-default wich is deprecated
+                   ;; since 5.x.
+                   "--enable-prte-prefix-by-default"
 
-                ;; Enable support for the 'Process Management Interface for Exascale'
-                ;; (PMIx) used e.g. by Slurm for the management communication and
-                ;; coordination of MPI processes.
-                (string-append "--with-pmix=" #$(this-package-input "openpmix"))
-                (string-append "--with-prrte=" #$(this-package-input "prrte"))
+                   ;; Enable support for the 'Process Management Interface for Exascale'
+                   ;; (PMIx) used e.g. by Slurm for the management communication and
+                   ;; coordination of MPI processes.
+                   (string-append "--with-pmix=" #$(this-package-input "openpmix"))
+                   (string-append "--with-prrte=" #$(this-package-input "prrte"))
 
-                ;; Since 5.x, Infiniband support is provided by ucx.
-                ;; See https://docs.open-mpi.org/en/main/release-notes/networks.html#miscellaneous-network-notes
-                (string-append "--with-ucx=" #$(this-package-input "ucx"))))
+                   ;; Since 5.x, Infiniband support is provided by ucx.
+                   ;; See https://docs.open-mpi.org/en/main/release-notes/networks.html#miscellaneous-network-notes
+                   (string-append "--with-ucx=" #$(this-package-input "ucx")))
 
-       ((#:phases phases)
-        #~(modify-phases #$phases
-            (delete 'remove-absolute)
-            (delete 'scrub-timestamps)))))))
+           #:phases
+           #~(modify-phases %standard-phases
+               (add-before 'build 'remove-absolute
+                 (lambda _
+                   ;; Remove compiler absolute file names (OPAL_FC_ABSOLUTE
+                   ;; etc.) to reduce the closure size.  See
+                   ;; <https://lists.gnu.org/archive/html/guix-devel/2017-07/msg00388.html>
+                   ;; and
+                   ;; <https://www.mail-archive.com/users@lists.open-mpi.org//msg31397.html>.
+                   (substitute* '("oshmem/tools/oshmem_info/param.c"
+                                  "ompi/tools/ompi_info/param.c")
+                     (("_ABSOLUTE") "")))))
+
+           #:disallowed-references (list (canonical-package gcc))))))
 
 (define-public openmpi-c++
   (package/inherit openmpi
-- 
2.46.0





^ permalink raw reply related	[flat|nested] 4+ messages in thread

* [bug#73818] [PATCH 2/2] gnu: prrte: Remove reference to GCC and other build tools.
  2024-10-15 12:42 [bug#73818] [PATCH 0/2] Reduce size of openmpi@5 closure Ludovic Courtès
  2024-10-15 12:45 ` [bug#73818] [PATCH 1/2] gnu: openmpi@5: Remove reference to GCC and other build tools Ludovic Courtès
@ 2024-10-15 12:45 ` Ludovic Courtès
  2024-10-25 10:38 ` bug#73818: [PATCH 0/2] Reduce size of openmpi@5 closure Ludovic Courtès
  2 siblings, 0 replies; 4+ messages in thread
From: Ludovic Courtès @ 2024-10-15 12:45 UTC (permalink / raw)
  To: 73818; +Cc: Ludovic Courtès

From: Ludovic Courtès <ludovic.courtes@inria.fr>

This reduces the closure of ‘prrte’ from 305 MiB to 99 MiB.

* gnu/packages/parallel.scm (prrte)[arguments]: Add #:phases.

Change-Id: Idc26cf5899dd5fa8378535fc8530dbdb3e20608d
---
 gnu/packages/parallel.scm | 22 +++++++++++++++++++---
 1 file changed, 19 insertions(+), 3 deletions(-)

diff --git a/gnu/packages/parallel.scm b/gnu/packages/parallel.scm
index fc96136065..186aebad45 100644
--- a/gnu/packages/parallel.scm
+++ b/gnu/packages/parallel.scm
@@ -711,9 +711,25 @@ (define-public prrte
               "0wiy0vk37v4db1jgxza8bci0cczcvj34dalzsrlz05dk45zb7dl3"))))
    (build-system gnu-build-system)
    (arguments
-    (list #:configure-flags #~(list (string-append "--with-hwloc="
-                                                   (assoc-ref %build-inputs "hwloc"))
-                                    (string-append "--with-pmix=" #$(this-package-input "openpmix")))))
+    (list #:configure-flags
+          #~(list (string-append "--with-hwloc="
+                                 (assoc-ref %build-inputs "hwloc"))
+                  (string-append "--with-pmix="
+                                 #$(this-package-input "openpmix")))
+
+          #:phases
+          #~(modify-phases %standard-phases
+              (add-after 'unpack 'remove-absolute-references
+                (lambda _
+                  ;; Remove references to GCC, the shell, etc. (shown by
+                  ;; 'prte_info') to reduce the closure size.
+                  (substitute* "src/tools/prte_info/param.c"
+                    (("_ABSOLUTE")
+                     "")
+                    (("PRTE_CONFIGURE_CLI")
+                     "\"[elided to reduce closure]\"")))))
+
+          #:disallowed-references (list (canonical-package gcc))))
    (inputs (list libevent
                  `(,hwloc "lib")
                  openpmix))
-- 
2.46.0





^ permalink raw reply related	[flat|nested] 4+ messages in thread

* bug#73818: [PATCH 0/2] Reduce size of openmpi@5 closure
  2024-10-15 12:42 [bug#73818] [PATCH 0/2] Reduce size of openmpi@5 closure Ludovic Courtès
  2024-10-15 12:45 ` [bug#73818] [PATCH 1/2] gnu: openmpi@5: Remove reference to GCC and other build tools Ludovic Courtès
  2024-10-15 12:45 ` [bug#73818] [PATCH 2/2] gnu: prrte: " Ludovic Courtès
@ 2024-10-25 10:38 ` Ludovic Courtès
  2 siblings, 0 replies; 4+ messages in thread
From: Ludovic Courtès @ 2024-10-25 10:38 UTC (permalink / raw)
  To: 73818-done; +Cc: romain.garbage

Ludovic Courtès <ludo@gnu.org> skribis:

> This patch set reduces the closure size of openmpi@5 from
> 605 MiB to 249 MiB.  It also removes potentially misleading
> argument inheritance from openmpi@4 to openmpi@5.

Pushed:

  38af41c4af * gnu: prrte: Remove reference to GCC and other build tools.
  30e469cc9c * gnu: openmpi@5: Remove reference to GCC and other build tools.

Ludo'.




^ permalink raw reply	[flat|nested] 4+ messages in thread

end of thread, other threads:[~2024-10-25 10:39 UTC | newest]

Thread overview: 4+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2024-10-15 12:42 [bug#73818] [PATCH 0/2] Reduce size of openmpi@5 closure Ludovic Courtès
2024-10-15 12:45 ` [bug#73818] [PATCH 1/2] gnu: openmpi@5: Remove reference to GCC and other build tools Ludovic Courtès
2024-10-15 12:45 ` [bug#73818] [PATCH 2/2] gnu: prrte: " Ludovic Courtès
2024-10-25 10:38 ` bug#73818: [PATCH 0/2] Reduce size of openmpi@5 closure Ludovic Courtès

Code repositories for project(s) associated with this external index

	https://git.savannah.gnu.org/cgit/guix.git

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.