From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp0 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms11 with LMTPS id aJGuB1bZtV8HEQAA0tVLHw (envelope-from ) for ; Thu, 19 Nov 2020 02:32:54 +0000 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp0 with LMTPS id iAyBA1bZtV++KAAA1q6Kng (envelope-from ) for ; Thu, 19 Nov 2020 02:32:54 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id BC40C9401BE for ; Thu, 19 Nov 2020 02:32:53 +0000 (UTC) Received: from localhost ([::1]:34886 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kfZki-0006rl-Ky for larch@yhetil.org; Wed, 18 Nov 2020 21:32:52 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:53048) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1kfZka-0006r5-2f for guix-devel@gnu.org; Wed, 18 Nov 2020 21:32:44 -0500 Received: from mail-wr1-x42d.google.com ([2a00:1450:4864:20::42d]:46130) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1kfZkX-0008Vc-N1; Wed, 18 Nov 2020 21:32:43 -0500 Received: by mail-wr1-x42d.google.com with SMTP id d12so4808417wrr.13; Wed, 18 Nov 2020 18:32:40 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:subject:in-reply-to:references:date:message-id:mime-version; bh=F9sDJ7kwv2Zhq3Dz+lyMy9YQQFDIJ+T6+3mYHoXDXbU=; b=B38M2u2QvSVbZF2JbDFy9ejY2P7rLlPC4ILF4V13ZEXsA96gx0PIQSCMXMqWEhMV89 qsQm11AhFbw0hllMuKk4rzYE3gkpEO4hiMCzaS/4jK6NVjPgNM8qmaXfA0GiW7VffBEK Co/bpkd+F8cKttO4yp4HSJ5Ralm/vSAqx4+w006OoOjhkhfjsP4XNiRwGzq6T3akHZOm p6kFF14wpLd8Z9cYGM/ZuCLLA0NhokKM5W70CPP11a0wVMwMzjE2GqZIZe0hhGhcc42P /rMkCOeYKPk1hWwnwOlC4bDL/9+xqOqMYSgHcKBemwVxRFQIUrBxDLJkU0N9jcZjHoxE ZxOA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:subject:in-reply-to:references:date :message-id:mime-version; bh=F9sDJ7kwv2Zhq3Dz+lyMy9YQQFDIJ+T6+3mYHoXDXbU=; b=RFR9NnUgqJ2QsicJyfMdVmkxvMIMAL8MLl/KeX45eqU3YhIpXHyRp/cthEHw1rBCsP m+09bOjc63WB8B72hw504fK3r7WMeZJ7Y9PgusBVk1mHEQSDgq7+HqddkhburkvqP3PG 7kGOtBNbUzKezcMBTuSTku+gVBxNnnJiPpJPDXzYvBLbXNHhnOF0uHn2zXPl/mhnQPWA YtPq8tGkUpNgdZ1RbLcbPiteRijf8OkA0eyk83YJiNgJRd4zxdkVMuZP48joiK4ZLuWF k5TZ0masIVp7VbyYwy4139spLZhnns3UnaVF3t6yqInX1EYmugJVCWyNh5nXml3dY3R4 tLeA== X-Gm-Message-State: AOAM531wK9UXKEcbB0z5RuQVg0vg+L9UKSblHsmhfUWZwkZLT31HiIFG FINyEiun8USR9BBMGjCEHfPRTnUza+xrPw== X-Google-Smtp-Source: ABdhPJyiddjVNAR8jYeF9VOZaKR2j5zF1NqVacr4hGIWqjvY6Gxkjfx6YPcO28SJ7986mXL14khoKw== X-Received: by 2002:adf:fa0c:: with SMTP id m12mr6047927wrr.222.1605753159408; Wed, 18 Nov 2020 18:32:39 -0800 (PST) Received: from lili ([2a01:e0a:59b:9120:65d2:2476:f637:db1e]) by smtp.gmail.com with ESMTPSA id f20sm6626216wmc.26.2020.11.18.18.32.38 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 18 Nov 2020 18:32:38 -0800 (PST) From: zimoun To: Ludovic =?utf-8?Q?Court=C3=A8s?= , guix-devel@gnu.org Subject: Re: GNU Guix 1.2.0rc2 available for testing! In-Reply-To: <871rgqlco4.fsf@gnu.org> References: <871rgqlco4.fsf@gnu.org> Date: Thu, 19 Nov 2020 03:24:52 +0100 Message-ID: <86ft562idn.fsf@gmail.com> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="=-=-=" Received-SPF: pass client-ip=2a00:1450:4864:20::42d; envelope-from=zimon.toutoune@gmail.com; helo=mail-wr1-x42d.google.com X-detected-operating-system: by eggs.gnu.org: No matching host in p0f cache. That's all we know. X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: "Guix-devel" X-Scanner: ns3122888.ip-94-23-21.eu Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=gmail.com header.s=20161025 header.b=B38M2u2Q; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (aspmx1.migadu.com: domain of guix-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-devel-bounces@gnu.org X-Spam-Score: -1.71 X-TUID: 5k+ViSJtkQwa --=-=-= Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Hi Ludo, On Wed, 18 Nov 2020 at 19:53, Ludovic Court=C3=A8s wrote: > If everything goes well, let=E2=80=99s release on Monday 23rd. Birthday release? :-) > You can also check the =E2=80=98NEWS=E2=80=99 file and the draft blog pos= t at > > to make sure your favorite feature is mentioned and/or to discuss the > highlights in the blog post. Attached the first rough draft blog post for GuixHPC blog; I forgot my password to push to the INRIA forge=E2=80=A6 and too late to wait the reset= . :-) All the best, simon -- --=-=-= Content-Type: text/x-diff; charset=utf-8 Content-Disposition: inline; filename=0001-Add-draft-notes-for-1.2.0.patch Content-Transfer-Encoding: quoted-printable Content-Description: draft-hpc >From 2823439d49d83e35ae30df51dcd38d6fb86cd5b7 Mon Sep 17 00:00:00 2001 From: Simon Tournier Date: Thu, 19 Nov 2020 03:10:55 +0100 Subject: [PATCH] Add draft notes for 1.2.0. * drafts/hpc-reproducible-research-in-guix-1.2.0.md: New file. --- ...hpc-reproducible-research-in-guix-1.2.0.md | 132 ++++++++++++++++++ 1 file changed, 132 insertions(+) create mode 100644 drafts/hpc-reproducible-research-in-guix-1.2.0.md diff --git a/drafts/hpc-reproducible-research-in-guix-1.2.0.md b/drafts/hpc= -reproducible-research-in-guix-1.2.0.md new file mode 100644 index 0000000..e3c997a --- /dev/null +++ b/drafts/hpc-reproducible-research-in-guix-1.2.0.md @@ -0,0 +1,132 @@ +title: DRAFT HPC & reproducible research in Guix 1.2.0 +date: 2020-11-19 02:00:00 +author: Simon Tournier +slug: hpc-reproducible-research-in-guix-1.2.0 +tags: packages, releases +--- + +Version 1.2.0 of Guix was [announced +yesterday](https://guix.gnu.org/blog/2020/gnu-guix-1.2.0-released/). As +the announcement points out, some 200 people contributed more than +10,000 commits since the previous release. This post focuses on +important changes for HPC users, admins, and scientists made since +version 1.1.0 was released in April 2020. + +# Reproducible science workflows + +We=E2=80=99re giving users more flexibility on the command line, with the +addition of three [*package transformation +options*](https://guix.gnu.org/manual/en/html_node/Package-Transformation-= Options.html): +`--with-debug-info` ([always debug in good +conditions](https://guix.gnu.org/manual/devel/en/html_node/Rebuilding-Debu= g-Info.html)!), +`--with-c-toolchain`, and `--without-tests`. Consider this example: + +``` +guix build octave-cli \ + --with-c-toolchain=3Dfftw=3Dgcc-toolchain@10 \ + --with-c-toolchain=3Dfftwf=3Dgcc-toolchain@10 +``` + +The command above builds a variant of the fftw and fftwf packages using +version 10 of gcc-toolchain instead of the default tool chain, and then bu= ilds +a variant of the GNU Octave command-line interface using them. GNU Octave +itself is also built with gcc-toolchain@10. + +This other example builds the Hardware Locality (hwloc) library and its +dependents up to intel-mpi-benchmarks with the Clang C compiler: + +``` +guix build --with-c-toolchain=3Dhwloc=3Dclang-toolchain \ + intel-mpi-benchmarks +``` + +On the side of long-term archival of all the software Guix packages refer = to, +Guix now serves the file [`sources.json`](http://guix.gnu.org/sources.json) +that is ingested by [Software Heritage](https://softwareheritage.org) via = the +[nixguix +loader](https://docs.softwareheritage.org/devel/_modules/swh/loader/packag= e/nixguix.html). +In addition to the =E2=80=9Carchival=E2=80=9D check of `guix lint` which s= ends a =E2=80=9Csave=E2=80=9D +request to Software Heritage for the specified packages. More packages are +continuously archived. + +The new option `--path` of [`guix +graph`](https://guix.gnu.org/manual/devel/en/html_node/Invoking-guix-graph= .html), +shows the shortest path between two nodes. The example below shows the +shortest path between the packages gmsh and cunit: + +``` +guix graph --path gmsh cunit +gmsh@4.6.0 +metis@5.1.0 +openblas@0.3.9 +cunit@2.1-3 + +``` + +Moreover, the command [`guix +repl`](https://guix.gnu.org/manual/devel/en/html_node/Invoking-guix-repl.h= tml) +can now be passed a script which ease [package exploratinon in +Guile](https://hpc.guix.info/blog/2020/01/reproducible-computations-with-g= uix/) +especially when dealing with the new Scheme `(guix transformation)` module= for +package transformations. And the section [=E2=80=9CProgramming +Interface=E2=80=9D](https://guix.gnu.org/manual/devel/en/html_node/Program= ming-Interface.html) +of the *reference manual* has been greatly expounded. + +The [`guix +pack`](https://guix.gnu.org/manual/devel/en/html_node/Invoking-guix-pack.h= tml#Invoking-guix-pack) +command creates =E2=80=9Capplication bundles=E2=80=9D that can be used to = deploy software on +machines that do not run Guix (yet!), such as HPC clusters. Since its +[inception in +2017](https://guix.gnu.org/blog/2017/creating-bundles-with-guix-pack/), it= has +seen a number of improvements. The relocatable packs can be now [faster by +the addition of the Fakechroot +engine](https://hpc.guix.info/blog/2020/05/faster-relocatable-packs-with-f= akechroot/). + + +# Packages + +Here are highlights among the 2,179 packages added and 4,487 packages +upgraded since the previous release: + + - [Gmsh](https://hpc.guix.info/package/gmsh) has been upgraded to 4.6.0. + - [MPICH](https://hpc.guix.info/package/mpich) is now at 3.3.2. + - [Open=C2=A0MPI](https://hpc.guix.info/package/openmpi) is now at 4.0.5. + - [GCC](https://hpc.guix.info/package/gcc-toolchain) 10.2.0 is + available and [LLVM, Clang](https://hpc.guix.info/package/clang-toolch= ain) + 11.0.0 too. + - [Julia](https://hpc.guix.info/package/julia) has been upgraded to + 1.5.2. + - [MPI4PY](https://hpc.guix.info/package/python-mpi4py) is at + 3.0.3. + - For statisticians, there=E2=80=99s now a total of 1,488 R packages, man= y of + which comes from [Bioconductor](https://www.bioconductor.org/) 3.11. +=20=20=20=20 +Last but not least, *the manual is fully translated* to +[French](https://guix.gnu.org/manual/fr/html_node/), +[German](https://guix.gnu.org/manual/de/html_node/), and +[Spanish](https://guix.gnu.org/manual/es/html_node/), with partial +translations in [Russian](https://guix.gnu.org/manual/ru/html_node/) and +[Chinese](https://guix.gnu.org/manual/zh-cn/html_node/). + +Do not miss the [release +notes](https://guix.gnu.org/blog/2020/gnu-guix-1.2.0-released/) for more. + +### Try it! + +We want Guix to be accessible and useful to a broad audience and that +has again been a guiding principle for this release. The [graphical +system +installer](https://guix.gnu.org/en/videos/system-graphical-installer/) +and the [script to install Guix on another +distro](https://guix.gnu.org/manual/en/html_node/Binary-Installation.html) +have both received bug fixes and usability improvements. First-time +users will appreciate the fact that `guix help` now gives a clear +overview of the available commands, that `guix` commands are less +verbose by default, and that `guix pull` displays a progress bar as it +updates its Git checkout. + +We=E2=80=99ve been told [you may soon be able to `apt install +guix`](https://packages.debian.org/guix) if you=E2=80=99re on Debian or a = derivative +distro!=E2=80=94[get in touch with us](https://guix.gnu.org/en/contact/). + +Enjoy the new release! base-commit: 67a725bebe63d3933ae133da2bc5d778994dbc39 --=20 2.28.0 --=-=-=--