From mboxrd@z Thu Jan 1 00:00:00 1970 From: Ben Woodcroft Subject: Re: Guix on clusters and in HPC Date: Sat, 19 Nov 2016 16:18:51 +1000 Message-ID: <1c1d1d52-9b67-2fdb-bfef-70e31eb60522@uq.edu.au> References: <87r37divr8.fsf@gnu.org> <86vawh9lvw.fsf@gmail.com> <877f8vgvns.fsf@elephly.net> <86mvhkfaag.fsf@gmail.com> <8737jbk6vk.fsf@elephly.net> <2afb1274-15dd-46b3-0f21-3cf4f4b48be7@uq.edu.au> <87bmxwvfse.fsf@gnu.org> Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: quoted-printable Return-path: Received: from eggs.gnu.org ([2001:4830:134:3::10]:52861) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1c7yzX-00016C-F3 for guix-devel@gnu.org; Sat, 19 Nov 2016 01:19:12 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1c7yzU-0005vR-9b for guix-devel@gnu.org; Sat, 19 Nov 2016 01:19:11 -0500 In-Reply-To: <87bmxwvfse.fsf@gnu.org> List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+gcggd-guix-devel=m.gmane.org@gnu.org Sender: "Guix-devel" To: =?UTF-8?Q?Ludovic_Court=c3=a8s?= Cc: Guix-devel , myglc2 Hi Ludo, I hope the proposal is/was working out. On 03/11/16 23:44, Ludovic Court=C3=A8s wrote: > Hi! > > Ben Woodcroft skribis: > >> I'm a little late here, but please do all of the things on that list := ) > :-) > >> With this suggestion: >> >> + for [[https://lists.gnu.org/archive/html/guix-devel/2016-10/msg= 00005.html][CPU-specific optimizations]] >> + somehow support -mtune=3Dnative (and even profile-guided >> optimizations?) >> >> I'm not sure if you already thought of this, but an important use case= is that of pipelines, where we may want to optimise not just the package= being built, but instead one (or more) of its dependencies. So your sugg= estion of this syntax: >> >> guix package --tune=3Dhaswell -i diamond >> >> requires some extensions, maybe something like this, where bamm can be= used as a pipeline that uses bwa and samtools: >> >> guix package -i bamm --tune=3Dhaswell bwa samtools >> >> and to optimise the C in bamm itself too: >> >> guix package -i bamm --tune=3Dhaswell bwa samtools bamm > So you=E2=80=99re saying that --tune should apply recursively, right? Sort of. The difficulty with applying it fully recursively is that it=20 might greatly increase the maintenance burden of using --tune for little=20 performance improvement, since all inputs would have to be tuned, not=20 just those that substantively affect performance. This is all conjecture=20 though, I'm not sure how many packages will fail to build when tuned. > >> On 01/11/16 17:15, Ricardo Wurmus wrote: > [...] > >>> I strongly encourage users to do two things: >>> >>> - use manifests >>> - record the current version of Guix and our local package repository >>> when instantiating a manifest. It only takes these two pieces of >>> information to reproduce a software environment >> Is it possible to help automate this process somehow e.g. by checking >> if packages in GUIX_PACKAGE_PATH are within git repositories and >> reporting their statuses? > It would be nice. > > As you note, there=E2=80=99s a design question that needs to be discuss= ed. On > one hand, Guix doesn=E2=80=99t need to know and care about how things i= n > $GUIX_PACKAGE_PATH were obtained, etc. On the other hand, if Guix woul= d > manage such external repos by itself, it would be able to give more > precise information on what=E2=80=99s being used and to provide more fe= atureful > tools. > > This is related to the idea of =E2=80=9Cchannels=E2=80=9D that we=E2=80= =99ve been discussing > notably with Pjotr. Right, that is probably a more general solution. ben