From mboxrd@z Thu Jan 1 00:00:00 1970 From: Alex Sassmannshausen Subject: Re: persistent reproducibility ? Date: Tue, 21 Mar 2017 15:49:09 +0100 Message-ID: <87mvceelcq.fsf@gmail.com> References: Reply-To: alex.sassmannshausen@gmail.com Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit Return-path: Received: from eggs.gnu.org ([2001:4830:134:3::10]:41781) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1cqL65-0004gD-9P for help-guix@gnu.org; Tue, 21 Mar 2017 10:49:18 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1cqL60-0000r7-9s for help-guix@gnu.org; Tue, 21 Mar 2017 10:49:17 -0400 Received: from mail-wr0-x231.google.com ([2a00:1450:400c:c0c::231]:33561) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1cqL60-0000r1-3H for help-guix@gnu.org; Tue, 21 Mar 2017 10:49:12 -0400 Received: by mail-wr0-x231.google.com with SMTP id u48so113504524wrc.0 for ; Tue, 21 Mar 2017 07:49:11 -0700 (PDT) In-reply-to: List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: help-guix-bounces+gcggh-help-guix=m.gmane.org@gnu.org Sender: "Help-Guix" To: zimoun Cc: help-guix@gnu.org Hi Simon, zimoun writes: > Hi Guixers, > > > Disclaimer: my background is about numerical analysis (PDE, Krylov > solver, etc.) and I am currently working in some Core Facility about > biology and bioinformatic (NGS pipelines, flow cytometry clustering, > etc.). Orthogonal communities but same issues. :-) Welcome! Sounds very exciting :-) > The typical research workflow is: > > - Alice proposes new method and/or algorithm, publishes a paper and > illustrates that by the software `foo'. Let the best case: Alice > provides a Guix "recipe", and all the material is stored in Github > (let say). This software `foo' depends on both `bar' and `baz', one > also in Github and the other one included in the Guix package tree. > > - It is easy for Bob to check out and experiment. Guix allows him to > straightforwardly build the bit identical `foo' (all dependencies > included). Nice!! Repeatability is there for free. > > - New features are added to `foo', `bar' and `baz'. All the codes > evolve, especially the research ones. > > - Now, Joe is implementing the Alice's method; science means > reproducible. And Joe would like to compare his implementation to the > Alice one provided by `foo'. However, how ? The `foo' "ecosystem" has > changed with the new features. Therefore, Joe has to navigate in the > Git tree of the Guix "recipe" of `foo', `bar', `baz' to be able to > produce the bit-identical `foo' used in the initial paper. I mean, it > is what I understand to do, and it does not seem reasonable. There are others on here who may have more in-depth experience of precisely this issue, but here's my impression of how this would work. Alice's package recipe would specify the exact version of itself, and also of `bar` and `baz` that that exactly version required. As a result, when software, and also package recipe versions evolve, all Joe would have to do is locate the historic package recipe of `foo` that Joe is trying to reproduce. That package recipe would then point to the historic versions of `bar` & `baz`, so Joe would not have to worry about that. > My question is: does Guix provide any mechanism to build reproducible > software over the time ? Guix just parses the recipe. The recipe details the exact versions of software required. If the exact recipe of a given time is not available then Guix cannot help that (though if the recipe is added to Guix then it will be available in Guix's repository). If the repository hosting the exact version of the software that the recipe specifies is no longer available then Guix cannot help. > Last, `foo' and `bar' are stored in two Github repositories. And they > should disappear. > ( I am not talking if it is good or not to use github, right now, it > just is used by many teams of researchers ) > > Could we used the Software Heritage initiative to maintain a kind of > persistency ? > https://www.softwareheritage.org There was some conversation about this at some point. Again others may know more about this. It certainly seems a nice means of ensuring software remains available… > I do not know if my wishes make any sense. I think they definitely do :-) HTH, Alex