From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp11.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms9.migadu.com with LMTPS id eTUuG/1inWQFzgAASxT56A (envelope-from ) for ; Thu, 29 Jun 2023 12:54:53 +0200 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp11.migadu.com with LMTPS id oDRDGv1inWR6YgEA9RJhRA (envelope-from ) for ; Thu, 29 Jun 2023 12:54:53 +0200 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 13B3538FDB for ; Thu, 29 Jun 2023 12:54:53 +0200 (CEST) Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1qEpI7-00089u-KQ; Thu, 29 Jun 2023 06:54:23 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1qEpI6-00089f-1w for guix-science@gnu.org; Thu, 29 Jun 2023 06:54:22 -0400 Received: from mail3-relais-sop.national.inria.fr ([192.134.164.104]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1qEpI3-0006gu-Nm for guix-science@gnu.org; Thu, 29 Jun 2023 06:54:21 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inria.fr; s=dc; h=from:to:cc:subject:references:date:in-reply-to: message-id:mime-version:content-transfer-encoding; bh=PpwsqNkLkod8ryvYLnOO8hCM+bqordCrlfmga/GjC3g=; b=Bkc6CsijTjdoFhpXK9rw4N1sbwmDZMRFafFt+ZNn0Ib5Uy52UXdhTM5x SRp2slo+FIqDcQuIaC2vS+eMTufqFKU4tOytv7bTrHr2t7HQf8auETrng PvJDPmV4k2eJ0MQ4Dwrwgu+lblrWlDJPXwr/5M1JoE+SQcAdSMdHcccL5 I=; X-IronPort-AV: E=Sophos;i="6.01,168,1684792800"; d="scan'208";a="60131045" Received: from unknown (HELO ribbon) ([193.50.110.213]) by mail3-relais-sop.national.inria.fr with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 29 Jun 2023 12:54:16 +0200 From: =?utf-8?Q?Ludovic_Court=C3=A8s?= To: Giovanni Biscuolo Cc: guix-science@gnu.org Subject: Re: A guide to reproducible research papers References: <87o7l633v7.fsf@inria.fr> <87h6qqo8ot.fsf@xelera.eu> X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: Primidi 11 Messidor an 231 de la =?utf-8?Q?R=C3=A9vo?= =?utf-8?Q?lution=2C?= jour de la Coriandre X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu Date: Thu, 29 Jun 2023 12:54:15 +0200 In-Reply-To: <87h6qqo8ot.fsf@xelera.eu> (Giovanni Biscuolo's message of "Thu, 29 Jun 2023 12:37:54 +0200") Message-ID: <87o7kyr12g.fsf@inria.fr> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Received-SPF: pass client-ip=192.134.164.104; envelope-from=ludovic.courtes@inria.fr; helo=mail3-relais-sop.national.inria.fr X-Spam_score_int: 0 X-Spam_score: -0.1 X-Spam_bar: / X-Spam_report: (-0.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URI_DOTEDU=1.999 autolearn=no autolearn_force=no X-Spam_action: no action X-BeenThere: guix-science@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-science-bounces+larch=yhetil.org@gnu.org Sender: guix-science-bounces+larch=yhetil.org@gnu.org X-Migadu-Country: US X-Migadu-Flow: FLOW_IN ARC-Seal: i=1; s=key1; d=yhetil.org; t=1688036093; a=rsa-sha256; cv=none; b=ovNR6oB4LE28R47b8C4ZRi0nHmm01hf+NW/CAYFg8C+nofU0xnxl+C7NMyTjwxlRQNKbfA tZt6PQyw3b7Ibhyq1CaXQOw4SRKrgLh58a0nYP0N/YxX1BZ+4PWwUE52MlIeYILBCctAXD HN/HTs6eVJmGRssK7AICzboVptAbNFIzZjWuUZHkCPHq5KIy5JTXr+4bOjjg6C3ILn9b4N F0BqpQzeESA8hw+rMd5V5Zd5vJxrIguASWEGIjdMvzZupE26/VmctzHcADwW68ceVP052L Gye5EMWfOrWUDddibvHp2iPTrOX46vUp7voq94DasAqIcJBk1cC1cIK3XxZ7sg== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=pass header.d=inria.fr header.s=dc header.b=Bkc6Csij; dmarc=pass (policy=none) header.from=inria.fr; spf=pass (aspmx1.migadu.com: domain of "guix-science-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-science-bounces+larch=yhetil.org@gnu.org" ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1688036093; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-unsubscribe:list-subscribe:list-post:dkim-signature; bh=PpwsqNkLkod8ryvYLnOO8hCM+bqordCrlfmga/GjC3g=; b=UDnDr3JTuDo1L8HDe7cDdMlET0TwPzGaVJvEpie5sBo6627qGWtANeyPnaon2UaybpHj0L hQiV5RIfsiZVEqy8w/17GTFBKrpdvoLEhaE5KjaEgd/8ZlFg5tR4j3YvHqze8fszrHBFQW pxcAHASnjA5IJZZAwRIcVHzLK6Ei8mad47dcVVDST3hNyCGxOGnOXwshaxPcVUhaD8LTih q0phRAmFBkEtLj4gYi1bUjiRLuFBx+dW83YNGgpES2PativZDf56awVSDVAJwR/9a848jZ aUoMAfOG5QZVy4cFXlfmbHCThqvTqP2x6pssw+krLWovJEt3KSpLv/43JGohlw== Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=inria.fr header.s=dc header.b=Bkc6Csij; dmarc=pass (policy=none) header.from=inria.fr; spf=pass (aspmx1.migadu.com: domain of "guix-science-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-science-bounces+larch=yhetil.org@gnu.org" X-Migadu-Scanner: scn0.migadu.com X-Migadu-Spam-Score: -10.07 X-Spam-Score: -10.07 X-Migadu-Queue-Id: 13B3538FDB X-TUID: rvAt2ELQ+lm1 Ciao Giovanni, Giovanni Biscuolo skribis: > You mentioned this citation from Jon Claerbout: > > Published documents are merely the advertisement of scholarship whereas > the computer programs, input data, parameter values, etc. embody the > scholarship itself. > > and I was very curious about the source: I found that's a citation from > the abstract of =C2=ABMaking scientc computations reproducible=C2=BB (Mat= thias > Schwab , Martin Karrenbach, Jon Claerbout, Published 2000) [1] Right, I found this one but couldn=E2=80=99t find precisely the original so= urce (I spent quite a while looking for it and eventually gave up). > Nevertheless, the first occurrence of a similar statement by Jon > Claerbout is in a talk named =C2=ABSeventeen years of super computing and > other problems in seismology=C2=BB dated Oct 2 1994, precisely in the sec= tion > about "Technology transfer and research reproducibility" [2] > > > In engineering, a published paper is an advertisement of scholarship but > the electronic document can be the scholarship itself. Forty years ago > data were "pencil marks on paper" and theory was some Greek > symbols. Then paper documents were adequate. No more. Now we need > electronic documents. > > Just to add a little bit of history of computational reproducibility of > research. [...] > [2] https://sepwww.stanford.edu/sep/jon/nrc.html#Technology%20transfer%20= and%20research%20reproducibility Excellent, thank you for sharing! The takeaway here is that there=E2=80=99s nothing new: we=E2=80=99re probab= ly going further in implementing these ideas and adapting them to current practices, but the core issue was already well documented 25+ years ago. Ludo=E2=80=99.