From mboxrd@z Thu Jan 1 00:00:00 1970 From: Ricardo Wurmus Subject: Re: Treating tests as special case Date: Thu, 05 Apr 2018 12:14:53 +0200 Message-ID: <87fu4aj6xu.fsf@elephly.net> References: <20180405052439.GA30291@thebird.nl> <20180405082115.60e604a6@alma-ubu> Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Return-path: Received: from eggs.gnu.org ([2001:4830:134:3::10]:51509) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1f41vI-0006IZ-F3 for guix-devel@gnu.org; Thu, 05 Apr 2018 06:15:18 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1f41vD-00030G-6a for guix-devel@gnu.org; Thu, 05 Apr 2018 06:15:16 -0400 Received: from sender-of-o51.zoho.com ([135.84.80.216]:21130) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1f41vC-0002zn-Sf for guix-devel@gnu.org; Thu, 05 Apr 2018 06:15:11 -0400 In-reply-to: <20180405082115.60e604a6@alma-ubu> List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+gcggd-guix-devel=m.gmane.org@gnu.org Sender: "Guix-devel" To: =?utf-8?Q?Bj=C3=B6rn_H=C3=B6fling?= Cc: guix-devel@gnu.org Bj=C3=B6rn H=C3=B6fling writes: > And you mentioned different environment conditions like machine and > kernel. We still have "only" 70-90% reproducibility. Where does that number come from? In my tests for a non-trivial set of bioinfo pipelines I got to 97.7% reproducibility (or 95.2% if you include very minor problems) for 355 direct inputs. I rebuilt on three different machines. -- Ricardo