From mboxrd@z Thu Jan 1 00:00:00 1970 From: Leo Famulari Subject: Re: Install FAQ: Only build the non-deterministic packages? Date: Mon, 19 Sep 2016 17:47:08 -0400 Message-ID: <20160919214708.GE10174@jasmine> References: <20160916171100.GA1210@lo.psyced.org> <20160917233502.GB19908@jasmine> <874m5cno73.fsf@we.make.ritual.n0.is> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Return-path: Received: from eggs.gnu.org ([2001:4830:134:3::10]:35801) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1bm6PL-0005LZ-8q for guix-devel@gnu.org; Mon, 19 Sep 2016 17:47:24 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1bm6PG-0001pD-Ib for guix-devel@gnu.org; Mon, 19 Sep 2016 17:47:22 -0400 Received: from out2-smtp.messagingengine.com ([66.111.4.26]:39347) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1bm6PF-0001hs-CH for guix-devel@gnu.org; Mon, 19 Sep 2016 17:47:18 -0400 Content-Disposition: inline In-Reply-To: <874m5cno73.fsf@we.make.ritual.n0.is> List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+gcggd-guix-devel=m.gmane.org@gnu.org Sender: "Guix-devel" To: ng0 Cc: guix-devel@gnu.org On Mon, Sep 19, 2016 at 11:06:40AM +0000, ng0 wrote: > Leo Famulari writes: > > Basically, we need someone to be a reproducibility champion in Guix! We > > have all the tools to test reproducibility, but somebody needs to > > implement a system to actually perform the tests automatically > > Do we have comparable tests available in th test suite of guix? > If not, I'll open a bug on this so that someone with competence in the > test suite can put it on their todo list. Since this test would involve building every package at least twice, I think it wouldn't be possible for most users who would run `make check`. > > , store the results, and make the results available to users. > > Could Cuiriass - or what our soon-to-be-replacement of hydra is called > again - do this? Have one testing checkout where all the packages will > be run again the test(s) we created before and then process the build > logs? Right, I think that testing all the packages for reproducibility is best done by the continuous integration server, whether Hydra or Cuirass. The CI server can perform the tests on a variety of build farm machines, record the results, and present them to users somehow.