From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <help-guix-bounces+larch=yhetil.org@gnu.org>
Received: from mp12.migadu.com ([2001:41d0:403:58f0::])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits))
	by ms8.migadu.com with LMTPS
	id eAFcOY6UQmWFrAAAauVa8A:P1
	(envelope-from <help-guix-bounces+larch=yhetil.org@gnu.org>)
	for <larch@yhetil.org>; Wed, 01 Nov 2023 19:10:23 +0100
Received: from aspmx1.migadu.com ([2001:41d0:403:58f0::])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits))
	by mp12.migadu.com with LMTPS
	id eAFcOY6UQmWFrAAAauVa8A
	(envelope-from <help-guix-bounces+larch=yhetil.org@gnu.org>)
	for <larch@yhetil.org>; Wed, 01 Nov 2023 19:10:23 +0100
Received: from lists.gnu.org (lists.gnu.org [209.51.188.17])
	(using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
	(No client certificate requested)
	by aspmx1.migadu.com (Postfix) with ESMTPS id 8009D41F94
	for <larch@yhetil.org>; Wed,  1 Nov 2023 19:10:22 +0100 (CET)
Authentication-Results: aspmx1.migadu.com;
	dkim=pass header.d=reproducible-builds.org header.s=1.vagrant header.b=0hfzV7fc;
	dmarc=none;
	spf=pass (aspmx1.migadu.com: domain of "help-guix-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="help-guix-bounces+larch=yhetil.org@gnu.org"
ARC-Seal: i=1; s=key1; d=yhetil.org; t=1698862222; a=rsa-sha256; cv=none;
	b=GnyBLm5Yi64mmYZLB31CDoGGI60czvOqoXqTnpUbW1qUsxiXH5BLfbHhjtRcXzP/3VHZMf
	3Leyqe2hgaQlhFQ94qY0hq9cfAV+6XSwCLBFvPNM3U6oWEBwR0cKmXzrko/Z4nmJ0WKAXc
	snrI31VJT4A1PMBvutM5RCP8xltENwyZPPCfVjfbXsGUANQGgNTroAtoazmwr376OYk30K
	sEkHKVc6Imqt963AZ4cLXddSverXXDlU+9exooAUVsA1takct3xVpEmWsa0QDdHfM9iapd
	hQMDi/IjnnWU6x3sn+uMt5iC/ihfK91PP98ft3wcM/hYuisvoIMjksnBm6ubmg==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org;
	s=key1; t=1698862222;
	h=from:from:sender:sender:reply-to:subject:subject:date:date:
	 message-id:message-id:to:to:cc:mime-version:mime-version:
	 content-type:content-type:in-reply-to:in-reply-to:
	 references:references:list-id:list-help:list-unsubscribe:
	 list-subscribe:list-post:dkim-signature;
	bh=2KIsr8b8rqockHSs/T8a/10TL6UkHamjTk11EOkm9xg=;
	b=LJJrp4CgovfjYsX5cXyngu00Ciq+TUetIOXQ///W1hZ6hQJ8wjwrzN+mBnOb8tGa6uRY/B
	c6JmE8YCC77ttkWkaP+AkljWX6HGjUsxp8GNpHPxfoT/z0mgkhcNoATGpS1pN/lwohA3Nw
	hy+adLvtSJnLRryMmdUXuZokfW4jpina+I7ExaGB/amCR2rvtHJZVmsWWdHBzT7pcLS6Zx
	zg7jtv0VwBajJCu/5l4Ej4+v24d1xi9mAXfdtZKylz7+ZKwxondDPu625PcZm57femA2Du
	OQpepKF3TdtE7wddQ8Le29v7fJpIS8KJca5DAeMkTZ7TiuRpaCbw3F9/q7PYZw==
ARC-Authentication-Results: i=1;
	aspmx1.migadu.com;
	dkim=pass header.d=reproducible-builds.org header.s=1.vagrant header.b=0hfzV7fc;
	dmarc=none;
	spf=pass (aspmx1.migadu.com: domain of "help-guix-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="help-guix-bounces+larch=yhetil.org@gnu.org"
Received: from localhost ([::1] helo=lists1p.gnu.org)
	by lists.gnu.org with esmtp (Exim 4.90_1)
	(envelope-from <help-guix-bounces@gnu.org>)
	id 1qyFf7-00064d-Rw; Wed, 01 Nov 2023 14:09:53 -0400
Received: from eggs.gnu.org ([2001:470:142:3::10])
 by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <vagrant@reproducible-builds.org>)
 id 1qyFf5-00064L-SX
 for help-guix@gnu.org; Wed, 01 Nov 2023 14:09:51 -0400
Received: from cascadia.aikidev.net ([2600:3c01:e000:267:0:a171:de7:c])
 by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <vagrant@reproducible-builds.org>)
 id 1qyFf2-0001qY-Vc
 for help-guix@gnu.org; Wed, 01 Nov 2023 14:09:51 -0400
Received: from localhost (unknown [IPv6:2600:3c01:e000:21:7:77:0:50])
 (Authenticated sender: vagrant@aikidev.net)
 by cascadia.aikidev.net (Postfix) with ESMTPSA id 3ACC81A982;
 Wed,  1 Nov 2023 11:09:42 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple;
 d=reproducible-builds.org; s=1.vagrant; t=1698862182;
 bh=DGvZzVeG5x9AWsgPqimdY9tyiwzzwM/nEkGGeSzKoTE=;
 h=From:To:Subject:In-Reply-To:References:Date:From;
 b=0hfzV7fcNP4b2wB/n/Yh5eHTEMS1JE+xsYEytQjI02MuMJXX8yYb1VHSpJMzOQK0z
 khswcUObfFl2AA0J4Cqq+2XI4N5Qrdr9gQsoZ8RgkMzAg4os+fMI9Ks5NMR4tnxT/C
 SNiWStsuNSMvlQg/6nBJA6Ygu+yQqGxJUOsbeWO/lLa6Gd0452E1APvzIthDpz9R28
 L3GN07J0U6aYIZ/b1ufihe5ZkWu4kOG4ML2dlK7XgfzwxmKmaqqC2V4XpXeld/ukYz
 Jvsoo9HtkakUCOVt2R10jHCrOIXkOuFg1swFhYMa9vZeFplS+d9Km7C4FWi7osuq+j
 Q41O/3A7f98yQ==
From: Vagrant Cascadian <vagrant@reproducible-builds.org>
To: Felix Lechner <felix.lechner@lease-up.com>, Julien Lepiller
 <julien@lepiller.eu>, Suhail <suhail@bayesians.ca>, Help-Guix mailing list
 <help-guix@gnu.org>
Subject: Re: Unable to build "Ten Years Reproducibility Challenge" paper
In-Reply-To: <87msvyb0vx.fsf@lease-up.com>
References: <ECCAA81A-511B-4750-AE72-736060A830BE@lepiller.eu>
 <87msvyb0vx.fsf@lease-up.com>
Date: Wed, 01 Nov 2023 11:09:38 -0700
Message-ID: <87bkcdjqfx.fsf@wireframe>
MIME-Version: 1.0
Content-Type: multipart/signed; boundary="=-=-=";
 micalg=pgp-sha512; protocol="application/pgp-signature"
Received-SPF: pass client-ip=2600:3c01:e000:267:0:a171:de7:c;
 envelope-from=vagrant@reproducible-builds.org; helo=cascadia.aikidev.net
X-Spam_score_int: -20
X-Spam_score: -2.1
X-Spam_bar: --
X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1,
 DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, SPF_HELO_NONE=0.001,
 SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=ham autolearn_force=no
X-Spam_action: no action
X-BeenThere: help-guix@gnu.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: <help-guix.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/help-guix>,
 <mailto:help-guix-request@gnu.org?subject=unsubscribe>
List-Archive: <https://lists.gnu.org/archive/html/help-guix>
List-Post: <mailto:help-guix@gnu.org>
List-Help: <mailto:help-guix-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/help-guix>,
 <mailto:help-guix-request@gnu.org?subject=subscribe>
Errors-To: help-guix-bounces+larch=yhetil.org@gnu.org
Sender: help-guix-bounces+larch=yhetil.org@gnu.org
X-Migadu-Flow: FLOW_IN
X-Migadu-Country: US
X-Migadu-Scanner: mx11.migadu.com
X-Spam-Score: -8.18
X-Migadu-Queue-Id: 8009D41F94
X-Migadu-Spam-Score: -8.18
X-TUID: Xld6t6OlZ1xG

--=-=-=
Content-Type: text/plain

On 2023-10-31, Felix Lechner via wrote:
> On Tue, Oct 31 2023, Julien Lepiller wrote:
>
>> You could skip tests, but that would build a different derivation
>> tree, so it might affect reproducibility
>
> Those shortfalls are a consequence of our packaging habits. In an ideal
> world, would running a test suite ever build a different derivation?

Ideally, no... and there are some things in a package, such as synopsis
and description, which do not affect the build; I suspect it would take
considerably more fiddling to exclude tests derivation hash
calculation...


> Should it ever affect a package's reproducibility?

Should build-time tests affect reproducibility? No, surely not!

Do they in practice? Most definitely yes. :(


> Please bear with me as I again belabor the same point without receiving
> public support. Building packages should be separate from testing them.

In general, I agree... sort of.

I do see value in build-time tests preventing a build from
succeeding... being a way to ensure that a broken build does not
actually get distributed.

You could completely separate out the tests, and set up some other
mechanism to prevent broken things from getting distributed, but that is
considerably more complicated.

I guess the question comes down to which corner-cases do you choose to
cater to?


live well,
  vagrant

--=-=-=
Content-Type: application/pgp-signature; name="signature.asc"

-----BEGIN PGP SIGNATURE-----

iHUEARYKAB0WIQRlgHNhO/zFx+LkXUXcUY/If5cWqgUCZUKUYgAKCRDcUY/If5cW
qpEgAQDFHNCdO3TGyiFgN3qfyX6Lw29QMCuv4047Phvobry/TAD/cKnRLQ5Xp3kA
Vku1i2AC+ztRSyTll+k+0MlGxGVK4gk=
=fmce
-----END PGP SIGNATURE-----
--=-=-=--