From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <help-guix-bounces+larch=yhetil.org@gnu.org>
Received: from mp10.migadu.com ([2001:41d0:303:e224::])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits))
	by ms8.migadu.com with LMTPS
	id aMkQBDjRS2WSEAEAG6o9tA:P1
	(envelope-from <help-guix-bounces+larch=yhetil.org@gnu.org>)
	for <larch@yhetil.org>; Wed, 08 Nov 2023 19:19:36 +0100
Received: from aspmx1.migadu.com ([2001:41d0:303:e224::])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits))
	by mp10.migadu.com with LMTPS
	id aMkQBDjRS2WSEAEAG6o9tA
	(envelope-from <help-guix-bounces+larch=yhetil.org@gnu.org>)
	for <larch@yhetil.org>; Wed, 08 Nov 2023 19:19:36 +0100
Received: from lists.gnu.org (lists.gnu.org [209.51.188.17])
	(using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
	(No client certificate requested)
	by aspmx1.migadu.com (Postfix) with ESMTPS id E30FB5F2EA
	for <larch@yhetil.org>; Wed,  8 Nov 2023 19:19:35 +0100 (CET)
Authentication-Results: aspmx1.migadu.com;
	dkim=pass header.d=reproducible-builds.org header.s=1.vagrant header.b=UsBRnf3A;
	dmarc=none;
	spf=pass (aspmx1.migadu.com: domain of "help-guix-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="help-guix-bounces+larch=yhetil.org@gnu.org"
ARC-Seal: i=1; s=key1; d=yhetil.org; t=1699467575; a=rsa-sha256; cv=none;
	b=rwYvcvtPnQ+ovsDsUJHbqULr6xrjpjTfOr8y58UPXls9lkWPrbgCwJ4IpVtpgvDX4HM1/y
	4YmLtxQ3AP2jRoZR6aMwz8QcAoOSx5Pxo8uAiNHC6aMpfwMDoga27TRrVj899KaZiddI3r
	dFK6Vst8Ij+BmqbCKXHK7np/6pU8THYfoJ50WlQjQjgg01iMSI4BzGuAhU/jcOSk2MrVb3
	waYKcJ9qDknabx8zqA3RsyQr5wEi20O/HD+9beHzIEMOiludCnoBSa+nS+xuupc/+mQRZm
	ztFPu0baab4Q9K9SwxHFFiMqL5Re9OczPAXpAFi7ooT4UGewJGBa0brGVTbu+A==
ARC-Authentication-Results: i=1;
	aspmx1.migadu.com;
	dkim=pass header.d=reproducible-builds.org header.s=1.vagrant header.b=UsBRnf3A;
	dmarc=none;
	spf=pass (aspmx1.migadu.com: domain of "help-guix-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="help-guix-bounces+larch=yhetil.org@gnu.org"
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org;
	s=key1; t=1699467575;
	h=from:from:sender:sender:reply-to:subject:subject:date:date:
	 message-id:message-id:to:to:cc:cc:mime-version:mime-version:
	 content-type:content-type:in-reply-to:in-reply-to:
	 references:references:list-id:list-help:list-unsubscribe:
	 list-subscribe:list-post:dkim-signature;
	bh=ig9gOraVwFrHk8AGb75ZWkjIvxBkmwTvJYDzdVf+Q5Q=;
	b=lOklkfvASWuEAqX1YphuzHZGinJFMJjZ7RS4urlsfmzRppB3Yy3oZJ2xn2p+1RitpuiAN7
	cgH0gPaTMQSG7FdMuYNgfDvBCzER/ZwY5Nv/Pim5k/pG6ysBPfaS8/O/XRsC6dB2hHI9Dd
	c5KoIvOm38aiChIjjFANh4FfuSRG68mG7lE+BRGYBTfX/w2pbU/MtUcsLyN67VGuG8pwPM
	aQ3Q9cMR/HMF/qFsujnZUyek7vv7MhI0WhOadBsZJCV5H86YsTpt9Vc6YOdZNQsD/oxWEs
	WMbgFUCoK3EoDKE/JKgPtWmtSNKx2z7euPP2WXaJKNw2VVgVelPlTZxOquS3Ig==
Received: from localhost ([::1] helo=lists1p.gnu.org)
	by lists.gnu.org with esmtp (Exim 4.90_1)
	(envelope-from <help-guix-bounces@gnu.org>)
	id 1r0n8l-0005e3-HJ; Wed, 08 Nov 2023 13:18:59 -0500
Received: from eggs.gnu.org ([2001:470:142:3::10])
 by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <vagrant@reproducible-builds.org>)
 id 1r0n8i-0005dH-2P; Wed, 08 Nov 2023 13:18:56 -0500
Received: from cascadia.aikidev.net ([2600:3c01:e000:267:0:a171:de7:c])
 by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <vagrant@reproducible-builds.org>)
 id 1r0n8f-0008UU-UX; Wed, 08 Nov 2023 13:18:55 -0500
Received: from localhost (unknown [IPv6:2600:3c01:e000:21:7:77:0:20])
 (Authenticated sender: vagrant@aikidev.net)
 by cascadia.aikidev.net (Postfix) with ESMTPSA id 82D1A1ACE1;
 Wed,  8 Nov 2023 10:18:46 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple;
 d=reproducible-builds.org; s=1.vagrant; t=1699467526;
 bh=NALjn70V0j1presZShWD/o3q99/QtgQR0mx0Mc4Cuuw=;
 h=From:To:Cc:Subject:In-Reply-To:References:Date:From;
 b=UsBRnf3A3b3F3TE+1wveeHbP6XOGY8Igki7QCL2VtsCT2X423azXVCu33h5E2WfgQ
 FvVCcsM1ZkcxPSwnLTX+QNmMswlzrH6rWt0wNBHsc06bC/xCZdH066OZ7qBtLcXZ9Z
 stD/yOTZJs59U98T+OpNwWd4kXESDBEViMWqLGCrRe4/N8P0hJXBkiu7yyAy4GopqM
 ORFlckCDU2vQBDMydK/cSGjSnQ9zgb/EdilXl7GDm7MV6Spe648ULouItikTscfsJc
 tLpbg/0Pmio0zuRqoOieqMAJZ9PULKoIyJBi2QHPzt4H0Zbgfee+QkNBsLC5z4Cvnp
 HxnmTt1eP6UWQ==
From: Vagrant Cascadian <vagrant@reproducible-builds.org>
To: Felix Lechner <felix.lechner@lease-up.com>, Maxim Cournoyer
 <maxim.cournoyer@gmail.com>
Cc: Suhail <suhail@bayesians.ca>, help-guix@gnu.org, Julien Lepiller
 <julien@lepiller.eu>, Simon Tournier <zimon.toutoune@gmail.com>,
 guix-devel@gnu.org
Subject: Re: Turning off tests leads to a different store item
In-Reply-To: <87ttpw897n.fsf@lease-up.com>
References: <65429087.0c0a0220.5908c.4d60SMTPIN_ADDED_BROKEN@mx.google.com>
 <87zfzpie51.fsf@gmail.com> <871qd19cqn.fsf@lease-up.com>
 <878r78gv6m.fsf@gmail.com> <87ttpw897n.fsf@lease-up.com>
Date: Wed, 08 Nov 2023 10:18:40 -0800
Message-ID: <871qd0p0qn.fsf@contorta>
MIME-Version: 1.0
Content-Type: multipart/signed; boundary="=-=-=";
 micalg=pgp-sha512; protocol="application/pgp-signature"
Received-SPF: pass client-ip=2600:3c01:e000:267:0:a171:de7:c;
 envelope-from=vagrant@reproducible-builds.org; helo=cascadia.aikidev.net
X-Spam_score_int: -20
X-Spam_score: -2.1
X-Spam_bar: --
X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1,
 DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, SPF_HELO_NONE=0.001,
 SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=ham autolearn_force=no
X-Spam_action: no action
X-BeenThere: help-guix@gnu.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: <help-guix.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/help-guix>,
 <mailto:help-guix-request@gnu.org?subject=unsubscribe>
List-Archive: <https://lists.gnu.org/archive/html/help-guix>
List-Post: <mailto:help-guix@gnu.org>
List-Help: <mailto:help-guix-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/help-guix>,
 <mailto:help-guix-request@gnu.org?subject=subscribe>
Errors-To: help-guix-bounces+larch=yhetil.org@gnu.org
Sender: help-guix-bounces+larch=yhetil.org@gnu.org
X-Migadu-Flow: FLOW_IN
X-Migadu-Country: US
X-Migadu-Queue-Id: E30FB5F2EA
X-Migadu-Scanner: mx12.migadu.com
X-Migadu-Spam-Score: -8.90
X-Spam-Score: -8.90
X-TUID: vepoyVRT5rZ5

--=-=-=
Content-Type: text/plain

On 2023-11-08, Felix Lechner via wrote:
> On Wed, Nov 08 2023, Maxim Cournoyer wrote:
>> A source tree doesn't produce a derivation.  A derivation is the
>> complete build recipe that captures the source and the package
>> definition, that when built by the daemon produces a store item.
>
> Okay, thanks! Now I'm going to get it right:
>
> The store item that is produced should not change whether build-time
> tests run or not.
>
> It does not make sense (and wastes resources) to rebuild a consuming
> package because build-time tests were enabled or disabled in an input.
>
> The historical version of openssl gave rise to this thread. It did not
> build anymore because the tests no longer worked with the certificates
> shipped in that release (a common problem in TLS libraries). Rebuilding
> openssl without running the tests rendered the rebuild useless because
> it produced a different store item. That should not happen.
>
> Does that make more sense?

I do not really think people are misunderstanding you, more that your
*should* does not align with reality in a way that guix can depend on;
build-time tests *do* affect the build result in some cases.

You can write tests that can be run outside the build environment, like
Debian's autopkgtest, but those may need to actually be different tests
and most upstreams do not provide them yet...

The only way to ensure they do not change the build results is even more
resource-intensive; systematically run the build without tests and then
run the build with tests and compare the store items... assuming the
build is reproducible in the first place, which is not yet 100% reliable
either, unfortunately.


This does seem well outside the context of help-guix (drop from CC in
replies?) at this point, and should perhaps be moved to guix-devel(added
to CC), as it may require significant changes to guix; it is not a
simple matter of helping someone figure out how to do something with
guix.


live well,
  vagrant

--=-=-=
Content-Type: application/pgp-signature; name="signature.asc"

-----BEGIN PGP SIGNATURE-----

iHUEARYKAB0WIQRlgHNhO/zFx+LkXUXcUY/If5cWqgUCZUvRAQAKCRDcUY/If5cW
qrVsAP0VkQiPcjrGhHcj6Fz85wW4z/d434nWWTBenrjDnJoYxwEAo+BXq1t5zuGF
ZuE++Rru29vDduqIa6Bg0UyTiEjnowo=
=B/S4
-----END PGP SIGNATURE-----
--=-=-=--