From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <help-guix-bounces+larch=yhetil.org@gnu.org>
Received: from mp10.migadu.com ([2001:41d0:303:e16b::])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits))
	by ms8.migadu.com with LMTPS
	id uDTdHC20SmX1ywAAG6o9tA:P1
	(envelope-from <help-guix-bounces+larch=yhetil.org@gnu.org>)
	for <larch@yhetil.org>; Tue, 07 Nov 2023 23:03:25 +0100
Received: from aspmx1.migadu.com ([2001:41d0:303:e16b::])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits))
	by mp10.migadu.com with LMTPS
	id uDTdHC20SmX1ywAAG6o9tA
	(envelope-from <help-guix-bounces+larch=yhetil.org@gnu.org>)
	for <larch@yhetil.org>; Tue, 07 Nov 2023 23:03:25 +0100
Received: from lists.gnu.org (lists.gnu.org [209.51.188.17])
	(using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
	(No client certificate requested)
	by aspmx1.migadu.com (Postfix) with ESMTPS id D49B3665AA
	for <larch@yhetil.org>; Tue,  7 Nov 2023 23:03:24 +0100 (CET)
Authentication-Results: aspmx1.migadu.com;
	dkim=pass header.d=riseup.net header.s=squak header.b=fyp0l2qB;
	spf=pass (aspmx1.migadu.com: domain of "help-guix-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="help-guix-bounces+larch=yhetil.org@gnu.org";
	dmarc=pass (policy=none) header.from=riseup.net
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org;
	s=key1; t=1699394605;
	h=from:from:sender:sender:reply-to:subject:subject:date:date:
	 message-id:message-id:to:to:cc:cc:mime-version:mime-version:
	 content-type:content-type:in-reply-to:in-reply-to:
	 references:references:list-id:list-help:list-unsubscribe:
	 list-subscribe:list-post:dkim-signature;
	bh=ThnFSbz5jKI7ca/G340rcyXZNzyuEb8aylYlxUpkbFk=;
	b=WSTXAt6PWFaKD0inkgP3Si7XiXyPzYZzi3NYpN6aLAZzJ4wJtwbUYxJftO8v8UwsHHtRFO
	St90pTXT8dXrQmr9D3DLuuxT8lXJ8Tld1ZcWje+v3jwoUqd/rR4tIkMYr590CPGsyaGjNt
	ivu6gK6DLaz8mdItX4timxU1k2JvzZ+VK/GFUvvLb1iWKnp/XGUidJAvDSO4TI5EoizU32
	lj5bGD2tdyP14ywo5ufVW2WCj/rLU4vHFESfZ7+DUhAEkJWrEF4m5lVxVCeW2PUlu0j6zh
	eBhwcKNipf+0jdEOmrGnUEY2U7ITBIEvokfcYpXN6BnljMnSY3+vGhJQEX3L/w==
ARC-Authentication-Results: i=1;
	aspmx1.migadu.com;
	dkim=pass header.d=riseup.net header.s=squak header.b=fyp0l2qB;
	spf=pass (aspmx1.migadu.com: domain of "help-guix-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="help-guix-bounces+larch=yhetil.org@gnu.org";
	dmarc=pass (policy=none) header.from=riseup.net
ARC-Seal: i=1; s=key1; d=yhetil.org; t=1699394605; a=rsa-sha256; cv=none;
	b=SPGgcnS0LpZIC0u4X3IoavYQBTtJaJvVr37Ur1FMr4TJ3rlAtaiHQ5+pdZFU5pMlPtEccg
	+41uK4wNcsiXjhI6OyVIu5Mie/MmoauTDMnhh4c+uGFIwQLN6vEmyjQSQOB9FCvzopFO2d
	DLjZevThmnHvZMP7RHNjpqxDn1KRWqamZelVJ1GTeWv/5yImTUf6Rxw98lQ3jrR/5mJWo+
	mK1MmyHrjujpkZf0lv1D0sasFKjrct95vmNaVrCgdaC9sJk8KPHsexlHt0Ij+f0Pq8uhzG
	j8D/MoA71EokO3AUASLGRarsUw6Iz+5AODR4qxsfgqKEe8jYinEguY9KMbgn/A==
Received: from localhost ([::1] helo=lists1p.gnu.org)
	by lists.gnu.org with esmtp (Exim 4.90_1)
	(envelope-from <help-guix-bounces@gnu.org>)
	id 1r0U9v-000562-9D; Tue, 07 Nov 2023 17:02:55 -0500
Received: from eggs.gnu.org ([2001:470:142:3::10])
 by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <raingloom@riseup.net>)
 id 1r0U9t-00055s-GF
 for help-guix@gnu.org; Tue, 07 Nov 2023 17:02:53 -0500
Received: from mx1.riseup.net ([198.252.153.129])
 by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <raingloom@riseup.net>)
 id 1r0U9r-0002t1-JY
 for help-guix@gnu.org; Tue, 07 Nov 2023 17:02:53 -0500
Received: from fews01-sea.riseup.net (fews01-sea-pn.riseup.net [10.0.1.109])
 (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
 key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256)
 (No client certificate requested)
 by mx1.riseup.net (Postfix) with ESMTPS id 4SQ2Jj2FzTzDrQR;
 Tue,  7 Nov 2023 22:02:45 +0000 (UTC)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=riseup.net; s=squak;
 t=1699394569; bh=FTYLniJehYS0tK+qDGlF4EuUSqdMPAjjYiuU+GeggRs=;
 h=References:From:To:Cc:Subject:Date:In-reply-to:From;
 b=fyp0l2qBpCUyAGfvIIa0/UioMkv1XfMTdmZ36dwiElrs5HnLA8oJpVZ2Jv2QLnIwt
 hLcsVIbPRdqVybzWJup5ySOoC6i5Zs+K4DLwzIiDQ/dWTJIkVyoNotzDs3jgATtEU8
 6npG9rb0anBP/nMgvKgaXkucxvSuegnQ3GllPAic=
X-Riseup-User-ID: A513AB68AF9DF482D49D77339077D50E1C7767FE037D45668E95537891D57935
Received: from [127.0.0.1] (localhost [127.0.0.1])
 by fews01-sea.riseup.net (Postfix) with ESMTPSA id 4SQ2Jh0pFCzJmyh;
 Tue,  7 Nov 2023 22:02:43 +0000 (UTC)
References: <65429087.0c0a0220.5908c.4d60SMTPIN_ADDED_BROKEN@mx.google.com>
 <87zfzpie51.fsf@gmail.com>
From: Csepp <raingloom@riseup.net>
To: Maxim Cournoyer <maxim.cournoyer@gmail.com>
Cc: Suhail <suhail@bayesians.ca>, Julien Lepiller <julien@lepiller.eu>,
 Felix Lechner <felix.lechner@lease-up.com>, Simon  Tournier
 <zimon.toutoune@gmail.com>, help-guix@gnu.org
Subject: Re: Turning off tests leads to a different store item
Date: Tue, 07 Nov 2023 22:58:35 +0100
In-reply-to: <87zfzpie51.fsf@gmail.com>
Message-ID: <cucjzqt2pe1.fsf@riseup.net>
MIME-Version: 1.0
Content-Type: text/plain
Received-SPF: pass client-ip=198.252.153.129;
 envelope-from=raingloom@riseup.net; helo=mx1.riseup.net
X-Spam_score_int: -27
X-Spam_score: -2.8
X-Spam_bar: --
X-Spam_report: (-2.8 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1,
 DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1,
 RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001,
 SPF_HELO_PASS=-0.001, SPF_PASS=-0.001,
 T_SCC_BODY_TEXT_LINE=-0.01 autolearn=ham autolearn_force=no
X-Spam_action: no action
X-BeenThere: help-guix@gnu.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: <help-guix.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/help-guix>,
 <mailto:help-guix-request@gnu.org?subject=unsubscribe>
List-Archive: <https://lists.gnu.org/archive/html/help-guix>
List-Post: <mailto:help-guix@gnu.org>
List-Help: <mailto:help-guix-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/help-guix>,
 <mailto:help-guix-request@gnu.org?subject=subscribe>
Errors-To: help-guix-bounces+larch=yhetil.org@gnu.org
Sender: help-guix-bounces+larch=yhetil.org@gnu.org
X-Migadu-Flow: FLOW_IN
X-Migadu-Country: US
X-Migadu-Spam-Score: -9.11
X-Spam-Score: -9.11
X-Migadu-Queue-Id: D49B3665AA
X-Migadu-Scanner: mx13.migadu.com
X-TUID: SX9W8EgXN+pD


Maxim Cournoyer <maxim.cournoyer@gmail.com> writes:

> Hi,
>
> Suhail <suhail@bayesians.ca> writes:
>
>> Felix Lechner via <help-guix@gnu.org> writes:
>>
>>> On Tue, Oct 31 2023, Julien Lepiller wrote:
>>>
>>>> You could skip tests, but that would build a different derivation
>>>> tree, so it might affect reproducibility
>>>
>>> Those shortfalls are a consequence of our packaging habits. In an ideal
>>> world, would running a test suite ever build a different derivation?
>
> You seem to be confusing 'derivation', which is the build recipe
> description that a package "compiles" to, with the package output, the
> result of executing the derivation.
>
> While I wouldn't expect the package output to change unless tests are
> installed when disabling the test suite, the derivation changes to
> account for the different build arguments used (e.g. that #:tests? #t vs
> #:tests? #f).
>
> Running tests *may* cause the output derivation to be different.  I
> remember a bug in Python that would cause some time stamps to be
> embedded in the .pyc when running the test suite (!).  I think it's
> safer to assume that a derivation with test enabled is not the same as a
> derivation with tests disabled.
>
> There was the "Intensional Store" RFC in Nix that tried to address that
> [0]; it may be worth reading but it looks like it comes with a lot of
> caveats and complexity.
>
> [0]  https://github.com/NixOS/rfcs/pull/17

Another way would be to run tests separately, but that might be even
more complicated.
I had the idea of simply exporting the build directory into a separate
output, or maybe only that would be an output and the regular package
just takes that as an input and only runs the install step, and the
test "package" just runs the test target.