From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp10.migadu.com ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms5.migadu.com with LMTPS id WNOBFjptnmI53gAAbAwnHQ (envelope-from ) for ; Mon, 06 Jun 2022 23:10:18 +0200 Received: from aspmx1.migadu.com ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp10.migadu.com with LMTPS id GPuQFTptnmKEyAAAG6o9tA (envelope-from ) for ; Mon, 06 Jun 2022 23:10:18 +0200 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 198FB9E37 for ; Mon, 6 Jun 2022 23:10:15 +0200 (CEST) Received: from localhost ([::1]:39750 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1nyJzK-0004GO-9u for larch@yhetil.org; Mon, 06 Jun 2022 17:10:14 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:44558) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nyJz8-0004Fw-Ds for bug-guix@gnu.org; Mon, 06 Jun 2022 17:10:02 -0400 Received: from debbugs.gnu.org ([209.51.188.43]:43118) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1nyJz8-00037G-0d for bug-guix@gnu.org; Mon, 06 Jun 2022 17:10:02 -0400 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1nyJz7-0006kW-Rx for bug-guix@gnu.org; Mon, 06 Jun 2022 17:10:01 -0400 X-Loop: help-debbugs@gnu.org Subject: bug#55822: option to run diffoscope with guix build --rounds=N and --check Resent-From: Vagrant Cascadian Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Mon, 06 Jun 2022 21:10:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: report 55822 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: 55822@debbugs.gnu.org X-Debbugs-Original-To: bug-guix@gnu.org Received: via spool by submit@debbugs.gnu.org id=B.165454978525916 (code B ref -1); Mon, 06 Jun 2022 21:10:01 +0000 Received: (at submit) by debbugs.gnu.org; 6 Jun 2022 21:09:45 +0000 Received: from localhost ([127.0.0.1]:37015 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nyJyq-0006jv-MJ for submit@debbugs.gnu.org; Mon, 06 Jun 2022 17:09:44 -0400 Received: from lists.gnu.org ([209.51.188.17]:47230) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nyJyg-0006je-1e for submit@debbugs.gnu.org; Mon, 06 Jun 2022 17:09:42 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:44516) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nyJyf-0004El-UV for bug-guix@gnu.org; Mon, 06 Jun 2022 17:09:33 -0400 Received: from cascadia.aikidev.net ([2600:3c01:e000:267:0:a171:de7:c]:56144) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1nyJyd-00035z-LU for bug-guix@gnu.org; Mon, 06 Jun 2022 17:09:33 -0400 Received: from localhost (unknown [IPv6:2600:3c01:e000:21:7:77:0:20]) (Authenticated sender: vagrant@aikidev.net) by cascadia.aikidev.net (Postfix) with ESMTPSA id 94B4C1AAD8 for ; Mon, 6 Jun 2022 14:09:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=reproducible-builds.org; s=1.vagrant; t=1654549767; bh=K65gyg4yNnMDNFsDzIyroaVK3bcuusSWXS7Lnk1aZ3c=; h=From:To:Subject:Date:From; b=lccq4LpEk+usA2/RPHuRtoKUdEenRWnfN0L1+c3oGqYUPbI6HaDls7LwaEYTh/8Wm 9/hoZ08FlCdRxQ2rt3cOf0Ji0ICiQZX5BJXmlRv2qIZk7WUIdEm2WzmkBqFXk8S8dp HdUcj3GygOO6DMmUx/nUU43hf4EcbAGRYCD4SBb2ZEqvyZw5siGhDb7G8rdPfu2a09 jdiRsxWKK128n+0baiL9BZWbMSOJIcmf0IPRTzVJiyFV8y4ajl01JjxlzcKjf33tjz txFwkzDtaoWSRTiFe+59xuRNTvZGVhSayFvaK9ZgSgxb1p1Gw7zHGjAGfU1V5GhRpP XU3BC4hAv8QEg== From: Vagrant Cascadian Date: Mon, 06 Jun 2022 14:09:23 -0700 Message-ID: <87tu8xfqik.fsf@contorta> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha512; protocol="application/pgp-signature" Received-SPF: none client-ip=2600:3c01:e000:267:0:a171:de7:c; envelope-from=vagrant@reproducible-builds.org; helo=cascadia.aikidev.net X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, SPF_HELO_NONE=0.001, SPF_NONE=0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-BeenThere: bug-guix@gnu.org List-Id: Bug reports for GNU Guix List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-guix-bounces+larch=yhetil.org@gnu.org Sender: "bug-Guix" X-Migadu-Flow: FLOW_IN X-Migadu-To: larch@yhetil.org X-Migadu-Country: US ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1654549815; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:mime-version:mime-version: content-type:content-type:resent-cc:resent-from:resent-sender: resent-message-id:list-id:list-help:list-unsubscribe:list-subscribe: list-post:dkim-signature; bh=m0veH6G0ht+VqmK3PryefT39AnpsmuH7JSvdKQsctXI=; b=At0GzfsGkntb439qA42zxHciRyCRtvWY9hrl4rZPUWEFVGJOzTblvnXs7ix1a2LG7fgR6e 4JXKYByppq7x2mz4ZGSBLpkIPjHeJ1MgETUWP7rN1Uzq+C1lgvd9/X19H1lEgpCsqXvLqS 6lizWW2sfiCDMtXordKvTPyOwxjX911woUAIyORBC51aWVTMPGLNMB9QU76ENno2sYKKyN XWWI2mlvwl+I6szbuZaj7wKQFum75pw++CjO8hHRMJifeuCiyv/La/7pfYR/W3xtbyy4PC 2sUAWdNqr0OsjE3AuOax5Oze63YaOwzjDDN2N211OqX7cpG/jLxhSEPEold8gA== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1654549815; a=rsa-sha256; cv=none; b=hIQ7fqseNk6bb5SHpHYjMhzHK42utWLYrKiuTssQ4b6JIMgQe0XWI030/5SOJWYRWeWlXn dq/3rLWNAHeIguHUsxHNrnMwxmK//hjaQM/HkwLmNCWMCmzJAYEvlHOt5d30vRhRIPFwaV SCPr80BeuSuXtAKmPhrkdH8jk97sknZGQdspxgtmHPqfkgYJljXYLLKjg6s43wASK2yZKg g+P2szd4Ecn3Mt08pSUCLyGwwxmgBEH1Rmz62/UEB6kP24yPY5DsEdJw2NxPDHUi/ydE8Z cho7e22UBhXzW+smGIBiFtA5yxnNIjiH7MQQv4w7qpB1i4zOfg9AmHVi2JSMeQ== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=fail ("headers rsa verify failed") header.d=reproducible-builds.org header.s=1.vagrant header.b=lccq4LpE; dmarc=none; spf=pass (aspmx1.migadu.com: domain of "bug-guix-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="bug-guix-bounces+larch=yhetil.org@gnu.org" X-Migadu-Spam-Score: -0.81 Authentication-Results: aspmx1.migadu.com; dkim=fail ("headers rsa verify failed") header.d=reproducible-builds.org header.s=1.vagrant header.b=lccq4LpE; dmarc=none; spf=pass (aspmx1.migadu.com: domain of "bug-guix-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="bug-guix-bounces+larch=yhetil.org@gnu.org" X-Migadu-Queue-Id: 198FB9E37 X-Spam-Score: -0.81 X-Migadu-Scanner: scn0.migadu.com X-TUID: mCpEyO0LuUi/ --=-=-= Content-Type: text/plain When I do: guix build --rounds=2 PACKAGE And the results differ, the process of actually running diffoscope on the results is very manual and a bit hard to automate. I might get output like: guix build: error: derivation `/gnu/store/dn50zya4d1zh21q6s3nh7f394s7ksknv-autogen-5.18.16.drv' may not be deterministic: output `/gnu/store/04byv4py1firka28h3nl70bj1g0a3n6k-autogen-5.18.16' differs from ?/gnu/store/04byv4py1firka28h3nl70bj1g0a3n6k-autogen-5.18.16-check? First of all, I have to actually remember to run: guix build --rounds=2 --keep-failed PACKAGE Would it be crazy for --rounds=N resonably assume --keep-failed ? Then it'll actually keep the produced /gnu/store/*-check ... then I have to screen-scrape the right files, sometimes accidentally grabbing the .drv instead of the right directory, and pass both the regular store item and the /gnu/store/*-check item ... if i get everything right I end up with: diffoscope /gnu/store/HASH-PACKAGE-VERSION /gnu/store/HASH-PACKAGE-VERSION-check And that basically works... but it is a very manual process... guix already has a similar tool to handle this sort of thing: guix challenge --diff=diffoscope PACKAGE But that assumes you are comparing things from your local build and the substitute server or servers, not two locally built things. How plausible would it be to implement something simile to "guix challenge --diff=diffoscope" like: guix build --rounds=2 --keep-failed --diff=diffoscope (or could --diff=diffoscope *assume* --keep-failed ?) Oh, and... basically all of the above applies for: guix build --check PACKAGE e.g. --keep-failed by default, option to support --diff=diffoscope, etc. Thanks for considering! live well, vagrant --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iHUEARYKAB0WIQRlgHNhO/zFx+LkXUXcUY/If5cWqgUCYp5tBAAKCRDcUY/If5cW qm/WAP9A6YyeK7lu6xGDJ8/3ij0A49mFRLskc5k2e9wQ/LsGZAEAlbBRkeFaiBL4 NnrXMVU1JQfA4Elcouy6MFdwZw/oag4= =eSY7 -----END PGP SIGNATURE----- --=-=-=--