From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp12.migadu.com ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms5.migadu.com with LMTPS id sGNgDpmlqWJUpQAAbAwnHQ (envelope-from ) for ; Wed, 15 Jun 2022 11:25:45 +0200 Received: from aspmx1.migadu.com ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp12.migadu.com with LMTPS id kE4YDpmlqWKgXAEAauVa8A (envelope-from ) for ; Wed, 15 Jun 2022 11:25:45 +0200 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id EAA8E43E84 for ; Wed, 15 Jun 2022 11:25:44 +0200 (CEST) Received: from localhost ([::1]:60876 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1o1PHU-0003vY-4S for larch@yhetil.org; Wed, 15 Jun 2022 05:25:44 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:58222) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1o1P2n-0001yg-7o for guix-devel@gnu.org; Wed, 15 Jun 2022 05:10:33 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]:57218) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1o1P2m-0001OG-Lo; Wed, 15 Jun 2022 05:10:32 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-Version:In-Reply-To:Date:References:Subject:To: From; bh=mgsBWgI68ah3HhPZRY8zh4s37TpdFD1dDfyb3T9sf2E=; b=ls5ey1RL/Xmgrv22Lr1+ qOkejrxBxzT56M8mhNv4StSHWLRyANETwq3dsuGAqOT2uBRGlmK8C2cLzuqak/tkkUjWMDzFEiBPu QmQOakiaLFdfzwacCT2VV2n3AgjChrLUkNOczTiBwf2crrBJACwjKFur/9A656m7+XoDVl40Thj09 TKE0fckWHV91gBivWq5WCslAag7YothNqQaDVWYygWHvBHzNnJsshrE80WmTrkFkv7zhvdCSJZ7j3 MKF/g0+p/N8+mw+NehmMjbnpMbCXM450SKLar1++0sCkSV4A8YLdtWtf18RMLbVxQ83vrSnLmIxLO V6X0hcfygMbUIg==; Received: from 91-160-117-201.subs.proxad.net ([91.160.117.201]:50879 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1o1P2k-0000hD-QT; Wed, 15 Jun 2022 05:10:31 -0400 From: =?utf-8?Q?Ludovic_Court=C3=A8s?= To: Vagrant Cascadian Cc: guix-devel@gnu.org Subject: Re: Reproducible Builds Status Summary for Guix References: <87o7yx43ph.fsf@contorta> X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: Septidi 27 Prairial an 230 de la =?utf-8?Q?R=C3=A9vo?= =?utf-8?Q?lution=2C?= jour de la Verveine X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu Date: Wed, 15 Jun 2022 11:10:28 +0200 In-Reply-To: <87o7yx43ph.fsf@contorta> (Vagrant Cascadian's message of "Sun, 12 Jun 2022 20:55:38 -0700") Message-ID: <87czfauwaj.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.1 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: "Guix-devel" X-Migadu-Flow: FLOW_IN X-Migadu-To: larch@yhetil.org X-Migadu-Country: US ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1655285145; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-unsubscribe:list-subscribe:list-post:dkim-signature; bh=mgsBWgI68ah3HhPZRY8zh4s37TpdFD1dDfyb3T9sf2E=; b=GnhbPZ2G8Q+3EuFGN1ZSxbn2jfZWMj2GVJANTEl5Q3sBVvQ2V4MQxnDO6Q8da+UKxj6p/m 3MPa3jaM+ysYlb9Lo+Dq9k++dnULPS2veRbhG8kUEDlebVpE45vuyhvS0D0zBm4qlMAJIZ NX4pk7JYc/M909qcnF0muvwlmse+pA8lDrVciBmZbX5C8ktvxzRjuyS7smBs3G0FJBC+WP YJp46O4F1WyhLiLV5F6gfPNqRL30MdjRnHGJIvzGzL3eCTE7xUfMbw/nrxjIRoW/hA8THE M5uRNDSfK2kXDIUH844m1msS1Dw/nulEtQ0VQtdcda8qbvWCbQ4PEyEFSOdBlw== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1655285145; a=rsa-sha256; cv=none; b=UoRO18ToFqifO2Eq5L7JB7fcI0eUDqTtZpcyjpQkIMCWawjjhWOx3lLZn4UZa0fKsTyp3v 2I9occACqAUwWlZIldPTuZZOGdjLWVh6JQZNMIAowI/2euNv1ed0wRF2T3vwH1ey8voqok 73j1svbqxoAfBGrdzdPQ4FHLJs7cHRqHAbt+1ZnDUFcybkrZ6Ehc7A6Zvry6Vk+251f6Wp Ui81OnTsvkTEtW/m7wdTH5a0ailWmmObhPiFpwmiAXDy9LLpGSh1U2RFTWkLOzZJDan1Xz 6eMz2Rdp2mZoVSz6grNCsRY/15CDl+Tx803tzYfljF/PJaKzLJX9y1XFuhODnw== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=pass header.d=gnu.org header.s=fencepost-gnu-org header.b=ls5ey1RL; dmarc=pass (policy=none) header.from=gnu.org; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" X-Migadu-Spam-Score: -8.99 Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=gnu.org header.s=fencepost-gnu-org header.b=ls5ey1RL; dmarc=pass (policy=none) header.from=gnu.org; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" X-Migadu-Queue-Id: EAA8E43E84 X-Spam-Score: -8.99 X-Migadu-Scanner: scn0.migadu.com X-TUID: aeQLieJ5FJND Hi! Vagrant Cascadian skribis: > I've been working on Reproducible Builds in guix a fair amount this > month. > > data.guix.gnu.org has proven invaluable for this work, big thanks for > that! > > https://data.guix.gnu.org/repository/1/branch/master/latest-processed-r= evision/package-reproducibility Neat! > A few times I ran into disk space issues, due to: > > guix challenge with diffoscope fails to clean up temporary directory > https://issues.guix.gnu.org/55809 Should be fixed now. :-) > Some rough summaries about the types of issues: > > * ecl-* packages account for nearly half of the issues (~500 out of > ~1000 packages) This seems to be a problem with generated identifiers at first sight; would be worth taking upstream. Any Common Lisper here? :-) > * ~850 packages categorized (ecl-* accounting for most of them) > > * 19 packages embed kernel version > > * 63 packages embed timestamps > > * 52 packages embed dates (harder to reproduce that full timestamps) > > * 5 timestamps in python .pyc files > > * 12 timestamps in .jar files > > * 66 ordering issues > > * 3 ordering issues in .pyc files > > * 9 ordering in .jar files > > * 16 ordering in guile .go files > > * ~160 largely unidentified and inscrutible issues > > That's unfortunately a lot of "unidentified" issues, but I figured I'd > at least mark the ones I looked at. Yes, that=E2=80=99s already an insightful breakdown. > There is a rough proposal for using a multi-project "notes" format that > debian uses: > > https://salsa.debian.org/reproducible-builds/reproducible-notes/-/tree/= master > https://salsa.debian.org/reproducible-builds/reproducible-notes/-/blob/= multi-project-syntax/ideas_on_sharing_notes_between_distros > > ... back in 2016, and touched on at later Reproducible Builds summits, > but not really adopted as far as I know. But I know some of the issues > are essentially the same across distros; yet some are surprisingly > different even with the same source code! I was very optimistic about using this database cross-distro back at the first R-B Summit! I still look at it occasionally when an issue pops up, but it=E2=80=99s not become the collaborative platform we were hoping f= or. It=E2=80=99s never too late though! (Debian is in sense stricter in that some things can be an issue there (like store build file names) and not here, because the Guix build environment is controlled and =E2=80=9Ccanonicalized=E2=80=9D. So not all = the issues in there are relevant to us I guess.) Thanks for the update! Ludo=E2=80=99.