From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp1 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms11 with LMTPS id gJGIKR29+V5eXQAA0tVLHw (envelope-from ) for ; Mon, 29 Jun 2020 10:06:21 +0000 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp1 with LMTPS id MJ0/JR29+V6QUwAAbx9fmQ (envelope-from ) for ; Mon, 29 Jun 2020 10:06:21 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 33894940145 for ; Mon, 29 Jun 2020 10:06:21 +0000 (UTC) Received: from localhost ([::1]:45766 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1jpqg8-0004D7-4F for larch@yhetil.org; Mon, 29 Jun 2020 06:06:20 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:54296) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1jpqdt-00021z-VU for bug-guix@gnu.org; Mon, 29 Jun 2020 06:04:02 -0400 Received: from debbugs.gnu.org ([209.51.188.43]:36467) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1jpqdt-0004wN-MT for bug-guix@gnu.org; Mon, 29 Jun 2020 06:04:01 -0400 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1jpqdt-00010Q-IN for bug-guix@gnu.org; Mon, 29 Jun 2020 06:04:01 -0400 X-Loop: help-debbugs@gnu.org Subject: bug#42009: package.cache not deterministic Resent-From: zimoun Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Mon, 29 Jun 2020 10:04:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 42009 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: Ludovic =?UTF-8?Q?Court=C3=A8s?= Received: via spool by 42009-submit@debbugs.gnu.org id=B42009.15934250143820 (code B ref 42009); Mon, 29 Jun 2020 10:04:01 +0000 Received: (at 42009) by debbugs.gnu.org; 29 Jun 2020 10:03:34 +0000 Received: from localhost ([127.0.0.1]:48013 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1jpqdR-0000zX-I8 for submit@debbugs.gnu.org; Mon, 29 Jun 2020 06:03:33 -0400 Received: from mail-wr1-f54.google.com ([209.85.221.54]:39823) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1jpqdO-0000zJ-RN for 42009@debbugs.gnu.org; Mon, 29 Jun 2020 06:03:32 -0400 Received: by mail-wr1-f54.google.com with SMTP id q5so15900251wru.6 for <42009@debbugs.gnu.org>; Mon, 29 Jun 2020 03:03:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:in-reply-to:references:date:message-id :mime-version:content-transfer-encoding; bh=vpFrYE6ZX8flXGGiCKE6e7O7wGcGTp947n9Q+t4HoWQ=; b=Ok7FREbMIcaORQD8+STOlD916iw23q9a2vVJSJRO8yo5AKWL45PfWaN8IkUbcCO4/4 F3+8wgzpWLLwHxWXWcckUPgDVyfocOMCYjx4adUFerhmtZ1iZsiX8kNGCACuBYeXf4W6 N+Hmaf4ukur8dzXh40pfLJto2Bq/BoQHcAU6/sY7a4SIf1oQhQPQb80SjONkcmBcVA9o v0WU5NhLyWpBm9hClVG/w3GLr9DagTko1izUNEOtI9N1TrBNkPpcJXeCgZEJ507ih6ce dNZDVq6gBBmxfdn525VYgYJmvDW9Vjq51JM6oTIfCB4OeWODwAhTpx7gv/L4O03V9L4y hDvQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:in-reply-to:references:date :message-id:mime-version:content-transfer-encoding; bh=vpFrYE6ZX8flXGGiCKE6e7O7wGcGTp947n9Q+t4HoWQ=; b=R5faTF2vVdxy2VQfaXvQYaIuRKsTdJ38aJkC0NHydb74yOF1mm7GAopl/AauNyQDI0 800NO5aqFdWs4kyhLILftmhGbkmySAIAT/5mFohUDYoO+r73Ipnvzj1mxicKSc2ZGm2w BpOGcS6xGNN5wTEor/uuL9tGxpOjdCKfyZ85vaZSqSIoeFLyTcWTB3lZcUuH4V/WdOSA /AwoSGaFLe47LwD+McIiCTkXn4s1LC6clnfF2y/cH4hC2MhFX1Ox98ouCghhvzoyx6VH pygW2NIora+a522RAv+PjP2dgp36Q18WMbxiHrj/7ddTApY4g6S6Uf1jgK35qRjzMJ62 8TSA== X-Gm-Message-State: AOAM5329rhvFx1Lof2VpF+NRxcHcH3ltrUTDBPG7k78DkvgOaLzRc5jy HQBtMnqcM/SNd80OlSBaiQfaAWfCxxM= X-Google-Smtp-Source: ABdhPJyArT6oKn3mObUDvDETtZj2uuNPYvzjvHfK6QhKBlnepHh+f6+WMMsWCHb2ZrtOkDVYyF8CJw== X-Received: by 2002:adf:81c8:: with SMTP id 66mr16357699wra.348.1593425004446; Mon, 29 Jun 2020 03:03:24 -0700 (PDT) Received: from lili ([2a01:e0a:59b:9120:65d2:2476:f637:db1e]) by smtp.gmail.com with ESMTPSA id r1sm14710460wrw.24.2020.06.29.03.03.22 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 29 Jun 2020 03:03:23 -0700 (PDT) From: zimoun In-Reply-To: <874kqvgchu.fsf@gnu.org> References: <1593096834.1154.5@disroot.org> <87h7uysrmr.fsf@nckx> <86366ibuor.fsf@gmail.com> <874kqvgchu.fsf@gnu.org> Date: Mon, 29 Jun 2020 12:03:22 +0200 Message-ID: <86o8p2b34l.fsf@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: 0.0 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-Spam-Score: -1.0 (-) X-BeenThere: bug-guix@gnu.org List-Id: Bug reports for GNU Guix List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: 42009@debbugs.gnu.org Errors-To: bug-guix-bounces+larch=yhetil.org@gnu.org Sender: "bug-Guix" X-Scanner: scn0 Authentication-Results: aspmx1.migadu.com; dkim=fail (rsa verify failed) header.d=gmail.com header.s=20161025 header.b=Ok7FREbM; dmarc=fail reason="SPF not aligned (relaxed)" header.from=gmail.com (policy=none); spf=pass (aspmx1.migadu.com: domain of bug-guix-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=bug-guix-bounces@gnu.org X-Spam-Score: 0.09 X-TUID: Ckj82/mS3O0d Hi Ludo, On Sun, 28 Jun 2020 at 22:29, Ludovic Court=C3=A8s wrote: > Most likely the problem with non-reproducible .go files is that the fix > for was incomplete. In particular, I think > that gensyms are not reproducible when building things in parallel, > because the gensym depends on what=E2=80=99s loaded vs. interpreted. Thank you for the pointer. How can I test the "hypothesis" of "building things in parallel"? --8<---------------cut here---------------start------------->8--- guix describe -f channels > /tmp/chan.scm guix pull -C /tmp/chan.scm --cores=3D1 -p /tmp/repull1 guix build --check --no-grafts --cores=3D1 \ $(guix gc --derivers \ $(readlink -f /tmp/repull1/lib/guix/package.cache)) The following profile hook will be built: /gnu/store/qbrgxbnx0hi13xm36a6a0zijzc1rcz22-guix-package-cache.drv building package cache... (repl-version 0 1 1) Generating package cache for '/gnu/store/bgqy3mfpzbpyz3pysqxzkpch39q98yv3-p= rofile'... (values (value "/gnu/store/15nnwjqrmh5w9hqy9yp4ycxsyfbsr0wi-guix-package-ca= che/lib/guix/package.cache")) guix build: error: derivation `/gnu/store/qbrgxbnx0hi13xm36a6a0zijzc1rcz22-= guix-package-cache.drv' may not be deterministic: output `/gnu/store/15nnwj= qrmh5w9hqy9yp4ycxsyfbsr0wi-guix-package-cache' differs --8<---------------cut here---------------end--------------->8--- BTW, I do not understand why the derivations have different hashes, containing derivations with different hashes and more importantly, why it is not the same order. --8<---------------cut here---------------start------------->8--- guix gc --derivers $(readlink -f ~/.config/guix/current/lib/guix/package.ca= che) /gnu/store/0pmc85ni7zsd5jrflb0prrj7bhvn1m1y-guix-package-cache.drv cat $(guix gc --derivers $(readlink -f ~/.config/guix/current/lib/guix/pack= age.cache)) Derive ([("out","/gnu/store/pfpbh4v1m2dgn9dwiz6rsbqgx8lmd3ms-guix-package-cache","= ","")] ,[("/gnu/store/3pkfaqkdkaqy8khsfbsl0si3r9mydygl-profile.drv",["out"]) ,("/gnu/store/nih4g42d2da8p2b5dmxqb081bbpv9ax4-inferior-script.scm.drv",= ["out"]) ,("/gnu/store/x32cnfkd50fnxs10xp1jdn24h7ai2gxr-guile-3.0.2.drv",["out"])] ,["/gnu/store/50h7d8cx9k28gdbdzc9y615d1564m8ia-guix-package-cache-builder"] ,"x86_64-linux","/gnu/store/0m0vd873jp61lcm4xa3ljdgx381qa782-guile-3.0.2/b= in/guile",["--no-auto-compile","/gnu/store/50h7d8cx9k28gdbdzc9y615d1564m8ia= -guix-package-cache-builder"] ,[("guix properties","((type . profile-hook) (hook . package-cache))") ,("out","/gnu/store/pfpbh4v1m2dgn9dwiz6rsbqgx8lmd3ms-guix-package-cache") ,("preferLocalBuild","1")]) --8<---------------cut here---------------end--------------->8--- --8<---------------cut here---------------start------------->8--- guix gc --derivers $(readlink -f /tmp/repull1/lib/guix/package.cache) /gnu/store/qbrgxbnx0hi13xm36a6a0zijzc1rcz22-guix-package-cache.drv cat $(guix gc --derivers $(readlink -f /tmp/repull1/lib/guix/package.cache)) Derive ([("out","/gnu/store/15nnwjqrmh5w9hqy9yp4ycxsyfbsr0wi-guix-package-cache","= ","")] ,[("/gnu/store/b4dcaccqli2zdfalrn0lc0cz94gd80sk-inferior-script.scm.drv",[= "out"]) ,("/gnu/store/hm03mwl234lw43ivx33nsap0j4pjwqjp-profile.drv",["out"]) ,("/gnu/store/x32cnfkd50fnxs10xp1jdn24h7ai2gxr-guile-3.0.2.drv",["out"])] ,["/gnu/store/251jkjnw9zza2zwr1k45x1049d1axl5q-guix-package-cache-builder"] ,"x86_64-linux","/gnu/store/0m0vd873jp61lcm4xa3ljdgx381qa782-guile-3.0.2/b= in/guile",["--no-auto-compile","/gnu/store/251jkjnw9zza2zwr1k45x1049d1axl5q= -guix-package-cache-builder"] ,[("guix properties","((type . profile-hook) (hook . package-cache))") ,("out","/gnu/store/15nnwjqrmh5w9hqy9yp4ycxsyfbsr0wi-guix-package-cache") ,("preferLocalBuild","1")]) --8<---------------cut here---------------end--------------->8--- And I am confused because if I repull again with '--cores=3D2', then, --8<---------------cut here---------------start------------->8--- /tmp/repull1/bin/guix pull -C /tmp/chan.scm --cores=3D2 -p /tmp/repull2 md5sum \ $(readlink -f /tmp/repull2/lib/guix/package.cache) \ $(readlink -f /tmp/repull2/lib/guix/package.cache) 75f6feb9f52c312cc9cc8f73534926ba /gnu/store/15nnwjqrmh5w9hqy9yp4ycxsyfbsr0= wi-guix-package-cache/lib/guix/package.cache 75f6feb9f52c312cc9cc8f73534926ba /gnu/store/15nnwjqrmh5w9hqy9yp4ycxsyfbsr0= wi-guix-package-cache/lib/guix/package.cache --8<---------------cut here---------------end--------------->8--- But '--check' fails in all cases. What do I miss? All the best, simon