From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp1.migadu.com ([2001:41d0:403:58f0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms8.migadu.com with LMTPS id QO2mK/uKBGYYfAAA62LTzQ:P1 (envelope-from ) for ; Wed, 27 Mar 2024 22:09:15 +0100 Received: from aspmx1.migadu.com ([2001:41d0:403:58f0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp1.migadu.com with LMTPS id QO2mK/uKBGYYfAAA62LTzQ (envelope-from ) for ; Wed, 27 Mar 2024 22:09:15 +0100 X-Envelope-To: larch@yhetil.org Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=gmail.com header.s=20230601 header.b=SWDYmj6k; spf=pass (aspmx1.migadu.com: domain of "guix-science-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-science-bounces+larch=yhetil.org@gnu.org"; dmarc=pass (policy=none) header.from=gmail.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1711573755; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-unsubscribe:list-subscribe:list-post:dkim-signature; bh=pTZW8AdxunxBCvPd9eETEPuG7fHTjVKaQK94PrMjKgc=; b=KU7tJ3cjDNQrc2LSaGiWIrEXRaz7ic6ugiLbaky5ZxnAJfIyKcDM2/LdDwm3ezuS5vwKM+ 1/HTaSuoyp0j2ep/ldoJnyHmjrTm3hmhctyAPpLv0zae2OUAJGaoZaB3iT8xtmyzA//ovu vzTeaYMEgaqMppv/i+8hRwQrsU/D7UjRcGt8Z3Fyc6X8UGRBJGZtnBsSyp3v6DCOfIiyBJ l2orXHdyCxn/rEk8OTvijuUBSptpLAPmq7/sPbKXnO7mBQ7DMUBdTK4bQICTMI5jf7MveE Mm0D/OciJLTFTupqwecCDNdUBA1GcA35Gf8I2dwMiM+x5tKJR49kVLM4F3VG0Q== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=pass header.d=gmail.com header.s=20230601 header.b=SWDYmj6k; spf=pass (aspmx1.migadu.com: domain of "guix-science-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-science-bounces+larch=yhetil.org@gnu.org"; dmarc=pass (policy=none) header.from=gmail.com ARC-Seal: i=1; s=key1; d=yhetil.org; t=1711573755; a=rsa-sha256; cv=none; b=hHR4NEcaLVDqbx51WcNl1Px6GeUX7L0MkkBIBfNSsi4f91eDfnvBPn158O0DwNQOKO/mpT aSCDF6QuoqtUYWYvjeDwDxVrVVrRiwU9cvCtOk7EOZmLDPSYa+bDS4aXkhXkyEy9rkd//J LKxP07l+idRWeTzbkzhLxv2aLyXIPK9MAd6m+GfBZ5esMCzhP+JntJbkGULVZvdo/IKDDZ ALfNEo7HQA51wQ2giWR8fnvx1370CkhFcGsY+YCW+ffXYGPskszen2v7Y8g7OQpVueJl+t aqCzJSnv4luBmhg1tzw5BoYdBpbpPkxfbfirl6BKy+b1g6HV7D4qN190uVckPA== Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 4AE9B6918E for ; Wed, 27 Mar 2024 22:09:15 +0100 (CET) Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1rpaVo-00070M-D6; Wed, 27 Mar 2024 17:08:44 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1rpaVh-000706-1K for guix-science@gnu.org; Wed, 27 Mar 2024 17:08:37 -0400 Received: from mail-wr1-x429.google.com ([2a00:1450:4864:20::429]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1rpaVd-00020G-36 for guix-science@gnu.org; Wed, 27 Mar 2024 17:08:36 -0400 Received: by mail-wr1-x429.google.com with SMTP id ffacd0b85a97d-341e36878b1so57929f8f.1 for ; Wed, 27 Mar 2024 14:08:31 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1711573710; x=1712178510; darn=gnu.org; h=content-transfer-encoding:mime-version:message-id:date:references :in-reply-to:subject:to:from:from:to:cc:subject:date:message-id :reply-to; bh=pTZW8AdxunxBCvPd9eETEPuG7fHTjVKaQK94PrMjKgc=; b=SWDYmj6kF102TbSttsAkq1D8PTAYYI4s2iN1TAoffT3HdUAnBX2GnfVTZItPuBdiKX +uTEUJax+llw3ef9Q8BsVOgIBhx0i7Ovv+eMD93HceozyrTMOcC010bqtnE2vDvxXyJ1 pRzfjsjvozty9TtQdbWLh8lvmmv8RWHm5OeOBsMVOr9YLOEBnkG2lEaCYQU+zEAN14Zq FAonAgCvd2fnwx58faF3mRAn+BIIwtPuw8dqjOYvKkzvb8kEKVIjPWYNg8YkDHEGPvrq AtvCcnbmNOst4I0Qp4WphlQcyeHBpOen81U1pUtqowvtw8NHtFqlkzB8G6AdGB0ksQEC T0Ow== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1711573710; x=1712178510; h=content-transfer-encoding:mime-version:message-id:date:references :in-reply-to:subject:to:from:x-gm-message-state:from:to:cc:subject :date:message-id:reply-to; bh=pTZW8AdxunxBCvPd9eETEPuG7fHTjVKaQK94PrMjKgc=; b=fPs6M8C/iHd4KJlPhLtp1/c5XSFXFTILlZzcdBuZQXIF0/z9YC5G1d1dG558XARFiC c1jjBcUo0og7dTLSfPKCuBkHUH2cBVjTgdj2C2wu9C8WhiOp/uXLFT0iFv+dvvrl0lFz z65uOTtu6llpa0wCkkULxIG4JK2jXpooHGqZIFVx8AVOu+Tu8Lbdzs7NoQLMUov+VzEM 2Adwf4i9gMMEYeRR76XBk3AvbZtuRv0td37UqykF1fb/G1eJaDo5mrUZocAnOlVkBkWg N5pM2yGX/Z0zX4qtbSCWdzdEa9towjtKKujNh+nuIi8W20/ryFr3d+C52RGmKbpCwu9G Ks9Q== X-Forwarded-Encrypted: i=1; AJvYcCXqYZ2P8O9S0mq3Tz0/PF36kC+53BabC5YLoMBqNsydAno5gGDwBBWNEGgtn2pckftYfqIye9k/+HNdYEJpbAwku7wV1w== X-Gm-Message-State: AOJu0YzKIPwjMCi4EraArjmdz207gGJQw5R1hg4xdmKeSIgLPn0+BXI6 GLov6SMB7N4I3h0uyRjymg+jv2HqtIh7qObLaM02yPs1W5CykVbOPk4LS2qL X-Google-Smtp-Source: AGHT+IH/a/eLzosFATy/Ai5gjVQZmhkZLQRHfP8seuTNflhNUQYm5uHOTaGZVSjmmD9HMWNKJ4tK3g== X-Received: by 2002:a5d:4607:0:b0:341:c58e:fba0 with SMTP id t7-20020a5d4607000000b00341c58efba0mr766881wrq.4.1711573710322; Wed, 27 Mar 2024 14:08:30 -0700 (PDT) Received: from lili ([2a01:e0a:2c5:4d10:1fec:1d9b:654c:c773]) by smtp.gmail.com with ESMTPSA id u4-20020adff884000000b00341d9e8cc62sm1296wrp.100.2024.03.27.14.08.29 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 27 Mar 2024 14:08:29 -0700 (PDT) From: Simon Tournier To: Emmanuel Medernach , guix-science@gnu.org Subject: Re: Problem with guix copy In-Reply-To: References: Date: Wed, 27 Mar 2024 14:05:14 +0100 Message-ID: <87ttkrakqd.fsf@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Received-SPF: pass client-ip=2a00:1450:4864:20::429; envelope-from=zimon.toutoune@gmail.com; helo=mail-wr1-x429.google.com X-Spam_score_int: -5 X-Spam_score: -0.6 X-Spam_bar: / X-Spam_report: (-0.6 / 5.0 requ) BAYES_00=-1.9, DATE_IN_PAST_06_12=1.543, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, WEIRD_QUOTING=0.001 autolearn=no autolearn_force=no X-Spam_action: no action X-BeenThere: guix-science@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-science-bounces+larch=yhetil.org@gnu.org Sender: guix-science-bounces+larch=yhetil.org@gnu.org X-Migadu-Flow: FLOW_IN X-Migadu-Country: US X-Migadu-Queue-Id: 4AE9B6918E X-Spam-Score: -8.13 X-Migadu-Spam-Score: -8.13 X-Migadu-Scanner: mx11.migadu.com X-TUID: FvNVHCf8tonB Hi Emmanuel, On lun., 25 mars 2024 at 11:13, Emmanuel Medernach wrote: >>> Machine_A # guix time-machine -q -C ~/.config/guix/channels.scm -- buil= d --no-grafts tensorflow -d >>> /gnu/store/s6fm43503ra6yxclqvk80gfiw4zxbp91-tensorflow-2.13.1.drv >>> Machine_B # guix time-machine -q -C ~/.config/guix/channels.scm -- buil= d --no-grafts tensorflow -d >>> /gnu/store/s6fm43503ra6yxclqvk80gfiw4zxbp91-tensorflow-2.13.1.drv [...] > Machine_A # guix time-machine -q -C ~/.config/guix/channels.scm -- build = tensorflow -d --no-grafts > /gnu/store/s6fm43503ra6yxclqvk80gfiw4zxbp91-tensorflow-2.13.1.drv Well, If I open the derivation /gnu/store/s6fm43503ra6yxclqvk80gfiw4zxbp91-tensorflow-2.13.1.drv the header reads: --8<---------------cut here---------------start------------->8--- Derive ([("out","/gnu/store/3mq3q11ripx53xg60shbshk7cr470yfx-tensorflow-2.13.1",""= ,"") ,("python","/gnu/store/qc234r07i3ndgrpa0fdkpkbg4d20h7i1-tensorflow-2.13.1= -python","","")] --8<---------------cut here---------------end--------------->8--- And you get: > Machine_A # guix time-machine -q -C ~/.config/guix/channels.scm -- build = tensorflow --no-grafts > /gnu/store/3mq3q11ripx53xg60shbshk7cr470yfx-tensorflow-2.13.1 > /gnu/store/qc234r07i3ndgrpa0fdkpkbg4d20h7i1-tensorflow-2.13.1-python Therefore, all seems consistent. IIUC, it is also consistent on both machines (see quote above from earlier message). It means that the manual =E2=80=9C--no-grafts=E2=80=9D is OK. The question is thus, is this derivation: > Machine_A # guix time-machine -q -C ~/.config/guix/channels.scm -- build = tensorflow -d > /gnu/store/vivxpmrpkh1wq5pnw28vq9c51qd3vwf6-tensorflow-2.13.1.drv built using /gnu/store/s6fm43503ra6yxclqvk80gfiw4zxbp91-tensorflow-2.13.1.drv or using another one? Anyway. :-) Now, if I run on my laptop: --8<---------------cut here---------------start------------->8--- $ guix time-machine -q -C channels.scm -- build tensorflow@2.13 -n [...] The following derivations would be built: /gnu/store/4g2whbzgn5nqs55x9iqgg23jdapf1srk-tensorflow-2.13.1.drv /gnu/store/8jfr297mkpv698d4y1cq270a7f03wyh6-bazel-6.3.2.drv /gnu/store/g90vfnx128ifhgy0n1zmlscjrn57l8xm-tensorflow-2.13.1-bazel-deps.= tar.xz.drv /gnu/store/h3zcigb52z7m6yyjl785w3a5ls1cjjc7-python-jax-0.4.20.drv /gnu/store/h9m0ix80glph19k4pfqh130nmkil8f39-python-jaxlib-0.4.20.drv /gnu/store/m4icdavpvbryliz34ai8817bb1d3l3xr-python-jaxlib-0.4.20.drv /gnu/store/ha0hl2j607g0wanxqbkwrcfy6yz3k2xq-python-jaxlib-0.4.20-bazel-de= ps.tar.xz.drv --8<---------------cut here---------------end--------------->8--- the output mentions another no-grafts derivation, i.e., /gnu/store/4g2whbzgn5nqs55x9iqgg23jdapf1srk-tensorflow-2.13.1.drv. This derivation 4g2whbzgn5nqs55x9iqgg23jdapf1srk-tensorflow-2.13.1.drv is not the derivation for grafting but the derivation for building the no-grafts. Well, I think the issue with =E2=80=9Cguix copy=E2=80=9D is coming from som= ething similar. There is a mismatch between what is computed. Let give a look. Let transform the one-line file to multi-lines: --8<---------------cut here---------------start------------->8--- $ cat /gnu/store/s6fm43503ra6yxclqvk80gfiw4zxbp91-tensorflow-2.13.1.drv | s= ed 's/,/\n,/g' > /tmp/manual --8<---------------cut here---------------end--------------->8--- And diff the both files (see complete raw below). Inline comments=E2=80=A6 2c2 < ,"/gnu/store/3mq3q11ripx53xg60shbshk7cr470yfx-tensorflow-2.13.1" --- > ,"/gnu/store/yhr2vxh26acz3pzpjlph4f82ffrw6icv-tensorflow-2.13.1" 6c6 < ,"/gnu/store/qc234r07i3ndgrpa0fdkpkbg4d20h7i1-tensorflow-2.13.1-p= ython" --- > ,"/gnu/store/fyjpsvfdmkdimd1vx6d99ik01z3x3j93-tensorflow-2.13.1-p= ython" That=E2=80=99s expected. Because this hash is the result of all the others, i.e., something that comes next; for instance, 90,91d89 < ,("/gnu/store/50vi4ywi79irbg71l814xqkww4k1afh2-python-jaxlib-0.4.= 20.drv" < ,["out"]) 130,131d127 < ,("/gnu/store/8avai81995rj5h7906nzgyrnrpvqi6if-tensorflow-2.13.1-= bazel-deps.tar.xz.drv" < ,["out"]) 135a132,133 > ,("/gnu/store/8jfr297mkpv698d4y1cq270a7f03wyh6-bazel-6.3.2.drv" > ,["out"]) 158,159d155 < ,("/gnu/store/an1hq0y3npd66plwghgnccm4sl7lyvka-bazel-6.3.2.drv" < ,["out"]) 229a226,227 > ,("/gnu/store/g90vfnx128ifhgy0n1zmlscjrn57l8xm-tensorflow-2.13.1-= bazel-deps.tar.xz.drv" > ,["out"]) Hum, it seems: + the order is different; + the derivations are also different Ok, the order might be one the problem. And that could be a bug for =E2=80=9Cguix copy=E2=80=9D. And because the derivations are not the same,= then the item is different. Let consider tensorflow-2.13.1-bazel-deps.tar which is =E2=80=9Cfixed-outpu= t=E2=80=9D: it means the hash (NAR SHA256) is known beforehand. Therefore the hash of the store item should be same. Well, let open these two derivations; they both read: Derive ([("out","/gnu/store/rdpxkb8gl0ym0vrz8viklc0rwnjkn7cl-tensorflow-2.= 13.1-bazel-deps.tar.xz", "sha256","487a1b6685767e8d9fc0a23a2e82d2d7be305e1bd5aeaa4acd1599bc9= 2e3142f")] It means the derivations are different but their result is the exact same item. Well, I will do further tests. :-) Cheers, simon --8<---------------cut here---------------start------------->8--- 2c2 < ,"/gnu/store/3mq3q11ripx53xg60shbshk7cr470yfx-tensorflow-2.13.1" --- > ,"/gnu/store/yhr2vxh26acz3pzpjlph4f82ffrw6icv-tensorflow-2.13.1" 6c6 < ,"/gnu/store/qc234r07i3ndgrpa0fdkpkbg4d20h7i1-tensorflow-2.13.1-python" --- > ,"/gnu/store/fyjpsvfdmkdimd1vx6d99ik01z3x3j93-tensorflow-2.13.1-python" 90,91d89 < ,("/gnu/store/50vi4ywi79irbg71l814xqkww4k1afh2-python-jaxlib-0.4.20.drv" < ,["out"]) 130,131d127 < ,("/gnu/store/8avai81995rj5h7906nzgyrnrpvqi6if-tensorflow-2.13.1-bazel-de= ps.tar.xz.drv" < ,["out"]) 135a132,133 > ,("/gnu/store/8jfr297mkpv698d4y1cq270a7f03wyh6-bazel-6.3.2.drv" > ,["out"]) 158,159d155 < ,("/gnu/store/an1hq0y3npd66plwghgnccm4sl7lyvka-bazel-6.3.2.drv" < ,["out"]) 229a226,227 > ,("/gnu/store/g90vfnx128ifhgy0n1zmlscjrn57l8xm-tensorflow-2.13.1-bazel-de= ps.tar.xz.drv" > ,["out"]) 251a250,251 > ,("/gnu/store/h3zcigb52z7m6yyjl785w3a5ls1cjjc7-python-jax-0.4.20.drv" > ,["out"]) 257a258,259 > ,("/gnu/store/h9m0ix80glph19k4pfqh130nmkil8f39-python-jaxlib-0.4.20.drv" > ,["out"]) 338,339d339 < ,("/gnu/store/lvbjhnrdgl5i5z558b1zpvj4vjqzdm4g-python-jax-0.4.20.drv" < ,["out"]) 519c519 < ,["/gnu/store/r200hqk2jn68qr5wqj6762dpqbns3vqj-tensorflow-2.13.1-builder" --- > ,["/gnu/store/a5pi7l07irynidrfkiw7x44s8angi2fh-tensorflow-2.13.1-builder" 528c528 < ,"/gnu/store/r200hqk2jn68qr5wqj6762dpqbns3vqj-tensorflow-2.13.1-builder"] --- > ,"/gnu/store/a5pi7l07irynidrfkiw7x44s8angi2fh-tensorflow-2.13.1-builder"] 530c530 < ,"/gnu/store/3mq3q11ripx53xg60shbshk7cr470yfx-tensorflow-2.13.1") --- > ,"/gnu/store/yhr2vxh26acz3pzpjlph4f82ffrw6icv-tensorflow-2.13.1") 532c532 < ,"/gnu/store/qc234r07i3ndgrpa0fdkpkbg4d20h7i1-tensorflow-2.13.1-python")]) \ No newline at end of file --- > ,"/gnu/store/fyjpsvfdmkdimd1vx6d99ik01z3x3j93-tensorflow-2.13.1-python")]) \ No newline at end of file --8<---------------cut here---------------end--------------->8---