From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp10.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms5.migadu.com with LMTPS id MN9wGy5T/2K2UwAAbAwnHQ (envelope-from ) for ; Fri, 19 Aug 2022 11:09:02 +0200 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp10.migadu.com with LMTPS id WL+WGi5T/2IfqwAAG6o9tA (envelope-from ) for ; Fri, 19 Aug 2022 11:09:02 +0200 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id E7C3616ADD for ; Fri, 19 Aug 2022 11:09:01 +0200 (CEST) Received: from localhost ([::1]:43708 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1oOxzw-0002bP-OD for larch@yhetil.org; Fri, 19 Aug 2022 05:09:00 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:34822) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1oOxyZ-0002Zg-7s for help-guix@gnu.org; Fri, 19 Aug 2022 05:07:35 -0400 Received: from mail-wr1-x433.google.com ([2a00:1450:4864:20::433]:36436) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1oOxyW-0000sF-7h for help-guix@gnu.org; Fri, 19 Aug 2022 05:07:34 -0400 Received: by mail-wr1-x433.google.com with SMTP id j7so4452602wrh.3 for ; Fri, 19 Aug 2022 02:07:31 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=content-transfer-encoding:mime-version:message-id:date:references :in-reply-to:subject:cc:to:from:from:to:cc; bh=Oc9NcoYIsKg8Xb7r9iVLw/Ep1G7kN3tjJ2JkKubKFzg=; b=TlpunlZcNRsJNbZJUzzHRUaNv4Cqw6IkeKFCbhqv/rkmgViCaS4pSltLqS8TqPdy0a BfAtRlH/NELXBKV775oZkRSx7hKcIzrSXojeXecwl+FbsEvR/1wtIG8N8OLqklYbblkD C9cQJo8RQnoyCdM/0sgHUZQBRbstjc0g/gN/y3m5Z+G2VG5VW+A8TG1QD/tU9lYxO/R7 i8izil2Y/919OZ2XVO16x7rFfmuL21g8GunNaXfMMsxmvochDf7j1L4e9L95vIkz0UTP 0KFv/7+oxC/aPJnY67bQL/VHvtbQsBV8P6KYMJPPM7Tzbl1qIYTJgmr4sQdH5RJXSMf0 9WcA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=content-transfer-encoding:mime-version:message-id:date:references :in-reply-to:subject:cc:to:from:x-gm-message-state:from:to:cc; bh=Oc9NcoYIsKg8Xb7r9iVLw/Ep1G7kN3tjJ2JkKubKFzg=; b=kuR33oYZUEJLRS899o3kyVj7knfogpEa+07/N4JqYAljaWdmx7MpJobhPthoxabeO3 YQuSTYmgQ4+yoU6DHuzZ8FlF5kzBT8b6XhQ5r2RWp1yAPYTUZPeac0cBjDYLziVES+WW AaXxIhC/DzGegbIUHVuLgoBP9NPIfg7OIz89RM4zbYKDUYLh927UWJh1+CkGapyc4AEN R+dkJSw8RE6i72WuSLU09GNpwEI2q9oQEkC7NqMsjPqSeLrHJzZxzYKzuiTnMGcfvTyf jpDmaWDRO2aw28sYP8YUYrMEY4ojGqjxPaQtpM9FjkoqIGQiBqHT5OwHAlpKpoLCn6Uw 90JA== X-Gm-Message-State: ACgBeo3bkezZcQhDT7iEFifb6eeEUcC2Mfcb6fnRnCzmaij8mt/zKFiz 23Y1qmcnE4mooBGL6eUXBYdxcFk5ZkQ= X-Google-Smtp-Source: AA6agR4/lse3OKZE71TPHPYMi0BIOUlT9gYa5ikgz7Iu/pmeKyOfDFfq5d5PFjlJt2xFBmwZrdiNnQ== X-Received: by 2002:a05:6000:804:b0:225:287d:987c with SMTP id bt4-20020a056000080400b00225287d987cmr3557083wrb.209.1660900050522; Fri, 19 Aug 2022 02:07:30 -0700 (PDT) Received: from pfiuh07 ([193.48.40.241]) by smtp.gmail.com with ESMTPSA id f12-20020adff98c000000b0021f13097d6csm3405418wrr.16.2022.08.19.02.07.29 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 19 Aug 2022 02:07:29 -0700 (PDT) From: zimoun To: Ricardo Wurmus , Mike Jones Cc: Hartmut Goebel , help-guix@gnu.org Subject: Re: Two copies of same library in store after cleaning generations and gc In-Reply-To: <87sfls3gkn.fsf@elephly.net> References: <8b9f85d8-3899-44ed-b968-7714732c1beb@www.fastmail.com> <87sfls3gkn.fsf@elephly.net> Date: Fri, 19 Aug 2022 11:06:02 +0200 Message-ID: <874jy87gcl.fsf@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Received-SPF: pass client-ip=2a00:1450:4864:20::433; envelope-from=zimon.toutoune@gmail.com; helo=mail-wr1-x433.google.com X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, WEIRD_QUOTING=0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: help-guix@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: help-guix-bounces+larch=yhetil.org@gnu.org Sender: "Help-Guix" X-Migadu-Flow: FLOW_IN X-Migadu-To: larch@yhetil.org X-Migadu-Country: US ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1660900142; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-unsubscribe:list-subscribe:list-post:dkim-signature; bh=Oc9NcoYIsKg8Xb7r9iVLw/Ep1G7kN3tjJ2JkKubKFzg=; b=Kd05dC87hzxzsTl3/i8RHNufh7u9ZDqgtFxNY/hULF/4IJ8zZiWBz+UqXit46o/Q5l8+hp rSa/Bh5/5590VIC9WhEY8gLirMQuqkJtFuMRMqrG6ZskRpshzCjzrvPglW6Mj0MQT3fEzL WI0HaTlCJzJKnxPFgM1NOC+PTuX6RCEvRTIutytgd+1eOzfE/EIGNz9AzWUU3gzIPH4noZ mbefrsv0bBOgGw9aponsWrU3mwhJ4Bysbe778mWzbItRWT9zpeKt88J3jBbgL3OAz7fvxc tov5X/igQb6QSd1uMJ8cSqmwE317OZ70lNDf3+EeL0ymSCUjwxfbAsmE9wF3lA== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1660900142; a=rsa-sha256; cv=none; b=AvvF0D3By1xQuqTXm/j00TzvmSQnVjlg8N65s/Bp8RF1VmoOM6M2ZNy6w71y4luhAGnmoq FDMmLxxwqN01g/E5Qz9h5y4FcrcukYmQ3PYSg57qgTqiHIb1+OjXNt51xV9oAzegCvs2GU UJ3Eh5jKpkVEny6TG8uQWExArQddU0fXZmrrJ1MbG8tklEjfGFAsQLoMFCN6dIlujVMLbm 6I5rAobg94VwRR3pt8P5Eve4Septk/f1BSrx/vUJ/8+a3HtCRxcJZN6apl8Mi5nr7au7EI HeeFAmzVUuVW/eQ9agBkYTzQamcRgkOhRPxf6UuEnV5BFwhsIPOuRSMFWQFXbA== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=pass header.d=gmail.com header.s=20210112 header.b=TlpunlZc; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (aspmx1.migadu.com: domain of "help-guix-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="help-guix-bounces+larch=yhetil.org@gnu.org" X-Migadu-Spam-Score: -3.85 Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=gmail.com header.s=20210112 header.b=TlpunlZc; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (aspmx1.migadu.com: domain of "help-guix-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="help-guix-bounces+larch=yhetil.org@gnu.org" X-Migadu-Queue-Id: E7C3616ADD X-Spam-Score: -3.85 X-Migadu-Scanner: scn1.migadu.com X-TUID: Phh5c36RJWw0 Hi, On ven., 19 ao=C3=BBt 2022 at 08:13, Ricardo Wurmus wr= ote: > This sounds like grafts working as intended. Do you also have more than > one instance of icecat =E2=80=93 one using the graft and one without? > > (Due to deduplication in /gnu/store this is not as wasteful as it may > seem.) Using Guix 8f0d45c, --8<---------------cut here---------------start------------->8--- $ guix build mesa /gnu/store/5y054ijr0dqpd6v4wlby9alhbzmha033-mesa-21.3.8-bin /gnu/store/74ags388lb0xasf7v1h8j9ywj8zrsgv9-mesa-21.3.8 $ guix build mesa --no-grafts /gnu/store/znvm7i9rgaviwi2841j8gimanif99wl1-mesa-21.3.8-bin /gnu/store/wdm2s2si8fqsrcd5xpc29ivmpkf20s8d-mesa-21.3.8 $ guix gc --references $(guix build icecat) | grep mesa /gnu/store/lcqz4q3834bjd3dlc8zsr95mvzz9n006-mesa-21.3.8 --8<---------------cut here---------------end--------------->8--- it can be confusing=E2=80=A6 Let examine. :-) First, let consider mesa referred by icecat. --8<---------------cut here---------------start------------->8--- $ guix gc --derivers /gnu/store/lcqz4q3834bjd3dlc8zsr95mvzz9n006-mesa-21.3.8 /gnu/store/qqa192m2cx4qrlvhr1dg7vrc49jqa84h-mesa-21.3.8.drv /gnu/store/y2yxw4zd4p916lby3sibmskdv860zvpa-mesa-21.3.8.drv --8<---------------cut here---------------end--------------->8--- It means that the both derivations, /gnu/store/qqa192m2cx4qrlvhr1dg7vrc49jqa84h-mesa-21.3.8.drv /gnu/store/y2yxw4zd4p916lby3sibmskdv860zvpa-mesa-21.3.8.drv have the same output: /gnu/store/lcqz4q3834bjd3dlc8zsr95mvzz9n006-mesa-21.3.8 Yes, that=E2=80=99s surprising but possible. >From /gnu/store/qqa192m2cx4qrlvhr1dg7vrc49jqa84h-mesa-21.3.8.drv, the guile-builder reads: --8<---------------cut here---------------start------------->8--- (define %build-inputs (quote (("x" . "/gnu/store/wdm2s2si8fqsrcd5xpc29ivmpkf20s8d-mesa-21.3.8") [...] ((old-outputs (quote (("out" . "/gnu/store/wdm2s2si8fqsrcd5xpc29ivmpkf20s8d-mesa-21.3.= 8")))) --8<---------------cut here---------------end--------------->8--- which grafts, I guess. Note that this derivation lists the other derivation /gnu/store/0yd0gxbcrkh32zy4q8dkpyyv2xpvm1mh-mesa-21.3.8.drv. >From /gnu/store/y2yxw4zd4p916lby3sibmskdv860zvpa-mesa-21.3.8.drv, the guile-builder is exactly the same (/gnu/store/a0h343=E2=80=A6-mesa-21.3.8-g= uile-builder). However, the derivation lists /gnu/store/ylx0p9sl6qla4qsmp6dsvaqgd7g3m1rw-mesa-21.3.8.drv. These two derivations, /gnu/store/0yd0gxbcrkh32zy4q8dkpyyv2xpvm1mh-mesa-21.3.8.drv /gnu/store/ylx0p9sl6qla4qsmp6dsvaqgd7g3m1rw-mesa-21.3.8.drv. have the same outputs; which reads: --8<---------------cut here---------------start------------->8--- Derive ([("bin","/gnu/store/znvm7i9rgaviwi2841j8gimanif99wl1-mesa-21.3.8-bin","","= ") ,("out","/gnu/store/wdm2s2si8fqsrcd5xpc29ivmpkf20s8d-mesa-21.3.8","","")] --8<---------------cut here---------------end--------------->8--- other said, the ungrafted version. So far, so good! Second, let consider the grafted build, --8<---------------cut here---------------start------------->8--- $ guix gc --derivers /gnu/store/74ags388lb0xasf7v1h8j9ywj8zrsgv9-mesa-21.3.8 /gnu/store/ji6h6y5jizwhsx2jzw67myk5fhiv87va-mesa-21.3.8.drv --8<---------------cut here---------------end--------------->8--- and the guile-builder (/gnu/store/j4j58b=E2=80=A6-mesa-21.3.8-guile-builder) contains, --8<---------------cut here---------------start------------->8--- (define %build-inputs (quote (("x" . "/gnu/store/znvm7i9rgaviwi2841j8gimanif99wl1-mesa-21.3.8-bin") ("x" . "/gnu/store/wdm2s2si8fqsrcd5xpc29ivmpkf20s8d-mesa-21.3.8") [...] ((old-outputs (quote (("bin" . "/gnu/store/znvm7i9rgaviwi2841j8gimanif99wl1-mesa-21.3.= 8-bin") ("out" . "/gnu/store/wdm2s2si8fqsrcd5xpc29ivmpkf20s8d-mesa-21.3.= 8")))) --8<---------------cut here---------------end--------------->8--- and that=E2=80=99s why the hash 74ags388lb=E2=80=A6 (from =E2=80=9Cguix bui= ld mesa=E2=80=9D) is different from lcqz4q383=E2=80=A6 (from icecat). This derivation /gnu/store/ji6h6y5jizwhsx2jzw67myk5fhiv87va-mesa-21.3.8.drv lists the other derivation, /gnu/store/0yd0gxbcrkh32zy4q8dkpyyv2xpvm1mh-mesa-21.3.8.drv. Wait, it has already appeared below. :-) Well, all seems consistent, isn=E2=80=99t it? I hope now it is less confus= ing. However, something still appears to me confusing: --8<---------------cut here---------------start------------->8--- $ diff -r --no-dereference /gnu/store/74ags388lb0xasf7v1h8j9ywj8zrsgv9-mesa= -21.3.8 /gnu/store/lcqz4q3834bjd3dlc8zsr95mvzz9n006-mesa-21.3.8=20 Binary files /gnu/store/74ags388lb0xasf7v1h8j9ywj8zrsgv9-mesa-21.3.8/lib/dr= i/i830_dri.so and /gnu/store/lcqz4q3834bjd3dlc8zsr95mvzz9n006-mesa-21.3.8/l= ib/dri/i830_dri.so differ [...] diff -r --no-dereference /gnu/store/74ags388lb0xasf7v1h8j9ywj8zrsgv9-mesa-2= 1.3.8/lib/pkgconfig/dri.pc /gnu/store/lcqz4q3834bjd3dlc8zsr95mvzz9n006-mesa= -21.3.8/lib/pkgconfig/dri.pc 1c1 < prefix=3D/gnu/store/74ags388lb0xasf7v1h8j9ywj8zrsgv9-mesa-21.3.8 --- > prefix=3D/gnu/store/lcqz4q3834bjd3dlc8zsr95mvzz9n006-mesa-21.3.8 [...] --8<---------------cut here---------------end--------------->8--- Other said, the grafted item is duplicated. Right? Therefore, my question is: is deduplication optimal? Or better worded: what is the waste by the duplicated grafted items? Cheers, simon