From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp0.migadu.com ([2001:41d0:303:e224::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms1.migadu.com with LMTPS id gGumLI2dVWZqdwAAqHPOHw:P1 (envelope-from ) for ; Tue, 28 May 2024 11:02:05 +0200 Received: from aspmx1.migadu.com ([2001:41d0:303:e224::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp0.migadu.com with LMTPS id gGumLI2dVWZqdwAAqHPOHw (envelope-from ) for ; Tue, 28 May 2024 11:02:05 +0200 X-Envelope-To: larch@yhetil.org Authentication-Results: aspmx1.migadu.com; dkim=fail ("headers rsa verify failed") header.d=gmail.com header.s=20230601 header.b="WQyfcUN/"; dmarc=none; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" ARC-Seal: i=1; s=key1; d=yhetil.org; t=1716886925; a=rsa-sha256; cv=none; b=kMtTx4gvtZew1mtlr0EvBMpn+81EAZGzMCWUGhOcNDZS5wlcOji5PGlTLo7z8ztRhRmSoN QeG6rJx+Qank4RHTMisbR8YwQRp7TTwnJyqBy9aQoEShvRELcYY6TUVhPzOeR8qouwPOOt psP3y5P4SuqEFvnZq848pNsn2+A3bv6T7Cdkb+d4N2/nlxjJUKRTCxvOJ9HIXYS+9/Bxds F6UZTjSQm4fE6ycIJPO926fUr8/nWoVK11jmPUN3OUyfymLvXNrYeU4WTvaY4AkzxgjjrM JbWim957SrtZq+LnL9ncHmdDv4ds98Fn28//Zyk2Jgtt8G2vxrCXUdIX7oeJdA== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=fail ("headers rsa verify failed") header.d=gmail.com header.s=20230601 header.b="WQyfcUN/"; dmarc=none; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1716886925; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:in-reply-to:in-reply-to: references:references:list-id:list-help:list-unsubscribe: list-subscribe:list-post:dkim-signature; bh=nYtLDQyLbfBB+h0wiXkDXFgRjqcQbTPljCpyXtHcFnY=; b=d9mNvpjcvF5jYDBRpv03QlNtQR37Sg/8M7rrFr4sFzZFX7rwpwvO+8S8CM492g57UcamGJ QDGIms8fD/A7KNPQMVRdh7scvdzPewGfNKjZnhX2JW65YQuNsuCeH7VKqg3lSrz7awLqv8 FgEdtf7xQWJ8R283mywmdYz+oFrxHRYBGnnV3fKxONv1x/JcdNq+GtfZTSn7GFE4Wkz8KS 7ZtgvnFEscJPUp/IBSeK3proNMw9XyFwaBeYqjNEe57tXk61aIgb1yrx/3oBiZRHLdhIZM EsoJlyFBTUmKHBoCTBpUpqguX/AzOZWSzgdrwjnxPACMe1QHQ1PaNZhsSFbqpg== Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 0A2BC1F0D3 for ; Tue, 28 May 2024 11:02:04 +0200 (CEST) Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1sBshr-00083i-SR; Tue, 28 May 2024 05:01:19 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1sBsho-00081H-T8 for guix-devel@gnu.org; Tue, 28 May 2024 05:01:17 -0400 Received: from mail-wm1-x336.google.com ([2a00:1450:4864:20::336]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1sBshm-0000bC-Uy for guix-devel@gnu.org; Tue, 28 May 2024 05:01:16 -0400 Received: by mail-wm1-x336.google.com with SMTP id 5b1f17b1804b1-421124a0b37so2762815e9.1 for ; Tue, 28 May 2024 02:01:14 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1716886873; x=1717491673; darn=gnu.org; h=in-reply-to:content-disposition:mime-version:references :mail-followup-to:message-id:subject:cc:to:from:date:sender:from:to :cc:subject:date:message-id:reply-to; bh=nYtLDQyLbfBB+h0wiXkDXFgRjqcQbTPljCpyXtHcFnY=; b=WQyfcUN/vYKjIzcSolYSLVlhWgdKYKsh21Swd5QEC4DPezyUHrxyUDMp9v7cLcsR04 bOIIYigYyijT4ZqDkWvb27yBVRrauo53jN+e0cwCi2KJcfNW+pU3eKfmC7XMaFvOXXpp tNdC6m1FpGzqHH2bGwn6tiVkUceHoEatuFDomyOTDa+7QytE8m+q0cJMA1IhnTj1OzWW KAkEgxAgoWQo59zP9lOLt4HDbBQ+q5KcjuP3gPkKM7Z65VRTYpSVpgFuNakrQz7GZoGl Pehfy6gkUnJt65v95vTdhOMFAcxtHwWTXzAMjRO0iyQsnenFojCvoOP2n/5zpeGUXrzc rpzQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1716886873; x=1717491673; h=in-reply-to:content-disposition:mime-version:references :mail-followup-to:message-id:subject:cc:to:from:date:sender :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=nYtLDQyLbfBB+h0wiXkDXFgRjqcQbTPljCpyXtHcFnY=; b=QgrsBbcsXHclkzGHR3sOmojkPDydunYK7KVGMvGnOStf/FSm5PPLcf17uXKZG+GQjr sRdVk2Xr/xHmf3T3d5HgUh+jNXDtQ3Vi3y3cJIw83gNmYTXGAhB9LmE/59Jx7Rr8niS7 FtDydE7I4DeV/1YXPdvQRPXJgD8uZOKGf5YEZZjRGcFOVEufRBOfMlKPqiNnSPw5gQNu E2QRVYqUD/La1WrJekiDVDRvuOqDOl5DbDvUuclFpDKVg+ZdeS2UMnYUPIoZPfkkMivc ArfReraMtA4QfN0QuNXdNY7EIN4OIzp5nBSib6cGivVeRrGdYx3bWeuk1OO1MSOnj6dP 2HZg== X-Gm-Message-State: AOJu0YwicCVSxj15b2e+Ofb7DFbk2R63ouWRTs+u83h4S55smWptnnNF p72slVRZpfjBLJeWpG6LJhiconcgiMo3SDra6NUu5PdxD4qY/bZb X-Google-Smtp-Source: AGHT+IGcVpExxwP93WqfbmtX+tuzN4Zv1NSNRHXplL7ly423rFo1p/sNrJU/qSIfUy2qnRNHibD5EA== X-Received: by 2002:a05:600c:21a:b0:415:6daf:c626 with SMTP id 5b1f17b1804b1-421089e9c64mr105608275e9.21.1716886872563; Tue, 28 May 2024 02:01:12 -0700 (PDT) Received: from localhost ([141.226.15.89]) by smtp.gmail.com with ESMTPSA id 5b1f17b1804b1-421010ba0f6sm165155055e9.47.2024.05.28.02.01.11 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 28 May 2024 02:01:11 -0700 (PDT) Date: Tue, 28 May 2024 12:01:10 +0300 From: Efraim Flashner To: Felix Lechner Cc: guix-devel@gnu.org Subject: Re: Are 'guix gc' stats exaggerated? Message-ID: Mail-Followup-To: Felix Lechner , guix-devel@gnu.org References: <87bk4stjpi.fsf@lease-up.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="mn1Koaih+2+yg4hv" Content-Disposition: inline In-Reply-To: <87bk4stjpi.fsf@lease-up.com> X-PGP-Key-ID: 0x41AAE7DCCA3D8351 X-PGP-Key: https://flashner.co.il/~efraim/efraim_flashner.asc X-PGP-Fingerprint: A28B F40C 3E55 1372 662D 14F7 41AA E7DC CA3D 8351 Received-SPF: pass client-ip=2a00:1450:4864:20::336; envelope-from=efraim.flashner@gmail.com; helo=mail-wm1-x336.google.com X-Spam_score_int: -17 X-Spam_score: -1.8 X-Spam_bar: - X-Spam_report: (-1.8 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FORGED_FROMDOMAIN=0.001, FREEMAIL_FROM=0.001, HEADER_FROM_DIFFERENT_DOMAINS=0.249, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=no autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: guix-devel-bounces+larch=yhetil.org@gnu.org X-Migadu-Country: US X-Migadu-Flow: FLOW_IN X-Migadu-Queue-Id: 0A2BC1F0D3 X-Migadu-Scanner: mx12.migadu.com X-Migadu-Spam-Score: -2.95 X-Spam-Score: -2.95 X-TUID: zhNKwy57DOje --mn1Koaih+2+yg4hv Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sun, May 26, 2024 at 01:13:45PM -0700, Felix Lechner via Development of = GNU Guix and the GNU System distribution. wrote: > Hi, >=20 > Today I ran 'guix gc' on equipment with an ext4 root partition. It had > these space characteristics beforehand: >=20 > Filesystem Size Used Avail Use% Mounted on > /dev/dm-3 309047680 157252980 138126064 54% / >=20 > or for human eyes: >=20 > /dev/dm-3 295G 150G 132G 54% / >=20 > After the run, the drive showed: >=20 > /dev/dm-3 309047680 88267956 207111088 30% / >=20 > or for human eyes: >=20 > /dev/dm-3 295G 85G 198G 30% / >=20 > By my math, about 65.8 GiB were recovered. >=20 > When 'guix gc' was done, it announced: >=20 > [184389 MiB] deleting '/gnu/store/...' > deleting `/gnu/store/trash' > deleting unused links... > note: currently hard linking saves 59224.03 MiB > guix gc: freed 110,649.49 MiBs >=20 > Seeing the 184389 MiB number, or 180 GiB, already made me suspicious. > It exceeded my drive usage by 30 GiB. Even the more conservative 110649 > MiB "freed," however, are off by a mile. That would have been 108 GiB, > or 42 GiB more than the space actually recovered. >=20 > Am I looking at those numbers the wrong way? Thanks! As your store grows larger the inherent deduplication from the guix-daemon approaches a 3:1 file deduplication ratio. If two files are the same then they are hardlinked to the same actual block on the drive and you save some space. I have found that if you switch to btrfs and add zstd (level 3) compression then you get about another 2:1 on top of that, for around 5.5:1. --=20 Efraim Flashner =D7=A8=D7=A0=D7=A9=D7=9C=D7=A4 = =D7=9D=D7=99=D7=A8=D7=A4=D7=90 GPG key =3D A28B F40C 3E55 1372 662D 14F7 41AA E7DC CA3D 8351 Confidentiality cannot be guaranteed on emails sent or received unencrypted --mn1Koaih+2+yg4hv Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEEoov0DD5VE3JmLRT3Qarn3Mo9g1EFAmZVnVEACgkQQarn3Mo9 g1Huwg//TYIOSexfg16ocvlfLotiZ3uWpfgQ4fcG8KuYLgtqMA3IK2x072s5p4LG oay1nsHPXNUaErx7A3NUci9PHf1ypbihkwDm3AkS3SOw3L4hIrGT5sBWFHuUui/x Tst5IQrWsgqg7EwjjHb1G8zp3f3rv3UStY9f4ai3cfuyV4VfYpdQFo8nh8YX34Sq u9VhZ6JV3x53RVJXM2x945s7ndCiAJxuLKYgqiOeHBjXeKzCOTU9ZqoqVk5DMcoi NHlVailLTzISxq5F+FR266g8QYn1fX1++zBARtbSYTdTP3i7BAhX/jJkCOi63U92 Udu26GZgX6KufL7Lu8JPf+FnKFxKyZ1EbGve5fszvUt9ehOQfy0pUAQiHFx4F486 80z6sUFu2mWAGfY1Fc4NwxnQoDgaFKD7DKr5FWTWsbizC2IY+di/rOkaOhcWXpXc iVzhrbPCZB/LaGk/aat9ZP05ewb1HRoqtST6TZWpKVh4mC3IPidCNNcnEGP4Tgpm rlH9aDVwmRhyFSnF8xzj2r5J9sZTYtb846Ag5KKyZG5eTDO14xSvOt/TsqqrBHYp 6ykm/qIDSgtp52u/xZNoZwP0cT7eQtypRgavxmqXNIfaUC4qE9ITvwt+5GuNH8cP 2hKs9sJjVG0PpsaQqgHfGkXFtz4osZTxME4gQlaj7A8exQYcEgs= =Ps4R -----END PGP SIGNATURE----- --mn1Koaih+2+yg4hv--