From: John Kehayias via Bug reports for GNU Guix <bug-guix@gnu.org>
To: "24937@debbugs.gnu.org" <24937@debbugs.gnu.org>
Subject: bug#24937: "deleting unused links" GC phase is too slow
Date: Mon, 22 Nov 2021 02:30:36 +0000 [thread overview]
Message-ID: <QAT6Oklv6MJDMioc_c1DjSQKV_v-3AWmaSFX9mnO5dqeHMJ-v9W43_z4orvQ0cp5awD2GfvFlO8rBIh5jwnHyj1ZxXGMBUsTUsOf5nYq_l8=@protonmail.com> (raw)
In-Reply-To: <87wpg7ffbm.fsf@gnu.org>
[-- Attachment #1: Type: text/plain, Size: 877 bytes --]
Hello,
A little late, but wanted to add my results here, from before the commit was made. I had reported some of this on IRC before and had some outlying results. Since then I finally did some generation deleting and gc-ing, though perhaps still have a bit of cruft. I've been on core-updates-frozen for a while, so keeping a lot from before making the branch switch, as well as lots of stuff piling up in trying to fix things or trying out changes in core-updates-frozen.
Anyway, attached are the plots from the above code. Running
ls -1A /gnu/store/.links | wc -l
showed 15776256 links at the time. Still quite a bit I think, but I've had 1.5-2x as much in the past, easily. (This had caused some earlier warnings on ext4 and enabling large_dir, which will make a system unbootable due to Grub not being up to speed on this old feature. I'm now on btrfs.)
John
[-- Attachment #2: nlink.png --]
[-- Type: image/png, Size: 19573 bytes --]
[-- Attachment #3: space-saving-contribution.png --]
[-- Type: image/png, Size: 22370 bytes --]
[-- Attachment #4: size-deduplicated.png --]
[-- Type: image/png, Size: 23091 bytes --]
[-- Attachment #5: nlink-small.png --]
[-- Type: image/png, Size: 20596 bytes --]
[-- Attachment #6: size-savings.png --]
[-- Type: image/png, Size: 19990 bytes --]
[-- Attachment #7: size.png --]
[-- Type: image/png, Size: 22996 bytes --]
prev parent reply other threads:[~2021-11-22 2:31 UTC|newest]
Thread overview: 25+ messages / expand[flat|nested] mbox.gz Atom feed top
2016-11-13 17:41 bug#24937: "deleting unused links" GC phase is too slow Ludovic Courtès
2016-12-09 22:43 ` Ludovic Courtès
2016-12-11 13:46 ` Ludovic Courtès
2016-12-11 14:23 ` Mark H Weaver
2016-12-11 18:02 ` Ludovic Courtès
2016-12-11 19:27 ` Mark H Weaver
2016-12-13 0:00 ` Ludovic Courtès
2016-12-13 12:48 ` Mark H Weaver
2016-12-13 17:02 ` Ludovic Courtès
2016-12-13 17:18 ` Ricardo Wurmus
2020-04-16 13:26 ` Ricardo Wurmus
2020-04-16 14:27 ` Ricardo Wurmus
2020-04-17 8:16 ` Ludovic Courtès
2020-04-17 8:28 ` Ricardo Wurmus
2016-12-13 4:09 ` Mark H Weaver
2016-12-15 1:19 ` Mark H Weaver
2021-11-09 14:44 ` Ludovic Courtès
2021-11-09 15:00 ` Ludovic Courtès
2021-11-11 20:59 ` Maxim Cournoyer
2021-11-13 16:56 ` Ludovic Courtès
2021-11-13 21:37 ` bug#24937: [PATCH 1/2] tests: Factorize 'file=?' Ludovic Courtès
2021-11-13 21:37 ` bug#24937: [PATCH 2/2] daemon: Do not deduplicate files smaller than 4 KiB Ludovic Courtès
2021-11-16 13:54 ` bug#24937: "deleting unused links" GC phase is too slow Ludovic Courtès
2021-11-13 21:45 ` Ludovic Courtès
2021-11-22 2:30 ` John Kehayias via Bug reports for GNU Guix [this message]
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
List information: https://guix.gnu.org/
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to='QAT6Oklv6MJDMioc_c1DjSQKV_v-3AWmaSFX9mnO5dqeHMJ-v9W43_z4orvQ0cp5awD2GfvFlO8rBIh5jwnHyj1ZxXGMBUsTUsOf5nYq_l8=@protonmail.com' \
--to=bug-guix@gnu.org \
--cc=24937@debbugs.gnu.org \
--cc=john.kehayias@protonmail.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
Code repositories for project(s) associated with this public inbox
https://git.savannah.gnu.org/cgit/guix.git
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).