From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp2 ([2001:41d0:8:6d80::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id 4MvWE/ostmErNAEAgWs5BA (envelope-from ) for ; Sun, 12 Dec 2021 18:10:18 +0100 Received: from aspmx1.migadu.com ([2001:41d0:8:6d80::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp2 with LMTPS id wKCAD/ostmEYUAAAB5/wlQ (envelope-from ) for ; Sun, 12 Dec 2021 17:10:18 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 055861F248 for ; Sun, 12 Dec 2021 18:10:18 +0100 (CET) Received: from localhost ([::1]:45564 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1mwSMb-0004Is-3d for larch@yhetil.org; Sun, 12 Dec 2021 12:10:17 -0500 Received: from eggs.gnu.org ([209.51.188.92]:42562) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mwSMM-0004Ik-7P for bug-guix@gnu.org; Sun, 12 Dec 2021 12:10:02 -0500 Received: from debbugs.gnu.org ([209.51.188.43]:41466) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1mwSML-0002h8-U4 for bug-guix@gnu.org; Sun, 12 Dec 2021 12:10:01 -0500 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1mwSML-0001jV-IM for bug-guix@gnu.org; Sun, 12 Dec 2021 12:10:01 -0500 X-Loop: help-debbugs@gnu.org Subject: bug#51787: GC takes more than 9 hours on berlin Resent-From: Mathieu Othacehe Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Sun, 12 Dec 2021 17:10:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 51787 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: 51787@debbugs.gnu.org Received: via spool by 51787-submit@debbugs.gnu.org id=B51787.16393289926642 (code B ref 51787); Sun, 12 Dec 2021 17:10:01 +0000 Received: (at 51787) by debbugs.gnu.org; 12 Dec 2021 17:09:52 +0000 Received: from localhost ([127.0.0.1]:53012 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1mwSMB-0001j4-SF for submit@debbugs.gnu.org; Sun, 12 Dec 2021 12:09:52 -0500 Received: from eggs.gnu.org ([209.51.188.92]:41766) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1mwSM9-0001ir-Vg for 51787@debbugs.gnu.org; Sun, 12 Dec 2021 12:09:50 -0500 Received: from [2001:470:142:3::e] (port=35650 helo=fencepost.gnu.org) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mwSM4-0002fl-QZ for 51787@debbugs.gnu.org; Sun, 12 Dec 2021 12:09:44 -0500 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-Version:In-Reply-To:Date:References:Subject:To: From; bh=q1IqzqZRjMyy8SGAcWVTq6J9mYkAHEDd3IDNK/2jRjk=; b=GDwFPaIk/oIPlwBlNcO8 7PLNJ9gWKBo6HemDuLU8JisJqm8+/+yZFt8j/8I0xby61NnknQ5/MaPBDL+zgS+9Be6j9Wa7m8dX9 +zp/nh64vNNuue3nmBYVaB6sWdijMWku1rlELItZrpN+j6BqApSn1XpIhOcvOCRx8S7ufubQxXIn0 p30aehLKCn9a8pBuhuDmGOp5li1Ja2Ajq1K5GQ0iLZJ713SplAkq69w34Mz8oodamghqEjbq9ybRe dqfkDE6gCNAIT/d4XU2ftwnHM4bBjk311ceTPkeQpOBAXDGzb8Avm0MVNcb3qFR11e4JwwRE1UB94 JlIKj2wPgJc3Lw==; Received: from [2a01:e0a:19b:d9a0:45b5:a14a:5c75:5737] (port=53994 helo=meije) by fencepost.gnu.org with esmtpsa (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mwSM4-00008D-NM for 51787@debbugs.gnu.org; Sun, 12 Dec 2021 12:09:44 -0500 From: Mathieu Othacehe References: <87o86pegr3.fsf@gnu.org> <87zgpuhig7.fsf@gnu.org> <87wnkv15k3.fsf@cbaines.net> <87zgpp971n.fsf@gnu.org> <87pmqet419.fsf@gnu.org> <87czm57zao.fsf@gnu.org> <87czm4bvzt.fsf@gnu.org> <877dcccrlq.fsf@gnu.org> <87a6h86s7o.fsf@gnu.org> <87bl1nxyt5.fsf@gnu.org> Date: Sun, 12 Dec 2021 18:09:42 +0100 In-Reply-To: <87bl1nxyt5.fsf@gnu.org> (Mathieu Othacehe's message of "Sat, 11 Dec 2021 10:42:30 +0100") Message-ID: <87o85lhhrd.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-BeenThere: bug-guix@gnu.org List-Id: Bug reports for GNU Guix List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-guix-bounces+larch=yhetil.org@gnu.org Sender: "bug-Guix" X-Migadu-Flow: FLOW_IN ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1639329018; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:mime-version:mime-version: content-type:content-type:resent-cc:resent-from:resent-sender: resent-message-id:in-reply-to:in-reply-to:references:references: list-id:list-help:list-unsubscribe:list-subscribe:list-post: dkim-signature; bh=q1IqzqZRjMyy8SGAcWVTq6J9mYkAHEDd3IDNK/2jRjk=; b=ponaoZmLE0QDifNCy7wwY3tDaB5wQhR3PT9qZwAyR73+ygzRX5R/xEvfxYOOuUODNAtJH3 tjTuiaaxalfnv3d0hUE3coPiAjt1ruTQhld76Tu4QM6PcZkpPGuy/s6o2j75VaMzjVGaPx R95Xx78VjVPk+yIQDP0uFe4iepep6An2jMWHdTD32RzmXdAiWGccy1w4luTzk2tkYeqtgU KEIaoTooveYdsLTOFZGwhZvDj0UElR8BCnizYa/KXMNbCLDGyPJXeyUccHp4aQpja/vQsn zuXi1gh027X6W3qnQo4bdQ17sEFQ5dKFET/SmKF8Smkt92PfNGk6odB0jJ/GqQ== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1639329018; a=rsa-sha256; cv=none; b=BAALHwnqp6j07qYA8EjKsCkcB87Gq/vRD1oEOCEE97SFDNAWK+IoL3P/B5Fowgi7w/dp5t 9bKckgKZCOKJH785m45wMnrTvzmzwoVN0epPS8b1/g2gL+k7TmawJcINUsMat6d1uqSjL4 kNsQRDtpkAdligL+/t3jOrDzrzZTNNDJ1Lov+x8zSTu4dds8weR64oEgd13fsSEyRusHmP aPdZdlelk1pa6XsPg4aJ8z7ylQi4Gj3koNhP1RuLlFWwrZIdiUdxzswzdCExPBOTQByVvC 7GkxPWCMMO3SHc8wWapE4LrNJmwWk78LqZpm8E7TiFL5//cz831Z4U9fgvyiKw== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=fail ("headers rsa verify failed") header.d=gnu.org header.s=fencepost-gnu-org header.b=GDwFPaIk; dmarc=pass (policy=none) header.from=gnu.org; spf=pass (aspmx1.migadu.com: domain of "bug-guix-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="bug-guix-bounces+larch=yhetil.org@gnu.org" X-Migadu-Spam-Score: -3.67 Authentication-Results: aspmx1.migadu.com; dkim=fail ("headers rsa verify failed") header.d=gnu.org header.s=fencepost-gnu-org header.b=GDwFPaIk; dmarc=pass (policy=none) header.from=gnu.org; spf=pass (aspmx1.migadu.com: domain of "bug-guix-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="bug-guix-bounces+larch=yhetil.org@gnu.org" X-Migadu-Queue-Id: 055861F248 X-Spam-Score: -3.67 X-Migadu-Scanner: scn1.migadu.com X-TUID: thFshDO6sP4r Hey, > OK, thanks. Looks it just finished removing the trash directory > content. I started a GC process from my session to monitor it closely. Daily GC recap: * The GC process I started yesterday, did collect 5.5TiB in approximately 24 hours, that are now in the /gnu/store/trash directory. * The /gnu/store/trash directory contains 288910 entries. If those items are removed at the same rate than on the previous days, it will take days/months to delete them all. * I noticed that the upstream Nix GC process can now operate without locking. I think it shouldn't be too hard to port it to our fork or maybe rewrite the process in Guile while we are at it. That will not fix the slow hard-drives issues though. Thanks, Mathieu