From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp11.migadu.com ([2001:41d0:306:2d92::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms9.migadu.com with LMTPS id MLhQF92q3GQ79QAASxT56A (envelope-from ) for ; Wed, 16 Aug 2023 12:54:21 +0200 Received: from aspmx1.migadu.com ([2001:41d0:306:2d92::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp11.migadu.com with LMTPS id WFHqFt2q3GSRRwAA9RJhRA (envelope-from ) for ; Wed, 16 Aug 2023 12:54:21 +0200 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 016783C78D for ; Wed, 16 Aug 2023 12:54:20 +0200 (CEST) Authentication-Results: aspmx1.migadu.com; dkim=fail ("headers rsa verify failed") header.d=gmail.com header.s=20221208 header.b=JZ0qX2YE; dmarc=fail reason="SPF not aligned (relaxed)" header.from=gmail.com (policy=none); spf=pass (aspmx1.migadu.com: domain of "bug-guix-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="bug-guix-bounces+larch=yhetil.org@gnu.org" ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1692183261; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:resent-to:resent-from:resent-sender: resent-message-id:in-reply-to:in-reply-to:references:references: list-id:list-help:list-unsubscribe:list-subscribe:list-post: dkim-signature; bh=c1BFXtlv6jSEdIULLoyIJEHYXclrHIVQdENur/ZZ50g=; b=VDJSWAEmA59yiEzvnd9XW5Db7MnzEXOfnakYNy6NqgcapQeF1o3d54tvNgO5UXc1XAlV5t 5iEMCrAdDlsrSgFZ8zfAzm/BaQciWaLHGDRooUwYM/EfiGJt2r0U7gzngpjxKQjefvRpls sXd3E5dkMxQH4pe+NH/ocQYJQncB5gvO7WMTaYW8wMeoVSB+oqck0ChWYBvAWlz4lKks0W OjFdg+WRRNiLxz0iB9roghc1JfdT2GaXRq1yJyPJRPt21Ibs8cM6ihcN+RlVBXMAJ8ah8U TK2b2sXX+jO0fYeK8JNb/CibzVD9kWoNYRfeK5y33t4vxSI2tJFUFO9AKpYxFw== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=fail ("headers rsa verify failed") header.d=gmail.com header.s=20221208 header.b=JZ0qX2YE; dmarc=fail reason="SPF not aligned (relaxed)" header.from=gmail.com (policy=none); spf=pass (aspmx1.migadu.com: domain of "bug-guix-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="bug-guix-bounces+larch=yhetil.org@gnu.org" ARC-Seal: i=1; s=key1; d=yhetil.org; t=1692183261; a=rsa-sha256; cv=none; b=D41BkQ6XsTApSrdHD98AmXRoVwlQQqQQZUYAei0DbVkq0/i+nBa4Rl1daiZ4JLcijZUQwu 1rqHk7UXDwnVF/qiG8/G0i0orbHPy1I+NEI+BmXA7fLtihq3G89IXvoA8ylM+uYeZLzH/G e8nueRgRDl2YisNYoTRxiKuCnoxN9M0MDFq25N6ZC82yBC09LsyCya5zNMr0JDqXvsKZZ5 9iXLD79zgNYmmYbvM+9BI3XKFLtdn9AogVEqNs4ccQuqIEGZilrc7qxCmwuifD9wig+gy1 KJbbzh4kP3Bhutt57NxPuDsb9PA/nuVpqOcyRGU4EjEdWEnYB5mTUEQ6HQ9FoQ== Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1qWEA8-0007fN-7x; Wed, 16 Aug 2023 06:54:04 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1qWEA6-0007ek-LJ for bug-guix@gnu.org; Wed, 16 Aug 2023 06:54:02 -0400 Received: from debbugs.gnu.org ([2001:470:142:5::43]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1qWEA6-0001QK-D0 for bug-guix@gnu.org; Wed, 16 Aug 2023 06:54:02 -0400 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1qWEA6-0000Xz-6F for bug-guix@gnu.org; Wed, 16 Aug 2023 06:54:02 -0400 Subject: bug#51787: GC takes more than 9 hours on berlin Resent-From: Maxim Cournoyer Original-Sender: "Debbugs-submit" Resent-To: bug-guix@gnu.org Resent-Date: Wed, 16 Aug 2023 10:54:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: cc-closed 51787 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: Mathieu Othacehe Cc: 51787-done@debbugs.gnu.org Mail-Followup-To: 51787@debbugs.gnu.org, maxim.cournoyer@gmail.com, othacehe@gnu.org Received: via spool by 51787-done@debbugs.gnu.org id=D51787.16921831952039 (code D ref 51787); Wed, 16 Aug 2023 10:54:01 +0000 Received: (at 51787-done) by debbugs.gnu.org; 16 Aug 2023 10:53:15 +0000 Received: from localhost ([127.0.0.1]:38937 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1qWE9L-0000Wp-BI for submit@debbugs.gnu.org; Wed, 16 Aug 2023 06:53:15 -0400 Received: from mail-qk1-x733.google.com ([2607:f8b0:4864:20::733]:50394) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1qWE9J-0000Wc-TW for 51787-done@debbugs.gnu.org; Wed, 16 Aug 2023 06:53:14 -0400 Received: by mail-qk1-x733.google.com with SMTP id af79cd13be357-765a7768f1dso513340185a.0 for <51787-done@debbugs.gnu.org>; Wed, 16 Aug 2023 03:53:13 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1692183188; x=1692787988; h=mime-version:user-agent:message-id:in-reply-to:date:references :subject:cc:to:from:from:to:cc:subject:date:message-id:reply-to; bh=c1BFXtlv6jSEdIULLoyIJEHYXclrHIVQdENur/ZZ50g=; b=JZ0qX2YExg7eltcMSOvjcgVC+6KLbi0/IJnI4F5YqlLTTLpEueTApU14UzcBiV9B0A 7mJZr7ZV3SQ6lmn1BL8CTbQ2pkebfEbYDx91bVW2tP+2bxOdz0vmyztG6qpTiWfCRpjj WoZ8NvAx4OsFDLqlquOOiCa42K4WrzmJ4dGT07AIclb7/Gve7uWr+2T7qfW8shlqdiBw bRW8qXcfUZNC5Jl+bX00GLQUAixskbkpoLiTrIDr1Z8/kBCQbga/rwp3zxB0kLwRdGwK m1A9XCRKQdrPKYJ3DoNKbxkezSywrM4lDVymLVL89GeJQwyYurFwxIqYzS1Ia2v334IG JUPw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1692183188; x=1692787988; h=mime-version:user-agent:message-id:in-reply-to:date:references :subject:cc:to:from:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=c1BFXtlv6jSEdIULLoyIJEHYXclrHIVQdENur/ZZ50g=; b=kUqYpVodGwJEIQ3AtlhvyFIrMLUMc3wGfqOV+1ndRsu/cOm9ESIyZ8vjzf8pIje8yE NtmR70jhKpBsk8B2FHJmfEhx4PRk1uYHh/1K0NoabiPBvoeEojs8hThZeqmnuc5SH7GK GuPAb2czIFNGNd7e1GdDqGSXc3Bt3/jD+BU1CxZOETNi4JBD2YS98xOX+SwI04NI+3nj cAMzpNVNEIknFFDr/tH+YjzEeJLs202Rm6EmFqgmZe4l4BjSzOPMyjLa6tpRxsecnO7d sFZkz1MWZ1CwJwTV4hyHxmeFgy/9vcXHNkZL85VboSi56fU+UrlH/NVTxLGoCoF+lGV2 HwzQ== X-Gm-Message-State: AOJu0YwflSyVRABRekvFMpuJpll9/u3jLb+gxlO1MzF8NSr6xe8OEuJG uaR3ck12lLBUzWQa6hBV/d7oRVDpCq8= X-Google-Smtp-Source: AGHT+IHFupaY9OfQ2lh1Zpt/9BCWoeAbBcg6co9NSFjCosWT0Av+uCKm9jOniTC/pL1VxK7oSOrPwQ== X-Received: by 2002:a05:620a:4108:b0:76c:8f86:49de with SMTP id j8-20020a05620a410800b0076c8f8649demr2050695qko.16.1692183188010; Wed, 16 Aug 2023 03:53:08 -0700 (PDT) Received: from hurd (dsl-152-182.b2b2c.ca. [66.158.152.182]) by smtp.gmail.com with ESMTPSA id j7-20020a37c247000000b0076730d0b0b9sm4330338qkm.14.2023.08.16.03.53.06 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 16 Aug 2023 03:53:07 -0700 (PDT) From: Maxim Cournoyer References: <87o86pegr3.fsf@gnu.org> Date: Wed, 16 Aug 2023 06:53:05 -0400 In-Reply-To: <87o86pegr3.fsf@gnu.org> (Mathieu Othacehe's message of "Fri, 12 Nov 2021 11:49:04 +0000") Message-ID: <87350jjm26.fsf@gmail.com> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-BeenThere: bug-guix@gnu.org List-Id: Bug reports for GNU Guix List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-guix-bounces+larch=yhetil.org@gnu.org Sender: bug-guix-bounces+larch=yhetil.org@gnu.org X-Migadu-Flow: FLOW_IN X-Migadu-Country: US X-Migadu-Spam-Score: -5.08 X-Spam-Score: -5.08 X-Migadu-Queue-Id: 016783C78D X-Migadu-Scanner: mx2.migadu.com X-TUID: DqqEZ8pOU9e0 Hi, Mathieu Othacehe writes: > Hello, > > On berlin, the daily GC command is still running whereas it was started > 9 hours ago. > > guix processes > [...] > SessionPID: 37231 > ClientPID: 37195 > ClientCommand: /gnu/store/49vfv8l1j96bbd73ssbqanpnjz83arss-guix-1.3.0-11.014f1b6/libexec/guix/guile \ /gnu/store/49vfv8l1j96bbd73ssbqanpnjz83arss-guix-1.3.0-11.014f1b6/bin/guix gc -F10995116277760 > > > and > > mathieu@berlin ~$ ps auxww|grep 37195 > root 37195 0.0 0.0 183260 33440 ? Sl 03:59 0:00 /gnu/store/49vfv8l1j96bbd73ssbqanpnjz83arss-guix-1.3.0-11.014f1b6/libexec/guix/guile \ /gnu/store/49vfv8l1j96bbd73ssbqanpnjz83arss-guix-1.3.0-11.014f1b6/bin/guix gc -F10995116277760 > > > That's really problematic as it is blocking some other berlin services > such as Cuirass, which has 4564 packages in its fetch queue: > > mathieu@berlin ~$ less /var/log/cuirass-remote-server.log > [...] > 2021-11-12T12:47:01 period update: 0 resumable, 0 failed builds. > 2021-11-12T12:47:01 period update: 4564 items in the fetch queue. I'm more than happy to close this old, no longer relevant bug :-). Since it was reported, the storage was migrated to a much faster array, and is using the Btrfs file system with zstd compression, which avoids the inodes exhaustion issue we've had with ext4 in the past. A full garbage collection (GC) is run daily to keep the store growth in check and for the GC to always take a similar amount of time (less than 20 minutes) every day. -- Thanks, Maxim