From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp10.migadu.com ([2001:41d0:403:4ea1::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id KF9zALQtyGE9EgAAgWs5BA (envelope-from ) for ; Sun, 26 Dec 2021 09:54:12 +0100 Received: from aspmx1.migadu.com ([2001:41d0:8:6d80::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp10.migadu.com with LMTPS id wHnbNbMtyGEHywAAG6o9tA (envelope-from ) for ; Sun, 26 Dec 2021 09:54:11 +0100 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 1616218DD0 for ; Sun, 26 Dec 2021 09:54:11 +0100 (CET) Received: from localhost ([::1]:35502 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1n1PIA-0003Lq-7U for larch@yhetil.org; Sun, 26 Dec 2021 03:54:10 -0500 Received: from eggs.gnu.org ([209.51.188.92]:56954) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1n1PI2-0003LU-Rn for bug-guix@gnu.org; Sun, 26 Dec 2021 03:54:02 -0500 Received: from debbugs.gnu.org ([209.51.188.43]:56903) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1n1PI2-00078w-HA for bug-guix@gnu.org; Sun, 26 Dec 2021 03:54:02 -0500 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1n1PI2-0001Tq-E1 for bug-guix@gnu.org; Sun, 26 Dec 2021 03:54:02 -0500 X-Loop: help-debbugs@gnu.org Subject: bug#51787: Disk performance on ci.guix.gnu.org Resent-From: Mathieu Othacehe Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Sun, 26 Dec 2021 08:54:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 51787 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: Ricardo Wurmus Received: via spool by 51787-submit@debbugs.gnu.org id=B51787.16405087995627 (code B ref 51787); Sun, 26 Dec 2021 08:54:02 +0000 Received: (at 51787) by debbugs.gnu.org; 26 Dec 2021 08:53:19 +0000 Received: from localhost ([127.0.0.1]:40216 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1n1PHK-0001Sh-Mp for submit@debbugs.gnu.org; Sun, 26 Dec 2021 03:53:18 -0500 Received: from eggs.gnu.org ([209.51.188.92]:56156) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1n1PHI-0001SR-MO for 51787@debbugs.gnu.org; Sun, 26 Dec 2021 03:53:17 -0500 Received: from [2001:470:142:3::e] (port=48226 helo=fencepost.gnu.org) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1n1PHD-000751-Au; Sun, 26 Dec 2021 03:53:11 -0500 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-Version:In-Reply-To:Date:References:Subject:To: From; bh=qruqFTh365w/HmbbUfe8RZ4oL1e72/w0zHfi5j25Lco=; b=covgoMa76rHYf6VOpUXX ocjaeLg1/ukT+AjYxB6ZfrrKTW9yhDWfTNqj7LqWQtDVzmq6oB3cCBnYhhflWyZYMv9mFVbD9q54A K1H1wJBpZIGMmw77QHGmwdEW8kW04F4Kpbt/Ob+3HWEy3nHgIhVcnNDV+pgCRrvAHBR4iIZA2+lbi j9uEQKp0A5ReUT4Utn3+9zyoyZcLg/m9jWLqA4ErU5WpaOFJlwtbJHOlcr05ALFhwnWdmrQgASm98 JgwAl0y+5QGySleCFl/4j1tDUbv7yVLDQ15TI9E7T0oNEpxUQkRXYByWRezCgv7gPkz6C3YfKs51R OOlLx/Qeje2HpA==; Received: from [2a01:cb18:832e:5f00:3563:417e:2a38:86d8] (port=48388 helo=meije) by fencepost.gnu.org with esmtpsa (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1n1PHD-0006X9-AA; Sun, 26 Dec 2021 03:53:11 -0500 From: Mathieu Othacehe References: <875yrjpi1y.fsf@elephly.net> <87o85bjjpm.fsf@gnu.org> <871r27p5jq.fsf@elephly.net> <87a6gv3pue.fsf@gnu.org> <87v8zhn9m1.fsf@elephly.net> <87wnjsjpdh.fsf@elephly.net> Date: Sun, 26 Dec 2021 09:53:09 +0100 In-Reply-To: <87wnjsjpdh.fsf@elephly.net> (Ricardo Wurmus's message of "Sat, 25 Dec 2021 23:19:23 +0100") Message-ID: <87fsqfd9xm.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-BeenThere: bug-guix@gnu.org List-Id: Bug reports for GNU Guix List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: 51787@debbugs.gnu.org Errors-To: bug-guix-bounces+larch=yhetil.org@gnu.org Sender: "bug-Guix" X-Migadu-Flow: FLOW_IN X-Migadu-Country: US ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1640508851; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:resent-cc:resent-from:resent-sender: resent-message-id:in-reply-to:in-reply-to:references:references: list-id:list-help:list-unsubscribe:list-subscribe:list-post: dkim-signature; bh=qruqFTh365w/HmbbUfe8RZ4oL1e72/w0zHfi5j25Lco=; b=UU+kELOCxr8727ukgYwhCXb5DBVBDFiOPXULaNTR6E0dhs+TPf05N2fWn7LgaYtRKDw3W9 kZ5pAVvQptZfaFPZQ/SDzi9kOhX1uS8VrDzba939HwbippKwaGV8ab1tGQ0/gipRYxUSwx qjnJYGIh1BVtAGlW330j7JI6Em3jiGlJczvSYbMUkspCXhgcjANXOtOTLz/zYK88lcR3IA SmDALqCqjK4ak2VKqWwefzBEyN4YLvtgVP8zFMBYCPZHh0EScdEPCQBJ+fASG8jnxVMNpW NuNgLLW41JmZfXgJVxyA4/wQHrzOOxENJJqbMVPAlbb5zP1UVdkNLPThQ1gGYw== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1640508851; a=rsa-sha256; cv=none; b=i0K9UqxbFzNiOgYOWv/+5gMIEfS3nxsFAMCMhDWHIqxQNP9iItBiecFrOKxouJdTotP57i ToJ4MT4DZc9voGv4J8/oDqc1yXuZ2IXGRstKX4YaRVq7TXZF8MvbfqsmM0RNpc41auypa8 /NXbBz4eh6eI0KYOGq/E2LLSkeXrfAkxLONyY2NnDePucMkCFAp909eZRth9Kn46ctgYrk cgqfEL/l4GuGEad5NPQGLsoxrfSvpCrhMd3K5A5Ssxtt/dDbWtJ/jgKIMi+uYbTRS3Ej9j 6D4aVXX5Owj+qRrpUdEIm+rn+gfqwTyaQs4LJQTojOieWzDxMDaqz5NefLIlGA== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=fail ("headers rsa verify failed") header.d=gnu.org header.s=fencepost-gnu-org header.b=covgoMa7; dmarc=pass (policy=none) header.from=gnu.org; spf=pass (aspmx1.migadu.com: domain of "bug-guix-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="bug-guix-bounces+larch=yhetil.org@gnu.org" X-Migadu-Spam-Score: -3.76 Authentication-Results: aspmx1.migadu.com; dkim=fail ("headers rsa verify failed") header.d=gnu.org header.s=fencepost-gnu-org header.b=covgoMa7; dmarc=pass (policy=none) header.from=gnu.org; spf=pass (aspmx1.migadu.com: domain of "bug-guix-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="bug-guix-bounces+larch=yhetil.org@gnu.org" X-Migadu-Queue-Id: 1616218DD0 X-Spam-Score: -3.76 X-Migadu-Scanner: scn1.migadu.com X-TUID: BwaDHCAOAMYD Hello Ricardo, > Should we attempt to overwrite /gnu/store and rely exclusively on > substitutes from the cache? Yes, I don't see any other options. Before that, what might be nice could be: 1. Ensure that all Berlin /var/cache/guix/publish directory is synchronized on Bordeaux. We are now at 117G out of X. We could then start a publish server on Bordeaux. As Bordeaux is already part of the default substitute servers list, the transition could be smooth I guess. 2. Determine what file-system out of ext4, btrfs and xfs could be the most suitable for Berlin's /gnu/store. I'm running some tests on an old HDD to try to determine the fragmentation impact on those file-systems. We can of course choose to be conservative and go for ext4 that did the job until now. Regarding the /gnu/store re-creation, I wonder how can we do it without reinstalling completely Berlin. Maybe we could save the system store closure somewhere and restore it on the shining new file-system? Thanks, Mathieu