From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp2 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id 8G+gMUXFwGGOsAAAgWs5BA (envelope-from ) for ; Mon, 20 Dec 2021 19:02:45 +0100 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp2 with LMTPS id yPddLUXFwGG0UgAAB5/wlQ (envelope-from ) for ; Mon, 20 Dec 2021 18:02:45 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 74B3740B3 for ; Mon, 20 Dec 2021 19:02:45 +0100 (CET) Received: from localhost ([::1]:36268 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1mzMzk-00024X-Dl for larch@yhetil.org; Mon, 20 Dec 2021 13:02:44 -0500 Received: from eggs.gnu.org ([209.51.188.92]:42400) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mzM15-0004Fv-9q for bug-guix@gnu.org; Mon, 20 Dec 2021 12:00:03 -0500 Received: from debbugs.gnu.org ([209.51.188.43]:39744) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1mzM14-0006XT-W5 for bug-guix@gnu.org; Mon, 20 Dec 2021 12:00:03 -0500 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1mzM14-00066n-Mc for bug-guix@gnu.org; Mon, 20 Dec 2021 12:00:02 -0500 X-Loop: help-debbugs@gnu.org Subject: bug#51787: Disk performance on ci.guix.gnu.org Resent-From: Mathieu Othacehe Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Mon, 20 Dec 2021 17:00:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 51787 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: Ricardo Wurmus Received: via spool by 51787-submit@debbugs.gnu.org id=B51787.164001958823426 (code B ref 51787); Mon, 20 Dec 2021 17:00:02 +0000 Received: (at 51787) by debbugs.gnu.org; 20 Dec 2021 16:59:48 +0000 Received: from localhost ([127.0.0.1]:51290 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1mzM0q-00065m-21 for submit@debbugs.gnu.org; Mon, 20 Dec 2021 11:59:48 -0500 Received: from eggs.gnu.org ([209.51.188.92]:41468) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1mzM0l-00065U-95 for 51787@debbugs.gnu.org; Mon, 20 Dec 2021 11:59:46 -0500 Received: from [2001:470:142:3::e] (port=45860 helo=fencepost.gnu.org) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mzM0f-0006Qj-Mm; Mon, 20 Dec 2021 11:59:37 -0500 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-Version:In-Reply-To:Date:References:Subject:To: From; bh=e7FuET/gbny9oP4pAlIHUNGsUk69aMrMMJUL//G4nUQ=; b=fjYMwiw2wZsJe8/E9pqK ZUEGvsxP/FZZ+ZyfhEAGmNzDPeDbRXeqbzi92IiwdBB3KWq92AOdalMtXD6ix2/42jlM/evAFg0TT YoSb9cAGG/A/I7oRYQWAjl0fawMbN5MhGiR2vY1pQYetzurRSXv0NT3McmDRMUrMCcUxmLGTmSwmT r7IypUWlKtxHAIwX+j1SvcnGRrVoQNKb18RYNfRnsME1mFvgCCkJ7q9aFKfTanLJaSCnDAmaa/2ga vqheSYcsZ8a62S+eKrKr28RCB21vdssGY/HRP9v17YKIDjxrSRXp5U4BRkj7Ayj2YxvmLb3h+suBy BO0FAPPLtTkeBg==; Received: from [2a01:cb1e:72:d94a:2d41:6e45:df8f:384b] (port=51880 helo=meije) by fencepost.gnu.org with esmtpsa (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mzM0e-0001dW-LZ; Mon, 20 Dec 2021 11:59:37 -0500 From: Mathieu Othacehe References: <875yrjpi1y.fsf@elephly.net> Date: Mon, 20 Dec 2021 17:59:33 +0100 In-Reply-To: <875yrjpi1y.fsf@elephly.net> (Ricardo Wurmus's message of "Mon, 20 Dec 2021 13:32:33 +0100") Message-ID: <87o85bjjpm.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-BeenThere: bug-guix@gnu.org List-Id: Bug reports for GNU Guix List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: 51787@debbugs.gnu.org Errors-To: bug-guix-bounces+larch=yhetil.org@gnu.org Sender: "bug-Guix" X-Migadu-Flow: FLOW_IN X-Migadu-Country: US ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1640023365; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:resent-cc:resent-from:resent-sender: resent-message-id:in-reply-to:in-reply-to:references:references: list-id:list-help:list-unsubscribe:list-subscribe:list-post: dkim-signature; bh=e7FuET/gbny9oP4pAlIHUNGsUk69aMrMMJUL//G4nUQ=; b=FmgF5z1uJQSmZg2FZ+PUbhq0t0llVfQ9ltbBbclgWv73jeuaX5c6LQ9BsiURE+2qAKUoJS 5UmDcxHH5JcJIsH0snO3K2sO7I9SbPR44i+tfD1KXt3d8E5wWbVCSNsvmTnLPb+mDhPGvm XGIk5RTF/kTU9GQQEb+fg3sSZNylY7zdJEyx5Es8wFzUO09+PKvzRxh7lhPIMPxfaUKTce rJAKcqagqBidJt1o3nKkisteJ5YFjfWFGsYAUtL/HLnd2tioRsBffgfAD9XXsZKrVhoAJL PzEoUFBFfRstL4B/rnsD0YVYh5jpiRqhXkMePjjtskRm10ltrSah+b958+6g7g== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1640023365; a=rsa-sha256; cv=none; b=GTV6QDTtnivxY9VnQJIbdKCZ3+Ahg8bUcALdxQbjeYzFfOJ5UXqBev7Tv4fnbmc5ZWY5ai dW4Ks2/9eQMNJ7k8GQZrW7OaLGSFWdqN1XHam741DFHvbQPfE1kv9a1ny1+rKHeuoeFuTI 2GcmPEno2sjdarNy8R27bwIEQ1fyDn6WehAWtLReWEzlb32YGQrehgmS7AjvItzohUHJef gLBpT7RfJej8ON5gBR15brkjbC8mLDrRd3B6EuMqZPOJ89BzytWhot01BEMCkf902oBIlJ pfuct08q/IRE3coygvgLL5NFTsvlnXZzI4bbc3eHn0d4a4toU0LaUR7PMa4zyA== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=fail ("headers rsa verify failed") header.d=gnu.org header.s=fencepost-gnu-org header.b=fjYMwiw2; dmarc=pass (policy=none) header.from=gnu.org; spf=pass (aspmx1.migadu.com: domain of "bug-guix-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="bug-guix-bounces+larch=yhetil.org@gnu.org" X-Migadu-Spam-Score: -2.72 Authentication-Results: aspmx1.migadu.com; dkim=fail ("headers rsa verify failed") header.d=gnu.org header.s=fencepost-gnu-org header.b=fjYMwiw2; dmarc=pass (policy=none) header.from=gnu.org; spf=pass (aspmx1.migadu.com: domain of "bug-guix-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="bug-guix-bounces+larch=yhetil.org@gnu.org" X-Migadu-Queue-Id: 74B3740B3 X-Spam-Score: -2.72 X-Migadu-Scanner: scn0.migadu.com X-TUID: tr4RPnXcmCpC Hey, > This is still pretty bad, but better than the <1M performance suggested > by previous runs. Mmh interesting, I also have a x10 speed up on sdb by increasing the block size from 4k to 512k. I'm not sure what conclusion should we draw from this observation. In particular for our most urging matter, /gnu/store/trash removal. Moving to a faster hard drive would definitely help here, but I still don't understand if that disk performance regression comes from Linux, the file-system fragmentation, or the disk itself. > READ: bw=1547MiB/s (1622MB/s), 1547MiB/s-1547MiB/s (1622MB/s-1622MB/s), io=3055MiB (3203MB), run=1975-1975msec > WRITE: bw=527MiB/s (553MB/s), 527MiB/s-527MiB/s (553MB/s-553MB/s), io=1042MiB (1092MB), run=1975-1975msec Wooh that's fast! On test could be to copy the /gnu/store/trash content to the SAN an observe how long that it takes for this operating to complete. Thanks for your support on that complex topic :) Mathieu