From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on dcvr.yhbt.net X-Spam-Level: X-Spam-ASN: AS3215 2.6.0.0/16 X-Spam-Status: No, score=-3.9 required=3.0 tests=AWL,BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_HI, SPF_HELO_NONE,SPF_PASS,URIBL_RED shortcircuit=no autolearn=ham autolearn_force=no version=3.4.2 Received: from mail-qk1-x736.google.com (mail-qk1-x736.google.com [IPv6:2607:f8b0:4864:20::736]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by dcvr.yhbt.net (Postfix) with ESMTPS id 160D21F8C7 for ; Thu, 5 Aug 2021 20:59:44 +0000 (UTC) Received: by mail-qk1-x736.google.com with SMTP id c9so7691360qkc.13 for ; Thu, 05 Aug 2021 13:59:44 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linuxfoundation.org; s=google; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to; bh=l+ougWjipxxFYXJ0q4iJwlA+lMvfDR00C7ezHI9xB2g=; b=eUDxZpV1mi0daAAp0E6Jd5/F/OWEqVe1eW1BQGO5gxsG3oEL1oe9nS/DJWs1QKG23F Bg/94ya9gz08fRRXcCyFkvwDyVJRNE7At159lBJSkpTims79nE75wkIb64LXQ9h1H2hI Qq7hTKwEpDeExbxNyk0DwQpxzJyKDy4ACJREs= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to; bh=l+ougWjipxxFYXJ0q4iJwlA+lMvfDR00C7ezHI9xB2g=; b=Whe5wVVCOwaLcMj6Y6JyKjPU7KyBQRoGuRd73nXEoFM7gjXRGYfzNY9VgCvLsINZfE S1MH4SPeBLnF0Gtfm2v4YiBJ9WNRB012p7/JAdqmKEE65NX9EEMFlsNdlYY+vNiGas47 8TnsA4nay91P6owqsyAkCEjTleWdBHrA8S5oqD31G1rjtpQDvjfB9vB5BZXz3FknymcA JZw4qzrxTw/ChC0Pn67fAosMFhzb2br7Z6lpP+IEj1fcEXRU7v/sxduscCmJ+8SBRHig iDxGPHgo08VSydBxWHeDwGFwUtaw9q2b0BswTNUYmWhfmJr7oRDa0nYOBHllcb6A6l4y i2mw== X-Gm-Message-State: AOAM533RxkCuh9TrOMm5XZbHwBMfU41ZFr35HT8gW92497KHPfJccQC0 k3W8v5FJYCCFXpYs+uclxswEvg== X-Google-Smtp-Source: ABdhPJxqaoDssK5IW2Nn6XIwiK3ajjbO7BAxL7hTS2T75PpfQ5EZW2kC/CU2CcUirkVTFAjTG4WL9Q== X-Received: by 2002:a05:620a:b1b:: with SMTP id t27mr6813146qkg.460.1628197182932; Thu, 05 Aug 2021 13:59:42 -0700 (PDT) Received: from nitro.local ([89.36.78.230]) by smtp.gmail.com with ESMTPSA id r77sm3677025qke.15.2021.08.05.13.59.41 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 05 Aug 2021 13:59:42 -0700 (PDT) Date: Thu, 5 Aug 2021 16:59:39 -0400 From: Konstantin Ryabitsev To: Eric Wong Cc: meta@public-inbox.org Subject: Re: --batch-size and --jobs combination Message-ID: <20210805205939.kpy6dixzjopbuhyx@nitro.local> References: <20210729202836.7qdwxojjel6jmxh6@nitro.local> <20210729211321.GA23521@dcvr> <20210729212444.3jnmaq4vo4dnudk3@nitro.local> <20210729220629.GA29593@dcvr> <20210801204024.ieab3lr6yl2yqpsd@nitro.local> <20210805110541.GA6446@dcvr> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline In-Reply-To: <20210805110541.GA6446@dcvr> List-Id: On Thu, Aug 05, 2021 at 11:05:41AM +0000, Eric Wong wrote: > > - I will bring up the rest of the nodes throughout the week, so > > x-lore.kernel.org will become more geoip-balanced. I will share any other > > observations once I have more data. Once all 4 nodes are up, I will share > > this more widely with kernel devs so they can kick some tires and report > > whether they are seeing decreased performance compared to current > > lore.kernel.org. It's entirely possible that my plan to use > > mirrors.edge.kernel.org nodes for this isn't one of my brightest ideas, in > > which case I may bring up several dedicated instances in multiple clouds > > instead. > > Increasing the size of the SSD caches would net the most > dramatic improvement (or going SSD-only). Even consumer grade > SSDs (MLC/TLC) leave enterprise HDDs in the dust. The more I poke at this, the more it seems that using faster storage is a much better plan than trying to make this work reasonably well with our distro mirroring nodes. Occasional high IO latency will go largely unnoticed when it's apt or dnf that's fronting the requests, but web or b4 calls that make someone wait for 10+ seconds seems like a recipe for some very irate developers. I actually have a good opportunity to move our current git.kernel.org systems to newer hardware at Equinix Metal. We'll go from 6 older nodes to 3 newer nodes, each with more CPU/RAM and 1.2TB total of SSD. This should give us plenty of room to colocate lore.kernel.org on the same systems as git.kernel.org, and it's a much better plan than trying to make spinning rust work well for this purpose. > > Thanks for all your work, Eric. > > You're welcome and thanks for the support. It's been a very > rough time, especially with the pandemic still dragging on :< And we thought we were all done this spring, eh? Ah well, this too shall pass. Best regards, -K