From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp11.migadu.com ([2001:41d0:8:6d80::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms5.migadu.com with LMTPS id AP8eKF6SWWNgTgEAbAwnHQ (envelope-from ) for ; Wed, 26 Oct 2022 22:02:38 +0200 Received: from aspmx1.migadu.com ([2001:41d0:8:6d80::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp11.migadu.com with LMTPS id gID/J16SWWNAGQAA9RJhRA (envelope-from ) for ; Wed, 26 Oct 2022 22:02:38 +0200 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 6ED8B2E96E for ; Wed, 26 Oct 2022 22:02:38 +0200 (CEST) Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1onmDw-0001br-2p; Wed, 26 Oct 2022 15:38:00 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1onmDu-0001Ww-Uy for guix-devel@gnu.org; Wed, 26 Oct 2022 15:37:58 -0400 Received: from mailout.easymail.ca ([64.68.200.34]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1onmDs-0005Qn-S6 for guix-devel@gnu.org; Wed, 26 Oct 2022 15:37:58 -0400 Received: from localhost (localhost [127.0.0.1]) by mailout.easymail.ca (Postfix) with ESMTP id C0EAF65D4A; Wed, 26 Oct 2022 19:37:52 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=bokr.com; s=easymail; t=1666813072; bh=SzBckqDvCME1cbWIs1ezUsFzVhp/RlLOA9CO94+obpY=; h=From:Date:To:Cc:Subject:References:In-Reply-To:From; b=S055gHp4GuJh8Sl9mq+Dw7Mfd75JVypo/LPQQbcQMFLNy6Z6djw4qi54lIHSbVzCc JEqDCKi+Z4cEgA3oz8Hz/F1OZhOaeKg2xProM3616D75fdWiDnrciUdyyV3Md720sy X3R8lHLR3DQ+vu9vz7k3Y3qvkgI8pLp5CtDuNhKPSQTsEWrHJ/wrFp0jopxZw2NE+M XxPim2sZWMVy3Jgvf/GRm8FA7q87zUy2NMRYoFIM4z9hBYsooZ9F1moXEDyRHzxGRL P3SAdHpKo/JRBE/FbfiVRvmCi+Z8becQiZhhMlyzH/S+6nlpk8CB76tDulsK4sh4Fx v0kRz9ep7brIA== X-Virus-Scanned: Debian amavisd-new at emo09-pco.easydns.vpn Received: from mailout.easymail.ca ([127.0.0.1]) by localhost (emo09-pco.easydns.vpn [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 1-F0tezg0UHG; Wed, 26 Oct 2022 19:37:52 +0000 (UTC) Received: from localhost (m90-129-200-243.cust.tele2.se [90.129.200.243]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by mailout.easymail.ca (Postfix) with ESMTPSA id EBB4065ACA; Wed, 26 Oct 2022 19:37:51 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=bokr.com; s=easymail; t=1666813072; bh=SzBckqDvCME1cbWIs1ezUsFzVhp/RlLOA9CO94+obpY=; h=From:Date:To:Cc:Subject:References:In-Reply-To:From; b=S055gHp4GuJh8Sl9mq+Dw7Mfd75JVypo/LPQQbcQMFLNy6Z6djw4qi54lIHSbVzCc JEqDCKi+Z4cEgA3oz8Hz/F1OZhOaeKg2xProM3616D75fdWiDnrciUdyyV3Md720sy X3R8lHLR3DQ+vu9vz7k3Y3qvkgI8pLp5CtDuNhKPSQTsEWrHJ/wrFp0jopxZw2NE+M XxPim2sZWMVy3Jgvf/GRm8FA7q87zUy2NMRYoFIM4z9hBYsooZ9F1moXEDyRHzxGRL P3SAdHpKo/JRBE/FbfiVRvmCi+Z8becQiZhhMlyzH/S+6nlpk8CB76tDulsK4sh4Fx v0kRz9ep7brIA== From: bokr@bokr.com Date: Wed, 26 Oct 2022 21:37:32 +0200 To: Maxim Cournoyer Cc: =?utf-8?B?RsOpbGl4IEJheWxhYyBKYWNxdcOp?= , guix-devel@gnu.org Subject: Re: How long does it take to run the full rustc bootstrap chain? Message-ID: <20221026193732.GA6899@LionPure> References: <87k0514k3g.fsf@alternativebit.fr> <8735bgufy5.fsf@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <8735bgufy5.fsf@gmail.com> User-Agent: Mutt/1.10.1 (2018-07-13) Received-SPF: pass client-ip=64.68.200.34; envelope-from=bokr@bokr.com; helo=mailout.easymail.ca X-Spam_score_int: -43 X-Spam_score: -4.4 X-Spam_bar: ---- X-Spam_report: (-4.4 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_MED=-2.3, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: "Guix-devel" Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org X-Migadu-Flow: FLOW_IN X-Migadu-Country: US ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1666814558; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-unsubscribe:list-subscribe:list-post:dkim-signature; bh=KQTG3gZLJbMgV9WF9kk5g2jlgIhO5ieUBz8hYYFv8WY=; b=UvFS6rRth2N5sW/kCF6wy+yWqOVwR/t3AQ47c1awKtuQzVs4cPz2Cd/wtw5EymTL7+5au/ fp3kyL8OheMyLClOgNvF47QOcQ8B9Xna2C6M/y15PD30yQib3WCLK+mi4IhNzsX49HYftv nft97DHeLBG35vEjmL5P/MYvr6LHY9NJC8RsovR2tQrZM5Lj5Vx5G/HntBeaukjPFJQ9Vm FXxvv+H6DbLtRtKOmZTxgTs/2sNS5SVZmSUscx1WV5sPtMTds81OawWH8mb7HSv9m2SPhH Q65E5KGpF6e+RE0hCp4BrhZfljDAo0nlv0uODvOJyTWDq4VWhEE5upsaNyh9LA== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1666814558; a=rsa-sha256; cv=none; b=nCRkw1LtuRxhgm6brhbqbq+puvCkohe2T0lccT7KNd/145r0kgx806YzBQplxdilxhIplm u4OgSQwf2AN5sjYznMHTGy7kAcSEzOGvaRrXt+biTSJiQoeMleGhLLyioOAlxeS+CCVy3B rT2s/XRk9G6P6xKkXbJPhv1XACT1I2PtoueiesOOhA0o1GtTFMZo3EeyC5rEmFOTxtSR5O 7Enbgd/0uR39Utx66fXoSAnuuciqDS6GpJ4xnfoKoKq6rVkVl0Ic3bm4YBfRY3TKdJQNM9 pgbnwUyfeVPT8zdqhGb978wohpHAOwNczOQ1NUhUZLkDSBxBv0LG1z6Sasm9iA== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=fail ("headers rsa verify failed") header.d=bokr.com header.s=easymail header.b=S055gHp4; dkim=fail ("headers rsa verify failed") header.d=bokr.com header.s=easymail header.b=S055gHp4; dmarc=none; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" X-Migadu-Spam-Score: 4.08 Authentication-Results: aspmx1.migadu.com; dkim=fail ("headers rsa verify failed") header.d=bokr.com header.s=easymail header.b=S055gHp4; dkim=fail ("headers rsa verify failed") header.d=bokr.com header.s=easymail header.b=S055gHp4; dmarc=none; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" X-Migadu-Queue-Id: 6ED8B2E96E X-Spam-Score: 4.08 X-Migadu-Scanner: scn1.migadu.com X-TUID: CUbyl+1FjabX Hi, On +2022-10-22 09:48:50 -0400, Maxim Cournoyer wrote: > Hi, > > Félix Baylac Jacqué writes: > > > Hey Guix, > > > > I'd be curious to know how long it takes to run the full rustc bootstrap > > chain on the Guix build farm. I'm sadly not sure how to approach this > > problem. > > > > Is there a way to extract this information from Cuirass or the Guix data > > service? > > > > Félix > > It used to be 16 hours on a Ryzen 3900x machine, then it got halved to 8 > hours with the work to bootstrap from 1.39, and recently we're > bootstrapping from 1.54, so it must have been greatly reduced again. > > Looking at (gnu packages rust), the mrustc-based bootstrap starts with > 1.54.0. This one is expensive, probably around 1 h 30 or more on a > Ryzen 3900x CPU (24 logical CPUs). > > The intermediate builds are typically around 15-20 minutes on that > machines, with the last one taking a bit more (30 minutes), so the > current bootstrap on such a machine should take about: > > 1.54.0: 1h30m > 1.55.0 - 1.60.0: 6 X 20 min = 1h20m > 1.60.0: final build with tests and extra tools: 30 min > > The total should be around 3 h 20 on a fast modern x86_64 machine. I > suppose the time for berlin to build it takes about this. > > HTH! > > -- > Thanks, > Maxim > I'm curious what --8<---------------cut here---------------start------------->8--- $ lsblk -o size,model,type,tran,vendor,name|grep -Ei 'ssd|model';echo;lspci |grep -i nvme --8<---------------cut here---------------end--------------->8--- on your relevant machines would show. I opted for the best SSD available for my purism librem13v4 at the time, and was really happy with seems like 10x faster than the SATA SSD in my older but still i7 x86_64 previous laptop. Prob really 4-5x faster. So above combo command line now gives me --8<---------------cut here---------------start------------->8--- SIZE MODEL TYPE TRAN VENDOR NAME 465.8G Samsung SSD 970 EVO Plus 500GB disk nvme nvme0n1 01:00.0 Non-Volatile memory controller: Samsung Electronics Co Ltd NVMe SSD Controller SM981/PM981 $ --8<---------------cut here---------------end--------------->8--- What /is/has been/ on your machines? Could your improved times be part from SSD/controller changes? There's really a huge difference between SATA and 4-lane pci (where both ends can handle it, which may require fw update or not be available) Obviously 4 lanes is also going to be faster than one. -- Regards, Bengt Richter