From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp1.migadu.com ([2001:41d0:303:e224::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms13.migadu.com with LMTPS id mGPoL7cgXGdk+wAA62LTzQ:P1 (envelope-from ) for ; Fri, 13 Dec 2024 11:55:35 +0000 Received: from aspmx1.migadu.com ([2001:41d0:303:e224::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp1.migadu.com with LMTPS id mGPoL7cgXGdk+wAA62LTzQ (envelope-from ) for ; Fri, 13 Dec 2024 12:55:35 +0100 X-Envelope-To: larch@yhetil.org Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=debbugs.gnu.org header.s=debbugs-gnu-org header.b=AgGZALzx; dkim=fail ("headers rsa verify failed") header.d=gmail.com header.s=20230601 header.b=MRIu9YdM; dmarc=none; spf=pass (aspmx1.migadu.com: domain of "bug-guix-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="bug-guix-bounces+larch=yhetil.org@gnu.org" ARC-Seal: i=1; s=key1; d=yhetil.org; t=1734090935; a=rsa-sha256; cv=none; b=pLhkMlYXgHTLLl/YIF97ypGjXG6Qhvb3sCWu507uXFTduRWLVCtr2axUvnVqMw/Y/4MQcg hpjk43d7WKM44YE1oaFJAwTvIe8JBFPQ3H9Sn760i26rQYbwQbFynSMI9xa5qJnfXCc6cj a+kHNbObn6Og/tW2Or34J5i3vrIouwyf3ptYyGoVbyO+9IxW+Hq9iSi+UMWllZjOXnYq1g knwUEY6hP0LebZvhXbHPv3JHBJlAmK5VLu14RGQMztGRnMQkaZpJjr3OcNICw6rTjp5eHn gR2/gcj8iw6OPhKn+Q4rdH1L1TKM0Y9Jv9948mjlFze6uS+kjEHW4izm9pgRZQ== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=pass header.d=debbugs.gnu.org header.s=debbugs-gnu-org header.b=AgGZALzx; dkim=fail ("headers rsa verify failed") header.d=gmail.com header.s=20230601 header.b=MRIu9YdM; dmarc=none; spf=pass (aspmx1.migadu.com: domain of "bug-guix-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="bug-guix-bounces+larch=yhetil.org@gnu.org" ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1734090935; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:resent-cc:resent-from:resent-sender: resent-message-id:in-reply-to:in-reply-to:references:references: list-id:list-help:list-unsubscribe:list-subscribe:list-post: dkim-signature; bh=U1ojSDIo+reafpOfQyh3XgTlliX1twFBH0kOzVzO/J4=; b=ATLWWnsdHpzkDZzbkLyDaAOH8oKOO/Qkp8yhqDOridMpJWtGU19oKVWmy/PhhzWoL4iXok IG3I8VXRKHjRkz89su8dI7F1xT4DQ/sd0+CqOtL1FOAhSqA2ACiN93vBc2iKwhSix2//oN 1ci3eh2CIxX0Xkb59plpPHooR1Qd4WZJVvzIPGRxy0d01sZgLInW4B3SwsixJXsDjvPp1o qTGLsv5Tvmd4c3tw8GaZq8jWeNyKVyesewz47hKJj1vYWWWBCf30OEKxwU2xA/fRcmiWbS gHn1tWQCywR7KkrR0HckmFPq3XJqk11VR/YS5GGGTNOrakkQ4h66fdqwbEmCYA== Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 8E5EF70A3 for ; Fri, 13 Dec 2024 12:55:35 +0100 (CET) Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1tM4GG-00055u-3v; Fri, 13 Dec 2024 06:55:12 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1tM4G7-0004yq-3f for bug-guix@gnu.org; Fri, 13 Dec 2024 06:55:05 -0500 Received: from debbugs.gnu.org ([2001:470:142:5::43]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1tM4G6-0006oD-O8 for bug-guix@gnu.org; Fri, 13 Dec 2024 06:55:02 -0500 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=debbugs.gnu.org; s=debbugs-gnu-org; h=In-Reply-To:MIME-Version:References:From:Date:To:Subject; bh=U1ojSDIo+reafpOfQyh3XgTlliX1twFBH0kOzVzO/J4=; b=AgGZALzxPWKbdAaB6LeNtLXgYI8sMf+v5HYdzGy3JvU44MqqvB3z/HFf46iIuo23oT63qLupasfjGZag2OyzcaZGQR8dGLnH/5k3ry7SGcWPYxr7vDFThQ5zDqtqa9T7HSJCjI7koFidFHdSmFXQh1jKDVSq2sXzXIkL2LKJhzoTYm2D1IGdVl6F6gcWNNCH5PEW8w4MKJv+/q2wizqTXYs93WveLjSRQu3FCQxPDtv3MrXkY3a4cLTdegQSW9JkEI/5J3Zqu1nj/0xnLx7c70nCSAfwLPy/teS3QAoC0/ac6ntN+/e9MHyOsKIe5joErT8L4NoZWtiXQeQNbTsJEA==; Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1tM4G6-0001rQ-9i for bug-guix@gnu.org; Fri, 13 Dec 2024 06:55:02 -0500 X-Loop: help-debbugs@gnu.org Subject: bug#74142: [rust-team] rust-bootstrap fails parallel build on x86-64 Resent-From: Efraim Flashner Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Fri, 13 Dec 2024 11:55:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 74142 X-GNU-PR-Package: guix X-GNU-PR-Keywords: confirmed To: Maxim Cournoyer Cc: 74142@debbugs.gnu.org, Greg Hogan Received: via spool by 74142-submit@debbugs.gnu.org id=B74142.17340908557080 (code B ref 74142); Fri, 13 Dec 2024 11:55:02 +0000 Received: (at 74142) by debbugs.gnu.org; 13 Dec 2024 11:54:15 +0000 Received: from localhost ([127.0.0.1]:41842 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1tM4FL-0001q8-6k for submit@debbugs.gnu.org; Fri, 13 Dec 2024 06:54:15 -0500 Received: from mail-wm1-f47.google.com ([209.85.128.47]:50586) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1tM4FH-0001pm-5j for 74142@debbugs.gnu.org; Fri, 13 Dec 2024 06:54:13 -0500 Received: by mail-wm1-f47.google.com with SMTP id 5b1f17b1804b1-43622354a3eso11658475e9.1 for <74142@debbugs.gnu.org>; Fri, 13 Dec 2024 03:54:11 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1734090785; x=1734695585; darn=debbugs.gnu.org; h=in-reply-to:content-disposition:mime-version:references :mail-followup-to:message-id:subject:cc:to:from:date:sender:from:to :cc:subject:date:message-id:reply-to; bh=U1ojSDIo+reafpOfQyh3XgTlliX1twFBH0kOzVzO/J4=; b=MRIu9YdMEyDhAX8Y2h1eayQp1gR5u8dTSv6IMfbnhyyiMw0/VUOygr0JXkf/NDrCjf XN9VHQqhCi02d3/+QWMlt8x6rQIjAElW6rB9AUGg2GJE4Hhlx+JrIXO3DFmtooopSaOi edBPaFIf8e6h8+K2J0nM+5qhHME+RAFGXgRU+axGBTRctCFEjj3voP33n+SwQMMA+/kR ge2BpyzZE3x5lIYy4QVogRI1lflT9PrO98f/3mpiisTI8uL55tP6+9zB7tvClBXfCEb6 ZI7+2sGdwYB6ri4X5Ynz6cFtQy/KwQDbk8jtVKJcg3Sym/76pDHcIhrjFiaJ0PA5ZD6P 3wSA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1734090785; x=1734695585; h=in-reply-to:content-disposition:mime-version:references :mail-followup-to:message-id:subject:cc:to:from:date:sender :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=U1ojSDIo+reafpOfQyh3XgTlliX1twFBH0kOzVzO/J4=; b=fpxGYfCTEFJ0RF46CVPztrMu8m8m3TUvVQuSLA6tdD+77GDK5B2o04FOKOFG0/pQVH eoHSZbx1Cbrv31LyhP/UdYRcmnxG0UT6Y8A276mCdN0opDKW4L+X6WLTvi5YQGdByWS+ ItKuR9JXrOnF+39LJvPNGn6w7pScRaGz9IF0c8kA4Gk2B9HY4s7auiYLTreuAIDljvf3 rwISXcPSARyxhoGV3E8e1oFEKSAaKX+7M2cORfLxA9nDoAOr9/L91Y61FxeClLMFIwuD f2U0fLuaG7mftKk4UV8WVrR+oQKBI4Luaq1glTcE0FBNbJu6QNovOK5w926GGVfdmoty a8ng== X-Forwarded-Encrypted: i=1; AJvYcCVhmjGCmgZfEfbT3dApjfp8B8eOrEEXzZ7Cu6gAMLSzIBOXY/fN6CZMRz4In0ddgyiwgdfH4Q==@debbugs.gnu.org X-Gm-Message-State: AOJu0Ywy1UMp4KS6XXN/aYVRgjn0hUrphrndH0gMKbZ4OXN2VKZfw9K9 PwtfQ95qOVkGu6QR6JIC0l80SblTlJ9nv9VDPKthP4t1azMM7nvn X-Gm-Gg: ASbGnctumknq5kfL3mxg8niHAl20cwHJW/3E1bguBDh0L/Qj4VOsBJmMRFvNXD+wvSN LBCQzHXTNuQZu7p2hX0+3hwxqoQT7q0kUh7fNN7AU9xJJ2eAUNnwDA3/KADactWznSL+gEKJPWt SCuW3JBAvuC2Q5HTvg9uBwRd4iMkNravxW+wV+M2S4WA0ZP2oLL6x897qGZ8uAzOOJZUTuqPuZZ i0Ofv7mzZnSU1IEMJaJwnHb328/YsQXmp+NiSwl6SPMlRMHT7x2DPXN X-Google-Smtp-Source: AGHT+IHEo8pDLcFmunqC7i7jLzBenOnZDhJCyGl0vCi81N5ytDyFljhMS4a0YJ9jzJ0XGa+oynkQbA== X-Received: by 2002:a05:600c:1c9f:b0:434:a923:9310 with SMTP id 5b1f17b1804b1-4362aa58ab4mr18174505e9.15.1734090784869; Fri, 13 Dec 2024 03:53:04 -0800 (PST) Received: from localhost ([31.210.180.118]) by smtp.gmail.com with ESMTPSA id 5b1f17b1804b1-436256b44f4sm46678005e9.30.2024.12.13.03.53.02 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 13 Dec 2024 03:53:03 -0800 (PST) Date: Fri, 13 Dec 2024 13:53:01 +0200 From: Efraim Flashner Message-ID: Mail-Followup-To: Efraim Flashner , Maxim Cournoyer , Greg Hogan , 74142@debbugs.gnu.org References: <87msh7k3nn.fsf@gmail.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="waW8qPcs0TGQkMuR" Content-Disposition: inline In-Reply-To: <87msh7k3nn.fsf@gmail.com> X-PGP-Key-ID: 0x41AAE7DCCA3D8351 X-PGP-Key: https://flashner.co.il/~efraim/efraim_flashner.asc X-PGP-Fingerprint: A28B F40C 3E55 1372 662D 14F7 41AA E7DC CA3D 8351 X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-BeenThere: bug-guix@gnu.org List-Id: Bug reports for GNU Guix List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-guix-bounces+larch=yhetil.org@gnu.org Sender: bug-guix-bounces+larch=yhetil.org@gnu.org X-Migadu-Flow: FLOW_IN X-Migadu-Country: US X-Migadu-Spam-Score: -5.69 X-Spam-Score: -5.69 X-Migadu-Queue-Id: 8E5EF70A3 X-Migadu-Scanner: mx12.migadu.com X-TUID: 2ED/jPZtAC2x --waW8qPcs0TGQkMuR Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sat, Dec 07, 2024 at 10:45:32PM +0900, Maxim Cournoyer wrote: > Hi, >=20 > Greg Hogan writes: >=20 > > On Sun, Nov 3, 2024 at 2:49=E2=80=AFAM Efraim Flashner wrote: > >> > >> On Thu, Oct 31, 2024 at 03:13:40PM -0400, Greg Hogan wrote: > >> > derivation: 83qbfg0xxsfr5lsc81m5a770c7c7b55k-rust-1.54.0.drv > >> > commit: 6e50b0c56a8cc767bd3acb26638f78c450bde718 > >> > > >> > Build log attached, tail portion below. Has consistently failed to > >> > build unless cores=3D1. > >> > > >> > The package definition has "#:parallel-build? ,(target-x86-64?)" but > >> > the noted build issue ("race conditions between various dependent > >> > crates") is also seen on x86-64. > >> > > >> > It is only the 1.54 build with mrustc that fails in this manner, the > >> > following rust packages in the chain build fine with parallelism > >> > enabled. > >> > > >> > Greg > >> > >> I see the note there says something about ppc64le having a race > >> condition too. My machine has "only" 24 cores, so I didn't run into > >> anything, but I see you're building with 32 cores. IIRC the ppc64le > >> machine was building with at least 32 cores also. > >> > >> Can you try building rust-1.54 with only 24 cores and see if that works > >> for you? If it does then I think we can switch the (job-count) variable > >> to (min 24 (parallel-job-count)) > > > > Log attached from what looks to be a similar failure on an 8 core insta= nce. >=20 > I encountered the same problem on a 32 "cores" (aka threads) machine. > I've reported it here [0]. >=20 > [0] https://github.com/thepowersgang/mrustc/issues/343 I followed up with Mutabah (the main author) on IRC and a bit on the bug tracker, and their suggestion is to use a later commit from mrustc. I used the latest commit from the master branch but there I ran into issues on aarch64 not building correctly. From there they basically said that they were focused on getting 1.74 bootstrapped, and they weren't going to be circling back to the master branch until 1.74 was merged. I went and tried out the rust_1.74 branch which is nearing completion and that one built without any issues on x86_64 but failed for different reasons on aarch64, powerpc64le and riscv64. Someone from Gentoo was also asking around, they're interested in using mrustc to bootstrap rust-1.74 and continuing on from there, so it's likely we'll get some help going forward with architecture support. I think in the meantime while it's not ready I'll change the parallel-builds? flag to false for everyone, and then I'll continue working on getting the bootstrap to work on the other architectures. The good news is it only takes about 15 minutes to fail on aarch64 and powerpc64le, so those should go pretty quickly through each iteration. I might need to try some by-hand builds on riscv64; that one was closer to 2 hours. Mutabah also said that their primary target is x86_64 and they don't have the hardware to test other architectures, so its more hit-or-miss there, and they rely on patches from others to get those ports working as well as they do. I don't love the answer, but I don't blame them. I'll probably focus on aarch64 first since I can offload that easily and I don't need to use a remote GUIX_DAEMON_SOCKET to get it to build, but unfortunately it looks like we're sticking with 1.54 for a while. --=20 Efraim Flashner =D7=90=D7=A4=D7=A8=D7=99=D7=9D = =D7=A4=D7=9C=D7=A9=D7=A0=D7=A8 GPG key =3D A28B F40C 3E55 1372 662D 14F7 41AA E7DC CA3D 8351 Confidentiality cannot be guaranteed on emails sent or received unencrypted --waW8qPcs0TGQkMuR Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEEoov0DD5VE3JmLRT3Qarn3Mo9g1EFAmdcIBoACgkQQarn3Mo9 g1Fv6g/9HFhxg3CL7uH8AuJRtksFGkGLlWWhCC8ESm3FFLAKjLPN7RQa20SL1Z7c W912afiy6Jyv0uBJSinjrCY971XHBIz54/34K5NWPz80VsLjGjZl6O3xp2mPAEeT m9rXCZF8ToWuTCQq+AlPmlGeACuGTHs07EPKYZ4f7THUd88qAgwtaq7+AfFsjpaA 3rBO3JYr8iUaTQvopI51XTA3j1Z0DhRkdLXWRCyrgjKjCcXNodb5hB133i9PdUhl /xCg/zn3z7o571eCO2Az1533zROkCQJp0AHo3yDv4/tDZ8u3YggCl79t3TGn+jHU GU/5+Zl4XZv9bkY2ibH19Id/j2uvbi8PtlgVkYozpjoFnntInzKiyywVLytT1DXx 1H9gWOEz6VFpUKCJbSPl+FqT1y+0Pl+Zl4eukXKfXDbRl1ObcUa9xuqDDoWrYRHS 0VCIgG/d/+2GCGKvudXjFqhHzN/ZbulwMouIAIgIh2cvaLfp1heez7dzsB0mXtdk /BgtNgL8Tdee7UOvr24PpKFnJQbM3ZEOy0aiJ3FFjsAYd2tHf1/f4NxFaOhx5uHW t1N4GNNAUknYKMXW5c8FARar/F3aZWkK71sfShHJ9zFhzeJnCo5EtuDQcjIZrdEE vn75b5+nBedQJG9jkJpJDJCtCUH5jMN/7fGXJuCcdUkrLEBsmfg= =B2OL -----END PGP SIGNATURE----- --waW8qPcs0TGQkMuR--