From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp12.migadu.com ([2001:41d0:403:478a::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms9.migadu.com with LMTPS id 4PSbNOiHBWXiyAAAauVa8A:P1 (envelope-from ) for ; Sat, 16 Sep 2023 12:48:09 +0200 Received: from aspmx1.migadu.com ([2001:41d0:403:478a::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp12.migadu.com with LMTPS id 4PSbNOiHBWXiyAAAauVa8A (envelope-from ) for ; Sat, 16 Sep 2023 12:48:08 +0200 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 3D8CB53DD8 for ; Sat, 16 Sep 2023 12:48:08 +0200 (CEST) Authentication-Results: aspmx1.migadu.com; dkim=fail ("headers rsa verify failed") header.d=gmail.com header.s=20230601 header.b=RWWH9x+n; dmarc=fail reason="SPF not aligned (relaxed)" header.from=gmail.com (policy=none); spf=pass (aspmx1.migadu.com: domain of "bug-guix-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="bug-guix-bounces+larch=yhetil.org@gnu.org" ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1694861288; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:resent-cc:resent-from:resent-sender: resent-message-id:in-reply-to:in-reply-to:references:references: list-id:list-help:list-unsubscribe:list-subscribe:list-post: dkim-signature; bh=9D+emSAYB57FbOmZoQQZt0FGyzA6LA5YfifIFhXBtXw=; b=jLHPDuXl3Hgh7wAdE3cjY3qrpXSRtGu2yvSZjxVKIS5G/ytUTZu6mfw+SDMkRduNu1lRbx p/INEKZuElb/HHldCHMeHdj4aWCZOECen7vXpX3Cx2VQtRxMCI7XQzFhZRmwgXo+5/x3ti BmD1CtsfcVITOq214cCkSBXxRFU2X2vv7YGXZ8KdfafFSqTSAJkbtEel+I0Wof7E9jNmOd tSgR6u/288wMsIOt2C0cFX/3Cu39J/C4a68eue1qbmWXg79Jmf42Q6CfII8w3lz8jYiNs/ V/ukp60teFWpWt0McLc/9dTxV3YcynTWt6M89VocWuj8GIVe/k57DOBzZTA3EQ== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1694861288; a=rsa-sha256; cv=none; b=S8ZOr+Eb0ArrWhsGWOQISEqNLqopkepKaigMtwjRcyix/5wlWH/8uxMqP5nAccVQgV6L67 /HfhxEXJJ4+SZLpg7JYMl81WfHJtgy7sBzD64Hq5Vx3mtdgHv01/qu3a+6WVxrdyijJ5V0 ZvnjD4WpHpxzmqMbJgovjHfaQmoDva2sFkY8wO6u1d6C5Aa/sbLYbaQkyGycqEv+6/6rYB lKmj0rTEKTx1T16yxuCmMvwFfTSj37AvRFu6oCnYLTsSfqt/V2gOQSiE8Fm8zv/a41gToa CEBgpiU+i+QWr8OnpvOia9SkFz521Q7cXweh5K+GOy4jphaVnaNZN5juAlT2pg== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=fail ("headers rsa verify failed") header.d=gmail.com header.s=20230601 header.b=RWWH9x+n; dmarc=fail reason="SPF not aligned (relaxed)" header.from=gmail.com (policy=none); spf=pass (aspmx1.migadu.com: domain of "bug-guix-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="bug-guix-bounces+larch=yhetil.org@gnu.org" Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1qhSqD-0003JY-I1; Sat, 16 Sep 2023 06:47:57 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1qhSqB-0003JC-7N for bug-guix@gnu.org; Sat, 16 Sep 2023 06:47:55 -0400 Received: from debbugs.gnu.org ([2001:470:142:5::43]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1qhSqA-00074H-Vq for bug-guix@gnu.org; Sat, 16 Sep 2023 06:47:55 -0400 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1qhSqH-0004k7-TJ for bug-guix@gnu.org; Sat, 16 Sep 2023 06:48:01 -0400 X-Loop: help-debbugs@gnu.org Subject: bug#63986: Julia is very slow Resent-From: Simon Tournier Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Sat, 16 Sep 2023 10:48:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 63986 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: Efraim Flashner , Ludovic =?UTF-8?Q?Court=C3=A8s?= Cc: 63986@debbugs.gnu.org, Nicolas Graves , csantosb@inventati.org Received: via spool by 63986-submit@debbugs.gnu.org id=B63986.169486127418176 (code B ref 63986); Sat, 16 Sep 2023 10:48:01 +0000 Received: (at 63986) by debbugs.gnu.org; 16 Sep 2023 10:47:54 +0000 Received: from localhost ([127.0.0.1]:45489 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1qhSqA-0004j3-0N for submit@debbugs.gnu.org; Sat, 16 Sep 2023 06:47:54 -0400 Received: from mail-wm1-x32d.google.com ([2a00:1450:4864:20::32d]:41032) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1qhSq7-0004iI-P6 for 63986@debbugs.gnu.org; Sat, 16 Sep 2023 06:47:52 -0400 Received: by mail-wm1-x32d.google.com with SMTP id 5b1f17b1804b1-3fe4f3b5f25so9068215e9.0 for <63986@debbugs.gnu.org>; Sat, 16 Sep 2023 03:47:44 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1694861258; x=1695466058; darn=debbugs.gnu.org; h=mime-version:message-id:date:references:in-reply-to:subject:cc:to :from:from:to:cc:subject:date:message-id:reply-to; bh=9D+emSAYB57FbOmZoQQZt0FGyzA6LA5YfifIFhXBtXw=; b=RWWH9x+nALmGNhw8aR5oQfyomhtFXi5zgMjWoa44RQm0YOu07JMS1kMK6XCzGkbxW5 mr1RHc9NFAmQ8G2rrF+6XWniddbmPsFfAUZPGE0pBrpJlf49xIeYhiu+0VsapjuApoQn XEUXu70LFYlff5ii7WuUjDgENOTvczL3Domd+HtYRgdNlUOeNWHvso42mWP1FnjV4BcX 1qRGMlJR0i9A/VVX2K6mWgQFEOK1PXixkBHYkEMfW7gME6cyyP4TvQnJ61/T682op00M j70ihQT9n9Jy1SwZtHPmgQbGewPZWN6V7LtJrD7evAaljZcUeIz6quWfcvdfb3Do8q54 qc9g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1694861258; x=1695466058; h=mime-version:message-id:date:references:in-reply-to:subject:cc:to :from:x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=9D+emSAYB57FbOmZoQQZt0FGyzA6LA5YfifIFhXBtXw=; b=AR9oovMqmctiE2sz7fbAZ0JslasOfzSxISWFX2nUtnszISb4s2yeHLkgONyovj2ntV f7WhsqZdYZv+BdyO2nfS4hxyX7ciuSQWjPbn9RDJTtZHfAo/SJUq6F/NY5+oDdw1iQU8 fa66kZFNMhlqN/VKIyIqzoV2/MyVQ4ph4QtNn2qCuYKA1O+kNjxBGyu8tO7iVgWIPpZ1 DvIn9AtC5I5oZEiOsMlEOatQ5A8kKuLQSYRMSjFOS0t4TEhZExgpo2WAI6on3QwCYxBf isZySjvTlMazH4Q+dJLH77/bQQr1/9LWzx0RVKPlLO7prmK7GfBAPRlwlZ+B7HzagL3x F86w== X-Gm-Message-State: AOJu0Yzc2lmjoipHDbK9fW152LG4NptvT8u8WVAyM8pK20iHV+7He5j7 33/KHw5YCcCmx2QvFIOCI7A= X-Google-Smtp-Source: AGHT+IFuH0D1/82zrLnSgpmI5+k/56YnZNB7BMEEyOUSW8zVVb9P0lbONqt3ECDS8IE+KapqIIOcAA== X-Received: by 2002:a5d:4451:0:b0:317:3a23:4855 with SMTP id x17-20020a5d4451000000b003173a234855mr3070905wrr.2.1694861258239; Sat, 16 Sep 2023 03:47:38 -0700 (PDT) Received: from pfiuh07 ([193.48.40.241]) by smtp.gmail.com with ESMTPSA id s1-20020a5d4ec1000000b0031fbbe347e1sm6843575wrv.65.2023.09.16.03.47.36 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sat, 16 Sep 2023 03:47:37 -0700 (PDT) From: Simon Tournier In-Reply-To: References: <87wmzvmxt8.fsf@inventati.org> <87h6qz8pg0.fsf@gmail.com> <87cz1n8lq3.fsf@gmail.com> <871qi24k9z.fsf@inria.fr> <87h6qy71oa.fsf@gmail.com> <87o7kpku0u.fsf@gnu.org> <87jztpqvtz.fsf@gnu.org> Date: Sat, 16 Sep 2023 12:47:32 +0200 Message-ID: <87v8ca8ke3.fsf@gmail.com> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="=-=-=" X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-BeenThere: bug-guix@gnu.org List-Id: Bug reports for GNU Guix List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-guix-bounces+larch=yhetil.org@gnu.org Sender: bug-guix-bounces+larch=yhetil.org@gnu.org X-Migadu-Flow: FLOW_IN X-Migadu-Country: US X-Migadu-Spam-Score: 5.73 X-Spam-Score: 5.73 X-Migadu-Queue-Id: 3D8CB53DD8 X-Migadu-Scanner: mx0.migadu.com X-TUID: EhUmQ+VUPYtR --=-=-= Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Hi Efraim, On Thu, 14 Sep 2023 at 13:33, Efraim Flashner wrote: > On Sun, Aug 20, 2023 at 10:53:44PM +0200, Ludovic Court=C3=A8s wrote: > I've attached a diff to adjust openblas64 and to use it for x86_64 in > julia. I don't know if it's faster than the current openblas. I have applied the diff and turned into two patches. Attached below. Then, I have sent the cover-letter to guix-patches where you are CC. The idea was to trigger the Julia world rebuild. However, I do not get back any Debbugs ID for sending the two patches. I think that before pushing the change to master, we should wait that QA builds some substitutes. It will reduce the annoyance for user since some Julia paackages are long to build. I have no time today for waiting after some Debbugs troubles. Cheers, simon --=-=-= Content-Type: text/x-diff Content-Disposition: inline; filename=0000-cover-letter.patch Content-Description: cover-letter >From 7f2347d8e64562e1de563cf1e4cdfd192e81a9df Mon Sep 17 00:00:00 2001 Message-Id: From: Simon Tournier X-Debbugs-CC: Efraim Flashner , Cayetano Santos , Date: Sat, 16 Sep 2023 12:17:57 +0200 Subject: [PATCH 0/2] Fix bug#63986: Julia is very slow Hi, This series is for triggering the rebuild of the Julia world. Some Julia packages are long to build so let minimize the annoyance and make some substitutes available before pushing to master. :-) bug#63986: Julia is very slow Cayetano Santos via Bug reports for GNU Guix Fri, 09 Jun 2023 23:42:00 +0200 id:87legsl3cm.fsf@inventati.org https://yhetil.org/guix/87legsl3cm.fsf@inventati.org https://issues.guix.gnu.org/msgid/87legsl3cm.fsf@inventati.org Cheers, simon Efraim Flashner (2): gnu: openblas-ilp64: Add symbol suffix. gnu: julia: Conditionally use openblas with ILP64 support. gnu/packages/julia.scm | 22 ++++++++++++++-------- gnu/packages/maths.scm | 4 +++- 2 files changed, 17 insertions(+), 9 deletions(-) base-commit: eeec8371890fc95c60112da299dde78b21c948c2 -- 2.38.1 --=-=-= Content-Type: text/x-diff Content-Disposition: inline; filename=0001-gnu-openblas-ilp64-Add-symbol-suffix.patch Content-Description: openblas >From 2f044415efb5dc5703bf2b09439c6f5e2fd1fd72 Mon Sep 17 00:00:00 2001 Message-Id: <2f044415efb5dc5703bf2b09439c6f5e2fd1fd72.1694859477.git.zimon.toutoune@gmail.com> In-Reply-To: References: From: Efraim Flashner Date: Sat, 16 Sep 2023 11:59:28 +0200 Subject: [PATCH 1/2] gnu: openblas-ilp64: Add symbol suffix. * gnu/packages/maths.scm (openblas-ilp64)[arguments]<#:make-flags>: Add the symbol '64_' as suffix. --- gnu/packages/maths.scm | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/gnu/packages/maths.scm b/gnu/packages/maths.scm index 6141c0988612..c051e60d5e40 100644 --- a/gnu/packages/maths.scm +++ b/gnu/packages/maths.scm @@ -4638,7 +4638,9 @@ (define-public openblas-ilp64 (arguments (substitute-keyword-arguments (package-arguments openblas) ((#:make-flags flags #~'()) - #~(append (list "INTERFACE64=1" "LIBNAMESUFFIX=ilp64") + #~(append (list "INTERFACE64=1" + "SYMBOLSUFFIX=64_" + "LIBPREFIX=libopenblas64_") #$flags)))) (synopsis "Optimized BLAS library based on GotoBLAS (ILP64 version)") (license license:bsd-3))) -- 2.38.1 --=-=-= Content-Type: text/x-diff Content-Disposition: inline; filename=0002-gnu-julia-Conditionally-use-openblas-with-ILP64-supp.patch Content-Description: julia >From 7f2347d8e64562e1de563cf1e4cdfd192e81a9df Mon Sep 17 00:00:00 2001 Message-Id: <7f2347d8e64562e1de563cf1e4cdfd192e81a9df.1694859477.git.zimon.toutoune@gmail.com> In-Reply-To: References: From: Efraim Flashner Date: Sat, 16 Sep 2023 12:05:41 +0200 Subject: [PATCH 2/2] gnu: julia: Conditionally use openblas with ILP64 support. Fixes . Reported by Cayetano Santos . * gnu/packages/julia.scm (julia)[arguments]<#:phases>: Conditionally use OpenBLAS with ILP64 support for x86-64 target. <#:make-flags>: Likewise. [inputs]: Conditionally replace openblas by openblas-ilp64 for x86-64 target. Co-authored-by: Simon Tournier --- gnu/packages/julia.scm | 22 ++++++++++++++-------- 1 file changed, 14 insertions(+), 8 deletions(-) diff --git a/gnu/packages/julia.scm b/gnu/packages/julia.scm index ba541758223e..8ba2b480ce55 100644 --- a/gnu/packages/julia.scm +++ b/gnu/packages/julia.scm @@ -269,7 +269,10 @@ (define-public julia (substitute* (jlpath "nghttp2") (((from "libnghttp2")) (to "libnghttp2" "libnghttp2"))) (substitute* (jlpath "OpenBLAS") - (((from "libopenblas")) (to "openblas" "libopenblas"))) + (((from "libopenblas")) + ,@(if (target-x86-64?) + `((to "openblas" "libopenblas64_" "libopenblas")) + `((to "openblas" "libopenblas"))))) (substitute* (jlpath "OpenLibm") (((from "libopenlibm")) (to "openlibm" "libopenlibm"))) (substitute* (jlpath "PCRE2") @@ -479,12 +482,13 @@ (define-public julia "NO_GIT=1" ; build from release tarball. "USE_GPL_LIBS=1" ; proudly - ,@(if (target-aarch64?) - `("USE_BLAS64=0") - '()) - - "LIBBLAS=-lopenblas" - "LIBBLASNAME=libopenblas" + ,@(if (target-x86-64?) + `("USE_BLAS64=1" + "LIBBLAS=-lopenblas64_" + "LIBBLASNAME=libopenblas64_") + `("USE_BLAS64=0" + "LIBBLAS=-lopenblas" + "LIBBLASNAME=libopenblas")) (string-append "UTF8PROC_INC=" (assoc-ref %build-inputs "utf8proc") @@ -513,7 +517,9 @@ (define-public julia ("llvm" ,llvm-julia) ("mbedtls-apache" ,mbedtls-apache) ("mpfr" ,mpfr) - ("openblas" ,openblas) + ,@(if (target-x86-64?) + `(("openblas" ,openblas-ilp64)) + `(("openblas" ,openblas))) ("openlibm" ,openlibm) ("p7zip" ,p7zip) ("pcre2" ,pcre2) -- 2.38.1 --=-=-=--