From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp12.migadu.com ([2001:41d0:8:6d80::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id YEurHAU85mEvLwEAgWs5BA (envelope-from ) for ; Tue, 18 Jan 2022 05:03:17 +0100 Received: from aspmx1.migadu.com ([2001:41d0:8:6d80::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp12.migadu.com with LMTPS id 6GNUGQU85mFJLQAAauVa8A (envelope-from ) for ; Tue, 18 Jan 2022 05:03:17 +0100 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 11EBF2420C for ; Tue, 18 Jan 2022 05:03:17 +0100 (CET) Received: from localhost ([::1]:36326 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1n9fiF-00030o-Sa for larch@yhetil.org; Mon, 17 Jan 2022 23:03:15 -0500 Received: from eggs.gnu.org ([209.51.188.92]:41650) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1n9fi2-00030g-N7 for guix-patches@gnu.org; Mon, 17 Jan 2022 23:03:02 -0500 Received: from debbugs.gnu.org ([209.51.188.43]:55655) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1n9fi2-00017P-Di for guix-patches@gnu.org; Mon, 17 Jan 2022 23:03:02 -0500 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1n9fi2-0002FT-3o for guix-patches@gnu.org; Mon, 17 Jan 2022 23:03:02 -0500 X-Loop: help-debbugs@gnu.org Subject: [bug#48463] gnu: Add j. Resent-From: elaexuotee@wilsonb.com Original-Sender: "Debbugs-submit" Resent-CC: guix-patches@gnu.org Resent-Date: Tue, 18 Jan 2022 04:03:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 48463 X-GNU-PR-Package: guix-patches X-GNU-PR-Keywords: patch To: Liliana Marie Prikler Cc: Maxime Devos , 48463@debbugs.gnu.org Received: via spool by 48463-submit@debbugs.gnu.org id=B48463.16424785218556 (code B ref 48463); Tue, 18 Jan 2022 04:03:02 +0000 Received: (at 48463) by debbugs.gnu.org; 18 Jan 2022 04:02:01 +0000 Received: from localhost ([127.0.0.1]:48558 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1n9fh3-0002Ds-Cq for submit@debbugs.gnu.org; Mon, 17 Jan 2022 23:02:01 -0500 Received: from m42-5.mailgun.net ([69.72.42.5]:35842) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1n9fh1-0002DY-In for 48463@debbugs.gnu.org; Mon, 17 Jan 2022 23:02:00 -0500 DKIM-Signature: a=rsa-sha256; v=1; c=relaxed/relaxed; d=mg.wilsonb.com; q=dns/txt; s=krs; t=1642478519; h=Content-Transfer-Encoding: Content-Type: MIME-Version: Message-Id: In-Reply-To: References: From: Subject: Cc: To: Date: Sender; bh=R/Si6QKDrz/AYuK1pUMj0Y+B2Oj0QxiAOmjYpEWb8nE=; b=aTNKDg6WHA9OTzD2keD0l/0MG8+tWV+Y+YG5tr2bbTDFEt7zsGpxeOXYUIrxYS9/nwmkJkbL ZbxksPoP/nxwNLafQyVSBxFXXFcaN3nPCQU2gQCJzquU35pDKc6zTFJLX+bJQ4/OfoFZH9LL HL5UcNS/33tm0Ew31qsAKmtoUrH292E0dX0JuIHJlNSh/9sipLDNJFACB8Nd87Zc6gzB6VGS e8Zv5oXll7w1TFeubSi/bT2VSyRAbKfoj+CcadS+k+g11GWWTJClv6WXajTAtpU/5d8QgmlZ 7nM8/gTHl2NgMHfUyz173oQ4rFRiIELYNYk1acE/tVTNaJSdcI11RQ== X-Mailgun-Sending-Ip: 69.72.42.5 X-Mailgun-Sid: WyJjZGI4NCIsICI0ODQ2M0BkZWJidWdzLmdudS5vcmciLCAiMDg1NDdhIl0= Received: from wilsonb.com (wilsonb.com [104.199.203.42]) by smtp-out-n06.prod.us-east-1.postgun.com with SMTP id 61e63bb206362278a109fec1 (version=TLS1.3, cipher=TLS_AES_128_GCM_SHA256); Tue, 18 Jan 2022 04:01:54 GMT Received: from localhost (q045100.dynamic.ppp.asahi-net.or.jp [203.181.45.100]) by wilsonb.com (Postfix) with ESMTPSA id AE7B9A2E8B; Tue, 18 Jan 2022 04:01:48 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=wilsonb.com; s=201703; t=1642478509; bh=R/Si6QKDrz/AYuK1pUMj0Y+B2Oj0QxiAOmjYpEWb8nE=; h=Date:To:Cc:Subject:From:References:In-Reply-To:From; b=QHq+nGOdpmL1xxoUzQAhtZ8C07KO00hw68ACKe2DKq33fKZs2YTMTZW7i3kMzjbYP GlT/klW5Zl52wfYXu4yDfcJkGyBhWJCqh/IOJSQnwgnawXX+2LX46hGbhpXbZTSPdi 2Jn3DFeceKKNpu+Hpwh3BaVJhdRglZZsN/Hx6XcPP5lv2NdEg/tEcta4FZ9TsqFL6i AFQXbAkxK6urPRbRPI8nI/ff3LOftAbZCw0r5yxBbHsa2vvT6Fq0bIfNbNi/zWdY90 fYTW/asO74KvHS5MiDz11TDy6DXyKwSygcoa3bHEU+LmUmOv/7Cqq91K8206+vgDdR NAEchH/vJ6fpA5ZRQQMez0T2XdWWn/hfGE+1tBjD0gVHXpmwydyMbU1xdQ8lUmnT+u m7xkpypeVa4VzTeKI0WteLREIQbPMqr5W3NWIvp2LXtI3I+EPadVWv0TaU2j8GUH05 kr+HqNTD5DHuDjub5v/UqN712DqMRmXoUpn9KNpxVr/b/xJHXbY4R7gOPVQSch5qUp sSy0ANZoXPHmuWJQAdPCm6IAFrP2MEf5GoDiDwrcQF6ri54OHn1qjgW78EczC1sS4Y p8xgqtT2Cp6HzwxtGV1nbIgs/RqfjOISaUluH0GRpnwGNlC5WS9RQHo4DGZURXoF+0 ock1Cll7oYbKYDXHhiLt0FSg= Date: Tue, 18 Jan 2022 13:01:50 +0900 References: <3LOAUDT0FLL4U.2SOD925YP915T@wilsonb.com> <8b853d0585505ce29c9afc638b644fa34805e6c0.camel@student.tugraz.at> <293L8YPQS4CLB.3VK1B1A36XNAY@wilsonb.com> <5d30160bd2a4592459cd407f99cbd3edadb1db1b.camel@student.tugraz.at> <27DCD25Y68ZWJ.2HRC4G65PWIA7@wilsonb.com> <94f4625dcb0479d873cf60449631527e841fd457.camel@gmail.com> <2JQJMV0O718S1.31FZE8GKCTLPF@wilsonb.com> <90704c2259f576a14fb1268219e8c0dc2b3bf289.camel@telenet.be> <2P322C327XW0Q.21O5A4IFGMNDI@wilsonb.com> <72aff035c93f9f91afa54ef5b51c7381b0b02ccb.camel@gmail.com> <3MMTDZQJQ8IR6.334ZWY8AD0487@wilsonb.com> <62d37956f16c08bc4ce26e44da16dce704ddd0f8.camel@gmail.com> <24ZUUMG4QYSHN.2OS7YAMCKREUA@wilsonb.com> <83aba994536bec60f79900d551d4801c967742bd.camel@gmail.com> <25Z6NGGGNJYD1.3S7A1QLFX7I9Y@wilsonb.com> <24FU0VP6N4ZZ7.3PE5LG30BSNUQ@wilsonb.com> <2EZU214MJAIBY.3EXSPSUMS5WW5@wilsonb.com> In-Reply-To: Message-Id: <3T4YAXDRKZCAW.2LXSUL7VDA46J@wilsonb.com> User-Agent: mblaze/1.1 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-BeenThere: guix-patches@gnu.org List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-patches-bounces+larch=yhetil.org@gnu.org Sender: "Guix-patches" Reply-to: elaexuotee@wilsonb.com X-ACL-Warn: , elaexuotee--- via Guix-patches From: elaexuotee--- via Guix-patches via X-Migadu-Flow: FLOW_IN X-Migadu-Country: US ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1642478597; h=from:from:sender:sender:reply-to:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding:resent-cc: resent-from:resent-sender:resent-message-id:in-reply-to:in-reply-to: references:references:list-id:list-help:list-unsubscribe: list-subscribe:list-post:dkim-signature; bh=R/Si6QKDrz/AYuK1pUMj0Y+B2Oj0QxiAOmjYpEWb8nE=; b=bBSfopx+io64o4VYallyMKJUeSqTE3i6dQuP6cf2Bzs3hr5WSBjUakva+/OKaVtvXdHbbo rm2ROQN84pG0t9cjW/45nNE7Zn9CV+l0AjvgPOKKrv97ZcAmAoqWQVwPOL13P9U/p3BHKH VEEEQr1DvdXUprbgOFOt7gKkC4N8q3IL3dQT3YzxtFVfwktvFYjVIC3C6a7BANoTBZcsez a0WcBwiuLx3NKZQRbEwHSTZh8MDKpZz/Xl2uR4M5Bt40np7iheVj9VVjuWlK4fP2v0jZTT ZGU6pyLCANJ8Gu4Jk73US7bauqv8eTjSYygzaA6Aksq4TTYDDGh469+SRjGcrw== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1642478597; a=rsa-sha256; cv=none; b=q+a9vvdJE9poa7iRcrza1I6jsKojbvpQrKdv6+jNbBc29rO9eqU2jbEsC5sYohhBTHk6n4 BaAxL4uNu6ZDxasgeysXrs/5BBxFDNupJhm1e59nB8raYh+MOiPXKxsMhNyURRyvO/KED6 2Axs/9uGyGZfQHA4WdhiZdEQjuXbXJeyRXBuAOrIPVT367CNNIShQf+QUVyZlNKBnI2dJZ uhto9rMHvk/sYOkCBQVY/97x35Va0ORjdaWRIkYgtQ0nUPhRMIjazq6ABVcuJz21Uojm68 +f5GSjZ2NOj5nK8RKVm7sjHOvm0EQWQlb9bWLiCN/TmpWDl8YlZCFnZyFgajCA== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=fail ("headers rsa verify failed") header.d=mg.wilsonb.com header.s=krs header.b=aTNKDg6W; dkim=fail ("headers rsa verify failed") header.d=wilsonb.com header.s=201703 header.b=QHq+nGOd; dmarc=pass (policy=none) header.from=gnu.org; spf=pass (aspmx1.migadu.com: domain of "guix-patches-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-patches-bounces+larch=yhetil.org@gnu.org" X-Migadu-Spam-Score: -3.62 Authentication-Results: aspmx1.migadu.com; dkim=fail ("headers rsa verify failed") header.d=mg.wilsonb.com header.s=krs header.b=aTNKDg6W; dkim=fail ("headers rsa verify failed") header.d=wilsonb.com header.s=201703 header.b=QHq+nGOd; dmarc=pass (policy=none) header.from=gnu.org; spf=pass (aspmx1.migadu.com: domain of "guix-patches-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-patches-bounces+larch=yhetil.org@gnu.org" X-Migadu-Queue-Id: 11EBF2420C X-Spam-Score: -3.62 X-Migadu-Scanner: scn1.migadu.com X-TUID: Z+Yh/HcEes3x > I tried to get J ready for packaging, but thanks to my CPU not > supporting AVX2 and some helpful discussion in IRC, I was able to avoid > an error here. The black hole has extended it's grip... > The (guix cpu) code is not meant to be used at runtime as the comment > to ijconsole implies it wants it to be used. Rather, you should use it > at compile time to bake in the correct tuning parameters, and it should > ideally also support "cross-tuning" (though in that case you probably > need to disable the tests because your CPU won't make sense of the > code). Hrm... Mind if I ask about the rationale? We could go back to scraping /proc/cpuinfo, but I suspect that's not addressing the issue you have in mi= nd. > ijconsole not only fails that, but it also fails at an even more basic ta= sk > in Guix' launcher scripts, which is actually knowing the thing you launch= =2E > (We hardcode everything, period.) Okay. I see the logic in that. The original patch indeed hard-coded paths in the ijconsole script, but tha= t required having ijconsole be a wrapper package. I thought I was being cleve= r by eliminating a "needless" wrapper, but it sounds like we can just bring it back. > Now I could just disable everything AVX-related in J and push something > that works on x86 and amd64, but since you do claim that AVX is > important to J, there are also other options one could take here. One > is to implement tuning for this package the correct way, though since > it reinvents build systems, that's probably going to be a hard one.=20 > The other would be to define package variants (e.g. jsoftware-j-with- > avx) and use those -- there ought to be an old blog post on Guix HPC > detailing the rationale behind doing that. Not including AVX would be a hard hit. Morally, the ijconsole script just wraps the libj*.so libs into a "fat bina= ry". =46rom what I understand, fat binaries are (were?) an accepted solution in = =74he HPC world. Heck, the libj*.so total up to a whopping 15Mb, which feels more= like slim that fat, anyway. Questions floating around in my head: - What is wrong with detecting CPU features in a wrapper vs in the binary? - If a wrapper is theoretically okay, how can we fix the current one? - Is such a "proper fix" massively more subtle and bug-prone than the naive= solution? Why? > WDYT? Is AVX worth the trouble? Personally, I really do not like the jsoftware-j-with-* variants workaround= . If you say that tuning support is the only other acceptable solution, then I'l= l bite the bullet and see what is possible. P.S. Just throwing this out there, but if you'd like, I'd be willing to do = a mob session together. It seems like we are in compatible timezones.