From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp12.migadu.com ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms5.migadu.com with LMTPS id yK0EMIQicGPt9QAAbAwnHQ (envelope-from ) for ; Sat, 12 Nov 2022 23:47:32 +0100 Received: from aspmx1.migadu.com ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp12.migadu.com with LMTPS id Ucr9L4QicGO1IAEAauVa8A (envelope-from ) for ; Sat, 12 Nov 2022 23:47:32 +0100 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 5A37E3211F for ; Sat, 12 Nov 2022 23:47:32 +0100 (CET) Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1otzHO-0008Mg-Fk; Sat, 12 Nov 2022 17:47:14 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1otzHM-0008MJ-Sl for help-guix@gnu.org; Sat, 12 Nov 2022 17:47:13 -0500 Received: from mail.42l.fr ([45.155.171.163]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1otzHJ-0005Vx-SU for help-guix@gnu.org; Sat, 12 Nov 2022 17:47:12 -0500 Message-ID: <8dd94531b4a41b6bdc5f3159bec128c28f4400f3.camel@courrier.dev> DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=courrier.dev; s=mail; t=1668293195; bh=E1+YE5DAXgE50eIrD+raFsVZfjDwjT64qPEsKS9ghfk=; h=Subject:From:To:Cc:In-Reply-To:References; b=YWXq4w/DtSzhZHSO4SkxHe4Z8H0oSsvvP+ElmHVqKTFSYEoU50Q4XAm18Ct5tK5Rb 19kfQ7zloO4bnfhZVNLSutw8MoHVYSNQlHgN635ZeWysaXPRlvJ2ZBtr0Upz+CoIbh Bfh0wjawLV07nOpIt4hYXAVj1C+ru9/l6552dW1m1H1mMrtDRPZne3H8XJ1qLdRiRo 9+MNEJXnXjzJS5Ixx6CnaDuviRsGyE7HpG6RoT8g3bRjbJu0SSjDt7UaQaikTO3xJN ThX2txHVeOisv3tANwT6hr3KjfI1fpWNzQcG5bZ41M2YsC2fhz+pkzhshEryHkqlzx UEzQnisFtNPTw== Subject: Re: Python subprocess fails to execute Pip-installed module / Packaging Python Ray From: Pradana Adrinusa AUMARS To: Tobias Geerinckx-Rice Cc: Ricardo Wurmus , help-guix@gnu.org Date: Sat, 12 Nov 2022 23:46:32 +0100 In-Reply-To: <8d054eb211fd79040d5238c08f1a8e130fd11d2e.camel@courrier.dev> References: <87k04zeqsx.fsf@elephly.net> <98639a5072b42ebedb57275086836d0117f44d82.camel@courrier.dev> <871qr7zqw6.fsf@nckx> <8d054eb211fd79040d5238c08f1a8e130fd11d2e.camel@courrier.dev> Content-Type: text/plain; charset="UTF-8" Mime-Version: 1.0 Content-Transfer-Encoding: 8bit Received-SPF: pass client-ip=45.155.171.163; envelope-from=SRS0=9lqC=3M=courrier.dev=paumars@42l.fr; helo=mail.42l.fr X-Spam_score_int: -17 X-Spam_score: -1.8 X-Spam_bar: - X-Spam_report: (-1.8 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HEADER_FROM_DIFFERENT_DOMAINS=0.25, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=no autolearn_force=no X-Spam_action: no action X-BeenThere: help-guix@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: help-guix-bounces+larch=yhetil.org@gnu.org Sender: help-guix-bounces+larch=yhetil.org@gnu.org X-Migadu-Flow: FLOW_IN X-Migadu-Country: US ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1668293252; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-unsubscribe:list-subscribe:list-post:dkim-signature; bh=nya8X6L1Us61rMn8bYuHDuZLxNe/Me8gjJU5gwwv+Y8=; b=HsknfCHFJzw/fqQQRYkgz9gaSP4hBNBiw/XTMu7s5DcTrFyVBTss8TgPzjtDWS8MangNDm 7X4F3pevc/fOTK1H3H1nNxq3E6iNPSMyEgW1ue+O+uIAFIdFzd0bk/ApWivxZADW2s4cwf EgTTUnxnLmmiQ74epEcSD2rMZ0aoG1OiOxdttofdKn7IMHF8cxlZlZHTv0/I2o7JAWw6LQ tNd3E49+CgujhslGu3n4T4gVut1FF3WcfmtfccKLuRRdUhB+q8YrG+XqiWDSPFsUnmUxid M3E/ReLgZN2ETDC+XQ/0TUj5PfyDzphmxhJaUmwtkPOOCwnyTjTKorYS9G/+fA== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1668293252; a=rsa-sha256; cv=none; b=eA2la6NS74mzh70cS2P6rdTWNc8YqIEsYSOKPe7fprT5fBWU46VyGcSFe+BBvaByuAaFuP G3ftUn8RJENwQJCDsv1bnpahKMeRyto5W3gAdyZfkkkn9M/elbzwaRQTipon6Gp2yOS3LG UBZMaCJmyYG4ZLQ0TKoWHAvf7tsPv8fHcHGTcOeWVlveW2E3iDYUynNxeLknmRav3S/IdS Af8obFZozuPywVRzEvBt45CKL00+E+0Qfl8bujSOpjTrxljMq6BKKx+rmMAHG1OGsMqlj0 J5NL8C+Tnc+j//+bhGy8uajR2tIlYjRr68KzZB8Yv2+beYCA2eGOJMRoysGlCg== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=pass header.d=courrier.dev header.s=mail header.b="YWXq4w/D"; dmarc=pass (policy=quarantine) header.from=courrier.dev; spf=pass (aspmx1.migadu.com: domain of "help-guix-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="help-guix-bounces+larch=yhetil.org@gnu.org" X-Migadu-Spam-Score: -8.34 Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=courrier.dev header.s=mail header.b="YWXq4w/D"; dmarc=pass (policy=quarantine) header.from=courrier.dev; spf=pass (aspmx1.migadu.com: domain of "help-guix-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="help-guix-bounces+larch=yhetil.org@gnu.org" X-Migadu-Queue-Id: 5A37E3211F X-Spam-Score: -8.34 X-Migadu-Scanner: scn0.migadu.com X-TUID: Q70G85CDPuVI I'm in the process of packaging Ray for Python. Here is the current SCM configuration: (use-modules (guix packages) (guix download) ((guix licenses) #:prefix license:) (gnu packages python) (guix utils) (guix build-system python) (gnu packages linux) (gnu packages check) (gnu packages rpc) (gnu packages python-build) (gnu packages protobuf) (gnu packages machine-learning) (gnu packages python-science) (gnu packages python-web) (gnu packages python-xyz)) (define python-setproctitle (package (name "python-setproctitle") (version "1.2.2") (source (origin (method url-fetch) (uri (pypi-uri "setproctitle" version)) (sha256 (base32 "1pwp1lb9mf0kgg3sbf1z8dkfnmwcqvixc0by00s3sh2ji0n4gyvx")))) (build-system python-build-system) (arguments '(#:phases (modify-phases %standard-phases (replace 'check (lambda* (#:key tests? #:allow-other-keys) (setenv "PYTHON" (or (which "python3") (which "python"))) (setenv "PYCONFIG" (if (which "python3-config") "python3-config --embed" "python-config")) (substitute* "tests/conftest.py" (("cc") "gcc")) (when tests? (invoke "pytest" "tests/"))))))) (native-inputs (list procps python-pytest)) ; required for tests (home-page "") (synopsis "") (description "") (license license:bsd-3))) (package (name "python-ray") (version "2.0.0") (source (origin (method url-fetch) (uri (string-append "https://github.com/ray-project/ray/archive/refs/tags/ray-" version ".tar.gz")) (sha256 (base32 "1gqp2h9fngn2miavksvd041b7pd19vf1lamarc5qwcmdx3b42f1k")))) (build-system python-build-system) (arguments '(#:phases (modify-phases %standard-phases (replace 'build (lambda _ (invoke "python3" "python/setup.py" "build")))))) (native-inputs (list python-attrs python-click python-dataclasses python-filelock python-grpcio python-jsonschema python-msgpack python-numpy python-packaging python-pyyaml python-aiosignal python-frozenlist python-requests python-virtualenv python-wheel python-cython python-setproctitle python-colorama python-psutil)) (home-page "") (synopsis "") (description "") (license license:asl2.0)) When I build the package, pip tries to download from pypi.org/simple/psutil, even though it's written as an input in this configuration. The output gives this error: warning: build_py: byte-compiling is disabled, skipping. running build_ext WARNING: The directory '/homeless-shelter/.cache/pip' or its parent directory is not owned or is not writable by the current user. The cache has been disabled. Check the permissions and owner of that directory. If executing pip with sudo, you should use sudo's -H flag. WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno -2] Name or service not known')': /simple/psutil/ ... ERROR: Could not find a version that satisfies the requirement psutil (from versions: none) ERROR: No matching distribution found for psutil Has there been a similar issue with Python packages with psutil as an input or with pip not properly finding dependencies like this? Thanks Le dimanche 16 octobre 2022 à 20:53 +0200, Pradana Adrinusa AUMARS a écrit : > Thank you for the explanation, Ricardo, > > Thank you for the explanation Tobias, > > I tried a simple solution by finding where my "ld" is located with > "whereis" and a symbolic link to "/lib64/ld-linux-x86-64.so.2". > > Unfortunately, I get an Error 80 which means it used a corrupted shared > library. > > I think it's better to package Ray natively into Guix, but it's time- > consuming since Ray is not a simple Python package. I was hoping for a > temporary solution, but I don't think I can find one. I'll try to use > another machine to make this project run. > > Thank you anyways. > > Le dimanche 16 octobre 2022 à 17:50 +0200, Tobias Geerinckx-Rice a > écrit : > > Hi Pradana, > > > > Pradana Adrinusa AUMARS 写道： > > > dynamically linked, interpreter /lib64/ld-linux-x86-64.so.2, for > > > > And this file doesn't exist. > > > > Prebuilt binary blobs don't mix well with Guix for this reason: > > they hard-code file names such as this one. > > > > One (brand-)new work-around is > > > >   $ guix shell -CF [PACKAGE…] [-- your command line] > > > > E.g., > > > >   $ guix shell -CF -- ./hello # random binary downloaded from > >   Debian > >   Hello, world! > > > > which creates a virtual, backwards-compatible directory layout > > within the container. > > > > This is a (glorious) hack, but it's no substitute for proper Guix > > packaging! > > > > > outputs that bash cannot find this file. > > > > That error is criminally misleading.  ‘A’ file, but not ‘this’ > > file.  :-/ > > > > Kind regards, > > > > T G-R > >