From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp0.migadu.com ([2001:41d0:403:4876::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms1.migadu.com with LMTPS id iK2HAcHRPWZf9AAAqHPOHw:P1 (envelope-from ) for ; Fri, 10 May 2024 09:50:25 +0200 Received: from aspmx1.migadu.com ([2001:41d0:403:4876::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp0.migadu.com with LMTPS id iK2HAcHRPWZf9AAAqHPOHw (envelope-from ) for ; Fri, 10 May 2024 09:50:25 +0200 X-Envelope-To: larch@yhetil.org Authentication-Results: aspmx1.migadu.com; dkim=none; spf=pass (aspmx1.migadu.com: domain of "guix-patches-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-patches-bounces+larch=yhetil.org@gnu.org"; dmarc=pass (policy=none) header.from=gnu.org ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1715327424; h=from:from:sender:sender:reply-to:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-transfer-encoding:content-transfer-encoding:resent-cc: resent-from:resent-sender:resent-message-id:list-id:list-help: list-unsubscribe:list-subscribe:list-post; bh=GOHB7c6DWOEqdbrCCrXVW0mzq3xxKIHLsbPbGmI69vE=; b=stRk4S1Ih2wsx6sUkTVCAOG2pjfTrfC5GSy5p6fnIWIT8v7EvCKuhk4nLOgOulDb+ygqIu tGFNSRf8pyXiuL1ZGSAzUhSbWXrPQ4aRdWCmgHt15EuHMaF+YLvQPpLqQFGCEu0zoR2uPu Axjkx4kTruSlIoepiOVaHDl1CVZsEluuHrklC5RKBBkHyQnw0NDny20FXv0kLd0ltRaDeU n43vBd7NGH4460K5gT+VJT5ZYFYY1w+SYwtzWgpPJzU9OUBtjTy/bd7wL9JxoNSIyF0+fm t6j7E94Ms6eHVxyHIPoABlvuBln4JfUupQhjulqb8NJQtcAOXcY1QpZkJtlveg== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=none; spf=pass (aspmx1.migadu.com: domain of "guix-patches-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-patches-bounces+larch=yhetil.org@gnu.org"; dmarc=pass (policy=none) header.from=gnu.org ARC-Seal: i=1; s=key1; d=yhetil.org; t=1715327424; a=rsa-sha256; cv=none; b=fyXySI/3z89HoYwkMMDLt2ySBCzoIe8ejegCS1vkfDQ31lrKd4SDf1X8MdxMYYuPokfF+4 NTHsit0rfWiMBi0SBD/FBXwUqAp01RCYiFpwI4x/q+YMBr828LwpPef5FpXD9OQK6QNFs8 KlFoHzcEvX976QgnBK0cmfGeLw3fQvHw5sWtlLJBTbm8NWksN9ZXyG2g3EA2dPiQDRMVGa 6FcPFhdOijH3VX4GApNoWPuWiKXEqcpi+buCofsaWC1vjpwxRVvSQ0fGBk42BE+aLE+neY KlSFl9eq0s+XHSl8WDLU4iyvRG6MoLr219WJgCT7mOFEXwQ+fgfUifDFT19Ktw== Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 839C0732C8 for ; Fri, 10 May 2024 09:50:24 +0200 (CEST) Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1s5L1A-0005le-Ea; Fri, 10 May 2024 03:50:12 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1s5L13-0005hM-CX for guix-patches@gnu.org; Fri, 10 May 2024 03:50:06 -0400 Received: from debbugs.gnu.org ([2001:470:142:5::43]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1s5L12-0002l2-Cd for guix-patches@gnu.org; Fri, 10 May 2024 03:50:05 -0400 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1s5L0z-0000I1-Lx for guix-patches@gnu.org; Fri, 10 May 2024 03:50:01 -0400 X-Loop: help-debbugs@gnu.org Subject: [bug#70858] [PATCH 00/32] python-team: Remove native inputs Resent-From: Nicolas Graves Original-Sender: "Debbugs-submit" Resent-CC: guix-patches@gnu.org Resent-Date: Fri, 10 May 2024 07:50:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: report 70858 X-GNU-PR-Package: guix-patches X-GNU-PR-Keywords: patch To: 70858@debbugs.gnu.org Cc: ngraves@ngraves.fr X-Debbugs-Original-To: guix-patches@gnu.org Received: via spool by submit@debbugs.gnu.org id=B.17153273471087 (code B ref -1); Fri, 10 May 2024 07:50:01 +0000 Received: (at submit) by debbugs.gnu.org; 10 May 2024 07:49:07 +0000 Received: from localhost ([127.0.0.1]:41679 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1s5L06-0000HT-TJ for submit@debbugs.gnu.org; Fri, 10 May 2024 03:49:07 -0400 Received: from lists.gnu.org ([209.51.188.17]:42942) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1s5L03-0000HN-2R for submit@debbugs.gnu.org; Fri, 10 May 2024 03:49:05 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1s5Kzz-0003xC-Ui for guix-patches@gnu.org; Fri, 10 May 2024 03:49:00 -0400 Received: from 5.mo576.mail-out.ovh.net ([46.105.43.105]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1s5Kzs-0002Hx-D6 for guix-patches@gnu.org; Fri, 10 May 2024 03:48:59 -0400 Received: from director5.ghost.mail-out.ovh.net (unknown [10.108.9.167]) by mo576.mail-out.ovh.net (Postfix) with ESMTP id 4VbLc12Srnz1kdx for ; Fri, 10 May 2024 07:48:49 +0000 (UTC) Received: from ghost-submission-6684bf9d7b-pk562 (unknown [10.110.168.159]) by director5.ghost.mail-out.ovh.net (Postfix) with ESMTPS id 173271FEB3; Fri, 10 May 2024 07:48:49 +0000 (UTC) Received: from ngraves.fr ([37.59.142.102]) by ghost-submission-6684bf9d7b-pk562 with ESMTPSA id Bm9iAmHRPWYVLwAAP/Hm3w (envelope-from ); Fri, 10 May 2024 07:48:49 +0000 X-OVh-ClientIp: 81.67.146.208 Date: Fri, 10 May 2024 09:26:04 +0200 Message-ID: <20240510074844.2703-1-ngraves@ngraves.fr> X-Mailer: git-send-email 2.41.0 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Ovh-Tracer-Id: 15087340229833319138 X-VR-SPAMSTATE: OK X-VR-SPAMSCORE: 0 X-VR-SPAMCAUSE: gggruggvucftvghtrhhoucdtuddrgedvledrvdefjedgvddtucetufdoteggodetrfdotffvucfrrhhofhhilhgvmecuqfggjfdpvefjgfevmfevgfenuceurghilhhouhhtmecuhedttdenucenucfjughrpefhvfevufffkffoggfgsedtkeertdertddtnecuhfhrohhmpefpihgtohhlrghsucfirhgrvhgvshcuoehnghhrrghvvghssehnghhrrghvvghsrdhfrheqnecuggftrfgrthhtvghrnhepkeffgeetfffgffejgeejvdffgfdtvdeuueetgfefuedvjeegvdegjeejveeuueevnecukfhppeduvdejrddtrddtrddupdekuddrieejrddugeeirddvtdekpdefjedrheelrddugedvrddutddvnecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehinhgvthepuddvjedrtddrtddruddpmhgrihhlfhhrohhmpehnghhrrghvvghssehnghhrrghvvghsrdhfrhdpnhgspghrtghpthhtohepuddprhgtphhtthhopehguhhigidqphgrthgthhgvshesghhnuhdrohhrghdpoffvtefjohhsthepmhhoheejiedpmhhouggvpehsmhhtphhouhht Received-SPF: pass client-ip=46.105.43.105; envelope-from=ngraves@ngraves.fr; helo=5.mo576.mail-out.ovh.net X-Spam_score_int: -18 X-Spam_score: -1.9 X-Spam_bar: - X-Spam_report: (-1.9 / 5.0 requ) BAYES_00=-1.9, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H4=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-BeenThere: guix-patches@gnu.org List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-to: Nicolas Graves X-ACL-Warn: , Nicolas Graves via Guix-patches From: Nicolas Graves via Guix-patches via Errors-To: guix-patches-bounces+larch=yhetil.org@gnu.org Sender: guix-patches-bounces+larch=yhetil.org@gnu.org X-Migadu-Country: US X-Migadu-Flow: FLOW_IN X-Spam-Score: -6.58 X-Migadu-Queue-Id: 839C0732C8 X-Migadu-Scanner: mx10.migadu.com X-Migadu-Spam-Score: -6.58 X-TUID: yVCndvyCUbdu This is a full rewrite of patch series 70735 which I couldn't fully submit because debbugs doesn't seem to like when more than 100 patches are sent in 2h. It is therefore much more concise. Here's an adapted copy of the original cover-letter message: How did I proceed ? 1) Identify packages we often don't need as native-inputs. 2) Systematically remove these packages when they are in native-inputs. 3) Iterate : try to rebuild needed packages, and fixes along the way (these can be updates, packages rewrites, inputs additions...). Said fixes have been sent in patch series 70855. Back up from the native-input removal when it's not trivial, except for some specific cases (these are present as their own patches). 4) Stop when everything rebuilds properly, except for some specific cases. The packages that need rebuilding are identified from : guix graph --type=reverse-package -M 1 python-codecov python-coverage python-black python-isort python-pycodestyle python-pep8 python-pyflakes python-flake8 python-pylint python-mypy python-coveralls python-twine python-pytest-isort python-pytest-flake8 python-pytest-cov python-pytest-black python-pytest-pep8 python-pytest-mypy pre-commit | grep label | cut -d\" -f4 | cut -d@ -f1 | sort | uniq Some are removed from this list where the package was propagated rather than native, or when the package is left unchanged (e.g. open-adventure), or for those specific cases : - "chirp" ; needs to rebuild webkitgtk, no thanks - "cpplint" ; has been updated on master + requires pytest-runner==5.6 - "python-modin" ; this is broken by pandas upgrade, will fix this independently - "python-libcst" ; broken upstream but unchanged - "python-schema-salad" ; broken upstream but unchanged - "python-dolfin-adjoint" ; timeout, but probably works. - "reprotest" ; needs to rebuild the whole openjdk, no thanks. This patch series is built upon python-team's branch, with Vinicius' patch series 69980 and my patch series 70855 on top. Now, what about results in package node graph reduction? Here's a summary of number of packages under guix refresh -l : | package | master | python-team+patch series | |----------------------+--------+--------------------------| | python-codecov | 6 | 1 | | python-coverage | 2359 | 497 | | python-black | 332 | 37 | | python-isort | 275 | 153 | | python-pycodestyle | 392 | 184 | | python-pep8 | 219 | 215 | | python-pyflakes | 392 | 190 | | python-flake8 | 377 | 158 | | python-pylint | 235 | 8 | | python-mypy | 347 | 310 | | python-coveralls | 23 | 1 | | python-twine | 28 | 137 | | python-pytest-isort | 180 | 145 | | python-pytest-flake8 | 303 | 8 | | python-pytest-cov | 2309 | 286 | | python-pytest-black | 278 | 7 | | python-pytest-pep8 | 31 | 31 | | python-pytest-mypy | 280 | 307 | | pre-commit | 128 | 1 | | python-tox | 166 | 5 | This means e.g. that an update of python-pylint will trigger 8 packages rebuilds rather than 235. Nicolas Graves (32): guix: import: pypi: Ignore pypi-ignored-inputs. build-system/pyproject: Ignore unwanted pytest flags. build-system/pyproject: Remove python-black input. build-system/pyproject: Remove python-pylint native-input. build-system/pyproject: Remove python-flake8 inputs. build-system/pyproject: Remove python-coverage input. gnu: python-cram: Remove python-coverage native-input. gnu: u-boot-tools: Remove python-coverage native-input. gnu: python-aiosqlite: Remove python-coverage native-input. gnu: python-openid: Remove python-coverage native-input. build-system/pyproject: Remove python-coveralls native-input. build-system/pyproject: Remove python-pycodestyle native-input. gnu: python-versioneer: Remove python-pycodestyle native-input. gnu: python-versioneer: Remove python-pyflakes native-input. gnu: python-re-assert: Remove python-covdefaults native-input. build-system/pyproject: Remove python-codecov native-input. build-system/pyproject: Remove python-tox native-input. build-system/pyproject: Remove python-mypy native-input. gnu: python-immutables: Remove python-mypy native-input. build-system/pyproject: Remove python-isort native-input. build-system/pyproject: Remove python-twine native-input. build-system/pyproject: Remove python-pytest-cov native-input. gnu: python-tinycss2: Remove python-pytest-cov native-input. gnu: python-django-contact-form: Remove python-pytest-cov native-input. gnu: python-dateutil: Remove python-pytest-cov native-input. build-system/pyproject: Remove python-pytest-isort native-input. build-system/pyproject: Remove python-pytest-black native-input. build-system/pyproject: Remove python-pytest-flake8 native-input. build-system/pyproject: Remove python-pytest-mypy inputs. build-system/pyproject: Stop hiding options. gnu: python-linear-operator: Remove python-flake8-print native-input gnu: abjad-ext-ipython: Remove uneeded inputs. gnu/packages/android.scm | 6 +- gnu/packages/astronomy.scm | 33 +- gnu/packages/audio.scm | 2 +- gnu/packages/backup.scm | 2 +- gnu/packages/bioinformatics.scm | 31 +- gnu/packages/bootloaders.scm | 17 +- gnu/packages/build-tools.scm | 1 - gnu/packages/check.scm | 21 +- gnu/packages/cpp.scm | 4 +- gnu/packages/databases.scm | 17 +- gnu/packages/dav.scm | 4 - gnu/packages/diffoscope.scm | 2 - gnu/packages/django.scm | 12 +- gnu/packages/ebook.scm | 1 - gnu/packages/embedded.scm | 1 - gnu/packages/engineering.scm | 7 +- gnu/packages/finance.scm | 6 +- gnu/packages/fontutils.scm | 1 - gnu/packages/geo.scm | 9 +- gnu/packages/gettext.scm | 4 - gnu/packages/gpodder.scm | 3 +- gnu/packages/graph.scm | 6 +- gnu/packages/graphviz.scm | 5 - gnu/packages/jupyter.scm | 8 +- gnu/packages/logging.scm | 2 +- gnu/packages/machine-learning.scm | 65 +--- gnu/packages/mail.scm | 3 +- gnu/packages/mastodon.scm | 1 - gnu/packages/messaging.scm | 6 +- gnu/packages/music.scm | 24 +- gnu/packages/package-management.scm | 7 +- gnu/packages/patchutils.scm | 2 +- gnu/packages/pdf.scm | 6 +- gnu/packages/potassco.scm | 3 +- gnu/packages/protobuf.scm | 4 +- gnu/packages/python-check.scm | 33 +- gnu/packages/python-compression.scm | 21 +- gnu/packages/python-crypto.scm | 4 +- gnu/packages/python-science.scm | 21 +- gnu/packages/python-web.scm | 173 +++-------- gnu/packages/python-xyz.scm | 415 +++++++------------------- gnu/packages/radio.scm | 3 +- gnu/packages/serialization.scm | 1 - gnu/packages/simulation.scm | 2 - gnu/packages/sphinx.scm | 7 - gnu/packages/statistics.scm | 14 +- gnu/packages/syndication.scm | 8 +- gnu/packages/task-management.scm | 1 - gnu/packages/telegram.scm | 3 +- gnu/packages/terminals.scm | 9 +- gnu/packages/textutils.scm | 3 - gnu/packages/time.scm | 22 +- gnu/packages/version-control.scm | 1 - gnu/packages/virtualization.scm | 4 +- gnu/packages/vpn.scm | 2 - gnu/packages/web.scm | 6 +- gnu/packages/wm.scm | 2 - gnu/packages/xml.scm | 2 +- guix/build/pyproject-build-system.scm | 99 +++++- guix/import/pypi.scm | 21 +- guix/lint.scm | 12 +- tests/pypi.scm | 3 +- 62 files changed, 413 insertions(+), 805 deletions(-) -- 2.41.0