From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp0 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms11 with LMTPS id QKu5ALEimF/eCgAA0tVLHw (envelope-from ) for ; Tue, 27 Oct 2020 13:37:53 +0000 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp0 with LMTPS id 4PIwOLAimF97eQAA1q6Kng (envelope-from ) for ; Tue, 27 Oct 2020 13:37:52 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 815339401D0 for ; Tue, 27 Oct 2020 13:37:52 +0000 (UTC) Received: from localhost ([::1]:52122 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kXPAd-0005fP-Er for larch@yhetil.org; Tue, 27 Oct 2020 09:37:51 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:55020) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1kXP0B-00011C-Fs for bug-guix@gnu.org; Tue, 27 Oct 2020 09:27:03 -0400 Received: from debbugs.gnu.org ([209.51.188.43]:59990) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1kXP0A-0007IC-AE for bug-guix@gnu.org; Tue, 27 Oct 2020 09:27:03 -0400 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1kXP0A-00021S-55 for bug-guix@gnu.org; Tue, 27 Oct 2020 09:27:02 -0400 X-Loop: help-debbugs@gnu.org Subject: bug#44254: Performance of package input rewriting Resent-From: Lars-Dominik Braun Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Tue, 27 Oct 2020 13:27:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: report 44254 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: 44254@debbugs.gnu.org X-Debbugs-Original-To: bug-guix@gnu.org Received: via spool by submit@debbugs.gnu.org id=B.16038051887732 (code B ref -1); Tue, 27 Oct 2020 13:27:01 +0000 Received: (at submit) by debbugs.gnu.org; 27 Oct 2020 13:26:28 +0000 Received: from localhost ([127.0.0.1]:43303 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kXOzc-00020e-3A for submit@debbugs.gnu.org; Tue, 27 Oct 2020 09:26:28 -0400 Received: from lists.gnu.org ([209.51.188.17]:37288) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kXOza-00020X-JB for submit@debbugs.gnu.org; Tue, 27 Oct 2020 09:26:26 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:54994) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1kXOza-0000RJ-CZ for bug-guix@gnu.org; Tue, 27 Oct 2020 09:26:26 -0400 Received: from mail-wm1-x32b.google.com ([2a00:1450:4864:20::32b]:50204) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1kXOzV-00077Z-EG for bug-guix@gnu.org; Tue, 27 Oct 2020 09:26:24 -0400 Received: by mail-wm1-x32b.google.com with SMTP id 13so1382140wmf.0 for ; Tue, 27 Oct 2020 06:26:17 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=leibniz-psychology-org.20150623.gappssmtp.com; s=20150623; h=date:from:to:subject:message-id:mime-version:content-disposition :user-agent; bh=ZjVh0eJCUzXdE2IxvJX1OarM1aaN5YM9z/OeTxE2HUo=; b=HBBwsc4d+EPGzE7bY4qyemwqEOST+LS+Hr3kHT8pvuh5Hd5C9266RXZNph1dai0OqR /iqqxJ5zJnXg0cXjKEVlg3pOEKj7YMvCgqzmiGYiHjMPwjCSqbtYduZgjWzp8mpEXB3W XiMLfor9MIxp5SbFpEclSDdhSw6bHhpJiZ/73Uk9UHL9K/jYxwNSSa7JzRLriIRzeZJA s33F+6sQlikhxuRLLomnjkyhhrSzPdFmbZi1QHZXV2zHXRcG4xFllNAMimAXHiOO4Aob 2U2ZRZ4J9EM9DsR6nF9QGtZA4FreC1KkR/NxktqXg727gw+QQzQKOnZ4UlfFB4T9R+ty 9/Gw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:subject:message-id:mime-version :content-disposition:user-agent; bh=ZjVh0eJCUzXdE2IxvJX1OarM1aaN5YM9z/OeTxE2HUo=; b=UuiSz1eKQsGpZElRLYs2uuu6iA17N4tw8nzAfqHgW5iTbbasEFmIhboVDjvQj6255O QzUA9LYn49bz2tZFN5vljXXMR2b3/gOOh4FSVtv8Zw2SbAuwYf+UmUXP5GBzFV2W8E2o q7DIuoJGD6isElhyMkmcj8RvmIMA07ULVNLdFtLzuSahKFe5tBKQMeaLOqoMfPcYClK7 5RpBvNUG5ccF0WJeRdx5WZhHqBHtDt9nE8JNVwdEK5r3UvH46yT7X8WQB5jfVeXvDmmJ HsqVh6qD35P4puO6fFl6OAjPn1DLRFMVvFKmhO9ckcE2COr9a3IpPWjZTBLj8bKMbxXN Uthg== X-Gm-Message-State: AOAM532kUrYFSNtV7Y5e7w/4X08c1kD32mPkd4s++t+32LReQVYppEuI G9Wy5QYtkeSVHCAtyecSdQ9XoN87dTwo9pUDBW/Xjk/O6qLR/1hIXR2IGOLcnlgarGthnoqZxfz nEb0yWQ+SAwtOnwwcbkp5SyKEcgZwQwx2ze8SDCIoGGs2X/K0+Xusz7y0YquIhZS9uO7FabSfSd JCE2kr X-Google-Smtp-Source: ABdhPJyjj4F9yKW76jPyjQKTMUmBLEtI4zZDePrGvA2cEnzNotwDCH4pBkWghiakXPXHA3XZXZxFuA== X-Received: by 2002:a7b:c418:: with SMTP id k24mr2901498wmi.118.1603805175533; Tue, 27 Oct 2020 06:26:15 -0700 (PDT) Received: from localhost (dynamic-2a01-0c23-7c00-b000-7592-f1eb-27a8-a555.c23.pool.telefonica.de. [2a01:c23:7c00:b000:7592:f1eb:27a8:a555]) by smtp.gmail.com with ESMTPSA id y201sm1904264wmd.27.2020.10.27.06.26.14 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 27 Oct 2020 06:26:14 -0700 (PDT) Date: Tue, 27 Oct 2020 14:26:14 +0100 From: Lars-Dominik Braun Message-ID: <20201027132614.GB3081@zpidnp36> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="5/uDoXvLw7AC5HRs" Content-Disposition: inline User-Agent: Mutt/1.10.1 (2018-07-13) Received-SPF: none client-ip=2a00:1450:4864:20::32b; envelope-from=ldb@leibniz-psychology.org; helo=mail-wm1-x32b.google.com X-detected-operating-system: by eggs.gnu.org: No matching host in p0f cache. That's all we know. X-Spam_score_int: -18 X-Spam_score: -1.9 X-Spam_bar: - X-Spam_report: (-1.9 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_NONE=0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-Spam-Score: -2.3 (--) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-Spam-Score: -3.3 (---) X-BeenThere: bug-guix@gnu.org List-Id: Bug reports for GNU Guix List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-guix-bounces+larch=yhetil.org@gnu.org Sender: "bug-Guix" X-Scanner: scn0 Authentication-Results: aspmx1.migadu.com; dkim=fail (rsa verify failed) header.d=leibniz-psychology-org.20150623.gappssmtp.com header.s=20150623 header.b=HBBwsc4d; dmarc=none; spf=pass (aspmx1.migadu.com: domain of bug-guix-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=bug-guix-bounces@gnu.org X-Spam-Score: -1.61 X-TUID: mF90YWqHy5UP --5/uDoXvLw7AC5HRs Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hi, this issue is similar to https://issues.guix.gnu.org/41702, but I=E2=80=99m= not sure it=E2=80=99s exactly the same. For guix-science I=E2=80=99m trying to provi= de some packages like python-jupyterlab, which depend on a mix of packages from guix proper = and newer versions of packages already included in guix proper. Thus I need to rewrite inputs of the former to the latter. (Because Python only propagates dependencies and thus collisions would occur.) Previously I have been doing this using package-input-rewriting, but starti= ng an environment containing python-jupyterlab alone took about 20s (warm cach= es, all derivations in the store). Manually rewriting inputs by inheriting and alist-delete=E2=80=99ing brings this down to 3s, which is pretty significan= t. --no-grafts has not much of an impact (15s vs 2s) here. See https://github.com/guix-science/guix-science/commit/972795a23cc9eb5a0bb1a2f= fb5681d151fc4d4b0 for the exact changes. My expectation would be that package-input-rewriting is the preferred, beca= use easier, solution to this problem and thus should have minimal impact on performance. Cheers, Lars --5/uDoXvLw7AC5HRs Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQGzBAABCgAdFiEEyk+M9DfXR4/aBV/UQhN3ARo3hEYFAl+YH/IACgkQQhN3ARo3 hEYtWgv/ZeeJRbS39QGqBHhDiCkMrRAP2BxrkQeiIms/Vtp2JtOWEelrmdWj6ZNe +46a4EnqRX/kv6z+ZKZPHz5KBkEPvwnNoRQbdFOlKSFPCe5PrvNHbyhpscS+TMj/ u/hGS8NKt1di24SfnyqJHeWYeK9QTQnxNwycsCnQx1SUB5BrWQx49jEVS1DmmwkY zcSnB0ztlhOu+Fa+D6CrkppC2BILPdQZc3sDYQ0Cj74VCp3FwSNJJ1spLeKXIMCr cLbzdL8mAMhr5b43+ePz0pBJ9FUz+ly5nV9Ml+d1oo+wpA6dn0REqLn+7Hu4uJJF vzkCIVJ8UiG8/7HCKPiX5YZd7ka5wgyGVbE9nIAFGJ58oB22dRaAcVWho0TzTITK oJOyQ1xuCN+RbjkpWSq89NqeNC5ajoa90p8yaW9ANRn4Z6jDMH26cEbCl/mNIolH KdF1Fsbcvyk55GYmPEGEMdzgTmSDOg31quMENSP2aYrMUntSu4LI0yQbnlhPnbzj z3oMKxDF =X55m -----END PGP SIGNATURE----- --5/uDoXvLw7AC5HRs--