From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp10.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id qE0hAmpw8mE/9QAAgWs5BA (envelope-from ) for ; Thu, 27 Jan 2022 11:14:02 +0100 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp10.migadu.com with LMTPS id 35R2Nmlw8mHPWAAAG6o9tA (envelope-from ) for ; Thu, 27 Jan 2022 11:14:01 +0100 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 50C8C2ACB4 for ; Thu, 27 Jan 2022 11:13:57 +0100 (CET) Received: from localhost ([::1]:34986 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1nD1mu-0003LK-6U for larch@yhetil.org; Thu, 27 Jan 2022 05:13:56 -0500 Received: from eggs.gnu.org ([209.51.188.92]:50302) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nD1XW-0007UO-MI for bug-guix@gnu.org; Thu, 27 Jan 2022 04:58:02 -0500 Received: from debbugs.gnu.org ([209.51.188.43]:33253) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1nD1XW-0003Sm-Bf for bug-guix@gnu.org; Thu, 27 Jan 2022 04:58:02 -0500 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1nD1XW-00012L-C2 for bug-guix@gnu.org; Thu, 27 Jan 2022 04:58:02 -0500 X-Loop: help-debbugs@gnu.org Subject: bug#48007: computing derivations through inferior takes twice as long Resent-From: Ricardo Wurmus Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Thu, 27 Jan 2022 09:58:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 48007 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: Ludovic =?UTF-8?Q?Court=C3=A8s?= Received: via spool by 48007-submit@debbugs.gnu.org id=B48007.16432774653960 (code B ref 48007); Thu, 27 Jan 2022 09:58:02 +0000 Received: (at 48007) by debbugs.gnu.org; 27 Jan 2022 09:57:45 +0000 Received: from localhost ([127.0.0.1]:54389 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nD1XF-00011o-L6 for submit@debbugs.gnu.org; Thu, 27 Jan 2022 04:57:45 -0500 Received: from sender4-of-o51.zoho.com ([136.143.188.51]:21155) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nD1XC-00011c-54 for 48007@debbugs.gnu.org; Thu, 27 Jan 2022 04:57:44 -0500 ARC-Seal: i=1; a=rsa-sha256; t=1643277452; cv=none; d=zohomail.com; s=zohoarc; b=n3Bi9EnYMHKpgxvIlZfu4o/Ny2zf9z00YewYnvgpKp5Mq9+kzxtOOEg8LqXWYQMd+NMg4bQNt0q/NUrtR3Ggo2NULuQ3j0AULvd68o6pVBu4L5kU9doFhyCNIhEkT9CZe49quMb5QFJuA2EBlYc/AOvYNFLZQq+5WIzkdjJ4+08= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zohomail.com; s=zohoarc; t=1643277452; h=Content-Type:Content-Transfer-Encoding:Cc:Date:From:In-Reply-To:MIME-Version:Message-ID:References:Subject:To; bh=CGR2oSHTVBJXUyRQPvQd5as0QOqXmU6uQtOTD+8wF0k=; b=RzjEsct4HKpUBgJs3rotHfsAIQSS81qGKoOw/XdAA3CUMtRJZwsk22Xf8frJf446L24x4POB3fC/pVehEbIZOSg6YdEjadzc7Act7k/rDuTo3JfeBOouNwB7++1F3NOBVfTGePduS/sKybApXkFdjRqtEm2rviMm73gz6++n7oc= ARC-Authentication-Results: i=1; mx.zohomail.com; dkim=pass header.i=elephly.net; spf=pass smtp.mailfrom=rekado@elephly.net; dmarc=pass header.from= DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; t=1643277452; s=zoho; d=elephly.net; i=rekado@elephly.net; h=References:From:To:Cc:Subject:Date:In-reply-to:Message-ID:MIME-Version:Content-Type:Content-Transfer-Encoding; bh=CGR2oSHTVBJXUyRQPvQd5as0QOqXmU6uQtOTD+8wF0k=; b=USeb6PkONopgUYI0ay7LjITcTuAoraZh2T4nR+rQAxYSJRDT8cPYnL3rcAjBRPAH 6Zsph1So/2fJcUlJuiHy5ggR1Ws/uIslX1Ko4jNIwaHY8XTOUO/8nrQYycTWvN7DcAX nizv0ZkHk9h8tt2JKxNabQNUoj0C87fDL/ql8flA= Received: from localhost (p54ad4ff6.dip0.t-ipconnect.de [84.173.79.246]) by mx.zohomail.com with SMTPS id 1643277449654233.21309897494416; Thu, 27 Jan 2022 01:57:29 -0800 (PST) References: <87wnsrpf25.fsf@elephly.net> <87r18ufcft.fsf@gnu.org> <87czkeji4h.fsf@elephly.net> <87mtjhftq8.fsf@gnu.org> User-agent: mu4e 1.6.10; emacs 27.2 From: Ricardo Wurmus Date: Thu, 27 Jan 2022 10:56:49 +0100 In-reply-to: <87mtjhftq8.fsf@gnu.org> X-URL: https://elephly.net X-PGP-Key: https://elephly.net/rekado.pubkey X-PGP-Fingerprint: BCA6 89B6 3655 3801 C3C6 2150 197A 5888 235F ACAC Message-ID: <87a6fhijqy.fsf@elephly.net> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-ZohoMailClient: External X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-BeenThere: bug-guix@gnu.org List-Id: Bug reports for GNU Guix List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: 48007@debbugs.gnu.org Errors-To: bug-guix-bounces+larch=yhetil.org@gnu.org Sender: "bug-Guix" X-Migadu-Flow: FLOW_IN X-Migadu-Country: US ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1643278441; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding:resent-cc: resent-from:resent-sender:resent-message-id:in-reply-to:in-reply-to: references:references:list-id:list-help:list-unsubscribe: list-subscribe:list-post:dkim-signature; bh=CGR2oSHTVBJXUyRQPvQd5as0QOqXmU6uQtOTD+8wF0k=; b=EUFd68mt+mnLqnBr6cS5emTQC9ALeuL5AgRepK+CXhpNt5TpdY0oz2ONftTnehfIVP9YQU phIchFdYvhCZ/BhPZW299ZMyPAvF6grFuRWJUj+FEyAXv86VVcsYQNblt+cOrucHR4fQBz KqBFMRnqmyB3cYj0yUiC8C7DVYV16An3w0J17aHqJmZqZfIyMTkexT6AQYgvwJqMYJmZN+ Pb7vmOBimd4ePmmrg9hANTtdmoUt7NQrBbgoLLGnt/4v/F0aZim3X8WwXpSaSOPu3suIWY djsP6/bHN270aDl2BHmX1GMoeawQGhf3c2rv+GZdWmSiBp3w4Kk0qQyYNWWxtg== ARC-Seal: i=2; s=key1; d=yhetil.org; t=1643278441; a=rsa-sha256; cv=fail; b=gYR3VTsQLKPXOMHtZOpKSVNo4/WdF+VlXEHOiyucMfMF//U9WUH8zZmtzHTrVRVCvPlOd4 fJ37LTIf/KFo8Krp6wF0c1G2aT+opa1PIkYoqFpU9OiPcCsMnwTiwkOSA/lS2+sVZUANNo /TNvjnDV7AcEVgv977chV2xWNotBshEwtueLhxxiWFPN0yy3Yxh36PZQWviBJvb6ce9BPG xcxb/+nKTtkRzRntixqyDMtRw3Hlbjz5c3jCNHKtxTGxeEYkW2jBEdPYd37XeiZtbOFll6 WiyfGOl5KJUoMr8sQmZbs9YbrIOyBgYhqGISpGV6P6/pNeOzOIcqKi6v/3dmdw== ARC-Authentication-Results: i=2; aspmx1.migadu.com; dkim=fail ("headers rsa verify failed") header.d=elephly.net header.s=zoho header.b=USeb6PkO; arc=reject ("signature check failed: fail, {[1] = sig:zohomail.com:reject}"); dmarc=none; spf=pass (aspmx1.migadu.com: domain of "bug-guix-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="bug-guix-bounces+larch=yhetil.org@gnu.org" X-Migadu-Spam-Score: -2.73 Authentication-Results: aspmx1.migadu.com; dkim=fail ("headers rsa verify failed") header.d=elephly.net header.s=zoho header.b=USeb6PkO; arc=reject ("signature check failed: fail, {[1] = sig:zohomail.com:reject}"); dmarc=none; spf=pass (aspmx1.migadu.com: domain of "bug-guix-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="bug-guix-bounces+larch=yhetil.org@gnu.org" X-Migadu-Queue-Id: 50C8C2ACB4 X-Spam-Score: -2.73 X-Migadu-Scanner: scn0.migadu.com X-TUID: iSGqpXETe4kn Ludovic Court=C3=A8s writes: > Ricardo Wurmus skribis: > >> I tried it in the GWL with the big RNAseq workflow I adopted from PiGx >> and the step to generate job scripts (which reference inferior packages) >> became considerably faster. There is still potential for improvement, >> but this change is the difference between not too bad (15 seconds) and >> unusable (> 5 minutes). > > Good, that=E2=80=99s a step in the right direction. > > I=E2=80=99ve sent in this issue a cleaned up patch series that achieves t= he same > result, plus some micro-optimizations. It=E2=80=99d be great if you could > confirm it still works for you. These patches look great to me and they work. My real-world test case is now down to about 12 seconds. Thanks! --=20 Ricardo