From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: Dmitry Gutov Newsgroups: gmane.emacs.devel Subject: Re: Native OS pipelines in eshell and Emacs Date: Wed, 29 May 2024 04:21:20 +0300 Message-ID: <08f95b98-7338-4365-8b55-7c337e57d447@gutov.dev> References: Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="12017"; mail-complaints-to="usenet@ciao.gmane.io" User-Agent: Mozilla Thunderbird Cc: johnw@gnu.org, spwhitton@spwhitton.name To: Spencer Baugh , emacs-devel@gnu.org Original-X-From: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Wed May 29 03:22:14 2024 Return-path: Envelope-to: ged-emacs-devel@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1sC818-0002wz-0Q for ged-emacs-devel@m.gmane-mx.org; Wed, 29 May 2024 03:22:14 +0200 Original-Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1sC80W-00035i-JM; Tue, 28 May 2024 21:21:37 -0400 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1sC80U-00034k-0s for emacs-devel@gnu.org; Tue, 28 May 2024 21:21:34 -0400 Original-Received: from wfhigh7-smtp.messagingengine.com ([64.147.123.158]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1sC80L-0000Km-K7; Tue, 28 May 2024 21:21:33 -0400 Original-Received: from compute4.internal (compute4.nyi.internal [10.202.2.44]) by mailfhigh.west.internal (Postfix) with ESMTP id C73F81800134; Tue, 28 May 2024 21:21:23 -0400 (EDT) Original-Received: from mailfrontend1 ([10.202.2.162]) by compute4.internal (MEProxy); Tue, 28 May 2024 21:21:24 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gutov.dev; h=cc :cc:content-transfer-encoding:content-type:content-type:date :date:from:from:in-reply-to:in-reply-to:message-id:mime-version :references:reply-to:subject:subject:to:to; s=fm3; t=1716945683; x=1717032083; bh=Npo8rSwFygBn1hMT8jhcBblQimdLDq6W4SPzbvHsdIE=; b= nIiHqBiTJ2+SGpPN8pKf1KQ0xsyp3IVAo9Ne2cUxMnMC30T1V/v+y0rNmByXFCEC V1URQYMUbJdlquzOlH0sfeQtI5+YB5Dh8qluaCLhSTAal6sWKmVnnq9q5HxlPqlN fQ0IvG5315wyAU32ZjsX1pvKZbo8kmRELNWB5oZn+ZbJ7XYtg6FYgJ2qjE/YGfdz /MTS0s09QCBvALbChEMxBbS+xZpI+upYk4VCHtBj30T9UGTjlTf45DYbdajbW9Kr 0Md4B9QK0dGnIaTHODnDaRytbXvNqHeTSruR2ADHAC1KeBAHnGMCSJteCh/c414B XejOfeqL7o6lOWmi/naEZg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:cc:content-transfer-encoding :content-type:content-type:date:date:feedback-id:feedback-id :from:from:in-reply-to:in-reply-to:message-id:mime-version :references:reply-to:subject:subject:to:to:x-me-proxy:x-me-proxy :x-me-sender:x-me-sender:x-sasl-enc; s=fm1; t=1716945683; x= 1717032083; bh=Npo8rSwFygBn1hMT8jhcBblQimdLDq6W4SPzbvHsdIE=; b=N 850uVTNOzC5yrEqIcGpTL6r81zr+Zz8tHuSjWExV0n+sRZsmtOLCwqFJOT+AuR8M Zzfh71j32O2p83USnDI4sbHuuin5u7CYT0rP4G9ZmHZayEiba7H8N60nLMFN+7bm W4I9/ZkUK3sQhLrKi6snOmr9F5ygjqRlcgDJxjUsNBWCMjlEcaLi7dCdSUwLGVNY mEOyKTkczxtm/bUjWRVEDbsLut1grZMwLcAVDzUg23kV+En0f27BZ17PkNgSEH2X khP+IKXpmZhPHN6Hlrk+R+pDgd7jBqmps6r7N4jwf5bsl7Bb+bLWvqKCkm54r5zD tvbSkeTjalX+M3jxHJXbA== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvledrvdejledggeegucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucesvcftvggtihhpihgvnhhtshculddquddttddmne cujfgurhepkfffgggfuffvvehfhfgjtgfgsehtjeertddtvdejnecuhfhrohhmpeffmhhi thhrhicuifhuthhovhcuoegumhhithhrhiesghhuthhovhdruggvvheqnecuggftrfgrth htvghrnhepteduleejgeehtefgheegjeekueehvdevieekueeftddvtdevfefhvdevgedu jeehnecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhhomhepug hmihhtrhihsehguhhtohhvrdguvghv X-ME-Proxy: Feedback-ID: i0e71465a:Fastmail Original-Received: by mail.messagingengine.com (Postfix) with ESMTPA; Tue, 28 May 2024 21:21:21 -0400 (EDT) Content-Language: en-US In-Reply-To: Received-SPF: pass client-ip=64.147.123.158; envelope-from=dmitry@gutov.dev; helo=wfhigh7-smtp.messagingengine.com X-Spam_score_int: -27 X-Spam_score: -2.8 X-Spam_bar: -- X-Spam_report: (-2.8 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_LOW=-0.7, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: emacs-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Emacs development discussions." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Original-Sender: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Xref: news.gmane.io gmane.emacs.devel:319665 Archived-At: On 28/05/2024 17:42, Spencer Baugh wrote: > This same ability would be useful for project.el, where it would be nice > for the output of project-files (e.g. "git ls-files") to be piped > directly to xargs grep for commands like project-find-regexp, instead of > sending the data through Emacs which makes it substantially slower. I have indeed been considering something like that for project-files -> xref-matches-in-files. But mostly in broad strokes. > Specifically, the new feature would be something like an :stdin argument > to make-process which allows a make-pipe-process (or other process) to > be passed as stdin, and grabs the output file descriptor from that > process (what Emacs would normally read) and passes it down as stdin for > the new process instead. It would be doubly interesting if we manage to implement it so that Tramp would be able to connect two processes directly without round-tripping the i/o from the remote host to local and back to remote. That's a major source of latency in project-find-regexp on remote.