From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: Dmitry Gutov Newsgroups: gmane.emacs.devel Subject: Re: Native OS pipelines in eshell and Emacs Date: Wed, 29 May 2024 05:08:19 +0300 Message-ID: References: <08f95b98-7338-4365-8b55-7c337e57d447@gutov.dev> Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="33841"; mail-complaints-to="usenet@ciao.gmane.io" User-Agent: Mozilla Thunderbird Cc: emacs-devel@gnu.org, johnw@gnu.org, spwhitton@spwhitton.name To: Spencer Baugh Original-X-From: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Wed May 29 04:09:24 2024 Return-path: Envelope-to: ged-emacs-devel@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1sC8km-0008ch-11 for ged-emacs-devel@m.gmane-mx.org; Wed, 29 May 2024 04:09:24 +0200 Original-Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1sC8js-00026F-JK; Tue, 28 May 2024 22:08:28 -0400 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1sC8jq-00025d-JC for emacs-devel@gnu.org; Tue, 28 May 2024 22:08:27 -0400 Original-Received: from wfout5-smtp.messagingengine.com ([64.147.123.148]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1sC8jo-0006RC-Q7; Tue, 28 May 2024 22:08:26 -0400 Original-Received: from compute7.internal (compute7.nyi.internal [10.202.2.48]) by mailfout.west.internal (Postfix) with ESMTP id DABB51C000A9; Tue, 28 May 2024 22:08:22 -0400 (EDT) Original-Received: from mailfrontend1 ([10.202.2.162]) by compute7.internal (MEProxy); Tue, 28 May 2024 22:08:23 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gutov.dev; h=cc :cc:content-transfer-encoding:content-type:content-type:date :date:from:from:in-reply-to:in-reply-to:message-id:mime-version :references:reply-to:subject:subject:to:to; s=fm3; t=1716948502; x=1717034902; bh=5JJlKr9BpakjJMvWU8LmHTXchfvBiLyhy0c8N1ZVU3Y=; b= eJNRonzZanmyCsDCbe8ZLhxIJZuUXCACdcTbNiFuxfyqJL/hBjv8Fk0Z88VQuttw jomUxBTjaKShGD26FuvcC8JOM6Ht+QkqU3fUU0DSiUNXqUg4Q03ORmV/9BU5673Q 0pALCDBcO8PTb67UMI/tG7CabEwrUQkPZaFc8RnbHgbYfw5x6MJVvTb3+rmmV/uE RbYnLkgO7sEeRAkTrvw5n1QRrLLJQouNH7maKKHJKHPX5XVi/0lo985uj1axfWUP jEMyPw17uYzFJTV1ohahDTJ/yDvDYOFq484Ava/FHSCxvSjHiWHbEK1/FZor/fag 1k9ms2f/bGrYSwrnc3B/BA== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:cc:content-transfer-encoding :content-type:content-type:date:date:feedback-id:feedback-id :from:from:in-reply-to:in-reply-to:message-id:mime-version :references:reply-to:subject:subject:to:to:x-me-proxy:x-me-proxy :x-me-sender:x-me-sender:x-sasl-enc; s=fm1; t=1716948502; x= 1717034902; bh=5JJlKr9BpakjJMvWU8LmHTXchfvBiLyhy0c8N1ZVU3Y=; b=a 5+lewRLyvOyqBF1v3HYJS4n1XImvlbmdaE743zSRPsk2BLoi2aS3hnY11Z4z1J7N clfr/nK0SXukDg2LWHTheSSszQe8My/HK878vYBj+tcQflvNX70+nF+w86AohjOq P+3+ylnQU/SHmFj6hd9qllsC9UB4yBuKrXB/gXjKw9I3EZyVRnI9DzSjyKXsFa+B fBOHAVoURL4Em9bnGaer3qUUZ4DvmRY8eBpUxSrVl2Ug7nVDBY2gKZY5Id2wBzJ+ eZ0shdPUQJqysD4T0JHMahNHhUfqp5ZnGlmlbjnk8lQuEeaIE79E1e54vhvKuvuR N1ZmUKw349qDhNUsyY/1Q== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvledrvdejledgheegucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucesvcftvggtihhpihgvnhhtshculddquddttddmne cujfgurhepkfffgggfuffvvehfhfgjtgfgsehtkeertddtvdejnecuhfhrohhmpeffmhhi thhrhicuifhuthhovhcuoegumhhithhrhiesghhuthhovhdruggvvheqnecuggftrfgrth htvghrnhepgeelfeetkefghfdvhfdtgeevveevteetgeetveegtedthefhudekteehffeu keeknecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhhomhepug hmihhtrhihsehguhhtohhvrdguvghv X-ME-Proxy: Feedback-ID: i0e71465a:Fastmail Original-Received: by mail.messagingengine.com (Postfix) with ESMTPA; Tue, 28 May 2024 22:08:20 -0400 (EDT) Content-Language: en-US In-Reply-To: Received-SPF: pass client-ip=64.147.123.148; envelope-from=dmitry@gutov.dev; helo=wfout5-smtp.messagingengine.com X-Spam_score_int: -26 X-Spam_score: -2.7 X-Spam_bar: -- X-Spam_report: (-2.7 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_LOW=-0.7, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_SBL_A=0.1 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: emacs-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Emacs development discussions." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Original-Sender: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Xref: news.gmane.io gmane.emacs.devel:319666 Archived-At: On 29/05/2024 04:43, Spencer Baugh wrote: > It would be doubly interesting if we manage to implement it so that > Tramp would be able to connect two processes directly without > round-tripping the i/o from the remote host to local and back to > remote. > That's a major source of latency in project-find-regexp on remote. > > > Unfortunately this is almost impossibly hard.  But, I actually have > worked extensively on doing this specific impossible thing (remote > process APIs that are powerful enough to do this) so I will eventually > try to implement them for Emacs and TRAMP.  It would allow full > make-process support in TRAMP as well as a make-pipe-process which > represents a pipe existing on a remote system. On the remote, it would be fine if the pipe is not direct between such processes, but goes through the shell, or maybe some other processes as well (maybe a temp file?). That would still be faster than doing the round-trip. > Anyway, in the short term it will probably only work efficiently for > local processes, with remote project-files having to roundtrip through > the local Emacs. Yes, well. For local processes, it would at least help with "asynchronous regexp search" Xref UI.