From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: Tyler Dodge Newsgroups: gmane.emacs.devel Subject: Re: limitation in how emacs processes subprocess output, maybe belongs to mainstream Date: Wed, 25 May 2022 13:18:52 -0700 Message-ID: References: <875yltzilg.fsf@gmail.com> Mime-Version: 1.0 (1.0) Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="8434"; mail-complaints-to="usenet@ciao.gmane.io" Cc: Jean Louis , Emacs Developers To: Robert Pluim Original-X-From: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Thu May 26 07:00:15 2022 Return-path: Envelope-to: ged-emacs-devel@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1nu5bZ-0001uF-RU for ged-emacs-devel@m.gmane-mx.org; Thu, 26 May 2022 07:00:14 +0200 Original-Received: from localhost ([::1]:45270 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1nu5bX-0003fd-Rk for ged-emacs-devel@m.gmane-mx.org; Thu, 26 May 2022 01:00:12 -0400 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]:55386) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1ntxTL-0001q1-3u for emacs-devel@gnu.org; Wed, 25 May 2022 16:19:15 -0400 Original-Received: from wout4-smtp.messagingengine.com ([64.147.123.20]:36789) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1ntxTB-0002Z1-Do for emacs-devel@gnu.org; Wed, 25 May 2022 16:19:09 -0400 Original-Received: from compute5.internal (compute5.nyi.internal [10.202.2.45]) by mailout.west.internal (Postfix) with ESMTP id 856DC32008FD; Wed, 25 May 2022 16:18:56 -0400 (EDT) Original-Received: from mailfrontend1 ([10.202.2.162]) by compute5.internal (MEProxy); Wed, 25 May 2022 16:18:56 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= tdodge.consulting; h=cc:cc:content-transfer-encoding :content-type:date:date:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:sender:subject :subject:to:to; s=fm2; t=1653509936; x=1653596336; bh=mDYPtgpgUB Vl1uVchlcEduD3qfa/UPp4La6Fp3eH6Ec=; b=mpunut4dwlogumgnT9EJL12rQJ Nkd1KlDOuQISU95ficTdEAPwRg+rWko7PljziHe8YbRa3T9KhWrzQPhSKK+WbrCE ag0IPETXNkR7kqU28HL0gRTwsUjmiME8vhHDDx1kYZ53EOs2WN1ukU6Rk1E5bdU0 2yr8iszJyaP0JJXYvGhzlubxIBgQ1Y66hFA+pREM9J7HirhwPtV4X8k5vLu9ngvm hUenD5ZlhtM4DYy29pM1yfXlBdshRWtdr5cQigbIndaXCkLGxJq5FPZgGGgExacn Kvo8By9Z6kiv4ifn35noW1DYXNaerykD5HDCu9GPswMAw+sp4XsaVKgKMKDA== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:cc:content-transfer-encoding :content-type:date:date:feedback-id:feedback-id:from:from :in-reply-to:in-reply-to:message-id:mime-version:references :reply-to:sender:subject:subject:to:to:x-me-proxy:x-me-proxy :x-me-sender:x-me-sender:x-sasl-enc; s=fm1; t=1653509936; x= 1653596336; bh=mDYPtgpgUBVl1uVchlcEduD3qfa/UPp4La6Fp3eH6Ec=; b=w 0pl1GL2yBTy6gKD3pBJOVRtOBjmtZwRqT0+8CJ1hYZiDcrNJNLjPjOLhwC89e4h0 5uY8Fe/3oGoFM25Z04szbTeAk6Qs8xAcxvR5nwsqduMVi5J6GBOQtTqtje6zG1Kj b7nTA6XMBAqYQL8trMzHhWzhMq2g5kX6itWRGOoSKi/iNDAVaGYh6QokM1pxl0Qh GucJumDEks5+g4bA312sVnLxSL0v0wUp8PuZ0Qla+g5f3rO9TEQl+BUoeYQcNyHn wCx6UBGdnJHrX3fkHvnr4WIXAy9tnqDs2OSCKfcKY7FKv8Q7RviNtJY2XDMaMRI7 YPd91cIDpTXkq8KlCVRaw== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvfedrjeehgddugeehucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucesvcftvggtihhpihgvnhhtshculddquddttddmne cujfgurheptgfghfggufffkfhfvegjvffosehtqhhmtdhhtdejnecuhfhrohhmpefvhihl vghrucffohgughgvuceothihlhgvrhesthguohgughgvrdgtohhnshhulhhtihhngheqne cuggftrfgrthhtvghrnhepudejgffhieelgeffueevudefuedvgeeiuefgheeukefhledu keetjeelleehteetnecuffhomhgrihhnpehtughoughgvgdrtghonhhsuhhlthhinhhgpd hgihhthhhusgdrtghomhenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgr ihhlfhhrohhmpehthihlvghrsehtughoughgvgdrtghonhhsuhhlthhinhhg X-ME-Proxy: Feedback-ID: icda14427:Fastmail Original-Received: by mail.messagingengine.com (Postfix) with ESMTPA; Wed, 25 May 2022 16:18:55 -0400 (EDT) In-Reply-To: <875yltzilg.fsf@gmail.com> X-Mailer: iPhone Mail (19D52) Received-SPF: pass client-ip=64.147.123.20; envelope-from=tyler@tdodge.consulting; helo=wout4-smtp.messagingengine.com X-Spam_score_int: -25 X-Spam_score: -2.6 X-Spam_bar: -- X-Spam_report: (-2.6 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, NO_DNS_FOR_FROM=0.001, RCVD_IN_DNSWL_LOW=-0.7, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=ham autolearn_force=no X-Spam_action: no action X-Mailman-Approved-At: Thu, 26 May 2022 00:51:15 -0400 X-BeenThere: emacs-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Emacs development discussions." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Original-Sender: "Emacs-devel" Xref: news.gmane.io gmane.emacs.devel:290261 Archived-At: Hi Robert, Thanks for reaching out. I=E2=80=99d love to sign over the copyright for thi= s. Please let me know what you all need from my end to facilitate that. Tyler Dodge > On May 25, 2022, at 9:23 AM, Robert Pluim wrote: >=20 > =EF=BB=BF >>=20 >>>>>> On Wed, 25 May 2022 15:10:55 +0300, Jean Louis sai= d: >=20 > Jean> I have read in Emacs News by Sacha Chua, about this Eshell speed u= p: > Jean> =46rom 70 Seconds To 3 Seconds > Jean> https://tdodge.consulting/blog/eshell/background-output-thread >=20 > Jean> and the fork of Emacs is here: >=20 > Jean> GitHub - tyler-dodge/emacs: Fork of emacs mirror Emacs. Has a > Jean> background thread optimization for getting past the 1024 byte > Jean> bottleneck on MacOS > Jean> https://github.com/tyler-dodge/emacs >=20 > Jean> Where author writes: >=20 >>> In a change that I made to my fork of emacs, I added a background >>> thread that continuously handles buffering subprocess output. This >>> has the benefit of ensuring that the subprocess output is consumed >>> as soon as it is available in STDOUT, which minimizes the amount of >>> time that the subprocess blocks waiting for emacs to consume its >>> output. This also makes it so that the strings passed to the >>> subprocess filter can be larger than 1024 bytes because multiple >>> reads can happen in the time between event loop evaluations. >=20 > Jean> Maybe developers and author may find it useful to implement autho= r's > Jean> feature in the main stream Emacs? >=20 > Maybe. What's the copyright status of those changes? >=20 > Thanks >=20 > Robert > --=20