From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: Robert Pluim Newsgroups: gmane.emacs.devel Subject: Re: limitation in how emacs processes subprocess output, maybe belongs to mainstream Date: Wed, 25 May 2022 18:23:55 +0200 Message-ID: <875yltzilg.fsf@gmail.com> References: Mime-Version: 1.0 Content-Type: text/plain Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="34038"; mail-complaints-to="usenet@ciao.gmane.io" Cc: Emacs Developers , "Tyler Dodge" To: Jean Louis Original-X-From: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Wed May 25 18:35:05 2022 Return-path: Envelope-to: ged-emacs-devel@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1nttyT-0008ef-82 for ged-emacs-devel@m.gmane-mx.org; Wed, 25 May 2022 18:35:05 +0200 Original-Received: from localhost ([::1]:37692 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1nttyS-0001yM-7z for ged-emacs-devel@m.gmane-mx.org; Wed, 25 May 2022 12:35:04 -0400 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]:41200) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nttnl-00067e-SQ for emacs-devel@gnu.org; Wed, 25 May 2022 12:24:03 -0400 Original-Received: from mail-wr1-x432.google.com ([2a00:1450:4864:20::432]:34590) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1nttni-00081T-Nj for emacs-devel@gnu.org; Wed, 25 May 2022 12:24:00 -0400 Original-Received: by mail-wr1-x432.google.com with SMTP id e2so19229937wrc.1 for ; Wed, 25 May 2022 09:23:57 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=from:to:cc:subject:references:gmane-reply-to-list:date:in-reply-to :message-id:mime-version; bh=c+k1LvYlSahaqt7PKz9YDC1iiFo5axHNbhwPkYfioRc=; b=ghGNWfp4mfF6D4VCyka1ALs58HWHdEbULStirU8EP36Pg8PTg0PmKNBqsHwr6OOVys dEwNcT3JS1ZVM0wOrywTx1TiQaFKYkCrHAsauNg/ZO8Ukhpzx5VI8uqB/6hsmnHhOIV/ t/l8xM5n817Xk+5Xk34MDIS7tagSp8D5Jh/Kwo1nDPe6qQxbqn2eZwIHe7hTnJQgiml7 yT0U0mrBWUhe9JiF8sZUI7PSPwrmrVVaVQmE3REBxcMzF93wPCnCTt8aOxePD0g+T6pc IXRo/9SDUbWziR5x8tyaD0eDzDjG+lQblxPlnnOMIMZwx1WK6RXZ2jeXviDPTWyULTS5 IstQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:from:to:cc:subject:references :gmane-reply-to-list:date:in-reply-to:message-id:mime-version; bh=c+k1LvYlSahaqt7PKz9YDC1iiFo5axHNbhwPkYfioRc=; b=FfzEG52p22txmkKGZLhV+cc59WK6zETh6w6uKxyDLVDTONni9NhjWiwSu/pH/h8b6v loFy0bv1tCFv546NyVYQTwD2cgyuyZ2lnP3Kikq91zExxy/RA0lchEHqfBGIJyLm0s1D 7/Qcw5mRH9ZKzf2kPQSf4i77+QKvaBgkCXd6KuNBmfUZHgxsyRF/8KwmuJkOaExQ498R dIoDEkpi2lzPjCzbdJwWhN6LEGoPE5ELCZK+k/yn8cAakBrOTQ0oF4WWMIsEoao4DGKu aMTh+WRWx5V3deov23bIupUfVcJ+g49DtkE9hjGSUu3z/b9VnJUesBu1sghRzKxfI3rB WbEw== X-Gm-Message-State: AOAM531gzFkTQ7MgX+4bC4cXrkw9h1quwr7PMSEA/g9dhvDJ9KtFaQvW jjRO8B4yZgchyf6v81G0uQw= X-Google-Smtp-Source: ABdhPJyJkCj8bdnF4qYEloAGUC7hyIrnFDz2r/o6b9RI18wGei5UO23cfWCfzzyvbZwhuLScl06lIg== X-Received: by 2002:a5d:5984:0:b0:20f:f3a1:fc56 with SMTP id n4-20020a5d5984000000b0020ff3a1fc56mr6685172wri.718.1653495836389; Wed, 25 May 2022 09:23:56 -0700 (PDT) Original-Received: from rltb ([2a01:e0a:3f3:fb50:80b9:1d4e:a948:40cd]) by smtp.gmail.com with ESMTPSA id l6-20020a05600c4f0600b003942a244f2fsm2385704wmq.8.2022.05.25.09.23.55 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 25 May 2022 09:23:55 -0700 (PDT) Gmane-Reply-To-List: yes In-Reply-To: (Jean Louis's message of "Wed, 25 May 2022 15:10:55 +0300") Received-SPF: pass client-ip=2a00:1450:4864:20::432; envelope-from=rpluim@gmail.com; helo=mail-wr1-x432.google.com X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: emacs-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Emacs development discussions." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Original-Sender: "Emacs-devel" Xref: news.gmane.io gmane.emacs.devel:290256 Archived-At: >>>>> On Wed, 25 May 2022 15:10:55 +0300, Jean Louis said: Jean> I have read in Emacs News by Sacha Chua, about this Eshell speed up: Jean> From 70 Seconds To 3 Seconds Jean> https://tdodge.consulting/blog/eshell/background-output-thread Jean> and the fork of Emacs is here: Jean> GitHub - tyler-dodge/emacs: Fork of emacs mirror Emacs. Has a Jean> background thread optimization for getting past the 1024 byte Jean> bottleneck on MacOS Jean> https://github.com/tyler-dodge/emacs Jean> Where author writes: >> In a change that I made to my fork of emacs, I added a background >> thread that continuously handles buffering subprocess output. This >> has the benefit of ensuring that the subprocess output is consumed >> as soon as it is available in STDOUT, which minimizes the amount of >> time that the subprocess blocks waiting for emacs to consume its >> output. This also makes it so that the strings passed to the >> subprocess filter can be larger than 1024 bytes because multiple >> reads can happen in the time between event loop evaluations. Jean> Maybe developers and author may find it useful to implement author's Jean> feature in the main stream Emacs? Maybe. What's the copyright status of those changes? Thanks Robert --