From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.org!not-for-mail From: Dan Nicolaescu Newsgroups: gmane.emacs.devel Subject: Re: slow processing of process output when it's huge Date: Tue, 29 Jul 2008 08:48:52 -0700 Message-ID: <200807291548.m6TFmqRj018784@sallyv1.ics.uci.edu> References: <200807272236.m6RMaCtR015237@sallyv1.ics.uci.edu> NNTP-Posting-Host: lo.gmane.org Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Trace: ger.gmane.org 1217346687 12759 80.91.229.12 (29 Jul 2008 15:51:27 GMT) X-Complaints-To: usenet@ger.gmane.org NNTP-Posting-Date: Tue, 29 Jul 2008 15:51:27 +0000 (UTC) To: emacs-devel@gnu.org Original-X-From: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Tue Jul 29 17:52:17 2008 Return-path: Envelope-to: ged-emacs-devel@m.gmane.org Original-Received: from lists.gnu.org ([199.232.76.165]) by lo.gmane.org with esmtp (Exim 4.50) id 1KNrUk-0004Mz-5W for ged-emacs-devel@m.gmane.org; Tue, 29 Jul 2008 17:52:14 +0200 Original-Received: from localhost ([127.0.0.1]:38539 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.43) id 1KNrTq-00079l-5Q for ged-emacs-devel@m.gmane.org; Tue, 29 Jul 2008 11:51:18 -0400 Original-Received: from mailman by lists.gnu.org with tmda-scanned (Exim 4.43) id 1KNrTm-00079d-2Z for emacs-devel@gnu.org; Tue, 29 Jul 2008 11:51:14 -0400 Original-Received: from exim by lists.gnu.org with spam-scanned (Exim 4.43) id 1KNrTk-00079L-I4 for emacs-devel@gnu.org; Tue, 29 Jul 2008 11:51:12 -0400 Original-Received: from [199.232.76.173] (port=45262 helo=monty-python.gnu.org) by lists.gnu.org with esmtp (Exim 4.43) id 1KNrTk-00079I-BO for emacs-devel@gnu.org; Tue, 29 Jul 2008 11:51:12 -0400 Original-Received: from sallyv1.ics.uci.edu ([128.195.1.109]:37767) by monty-python.gnu.org with esmtps (TLS-1.0:DHE_RSA_3DES_EDE_CBC_SHA1:24) (Exim 4.60) (envelope-from ) id 1KNrTj-00084J-UQ for emacs-devel@gnu.org; Tue, 29 Jul 2008 11:51:12 -0400 X-ICS-MailScanner-Watermark: 1217951333.268@DZJ7Ok/FE8OuNPn+sBzTQA Original-Received: from mothra.ics.uci.edu (mothra.ics.uci.edu [128.195.6.93]) by sallyv1.ics.uci.edu (8.13.7+Sun/8.13.7) with ESMTP id m6TFmqRj018784 for ; Tue, 29 Jul 2008 08:48:52 -0700 (PDT) In-Reply-To: <200807272236.m6RMaCtR015237@sallyv1.ics.uci.edu> (Dan Nicolaescu's message of "Sun, 27 Jul 2008 15:36:12 -0700") Original-Lines: 15 X-ICS-MailScanner: Found to be clean X-ICS-MailScanner-SpamCheck: not spam, SpamAssassin (score=-1.44, required 5, autolearn=disabled, ALL_TRUSTED -1.44) X-ICS-MailScanner-From: dann@mothra.ics.uci.edu X-detected-kernel: by monty-python.gnu.org: Solaris 10 (beta) X-BeenThere: emacs-devel@gnu.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: "Emacs development discussions." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Original-Sender: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Errors-To: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Xref: news.gmane.org gmane.emacs.devel:101693 Archived-At: One more data point that shows that this problem can actually occur for much smaller process output sizes (less than 10k lines). emacs -Q -nw M-: (setq-default case-fold-search nil) RET M-x rgrep RET emacs RET PATH_TO_EMACS_SOURCE_TREE/lisp RET this takes a few minutes. Running the correspondind command: find . \( -path \*/SCCS -o -path \*/RCS -o -path \*/CVS -o -path \*/MCVS -o -path \*/.svn -o -path \*/.git -o -path \*/.hg -o -path \*/.bzr -o -path \*/_MTN -o -path \*/_darcs -o -path \*/\{arch\} \) -prune -o -type f \( -name \* \) -print0 | xargs -0 -e grep -i -nH -e emacs from a shell (and redirecting the output to a file) takes less than one second.