From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: Manuel Giraud via "Bug reports for GNU Emacs, the Swiss army knife of text editors" Newsgroups: gmane.emacs.bugs Subject: bug#71094: [PATCH] Prefer to run find and grep in parallel in rgrep Date: Wed, 22 May 2024 20:06:44 +0200 Message-ID: <87pltdbu17.fsf@ledu-giraud.fr> References: <86ttiq6or8.fsf@gnu.org> <8aedd0ed-58fe-4ac7-98d6-950be2d4700b@gutov.dev> <868r026jlq.fsf@gnu.org> <861q5t7vrp.fsf@gnu.org> <10f62497-dfb1-4c46-b18a-6d1100de4b6a@gutov.dev> <86wmnl6f62.fsf@gnu.org> Reply-To: Manuel Giraud Mime-Version: 1.0 Content-Type: text/plain Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="10946"; mail-complaints-to="usenet@ciao.gmane.io" User-Agent: Gnus/5.13 (Gnus v5.13) Cc: Dmitry Gutov , 71094@debbugs.gnu.org, rgm@gnu.org, sbaugh@janestreet.com To: Eli Zaretskii Original-X-From: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org Wed May 22 20:07:10 2024 Return-path: Envelope-to: geb-bug-gnu-emacs@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1s9qMo-0002aD-8B for geb-bug-gnu-emacs@m.gmane-mx.org; Wed, 22 May 2024 20:07:10 +0200 Original-Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1s9qMc-0008H0-B3; Wed, 22 May 2024 14:06:58 -0400 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1s9qMb-0008GP-21 for bug-gnu-emacs@gnu.org; Wed, 22 May 2024 14:06:57 -0400 Original-Received: from debbugs.gnu.org ([2001:470:142:5::43]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1s9qMa-0000IR-QC for bug-gnu-emacs@gnu.org; Wed, 22 May 2024 14:06:56 -0400 Original-Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1s9qMg-0005qI-9Y for bug-gnu-emacs@gnu.org; Wed, 22 May 2024 14:07:02 -0400 X-Loop: help-debbugs@gnu.org Resent-From: Manuel Giraud Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Wed, 22 May 2024 18:07:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 71094 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: patch Original-Received: via spool by 71094-submit@debbugs.gnu.org id=B71094.171640121722450 (code B ref 71094); Wed, 22 May 2024 18:07:02 +0000 Original-Received: (at 71094) by debbugs.gnu.org; 22 May 2024 18:06:57 +0000 Original-Received: from localhost ([127.0.0.1]:57379 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1s9qMb-0005q2-1H for submit@debbugs.gnu.org; Wed, 22 May 2024 14:06:57 -0400 Original-Received: from ledu-giraud.fr ([51.159.28.247]:25875) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1s9qMY-0005pw-KS for 71094@debbugs.gnu.org; Wed, 22 May 2024 14:06:55 -0400 DKIM-Signature: v=1; a=ed25519-sha256; c=simple/simple; s=ed25519; bh=dCvbjo0R 1QQRke/vf3socaM5EglOSUwjbG0I7JLV2+U=; h=date:references:in-reply-to: subject:cc:to:from; d=ledu-giraud.fr; b=2wTFtui+RVzJAbxFcuD2mRmZBpiOZe zrmq6a1TJoiiGB0nc+hHxtdbjoj0MXKdvxESXzq/D8JQqC35YICNShBg== DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; s=rsa; bh=dCvbjo0R1QQRke/v f3socaM5EglOSUwjbG0I7JLV2+U=; h=date:references:in-reply-to:subject: cc:to:from; d=ledu-giraud.fr; b=1I3AUDzkl5AghOQARpyyO7KIveU1Wky5tq6FRw HQbSxoIf3r5FjNOEqr8ZprvAmSUb2FMNexW3CJVIsqNYEjmQ700PirseHkcj3vPoeDcUdh 0SFYqxo4GVuiRnzYjJ/QT8j40HtDYBfjcTFMtrfHZRJGYXipcjmCTSemlNejlFMNeqFJx+ 1R5JuvdoeXrI+7cHWZ/Ywy/2ldyFkyYhllSNUc7ixmqAjwXZYqeceEG507vWO31lE8W/gx tzhWTrJyyMHhNRNmnF5upf4a7O2ARSXnmtIuAWms+3LL5z6qzxuJfWDZcUZn/3mR6Lk4nq Whlr8caJ8nzEI9bv0gt+FsuQ== Original-Received: from computer ( [10.1.1.1]) by ledu-giraud.fr (OpenSMTPD) with ESMTPSA id 0aff69f9 (TLSv1.3:TLS_AES_256_GCM_SHA384:256:NO); Wed, 22 May 2024 20:06:46 +0200 (CEST) In-Reply-To: <86wmnl6f62.fsf@gnu.org> (Eli Zaretskii's message of "Wed, 22 May 2024 18:26:45 +0300") X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-BeenThere: bug-gnu-emacs@gnu.org List-Id: "Bug reports for GNU Emacs, the Swiss army knife of text editors" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org Original-Sender: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org Xref: news.gmane.io gmane.emacs.bugs:285646 Archived-At: Eli Zaretskii writes: [...] >> >> So here is another example: a Linux kernel checkout (76K files). Also >> >> about 30% improvement: 1.40s vs 2.00s. >> > >> > This is all highly system-dependent. >> >> Naturally. So it'd be great to see some additional data points from >> users on other systems. >> >> Especially those where the default limit is lower than it is on mine. > > I'd be happy if someone could time these methods on MS-Windows and on > some *BSD system, at least. Bonus points for macOS. I'm not sure it is what you asked for but here is some numbers on OpenBSD (native 'find' and 'xargs'): $ time find ~/emacs-repo -type f -exec grep foo {} + > /dev/null 0m04.09s real 0m03.29s user 0m00.74s system $ time find ~/emacs-repo -type f -print0 | xargs -0 grep foo > /dev/null 0m04.10s real 0m03.45s user 0m00.66s system $ find /usr/src -type f | wc -l 114315 $ time find /usr/src -type f -exec grep foo {} + > /dev/null 0m14.07s real 0m07.68s user 0m06.29s system $ time find /usr/src -type f -print0 | xargs -0 grep foo > /dev/null 0m13.83s real 0m07.94s user 0m06.25s system -- Manuel Giraud