bug#67672: EMACS - Slow opening files

bug#67672: EMACS - Slow opening files

[Chand, Suresh]

[-- Attachment #1: Type: text/plain, Size: 1183 bytes --]

Hello,

We were hoping you could help us with issues that our reviewer is experiencing, slowness in opening files. It takes 30-60 seconds to open a file.
The installed version is v27 on Ubuntu 18.04.

Any help would be greatly appreciated.



Suresh Chand
Senior Litigation and E-Discovery Data Specialist
Cooley LLP
3175 Hanover Street
Palo Alto, CA  94304-1130
+1 650 843 5919 office
+1 650 849 7400 fax
schand@cooley.com<mailto:rmoore@cooley.com>


Cooley is one of Fortune's 100 Best Companies to Work For<http://www.cooley.com/greatplacetowork>
Cooley GO > Start and build your business<http://www.cooleygo.com/>



________________________________

This email message is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.


[-- Attachment #2: Type: text/html, Size: 5615 bytes --]

bug#67672: EMACS - Slow opening files

[Eli Zaretskii]

> Cc: "Moore, Rider" <rmoore@cooley.com>
> From: "Chand, Suresh" <schand@cooley.com>
> Date: Wed, 6 Dec 2023 22:43:02 +0000
> 
> We were hoping you could help us with issues that our reviewer is experiencing, slowness in opening
> files. It takes 30-60 seconds to open a file.
> 
> The installed version is v27 on Ubuntu 18.04.

Are they files on a volume mounted via a network?  Or are they files
on a local filesystem?

bug#67672: EMACS - Slow opening files

[Moore, Rider]

Hi Eli,

The computer is offline at all times and the volume is mounted via truecrypt.

Thanks,

-Rider

-----Original Message-----
From: Eli Zaretskii <eliz@gnu.org>
Sent: Wednesday, December 6, 2023 10:43 PM
To: Chand, Suresh <schand@cooley.com>
Cc: 67672@debbugs.gnu.org; Moore, Rider <rmoore@cooley.com>
Subject: Re: bug#67672: EMACS - Slow opening files

[External]

______________________________________________________________________
> Cc: "Moore, Rider" <rmoore@cooley.com>
> From: "Chand, Suresh" <schand@cooley.com>
> Date: Wed, 6 Dec 2023 22:43:02 +0000
>
> We were hoping you could help us with issues that our reviewer is
> experiencing, slowness in opening files. It takes 30-60 seconds to open a file.
>
> The installed version is v27 on Ubuntu 18.04.

Are they files on a volume mounted via a network?  Or are they files on a local filesystem?

________________________________

This email message is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.

bug#67672: EMACS - Slow opening files

[Eli Zaretskii]

> From: "Moore, Rider" <rmoore@cooley.com>
> CC: "67672@debbugs.gnu.org" <67672@debbugs.gnu.org>
> Date: Thu, 7 Dec 2023 16:39:32 +0000
> 
> The computer is offline at all times and the volume is mounted via truecrypt.

Then perhaps volumes mounted via truecrypt implement some file I/O
operations slowly?  Can you start "M-x profiler-start" before opening
a file on such a volume, then "M-x profiler-report" after the file is
opened, and post the full expanded profile here?

bug#67672: EMACS - Slow opening files

[Moore, Rider]

Just to confirm we type the start command without sudo just before we open a file with command gmacs [filename]?

-----Original Message-----
From: Eli Zaretskii <eliz@gnu.org>
Sent: Thursday, December 7, 2023 10:02 AM
To: Moore, Rider <rmoore@cooley.com>
Cc: Chand, Suresh <schand@cooley.com>; 67672@debbugs.gnu.org
Subject: Re: bug#67672: EMACS - Slow opening files

[External]

______________________________________________________________________
> From: "Moore, Rider" <rmoore@cooley.com>
> CC: "67672@debbugs.gnu.org" <67672@debbugs.gnu.org>
> Date: Thu, 7 Dec 2023 16:39:32 +0000
>
> The computer is offline at all times and the volume is mounted via truecrypt.

Then perhaps volumes mounted via truecrypt implement some file I/O operations slowly?  Can you start "M-x profiler-start" before opening a file on such a volume, then "M-x profiler-report" after the file is opened, and post the full expanded profile here?

________________________________

This email message is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.

bug#67672: EMACS - Slow opening files

[Eli Zaretskii]

> From: "Moore, Rider" <rmoore@cooley.com>
> CC: "Chand, Suresh" <schand@cooley.com>,
>         "67672@debbugs.gnu.org"
> 	<67672@debbugs.gnu.org>
> Date: Thu, 7 Dec 2023 18:16:59 +0000
> 
> Just to confirm we type the start command without sudo just before we open a file with command gmacs [filename]?

No, please start Emacs without the FILENAME argument, then invoke
"M-x profiler-start", the "C-x C-f THE-FILE RET", then
"M-x profiler-report".

bug#67672: EMACS - Slow opening files

[Moore, Rider]

[-- Attachment #1: Type: text/plain, Size: 1414 bytes --]

Eli,

Please find the report attached.

Thanks,

-Rider

-----Original Message-----
From: Eli Zaretskii <eliz@gnu.org>
Sent: Thursday, December 7, 2023 10:29 AM
To: Moore, Rider <rmoore@cooley.com>
Cc: Chand, Suresh <schand@cooley.com>; 67672@debbugs.gnu.org
Subject: Re: bug#67672: EMACS - Slow opening files

[External]

______________________________________________________________________
> From: "Moore, Rider" <rmoore@cooley.com>
> CC: "Chand, Suresh" <schand@cooley.com>,
>         "67672@debbugs.gnu.org"
>       <67672@debbugs.gnu.org>
> Date: Thu, 7 Dec 2023 18:16:59 +0000
>
> Just to confirm we type the start command without sudo just before we open a file with command gmacs [filename]?

No, please start Emacs without the FILENAME argument, then invoke "M-x profiler-start", the "C-x C-f THE-FILE RET", then "M-x profiler-report".

________________________________

This email message is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.


[-- Attachment #2: GNU Emacs.txt --]
[-- Type: text/plain, Size: 2367 bytes --]

Function							CPU Samples	%


-command-execute						259		93%
-Call-interactively						259		93%
-Funcall-interactively						153		55%
-Find-file							103		37%
-find-file-noselect						103		37%
-find-file-noselect-1						103		37%
-after-find-file						103		37%
-normal-mode							103		37%
-set-auto-mode-0						103		37%
-python-mode							99		35%
-byte-code							95		34%
-require							95		34%
-byte-code							77		27%
-require							77		27%
-byte-code							66		23%
-require							66		23%
-byte-code							66		23%
-require							66		23%
-byte-code							50		17%
-ucs-normalize-make-transla...					36		12%
make-traslation-table-fr...					4		1%
-require							10		3%
bytecode							3		1%
-eieio-defclass-internal					4		1%
-eieio--add-new-slot						4		1%
cl-member							4		1%
-load-with-code-conversion					4		1%
eval-buffer							4		1%
-do-after-load-evaluation					4		1%
-run-hook-with-args						4		1%
-eval-after-load-helper						4		1%
-#<lambda 0xaa245030a704c0>					4		1%
-progn								4		1%
tramp-set-completion-funct...					4		1%
-file-truename							3		1%
-file-truename							3		1%
file-truename							3		1%
-require							10		3%
-require							10		3%
-byte-code							6		2%
-cl-generic-define-method					6		2%
-cl--generic-make-function					6		2%
-cl--generic-make-next-function					6		2%
-cl--generic-get-dispatcher					6		2%
-byte-compile							6		2%
-#<compiled 0xe9e7e7>						3		1%
-byte-compile-top-level						3		1%
byte-optimize-form						3		1%
-execute-extended-command					50		17%
-execute-extended-command--shorter				38		13%
-completion-try-completion					38		13%
-completion--nth-completion					38		13%
-completion--some						38		13%
-#<compiled 0x47733b>						38		13%
-completion-pcm-try-completion					20		7%
-completion-pcm--find-all-completions				20		7%
completion-pcm--all-completions					20		7%
completion-basic-try-completion					18		6%
-sit-for							12		4%
redisplay							4		1%
-byte-code							106		38%
-find-file-read-args						55		19%
-read-file-name							55		19%
-read-file-name-default						55		19%
-completing-read						55		19%
-completing-read-default					55		19%
read-from-minibuffer						36		12%
-read-extended-command						51		18%
-completing-read						51		18%
-completing-read-default					51		18%
read-from-minibuffer						35		12%
+...								19		6%

bug#67672: EMACS - Slow opening files

[Eli Zaretskii]

> From: "Moore, Rider" <rmoore@cooley.com>
> CC: "Chand, Suresh" <schand@cooley.com>,
>         "67672@debbugs.gnu.org"
> 	<67672@debbugs.gnu.org>
> Date: Fri, 8 Dec 2023 21:41:31 +0000
> 
> 
> Please find the report attached.

This seems to indicate that the file you opened was a Python program
source.  Are all of the files that are slow to open like that,
i.e. they are Python sources?  If not, can you show a profile from
opening a file which ends up in Text mode or, better, Fundamental
mode?

Thanks.

bug#67672: EMACS - Slow opening files

[Moore, Rider]

Eli,

I believe this happens with every text-based file and even when Emacs is opened without a specific file involved.

Thanks,

-Rider

-----Original Message-----
From: Eli Zaretskii <eliz@gnu.org>
Sent: Friday, December 8, 2023 11:29 PM
To: Moore, Rider <rmoore@cooley.com>
Cc: Chand, Suresh <schand@cooley.com>; 67672@debbugs.gnu.org
Subject: Re: bug#67672: EMACS - Slow opening files

[External]

______________________________________________________________________
> From: "Moore, Rider" <rmoore@cooley.com>
> CC: "Chand, Suresh" <schand@cooley.com>,
>         "67672@debbugs.gnu.org"
>       <67672@debbugs.gnu.org>
> Date: Fri, 8 Dec 2023 21:41:31 +0000
>
>
> Please find the report attached.

This seems to indicate that the file you opened was a Python program source.  Are all of the files that are slow to open like that, i.e. they are Python sources?  If not, can you show a profile from opening a file which ends up in Text mode or, better, Fundamental mode?

Thanks.

________________________________

This email message is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.

bug#67672: EMACS - Slow opening files

[Eli Zaretskii]

> From: "Moore, Rider" <rmoore@cooley.com>
> CC: "Chand, Suresh" <schand@cooley.com>,
>         "67672@debbugs.gnu.org"
> 	<67672@debbugs.gnu.org>
> Date: Mon, 11 Dec 2023 17:16:47 +0000
> mdeoeh: 9337e75e-fb2e-4aff-bbe4-2aaff68f5e4d
> mde-o-pchanged: 12/11/2023 9:15:50 AM
> 
> Eli,
> 
> I believe this happens with every text-based file and even when Emacs is opened without a specific file involved.

If so, then your profile is not informative enough, since it seems to
say that most of the time is taken by Python-related processing of the
file's contents.

I honestly don't know how to make any progress here.  We must
understand what takes the time in your case.  Maybe try running that
command in Emacs under 'perf' or something, and then post the profile
here.

bug#67672: EMACS - Slow opening files

[Moore, Rider]

Eli,

The delay is only present for files located within the Truecrypt volume we are using (essential for our purposes).
Do you know of any commands or settings adjustments needed when working with a Emacs and a Truecrypt volume?

Thanks,

-Rider

-----Original Message-----
From: Eli Zaretskii <eliz@gnu.org>
Sent: Monday, December 11, 2023 9:54 AM
To: Moore, Rider <rmoore@cooley.com>
Cc: Chand, Suresh <schand@cooley.com>; 67672@debbugs.gnu.org
Subject: Re: bug#67672: EMACS - Slow opening files

[External]

______________________________________________________________________
> From: "Moore, Rider" <rmoore@cooley.com>
> CC: "Chand, Suresh" <schand@cooley.com>,
>         "67672@debbugs.gnu.org"
>       <67672@debbugs.gnu.org>
> Date: Mon, 11 Dec 2023 17:16:47 +0000
> mdeoeh: 9337e75e-fb2e-4aff-bbe4-2aaff68f5e4d
> mde-o-pchanged: 12/11/2023 9:15:50 AM
>
> Eli,
>
> I believe this happens with every text-based file and even when Emacs is opened without a specific file involved.

If so, then your profile is not informative enough, since it seems to say that most of the time is taken by Python-related processing of the file's contents.

I honestly don't know how to make any progress here.  We must understand what takes the time in your case.  Maybe try running that command in Emacs under 'perf' or something, and then post the profile here.

________________________________

This email message is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.

bug#67672: EMACS - Slow opening files

[Eli Zaretskii]

> From: "Moore, Rider" <rmoore@cooley.com>
> CC: "Chand, Suresh" <schand@cooley.com>,
>         "67672@debbugs.gnu.org"
> 	<67672@debbugs.gnu.org>
> Date: Tue, 12 Dec 2023 15:52:53 +0000
> 
> The delay is only present for files located within the Truecrypt volume we are using (essential for our purposes).

OK, this is good to know, thanks.

> Do you know of any commands or settings adjustments needed when working with a Emacs and a Truecrypt volume?

No, I don't.  I don't think we have ever heard about problems with
these particular volumes.  Which is why I suggested to run this slow
operation under perf, which will allow you to produce a profile of the
code, and hopefully will show us which part of the code is the
bottleneck.  I don't think we can make any progress here unless we
understand which parts of the code are slow when opening files on
Truecrypt volumes.

Another, less convenient method is to step in a debugger through the
code in find-file and its subroutines, and see which part(s) there
take such a long time.  Presumably, if this takes minutes, you should
be able to identify the calls that take such a long time.

As a "leap of faith", how about timing the following, after starting
"emacs -Q":

  M-: (insert-file-contents "SOME-FILE") RET

where SOME-FILE is a file on a Truecrypt volume.  Does the above take
an abnormally long time, or is it as fast as when you do the same with
a file on any other volume?

bug#67672: EMACS - Slow opening files

[Moore, Rider]

Eli,

For the purpose of our business we only want to use Emacs as a text editor.  We are working with very large mercurial and git repositories under version control.  If files are under version control, is Emacs doing anything extra besides opening them as a normal text editor would?

Thanks,

-Rider

-----Original Message-----
From: Eli Zaretskii <eliz@gnu.org>
Sent: Tuesday, December 12, 2023 9:07 AM
To: Moore, Rider <rmoore@cooley.com>
Cc: Chand, Suresh <schand@cooley.com>; 67672@debbugs.gnu.org
Subject: Re: bug#67672: EMACS - Slow opening files

[External]

______________________________________________________________________
> From: "Moore, Rider" <rmoore@cooley.com>
> CC: "Chand, Suresh" <schand@cooley.com>,
>         "67672@debbugs.gnu.org"
>       <67672@debbugs.gnu.org>
> Date: Tue, 12 Dec 2023 15:52:53 +0000
>
> The delay is only present for files located within the Truecrypt volume we are using (essential for our purposes).

OK, this is good to know, thanks.

> Do you know of any commands or settings adjustments needed when working with a Emacs and a Truecrypt volume?

No, I don't.  I don't think we have ever heard about problems with these particular volumes.  Which is why I suggested to run this slow operation under perf, which will allow you to produce a profile of the code, and hopefully will show us which part of the code is the bottleneck.  I don't think we can make any progress here unless we understand which parts of the code are slow when opening files on Truecrypt volumes.

Another, less convenient method is to step in a debugger through the code in find-file and its subroutines, and see which part(s) there take such a long time.  Presumably, if this takes minutes, you should be able to identify the calls that take such a long time.

As a "leap of faith", how about timing the following, after starting "emacs -Q":

  M-: (insert-file-contents "SOME-FILE") RET

where SOME-FILE is a file on a Truecrypt volume.  Does the above take an abnormally long time, or is it as fast as when you do the same with a file on any other volume?

________________________________

This email message is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.

bug#67672: EMACS - Slow opening files

[Eli Zaretskii]

> From: "Moore, Rider" <rmoore@cooley.com>
> CC: "Chand, Suresh" <schand@cooley.com>,
>         "67672@debbugs.gnu.org"
> 	<67672@debbugs.gnu.org>
> Date: Tue, 12 Dec 2023 17:57:56 +0000
> 
> For the purpose of our business we only want to use Emacs as a text editor.  We are working with very large mercurial and git repositories under version control.  If files are under version control, is Emacs doing anything extra besides opening them as a normal text editor would?

Yes, it does.  Are you saying that the files that are slow to open are
under Git or Mercurial, and the respective repositories are on the
Truecrypt volumes?

bug#67672: EMACS - Slow opening files

[Moore, Rider]

Exactly right,  some of those repositories have millions of files within and are 100s of GB in size.  The largest is 1.3 TB.

Thanks,

-Rider

-----Original Message-----
From: Eli Zaretskii <eliz@gnu.org>
Sent: Tuesday, December 12, 2023 10:40 AM
To: Moore, Rider <rmoore@cooley.com>
Cc: Chand, Suresh <schand@cooley.com>; 67672@debbugs.gnu.org
Subject: Re: bug#67672: EMACS - Slow opening files

[External]

______________________________________________________________________
> From: "Moore, Rider" <rmoore@cooley.com>
> CC: "Chand, Suresh" <schand@cooley.com>,
>         "67672@debbugs.gnu.org"
>       <67672@debbugs.gnu.org>
> Date: Tue, 12 Dec 2023 17:57:56 +0000
>
> For the purpose of our business we only want to use Emacs as a text editor.  We are working with very large mercurial and git repositories under version control.  If files are under version control, is Emacs doing anything extra besides opening them as a normal text editor would?

Yes, it does.  Are you saying that the files that are slow to open are under Git or Mercurial, and the respective repositories are on the Truecrypt volumes?

________________________________

This email message is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.

bug#67672: EMACS - Slow opening files

[Eli Zaretskii]

> From: "Moore, Rider" <rmoore@cooley.com>
> CC: "Chand, Suresh" <schand@cooley.com>,
>         "67672@debbugs.gnu.org"
> 	<67672@debbugs.gnu.org>
> Date: Tue, 12 Dec 2023 19:06:54 +0000
> mdeoeh: a3d589e8-37b4-42bd-a262-9c75c36a3ed8
> mde-o-pchanged: 12/12/2023 11:05:33 AM
> 
> Exactly right,  some of those repositories have millions of files within and are 100s of GB in size.  The largest is 1.3 TB.

And if you visit files that are not under Git or Mercurial, but reside
on the same Truecrypt volume, does Emacs open them quickly?

bug#67672: EMACS - Slow opening files

[Moore, Rider]

Sorry, I should have tested that.  Confirmed, a file on the root of the truecrypt volume (not under version control) opens immediately.  The larger the repository, the longer the delay it seems as well.
I do seem to be getting better performance after uninstalling, then installing using the below command.
Sudo snap install emacs --classic



-----Original Message-----
From: Eli Zaretskii <eliz@gnu.org>
Sent: Tuesday, December 12, 2023 11:16 AM
To: Moore, Rider <rmoore@cooley.com>
Cc: Chand, Suresh <schand@cooley.com>; 67672@debbugs.gnu.org
Subject: Re: bug#67672: EMACS - Slow opening files

[External]

______________________________________________________________________
> From: "Moore, Rider" <rmoore@cooley.com>
> CC: "Chand, Suresh" <schand@cooley.com>,
>         "67672@debbugs.gnu.org"
>       <67672@debbugs.gnu.org>
> Date: Tue, 12 Dec 2023 19:06:54 +0000
> mdeoeh: a3d589e8-37b4-42bd-a262-9c75c36a3ed8
> mde-o-pchanged: 12/12/2023 11:05:33 AM
>
> Exactly right,  some of those repositories have millions of files within and are 100s of GB in size.  The largest is 1.3 TB.

And if you visit files that are not under Git or Mercurial, but reside on the same Truecrypt volume, does Emacs open them quickly?

________________________________

This email message is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.

bug#67672: EMACS - Slow opening files

[Eli Zaretskii]

> From: "Moore, Rider" <rmoore@cooley.com>
> CC: "Chand, Suresh" <schand@cooley.com>,
>         "67672@debbugs.gnu.org"
> 	<67672@debbugs.gnu.org>
> Date: Tue, 12 Dec 2023 19:33:37 +0000
> 
> Sorry, I should have tested that.  Confirmed, a file on the root of the truecrypt volume (not under version control) opens immediately.  The larger the repository, the longer the delay it seems as well.
> I do seem to be getting better performance after uninstalling, then installing using the below command.
> Sudo snap install emacs --classic

So which repository is that makes opening files so awfully slow? Git
or Mercurial?

bug#67672: EMACS - Slow opening files

[Moore, Rider]

Definitely Mercurial and the code we have is using a proprietary mercurial version.

-Rider

-----Original Message-----
From: Eli Zaretskii <eliz@gnu.org>
Sent: Tuesday, December 12, 2023 11:47 AM
To: Moore, Rider <rmoore@cooley.com>
Cc: Chand, Suresh <schand@cooley.com>; 67672@debbugs.gnu.org
Subject: Re: bug#67672: EMACS - Slow opening files

[External]

______________________________________________________________________
> From: "Moore, Rider" <rmoore@cooley.com>
> CC: "Chand, Suresh" <schand@cooley.com>,
>         "67672@debbugs.gnu.org"
>       <67672@debbugs.gnu.org>
> Date: Tue, 12 Dec 2023 19:33:37 +0000
>
> Sorry, I should have tested that.  Confirmed, a file on the root of the truecrypt volume (not under version control) opens immediately.  The larger the repository, the longer the delay it seems as well.
> I do seem to be getting better performance after uninstalling, then installing using the below command.
> Sudo snap install emacs --classic

So which repository is that makes opening files so awfully slow? Git or Mercurial?

________________________________

This email message is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.

bug#67672: EMACS - Slow opening files

[Ihor Radchenko]

"Moore, Rider" <rmoore@cooley.com> writes:

> Definitely Mercurial and the code we have is using a proprietary mercurial version.

A blind guess - does (remove-hook 'find-file-hook #'vc-refresh-state) help?

-- 
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://orgmode.org/>.
Support Org development at <https://liberapay.com/org-mode>,
or support my work at <https://liberapay.com/yantar92>

bug#67672: EMACS - Slow opening files

[Moore, Rider]

Forgive me, can you let me know how and where to run this command?  I believe it's within emacs, but can you provide instructions on where to run it in emacs and how to bring up the prompt?

Thanks,

-Rider

-----Original Message-----
From: Ihor Radchenko <yantar92@posteo.net>
Sent: Tuesday, December 12, 2023 1:03 PM
To: Moore, Rider <rmoore@cooley.com>
Cc: Eli Zaretskii <eliz@gnu.org>; 67672@debbugs.gnu.org; Chand, Suresh <schand@cooley.com>
Subject: Re: bug#67672: EMACS - Slow opening files

[External]

______________________________________________________________________
"Moore, Rider" <rmoore@cooley.com> writes:

> Definitely Mercurial and the code we have is using a proprietary mercurial version.

A blind guess - does (remove-hook 'find-file-hook #'vc-refresh-state) help?

--
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://urldefense.com/v3/__https://orgmode.org/__;!!OPvj_Mo!4pi-shtQttk56jWkicPcpsoDzsyt2icAMao4p_erDMss0kIJrR16BOPpoVjIwgzyMcgemVX_MAnw3qc$ >.
Support Org development at <https://urldefense.com/v3/__https://liberapay.com/org-mode__;!!OPvj_Mo!4pi-shtQttk56jWkicPcpsoDzsyt2icAMao4p_erDMss0kIJrR16BOPpoVjIwgzyMcgemVX_MMyLBM0$ >, or support my work at <https://urldefense.com/v3/__https://liberapay.com/yantar92__;!!OPvj_Mo!4pi-shtQttk56jWkicPcpsoDzsyt2icAMao4p_erDMss0kIJrR16BOPpoVjIwgzyMcgemVX_L-PhZSU$ >

________________________________

This email message is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.

bug#67672: EMACS - Slow opening files

[Ihor Radchenko]

"Moore, Rider" <rmoore@cooley.com> writes:

> Forgive me, can you let me know how and where to run this command?  I believe it's within emacs, but can you provide instructions on where to run it in emacs and how to bring up the prompt?

For example, you can do

M-: (remove-hook 'find-file-hook #'vc-refresh-state) <RET>

and then see if files are still opening slowly.

Or you can add
(remove-hook 'find-file-hook #'vc-refresh-state)
to your init.el and test...

-- 
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://orgmode.org/>.
Support Org development at <https://liberapay.com/org-mode>,
or support my work at <https://liberapay.com/yantar92>

bug#67672: EMACS - Slow opening files

[Moore, Rider]

Sorry I haven't used Emacs as anything other than a text editor.  Can you provide even further instructions on what these mean?

-Rider

-----Original Message-----
From: Ihor Radchenko <yantar92@posteo.net>
Sent: Tuesday, December 12, 2023 1:25 PM
To: Moore, Rider <rmoore@cooley.com>
Cc: Eli Zaretskii <eliz@gnu.org>; 67672@debbugs.gnu.org; Chand, Suresh <schand@cooley.com>
Subject: RE: bug#67672: EMACS - Slow opening files

[External]

______________________________________________________________________
"Moore, Rider" <rmoore@cooley.com> writes:

> Forgive me, can you let me know how and where to run this command?  I believe it's within emacs, but can you provide instructions on where to run it in emacs and how to bring up the prompt?

For example, you can do

M-: (remove-hook 'find-file-hook #'vc-refresh-state) <RET>

and then see if files are still opening slowly.

Or you can add
(remove-hook 'find-file-hook #'vc-refresh-state) to your init.el and test...

--
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://urldefense.com/v3/__https://orgmode.org/__;!!OPvj_Mo!5_UsMpXEcl0ivCF_hbuJwjjem008TUZky_SxIJ0HXC9fVpBbzM8VVyC72jQGaq7PaIn-4oBxd9wMVtU$ >.
Support Org development at <https://urldefense.com/v3/__https://liberapay.com/org-mode__;!!OPvj_Mo!5_UsMpXEcl0ivCF_hbuJwjjem008TUZky_SxIJ0HXC9fVpBbzM8VVyC72jQGaq7PaIn-4oBxy6tp4b0$ >, or support my work at <https://urldefense.com/v3/__https://liberapay.com/yantar92__;!!OPvj_Mo!5_UsMpXEcl0ivCF_hbuJwjjem008TUZky_SxIJ0HXC9fVpBbzM8VVyC72jQGaq7PaIn-4oBxttk-W7c$ >

________________________________

This email message is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.

bug#67672: EMACS - Slow opening files

[Moore, Rider]

Let me re-phrase, can you provide further instructions on how to execute these.  I don't know what M-: or <RET> mean.  I don't know where init.el is located.
Does M-: mean escape and <RET> mean return?  Where am I typing this and how do I bring up the prompt?

Thanks,

-Rider

-----Original Message-----
From: Moore, Rider
Sent: Tuesday, December 12, 2023 1:25 PM
To: Ihor Radchenko <yantar92@posteo.net>
Cc: Eli Zaretskii <eliz@gnu.org>; 67672@debbugs.gnu.org; Chand, Suresh <schand@cooley.com>
Subject: RE: bug#67672: EMACS - Slow opening files

Sorry I haven't used Emacs as anything other than a text editor.  Can you provide even further instructions on what these mean?

-Rider

-----Original Message-----
From: Ihor Radchenko <yantar92@posteo.net>
Sent: Tuesday, December 12, 2023 1:25 PM
To: Moore, Rider <rmoore@cooley.com>
Cc: Eli Zaretskii <eliz@gnu.org>; 67672@debbugs.gnu.org; Chand, Suresh <schand@cooley.com>
Subject: RE: bug#67672: EMACS - Slow opening files

[External]

______________________________________________________________________
"Moore, Rider" <rmoore@cooley.com> writes:

> Forgive me, can you let me know how and where to run this command?  I believe it's within emacs, but can you provide instructions on where to run it in emacs and how to bring up the prompt?

For example, you can do

M-: (remove-hook 'find-file-hook #'vc-refresh-state) <RET>

and then see if files are still opening slowly.

Or you can add
(remove-hook 'find-file-hook #'vc-refresh-state) to your init.el and test...

--
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://urldefense.com/v3/__https://orgmode.org/__;!!OPvj_Mo!5_UsMpXEcl0ivCF_hbuJwjjem008TUZky_SxIJ0HXC9fVpBbzM8VVyC72jQGaq7PaIn-4oBxd9wMVtU$ >.
Support Org development at <https://urldefense.com/v3/__https://liberapay.com/org-mode__;!!OPvj_Mo!5_UsMpXEcl0ivCF_hbuJwjjem008TUZky_SxIJ0HXC9fVpBbzM8VVyC72jQGaq7PaIn-4oBxy6tp4b0$ >, or support my work at <https://urldefense.com/v3/__https://liberapay.com/yantar92__;!!OPvj_Mo!5_UsMpXEcl0ivCF_hbuJwjjem008TUZky_SxIJ0HXC9fVpBbzM8VVyC72jQGaq7PaIn-4oBxttk-W7c$ >

________________________________

This email message is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.

bug#67672: EMACS - Slow opening files

[Ihor Radchenko]

"Moore, Rider" <rmoore@cooley.com> writes:

> Does M-: mean escape and <RET> mean return?  Where am I typing this and how do I bring up the prompt?

M-: means Alt-Shift-; (or Alt-:)
<RET> is "Enter" key.
M-x is Alt+x

See <F1> t or menu Help->Emacs tutorial. The basics about Emacs key
binding notation are described right at the beginning.

-- 
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://orgmode.org/>.
Support Org development at <https://liberapay.com/org-mode>,
or support my work at <https://liberapay.com/yantar92>

bug#67672: EMACS - Slow opening files

[Ihor Radchenko]

"Moore, Rider" <rmoore@cooley.com> writes:

> Sorry I haven't used Emacs as anything other than a text editor.  Can you provide even further instructions on what these mean?

1. Create a file test.el with the following contents

(remove-hook 'find-file-hook #'vc-refresh-state)

2. Open your Emacs

3. Run M-x load-file and select the newly created test.el

4. Try to open your problematic file in truecrypt mercurial repo.


-- 
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://orgmode.org/>.
Support Org development at <https://liberapay.com/org-mode>,
or support my work at <https://liberapay.com/yantar92>

bug#67672: EMACS - Slow opening files

[Moore, Rider]

Ah, thank you sooo much!!  I think this fixed our issue.
Thank you for the instructions as well.  Does it matter where we save the test.el file?  Once we run M-x load-file we are done with it?

-Rider

-----Original Message-----
From: Ihor Radchenko <yantar92@posteo.net>
Sent: Tuesday, December 12, 2023 1:33 PM
To: Moore, Rider <rmoore@cooley.com>
Cc: Eli Zaretskii <eliz@gnu.org>; 67672@debbugs.gnu.org; Chand, Suresh <schand@cooley.com>
Subject: RE: bug#67672: EMACS - Slow opening files

[External]

______________________________________________________________________
"Moore, Rider" <rmoore@cooley.com> writes:

> Sorry I haven't used Emacs as anything other than a text editor.  Can you provide even further instructions on what these mean?

1. Create a file test.el with the following contents

(remove-hook 'find-file-hook #'vc-refresh-state)

2. Open your Emacs

3. Run M-x load-file and select the newly created test.el

4. Try to open your problematic file in truecrypt mercurial repo.


--
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://urldefense.com/v3/__https://orgmode.org/__;!!OPvj_Mo!_GhMyg2loCrOuZXmARkyh7ru4zy8vHzo47-9KfAJZYUMGCgbvxm-uyJ-tTUDQbwHrLm6LxViHIn26o0$ >.
Support Org development at <https://urldefense.com/v3/__https://liberapay.com/org-mode__;!!OPvj_Mo!_GhMyg2loCrOuZXmARkyh7ru4zy8vHzo47-9KfAJZYUMGCgbvxm-uyJ-tTUDQbwHrLm6LxViplAev6k$ >, or support my work at <https://urldefense.com/v3/__https://liberapay.com/yantar92__;!!OPvj_Mo!_GhMyg2loCrOuZXmARkyh7ru4zy8vHzo47-9KfAJZYUMGCgbvxm-uyJ-tTUDQbwHrLm6LxViWZHGX3Q$ >

________________________________

This email message is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.

bug#67672: EMACS - Slow opening files

[Ihor Radchenko]

"Moore, Rider" <rmoore@cooley.com> writes:

> Ah, thank you sooo much!!  I think this fixed our issue.
> Thank you for the instructions as well.  Does it matter where we save the test.el file?  Once we run M-x load-file we are done with it?

Do note that removing vc-refresh-state may break some things related to
version control functionality of Emacs, so what I asked you to do is a
workaround at best; not a proper fix.

Eli or people more familiar with vc-hg.el internals might ask more
questions to narrow down the more precise cause.

For now, we just determined that `vc-refresh-state' is slow in your setup.

-- 
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://orgmode.org/>.
Support Org development at <https://liberapay.com/org-mode>,
or support my work at <https://liberapay.com/yantar92>

bug#67672: EMACS - Slow opening files

[Eli Zaretskii]

> From: Ihor Radchenko <yantar92@posteo.net>
> Cc: Eli Zaretskii <eliz@gnu.org>, "67672@debbugs.gnu.org"
>  <67672@debbugs.gnu.org>, "Chand, Suresh" <schand@cooley.com>
> Date: Tue, 12 Dec 2023 21:56:51 +0000
> 
> "Moore, Rider" <rmoore@cooley.com> writes:
> 
> > Ah, thank you sooo much!!  I think this fixed our issue.
> > Thank you for the instructions as well.  Does it matter where we save the test.el file?  Once we run M-x load-file we are done with it?
> 
> Do note that removing vc-refresh-state may break some things related to
> version control functionality of Emacs, so what I asked you to do is a
> workaround at best; not a proper fix.
> 
> Eli or people more familiar with vc-hg.el internals might ask more
> questions to narrow down the more precise cause.
> 
> For now, we just determined that `vc-refresh-state' is slow in your setup.

Dmitry, any ideas?

My best idea is to profile vc-refresh-state in those situations, to
see what is slow.  But maybe before that, running from the shell
prompt the hg command that is run by vc-refresh-state would be useful?
Because if hg is very slow with that many files on that type of
volume, there's little Emacs can do?

Can you show that command for the OP to try?

bug#67672: EMACS - Slow opening files

[Dmitry Gutov]

On 13/12/2023 13:49, Eli Zaretskii wrote:
>> From: Ihor Radchenko <yantar92@posteo.net>
>> Cc: Eli Zaretskii <eliz@gnu.org>, "67672@debbugs.gnu.org"
>>   <67672@debbugs.gnu.org>, "Chand, Suresh" <schand@cooley.com>
>> Date: Tue, 12 Dec 2023 21:56:51 +0000
>>
>> "Moore, Rider" <rmoore@cooley.com> writes:
>>
>>> Ah, thank you sooo much!!  I think this fixed our issue.
>>> Thank you for the instructions as well.  Does it matter where we save the test.el file?  Once we run M-x load-file we are done with it?
>>
>> Do note that removing vc-refresh-state may break some things related to
>> version control functionality of Emacs, so what I asked you to do is a
>> workaround at best; not a proper fix.
>>
>> Eli or people more familiar with vc-hg.el internals might ask more
>> questions to narrow down the more precise cause.
>>
>> For now, we just determined that `vc-refresh-state' is slow in your setup.
> 
> Dmitry, any ideas?

Something to try is (setq vc-hg-parse-hg-data-structures nil) and see 
whether that changes something.

Another - is to (setq vc-command-messages t), see what commands are run 
(in *Messages*) and test them in the terminal, comparing performance and 
debugging it on their side (perhaps working with TrueCrypt support, 
reporting that such and such commands are slow).

Finally, if the users only want to run Emacs as a "normal text editor", 
then setting vc-handled-backends to nil would improve performance, while 
removing all the VC related features.