OS X (configure --with-ns) typing unresponsive with Org and Viper

OS X (configure --with-ns) typing unresponsive with Org and Viper

[Michael Brand]

Hi all

There is an issue described well in the bug report
https://debbugs.gnu.org/cgi/bugreport.cgi?bug=2409
that I would like to analyze. Due to lack of knowledge I would like to
ask for some help in this regard. What can I profile or debug with
gdb? What code is involved and which temporary changes could I try out
to track down the issue?

Michael

Re: OS X (configure --with-ns) typing unresponsive with Org and Viper

[Paul Eggert]

On 05/13/2016 11:40 AM, Michael Brand wrote:
> What can I profile or debug with
> gdb?

You can use GDB to debug almost anything at the machine level. 'source 
.gdbinit' first.

For profiling, please see the Profiling chapter of the Elisp manual, 
e.g., the profiler-start function. You need a reasonably bleeding-edge 
version of Emacs for this. Possibly you will also need to do low-level 
profiling, which is incompatible with profiler-start; to do this, build 
emacs with './configure --enable-profiling'.

> What code is involved and which temporary changes could I try out
> to track down the issue?

Given the bug report, I'd look for changes installed in Emacs sometime 
in  January 2009, probably in the ns area.

Re: OS X (configure --with-ns) typing unresponsive with Org and Viper

[Michael Brand]

Hi all

On Fri, May 13, 2016 at 9:19 PM, Paul Eggert <eggert@cs.ucla.edu> wrote:

> Given the bug report, I'd look for changes installed in Emacs sometime in
> January 2009, probably in the ns area.

So I thought to try building different commits but failed with current
master "git clone -b master git://git.sv.gnu.org/emacs.git && make
configure": In autogen.sh "git rev-parse --git-common-dir 2>/dev/null"
=> "--git-common-dir" which looks wrong. My git version is 2.4.9
(Apple Git-60).

What am I doing wrong?

Michael

Re: OS X (configure --with-ns) typing unresponsive with Org and Viper

[Michael Brand]

On Sat, May 14, 2016 at 1:31 PM, Michael Brand
<michael.ch.brand@gmail.com> wrote:

> So I thought to try building different commits but failed with current
> master "git clone -b master git://git.sv.gnu.org/emacs.git && make
> configure": In autogen.sh "git rev-parse --git-common-dir 2>/dev/null"
> => "--git-common-dir" which looks wrong. My git version is 2.4.9
> (Apple Git-60).

Completing myself: Probably the "test -e .git" in autogen.ch was
intended the other way around.

Michael

Re: OS X (configure --with-ns) typing unresponsive with Org and Viper

[Noam Postavsky]

On Sat, May 14, 2016 at 7:42 AM, Michael Brand
<michael.ch.brand@gmail.com> wrote:
> On Sat, May 14, 2016 at 1:31 PM, Michael Brand
> <michael.ch.brand@gmail.com> wrote:
>
>> So I thought to try building different commits but failed with current
>> master "git clone -b master git://git.sv.gnu.org/emacs.git && make
>> configure": In autogen.sh "git rev-parse --git-common-dir 2>/dev/null"
>> => "--git-common-dir" which looks wrong. My git version is 2.4.9
>> (Apple Git-60).
>
> Completing myself: Probably the "test -e .git" in autogen.ch was
> intended the other way around.

No, the intention is to find the "real" .git/ directory, in case of
building in a separate git worktree. It looks like --git-common-dir
was added only in git 2.5.0 and rev-parse just passes unrecognized
options through.

~/src/git$ git rev-parse --foo ; echo $?
--foo
0

Putting --no-flags will drop them instead, perhaps we can use that?

~/src/git$ git rev-parse --no-flags --foo --git-common-dir ; echo $?
.git
0

Re: OS X (configure --with-ns) typing unresponsive with Org and Viper

[Paul Eggert]

[-- Attachment #1: Type: text/plain, Size: 438 bytes --]

Michael Brand wrote:
> In autogen.sh "git rev-parse --git-common-dir 2>/dev/null"
> => "--git-common-dir" which looks wrong. My git version is 2.4.9
> (Apple Git-60).
> 
> What am I doing wrong?

Nothing, Apple is just mired in the past. Git 2.4 was released when, 2015? I
installed the attached patch into Emacs to try to cater better to Git laggards.
Please give the patch a try. (This is Emacs. We *love* old software! :-)


[-- Warning: decoded text below may be mangled, UTF-8 assumed --]
[-- Attachment #2: 0001-Port-autogen.sh-to-Git-2.4.patch --]
[-- Type: text/x-diff; name="0001-Port-autogen.sh-to-Git-2.4.patch", Size: 1132 bytes --]

From 9105be11e61ea355e1168ac911c13fe7553de04d Mon Sep 17 00:00:00 2001
From: Paul Eggert <eggert@cs.ucla.edu>
Date: Sat, 14 May 2016 10:24:22 -0700
Subject: [PATCH] Port autogen.sh to Git 2.4

Problem reported by Michael Brand in:
http://lists.gnu.org/archive/html/emacs-devel/2016-05/msg00367.html
* autogen.sh (git_config): Don't assume that git rev-parse
groks --git-common-dir.
---
 autogen.sh | 6 ++++--
 1 file changed, 4 insertions(+), 2 deletions(-)

diff --git a/autogen.sh b/autogen.sh
index 3809942..b1bd86b 100755
--- a/autogen.sh
+++ b/autogen.sh
@@ -277,8 +277,10 @@ git_config ()
 # Get location of Git's common configuration directory.  For older Git
 # versions this is just '.git'.  Newer Git versions support worktrees.
 
-test -e .git && git_common_dir=`git rev-parse --git-common-dir 2>/dev/null` ||
-  git_common_dir=.git
+{ test -e .git &&
+  git_common_dir=`git rev-parse --no-flags --git-common-dir 2>/dev/null` &&
+  test -n "$git_common_dir"
+} || git_common_dir=.git
 hooks=$git_common_dir/hooks
 
 # Check hashes when transferring objects among repositories.
-- 
2.7.4

Re: OS X (configure --with-ns) typing unresponsive with Org and Viper

[Michael Brand]

Hi Paul

On Sat, May 14, 2016 at 7:26 PM, Paul Eggert <eggert@cs.ucla.edu> wrote:
> Michael Brand wrote:
>> In autogen.sh "git rev-parse --git-common-dir 2>/dev/null"
>> => "--git-common-dir" which looks wrong. My git version is 2.4.9
>> (Apple Git-60).
>>
>> What am I doing wrong?
>
> Nothing, Apple is just mired in the past. Git 2.4 was released when, 2015? I
> installed the attached patch into Emacs to try to cater better to Git laggards.
> Please give the patch a try. (This is Emacs. We *love* old software! :-)

The patch works for me, thank you.

Michael

Re: OS X (configure --with-ns) typing unresponsive with Org and Viper

[Michael Brand]

[-- Attachment #1: Type: text/plain, Size: 641 bytes --]

Hi Paul

On Fri, May 13, 2016 at 9:19 PM, Paul Eggert <eggert@cs.ucla.edu> wrote:

> For profiling, please see the Profiling chapter of the Elisp manual, e.g.,
> the profiler-start function. You need a reasonably bleeding-edge version of
> Emacs for this.

Attached are two profiles, one when in Viper insert mode typing
qwerqwerqwerqwer fast in Text mode where the feedback is responsive
and one in Org mode where the feedback is unresponsive but without the
desktop CPU meter jumping up during the few seconds lagging behind.

What should I be able to understand from these reports and what is
recommended to investigate further?

Michael

[-- Attachment #2: profiler_2016-05-15_when_in_Org_mode.txt --]
[-- Type: text/plain, Size: 6283 bytes --]


[profiler-profile "24.3" cpu #s(hash-table size 65 test equal rehash-size 1.5 rehash-threshold 0.8 data ([sit-for execute-extended-command funcall-interactively call-interactively command-execute nil nil nil nil nil nil nil nil nil nil nil] 12 [redisplay sit-for execute-extended-command funcall-interactively call-interactively command-execute nil nil nil nil nil nil nil nil nil nil] 7 [image-search-load-path find-image eval "#<compiled 0x400f38d7>" mapcar tool-bar-make-keymap-1 tool-bar-make-keymap redisplay_internal\ \(C\ function\) redisplay sit-for execute-extended-command funcall-interactively call-interactively command-execute nil nil] 1 [execute-extended-command funcall-interactively call-interactively command-execute nil nil nil nil nil nil nil nil nil nil nil nil] 9 [nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil] 2164 [viper-change-cursor-color viper-insert-state-post-command-sentinel run-hooks viper-post-command-sentinel nil nil nil nil nil nil nil nil nil nil nil nil] 44 [viper-change-cursor-color viper-restore-cursor-color viper-insert-state-pre-command-sentinel run-hooks viper-pre-command-sentinel nil nil nil nil nil nil nil nil nil nil nil] 47 [viper-insert-state-post-command-sentinel run-hooks viper-post-command-sentinel nil nil nil nil nil nil nil nil nil nil nil nil nil] 1 [org-self-insert-command funcall-interactively call-interactively command-execute nil nil nil nil nil nil nil nil nil nil nil nil] 1 [viper-get-saved-cursor-color-in-insert-mode viper-restore-cursor-color viper-insert-state-pre-command-sentinel run-hooks viper-pre-command-sentinel nil nil nil nil nil nil nil nil nil nil nil] 1 [viper-change-cursor-color viper-change-state viper-change-state-to-vi viper-exit-insert-state funcall-interactively call-interactively viper-intercept-ESC-key funcall-interactively call-interactively command-execute nil nil nil nil nil nil] 2 [viper-change-cursor-color viper-restore-cursor-color viper-post-command-sentinel nil nil nil nil nil nil nil nil nil nil nil nil nil] 2 [viper-read-key-sequence byte-code call-interactively command-execute nil nil nil nil nil nil nil nil nil nil nil nil] 6 [read-key-sequence viper-read-key-sequence byte-code call-interactively command-execute nil nil nil nil nil nil nil nil nil nil nil] 1 [princ "#<compiled 0x400c4dcd>" apply describe-key-briefly funcall-interactively call-interactively command-execute nil nil nil nil nil nil nil nil nil] 1 [if eval redisplay_internal\ \(C\ function\) nil nil nil nil nil nil nil nil nil nil nil nil nil] 2 [file-remote-p redisplay_internal\ \(C\ function\) nil nil nil nil nil nil nil nil nil nil nil nil nil nil] 3 [redisplay_internal\ \(C\ function\) nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil] 1 [mode-line-eol-desc eval redisplay_internal\ \(C\ function\) nil nil nil nil nil nil nil nil nil nil nil nil nil] 1 [viper-get-saved-cursor-color-in-insert-mode viper-change-state-to-insert viper-minibuffer-setup-sentinel read-from-minibuffer completing-read-default completing-read read-extended-command byte-code call-interactively command-execute nil nil nil nil nil nil] 1 [viper-change-cursor-color viper-change-state-to-insert viper-minibuffer-setup-sentinel read-from-minibuffer completing-read-default completing-read read-extended-command byte-code call-interactively command-execute nil nil nil nil nil nil] 2 [viper-get-saved-cursor-color-in-insert-mode viper-insert-state-post-command-sentinel run-hooks viper-post-command-sentinel read-from-minibuffer completing-read-default completing-read read-extended-command byte-code call-interactively command-execute nil nil nil nil nil] 1 [read-from-minibuffer completing-read-default completing-read read-extended-command byte-code call-interactively command-execute nil nil nil nil nil nil nil nil nil] 14 [completing-read-default completing-read read-extended-command byte-code call-interactively command-execute nil nil nil nil nil nil nil nil nil nil] 47 [previous-line-or-history-element funcall-interactively call-interactively command-execute read-from-minibuffer completing-read-default completing-read read-extended-command byte-code call-interactively command-execute nil nil nil nil nil] 1 [viper-change-cursor-color viper-restore-cursor-color viper-insert-state-pre-command-sentinel run-hooks viper-pre-command-sentinel read-from-minibuffer completing-read-default completing-read read-extended-command byte-code call-interactively command-execute nil nil nil nil] 4 [viper-change-cursor-color viper-change-state-to-insert viper-insert funcall-interactively call-interactively command-execute nil nil nil nil nil nil nil nil nil nil] 1 [ask-user-about-lock "#<subr self-insert-command>" apply "#<compiled 0x4040f74b>" apply self-insert-command org-self-insert-command funcall-interactively call-interactively command-execute nil nil nil nil nil nil] 3 [read-char ask-user-about-lock "#<subr self-insert-command>" apply "#<compiled 0x4040f74b>" apply self-insert-command org-self-insert-command funcall-interactively call-interactively command-execute nil nil nil nil nil] 1 [sit-for ask-user-about-lock "#<subr self-insert-command>" apply "#<compiled 0x4040f74b>" apply self-insert-command org-self-insert-command funcall-interactively call-interactively command-execute nil nil nil nil nil] 2 [read-event sit-for ask-user-about-lock "#<subr self-insert-command>" apply "#<compiled 0x4040f74b>" apply self-insert-command org-self-insert-command funcall-interactively call-interactively command-execute nil nil nil nil] 1 [apply "#<compiled 0x4040f74b>" apply self-insert-command org-self-insert-command funcall-interactively call-interactively command-execute nil nil nil nil nil nil nil nil] 1 [org-activate-plain-links font-lock-fontify-keywords-region font-lock-default-fontify-region font-lock-fontify-region "#<compiled 0x426a7fad>" run-hook-wrapped jit-lock--run-functions jit-lock-fontify-now jit-lock-function redisplay_internal\ \(C\ function\) nil nil nil nil nil nil] 1 [profiler-cpu-profile profiler-report-cpu profiler-report funcall-interactively call-interactively command-execute execute-extended-command funcall-interactively call-interactively command-execute nil nil nil nil nil nil] 1 [Automatic\ GC] 19)) (22328 54408 642384 0) nil]

[-- Attachment #3: profiler_2016-05-15_when_in_Text_mode.txt --]
[-- Type: text/plain, Size: 8115 bytes --]


[profiler-profile "24.3" cpu #s(hash-table size 65 test equal rehash-size 1.5 rehash-threshold 0.8 data ([sit-for execute-extended-command funcall-interactively call-interactively command-execute nil nil nil nil nil nil nil nil nil nil nil] 14 [redisplay sit-for execute-extended-command funcall-interactively call-interactively command-execute nil nil nil nil nil nil nil nil nil nil] 9 [image-search-load-path find-image eval "#<compiled 0x400f38d7>" mapcar tool-bar-make-keymap-1 tool-bar-make-keymap redisplay_internal\ \(C\ function\) redisplay sit-for execute-extended-command funcall-interactively call-interactively command-execute nil nil] 1 [execute-extended-command funcall-interactively call-interactively command-execute nil nil nil nil nil nil nil nil nil nil nil nil] 7 [nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil] 1395 [viper-change-cursor-color viper-insert-state-post-command-sentinel run-hooks viper-post-command-sentinel nil nil nil nil nil nil nil nil nil nil nil nil] 2 [viper-change-cursor-color viper-restore-cursor-color viper-insert-state-pre-command-sentinel run-hooks viper-pre-command-sentinel nil nil nil nil nil nil nil nil nil nil nil] 3 [viper-change-cursor-color viper-change-state viper-change-state-to-vi viper-exit-insert-state funcall-interactively call-interactively viper-intercept-ESC-key funcall-interactively call-interactively command-execute nil nil nil nil nil nil] 1 [viper-change-cursor-color viper-restore-cursor-color viper-post-command-sentinel nil nil nil nil nil nil nil nil nil nil nil nil nil] 1 [viper-undo funcall-interactively call-interactively command-execute nil nil nil nil nil nil nil nil nil nil nil nil] 1 [primitive-undo undo-more viper-undo funcall-interactively call-interactively command-execute nil nil nil nil nil nil nil nil nil nil] 1 [sit-for viper-undo funcall-interactively call-interactively command-execute nil nil nil nil nil nil nil nil nil nil nil] 1 [redisplay sit-for viper-undo funcall-interactively call-interactively command-execute nil nil nil nil nil nil nil nil nil nil] 1 [primitive-undo undo-more undo funcall-interactively call-interactively command-execute nil nil nil nil nil nil nil nil nil nil] 1 [display-buffer-pop-up-window display-buffer--maybe-pop-up-frame-or-window display-buffer list-buffers funcall-interactively call-interactively command-execute nil nil nil nil nil nil nil nil nil] 1 [viper-change-cursor-color viper-restore-cursor-color viper-hide-replace-overlay viper-change-state-to-emacs "#<compiled 0x404b7eb7>" mapc set-viper-state-in-major-mode run-hooks viper-post-command-sentinel nil nil nil nil nil nil nil] 1 [line-move-visual line-move next-line funcall-interactively call-interactively command-execute nil nil nil nil nil nil nil nil nil nil] 1 [file-remote-p redisplay_internal\ \(C\ function\) nil nil nil nil nil nil nil nil nil nil nil nil nil nil] 5 [if eval redisplay_internal\ \(C\ function\) nil nil nil nil nil nil nil nil nil nil nil nil nil] 4 [redisplay--update-region-highlight run-hook-with-args redisplay--pre-redisplay-functions apply "#<compiled 0x40627db7>" redisplay_internal\ \(C\ function\) nil nil nil nil nil nil nil nil nil nil] 1 [redisplay_internal\ \(C\ function\) nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil] 1 [push-mark beginning-of-buffer funcall-interactively call-interactively command-execute nil nil nil nil nil nil nil nil nil nil nil] 1 [multi-isearch-setup run-hooks isearch-mode isearch-forward funcall-interactively call-interactively command-execute nil nil nil nil nil nil nil nil nil] 2 [isearch-update isearch-mode isearch-forward funcall-interactively call-interactively command-execute nil nil nil nil nil nil nil nil nil nil] 1 [sit-for isearch-lazy-highlight-new-loop isearch-update isearch-mode isearch-forward funcall-interactively call-interactively command-execute nil nil nil nil nil nil nil nil] 1 [redisplay sit-for isearch-lazy-highlight-new-loop isearch-update isearch-mode isearch-forward funcall-interactively call-interactively command-execute nil nil nil nil nil nil nil] 2 [isearch-message isearch-search-and-update isearch-process-search-string isearch-process-search-char isearch-printing-char funcall-interactively call-interactively command-execute nil nil nil nil nil nil nil nil] 5 [sit-for isearch-lazy-highlight-new-loop isearch-update isearch-search-and-update isearch-process-search-string isearch-process-search-char isearch-printing-char funcall-interactively call-interactively command-execute nil nil nil nil nil nil] 6 [redisplay sit-for isearch-lazy-highlight-new-loop isearch-update isearch-search-and-update isearch-process-search-string isearch-process-search-char isearch-printing-char funcall-interactively call-interactively command-execute nil nil nil nil nil] 24 [isearch-update isearch-search-and-update isearch-process-search-string isearch-process-search-char isearch-printing-char funcall-interactively call-interactively command-execute nil nil nil nil nil nil nil nil] 4 [pos-visible-in-window-group-p isearch-update isearch-search-and-update isearch-process-search-string isearch-process-search-char isearch-printing-char funcall-interactively call-interactively command-execute nil nil nil nil nil nil nil] 4 [pos-visible-in-window-group-p isearch-update isearch-repeat isearch-repeat-forward funcall-interactively call-interactively command-execute nil nil nil nil nil nil nil nil nil] 3 [redisplay sit-for isearch-lazy-highlight-new-loop isearch-update isearch-repeat isearch-repeat-forward funcall-interactively call-interactively command-execute nil nil nil nil nil nil nil] 6 [isearch-message isearch-update isearch-repeat isearch-repeat-forward funcall-interactively call-interactively command-execute nil nil nil nil nil nil nil nil nil] 1 [isearch-done isearch-pre-command-hook nil nil nil nil nil nil nil nil nil nil nil nil nil nil] 1 [undefined nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil] 1 [viper-change-cursor-color viper-change-state-to-insert viper-minibuffer-setup-sentinel read-from-minibuffer completing-read-default completing-read read-extended-command byte-code call-interactively command-execute nil nil nil nil nil nil] 2 [read-from-minibuffer completing-read-default completing-read read-extended-command byte-code call-interactively command-execute nil nil nil nil nil nil nil nil nil] 14 [completing-read-default completing-read read-extended-command byte-code call-interactively command-execute nil nil nil nil nil nil nil nil nil nil] 47 [line-move-visual line-move previous-line previous-line-or-history-element funcall-interactively call-interactively command-execute read-from-minibuffer completing-read-default completing-read read-extended-command byte-code call-interactively command-execute nil nil] 2 [viper-change-cursor-color viper-restore-cursor-color viper-insert-state-pre-command-sentinel run-hooks viper-pre-command-sentinel read-from-minibuffer completing-read-default completing-read read-extended-command byte-code call-interactively command-execute nil nil nil nil] 3 [read-event sit-for execute-extended-command funcall-interactively call-interactively command-execute nil nil nil nil nil nil nil nil nil nil] 1 [viper-change-cursor-color viper-change-state-to-insert viper-insert funcall-interactively call-interactively command-execute nil nil nil nil nil nil nil nil nil nil] 1 [apply "#<compiled 0x404b7fe5>" apply self-insert-command funcall-interactively call-interactively command-execute nil nil nil nil nil nil nil nil nil] 1 [image-search-load-path find-image eval "#<compiled 0x400f38d7>" mapcar tool-bar-make-keymap-1 tool-bar-make-keymap redisplay_internal\ \(C\ function\) read-from-minibuffer completing-read-default completing-read read-extended-command byte-code call-interactively command-execute nil] 1 [profiler-cpu-profile profiler-report-cpu profiler-report funcall-interactively call-interactively command-execute execute-extended-command funcall-interactively call-interactively command-execute nil nil nil nil nil nil] 2 [Automatic\ GC] 22)) (22328 54365 592253 0) nil]

Re: OS X (configure --with-ns) typing unresponsive with Org and Viper

[Paul Eggert]

Michael Brand wrote:
> Attached are two profiles, one when in Viper insert mode typing
> qwerqwerqwerqwer fast in Text mode where the feedback is responsive
> and one in Org mode where the feedback is unresponsive but without the
> desktop CPU meter jumping up during the few seconds lagging behind.

Sorry, I didn't know the unresponsive version is not CPU-bound. If that's the
case, an Emacs CPU profile is not likely to help diagnose the problem.

Perhaps you can profile the rest of the OS X environment to see what the problem
is. However, I'm afraid I don't use OS X and can't be much help.

Re: OS X (configure --with-ns) typing unresponsive with Org and Viper

[Stefan Monnier]

> Attached are two profiles, one when in Viper insert mode typing
> qwerqwerqwerqwer fast in Text mode where the feedback is responsive
> and one in Org mode where the feedback is unresponsive but without the
> desktop CPU meter jumping up during the few seconds lagging behind.

I looked at the Org profile, but it only has about 250 samples, half of
which seem to be spent in other commands than the text insertion.

Could you redo it but spending more time typing (and
deleting) qwerqwerqwerqwer (like a minute or so) so it drowns out the
other commands?


        Stefan