bug#13906: 24.3; Display problems in Python shell

bug#13906: 24.3; Display problems in Python shell

[Konrad Hinsen]

[-- Attachment #1: message body text --]
[-- Type: text/plain, Size: 2193 bytes --]

This bug report will be sent to the Bug-GNU-Emacs mailing list
and the GNU bug tracker at debbugs.gnu.org.  Please check that
the From: line contains a valid email address.  After a delay of up
to one day, you should receive an acknowledgment at that address.

Please write in English if possible, as the Emacs maintainers
usually do not have translators for other languages.

Please describe exactly what actions triggered the bug, and
the precise symptoms of the bug.  If you can, give a recipe
starting from `emacs -Q':

I have been using Python mode with the Python shell configured for
IPython (as explained in the comments in python.el) for a while with
Emacs 24.2.92 and now with 24.3rc2. It has worked perfectly fine in
24.2.92, but in 24.3rc2 I get frequent display problems which
unfortunately I have not yet been able to make reproducible. The
trouble always starts with the display of a Python
traceback. Somewhere in the middle of the traceback, terminal escape
characters (used by IPython for coloring) are shown instead of being
executed. Here is an example (a screen capture is attached):

/Users/hinsen/Programs/MMTK/main_python_path/MMTK/Trajectory.pyc in __getattr__(self, name)
    254             var = self.trajectory.file.variables[name]
    255         except KeyError:
--> 256             raise AttributeError("no variable named " + name)
    257         if 'atom_number' in var.dimensions:
    258             return TrajectoryVariable^[[0m^[[1;33m(^[[0m^[[0mself^[[0m^[[1;33m.^[[0m^[[0muniverse^[[0m^[[1;33m,^[[0m ^[[0mself^[[0m^[[1;33m,^[[0m ^[[0mname^[[0m^[[1;33m)^[[0m^[[1;33m^[[0m^[[0m

^[[1;31mAttributeError^[[0m: no variable named file
> ^[[1;32m/Users/hinsen/Programs/MMTK/main_python_path/MMTK/Trajectory.py^[[0m(256)^[[0;36m__getattr__^[[1;34m()^[[0m
^[[1;32m    255 ^[[1;33m        ^[[1;32mexcept^[[0m ^[[0mKeyError^[[0m^[[1;33m:^[[0m^[[1;33m^[[0m^[[0m
^[[0m^[[1;32m--> 256 ^[[1;33m            ^[[1;32mraise^[[0m ^[[0mAttributeError^[[0m^[[1;33m(^[[0m^[[1;34m"no variable named "^[[0m ^[[1;33m+^[[0m ^[[0mname^[[0m^[[1;33m)^[[0m^[[1;33m^[[0m^[[0m
^[[0m^[[1;32m    257 ^[[1;33m        ^[[1;32mif^[[0m ^[[1;34m'atom_number'^[[0m ^[[1;32min^[[0m ^[[0mvar^[[0m^[[1;33m.^[[0m^[[0mdimensions^[[0m^[[1;33m:^[[0m^[[1;33m^[[0m^[[0m
^[[0m
ipdb>


[-- Attachment #2: screen.tiff --]
[-- Type: image/tiff, Size: 154276 bytes --]

[-- Attachment #3: message body text --]
[-- Type: text/plain, Size: 7552 bytes --]


If Emacs crashed, and you have the Emacs process in the gdb debugger,
please include the output from the following gdb commands:
    `bt full' and `xbacktrace'.
For information about debugging Emacs, please read the file
/Users/hinsen/Applications/Emacs_24.3.app/Contents/Resources/etc/DEBUG.


In GNU Emacs 24.3.1 (x86_64-apple-darwin11.4.2, NS apple-appkit-1138.51)
 of 2013-03-08 on Konrad-Hinsens-MacBook-Pro.local
Windowing system distributor `Apple', version 10.3.1138
Configured using:
 `configure '--with-ns''

Important settings:
  value of $LC_ALL: en_US.UTF-8
  value of $LANG: en_US.UTF-8
  locale-coding-system: utf-8-unix
  default enable-multibyte-characters: t

Major mode: Inferior Python

Minor modes in effect:
  compilation-shell-minor-mode: t
  global-auto-revert-mode: t
  recentf-mode: t
  show-paren-mode: t
  shell-dirtrack-mode: t
  diff-auto-refine-mode: t
  global-undo-tree-mode: t
  undo-tree-mode: t
  yas-global-mode: t
  yas-minor-mode: t
  mouse-wheel-mode: t
  menu-bar-mode: t
  file-name-shadow-mode: t
  global-font-lock-mode: t
  font-lock-mode: t
  auto-composition-mode: t
  auto-encryption-mode: t
  auto-compression-mode: t
  line-number-mode: t
  transient-mark-mode: t

Recent input:
t e r s SPC a r e SPC s h o w n SPC i n s t e a d SPC 
o f SPC b e i n g SPC e x e c u t e d C-a M-f M-f SPC 
( u s e d SPC b y SPC I P y t h o n SPC f p r SPC <backspace> 
<backspace> <backspace> o r SPC c o l o r i n g ) M-q 
<down> . SPC H e r e SPC i s SPC a n SPC e x a m p 
l : <backspace> e : <return> <return> M-` <up> <up> 
<up> <up> <up> <up> <up> <up> <up> <up> C-a C-SPC <down> 
<down> <down> <down> <down> <down> <down> <down> <down> 
<down> <down> <down> <down> <down> <down> <down> <down> 
<down> <down> <down> <down> <down> <down> <up> <right> 
<down> <right> <right> <right> M-w M-` C-y <up> <up> 
<up> <up> <up> <up> <up> <up> <up> <up> <up> <up> <up> 
<up> <up> <up> <up> <up> <up> <up> <up> <up> M-` <switch-frame> 
M-` M-` <down-mouse-1> <mouse-movement> <mouse-1> <up> 
<up> C-e <up> C-e <backspace> SPC ( a l s o SPC s h 
o w <backspace> <backspace> <backspace> <backspace> 
<backspace> <backspace> <backspace> <backspace> <backspace> 
s c r e e n SPC c a p t u r e SPC a <backspace> M-b 
M-b a SPC C-e i s SPC a t t a c h e d ) : <right> <down> 
<down> <down> <down> <down> C-x 1 <down> <down> <down> 
<down> <down> <down> <down> <down> <down> <down> <down> 
<down> <down> <down> <down> <down> <down> <down> <down> 
<ns-drag-file> <down> <down> <down> <down> <down> <down> 
<down> <down> <down> <down> <down> <down> <down> <down> 
<down> M-` M-x r e p o r t - e m <tab> b <tab> <re
turn>

Recent messages:
Checking 1 files in /Users/hinsen/Applications/Emacs_24.3.app/Contents/Resources/leim...
Checking for load-path shadows...done
byte-code: Beginning of buffer
Auto-saving...done
Auto-saving...done
Auto-saving...done
Auto-saving...done
Mark set
byte-code: End of buffer
Mark set

Load-path shadows:
~/.emacs.d/lisp/org-vm hides /Users/hinsen/Applications/Emacs_24.3.app/Contents/Resources/lisp/org/org-vm
~/.emacs.d/lisp/org-eshell hides /Users/hinsen/Applications/Emacs_24.3.app/Contents/Resources/lisp/org/org-eshell
/Users/hinsen/.emacs.d/elpa/magit-20130216.838/.dir-locals hides /Users/hinsen/Applications/Emacs_24.3.app/Contents/Resources/lisp/gnus/.dir-locals

Features:
(shadow emacsbug w3m-form w3m w3m-hist w3m-fb bookmark-w3m w3m-ems
w3m-ccl ccl w3m-favicon w3m-image w3m-proc w3m-util vm-w3m flyspell
ispell pp vm-sort vm-delete utf-7 gnutls network-stream starttls tls
vm-save tapestry vm-crypto utf7 vm-imap vm-rfaddons vm-menu vm-window
vm-toolbar vm-virtual vm-summary-faces vm-mouse vm-page vm compile
misearch multi-isearch python rx em-unix em-term term ehelp electric
em-script em-prompt em-ls em-hist em-pred em-glob em-dirs em-cmpl
em-basic em-banner em-alias thingatpt solar cal-dst holidays
hol-loaddefs diary-lib diary-loaddefs cal-iso vc-hg autorevert
disp-table org-indent server hippie-exp recentf tree-widget paren
uniquify ido windmove ein ein-loaddefs tramp tramp-compat
tramp-loaddefs french-holidays org-crypt org-w3m org-jsinfo org-infojs
org-html org-exp ob-exp org-exp-blocks org-agenda org-info org-eshell
org-docview org-bibtex bibtex ob-ditaa ob-clojure ob-haskell ob-js
ob-python ob-ruby ob-perl ob-R ob-sh shell inf-shen shen-mode derived
imenu ace-jump-mode magithub crm json url url-proxy url-privacy
url-expand url-methods url-history url-cookie url-domsuf url-util
url-parse url-vars mailcap magit-bisect magit-key-mode magit diff-mode
log-edit pcvs-util add-log monky bindat dired+ dired-x ediff-merg
ediff-diff ediff-wind ediff-mult ediff-help ediff-init ediff-util
dired-aux undo-tree yasnippet help-mode julia-mode gnuplot-context
gnuplot info-look bbdb-vm vm-mime vm-undo vm-message vm-macro
bbdb-snarf mail-extr bbdb-com bbdb-autoloads bbdb org-vm org ob-tangle
ob-ref ob-lob ob-table org-footnote org-src ob-comint ob-keys
org-pcomplete pcomplete org-list org-faces org-entities noutline
outline easy-mmode org-version ob-emacs-lisp ob org-compat org-macs
ob-eval org-loaddefs find-func cal-menu calendar cal-loaddefs warnings
advice advice-preload vm-reply vm-motion vm-summary vm-folder
vm-minibuf vm-misc vm-pcrisis vm-autoloads vm-version vm-vars mu4e
mu4e-speedbar speedbar sb-image ezimage dframe mu4e-main mu4e-view
comint ansi-color mu4e-headers mu4e-compose mu4e-actions smtpmail
auth-source eieio byte-opt bytecomp byte-compile cconv gnus-util
password-cache sendmail message format-spec rfc822 mml mml-sec
mm-decode mm-bodies mm-encode mail-parse rfc2231 rfc2047 rfc2045
ietf-drums mm-util mail-prsvr mailabbrev mail-utils gmm-utils
mailheader mu4e-mark mu4e-proc mu4e-utils doc-view jka-compr
image-mode html2text mu4e-vars hl-line mu4e-meta slime-autoloads
parenface-plus paredit edmacro kmacro em-smart ring esh-var esh-io
esh-cmd esh-opt esh-ext esh-proc esh-arg eldoc help-fns esh-groups
eshell esh-module esh-mode esh-util find-dired dired color-theme
wid-edit w3m-load browse-url auctex-autoloads tex-site info
auto-complete-autoloads color-theme-zenburn-autoloads
color-theme-autoloads elpy-autoloads expand-region-autoloads
find-file-in-project-autoloads fuzzy-autoloads gnuplot-autoloads
helm-autoloads helm-git-autoloads helm-mercurial-queue-autoloads
highlight-indentation-autoloads idomenu-autoloads ipython-autoloads
magithub-autoloads finder-inf magit-autoloads markdown-mode-autoloads
marmalade-autoloads furl-autoloads monky-autoloads
multiple-cursors-autoloads nose-autoloads nrepl-autoloads
clojure-mode-autoloads oauth2-autoloads paredit-autoloads
parenface-plus-autoloads popup-autoloads pymacs-autoloads
python-mode-autoloads python-pep8-autoloads python-pylint-autoloads
pyvirtualenv-autoloads virtualenv-autoloads yasnippet-autoloads
package cl-macs gv timezone whitespace cl cl-lib filesets easymenu
time-date tooltip ediff-hook vc-hooks lisp-float-type mwheel ns-win
tool-bar dnd fontset image regexp-opt fringe tabulated-list newcomment
lisp-mode register page menu-bar rfn-eshadow timer select scroll-bar
mouse jit-lock font-lock syntax facemenu font-core frame cham georgian
utf-8-lang misc-lang vietnamese tibetan thai tai-viet lao korean
japanese hebrew greek romanian slovak czech european ethiopic indian
cyrillic chinese case-table epa-hook jka-cmpr-hook help simple abbrev
minibuffer loaddefs button faces cus-face macroexp files
text-properties overlay sha1 md5 base64 format env code-pages mule
custom widget hashtable-print-readable backquote make-network-process
dbusbind ns multi-tty emacs)

bug#13906: 24.3; Display problems in Python shell

[Glenn Morris]

Any ideas about recent changes which might have caused this?

Konrad Hinsen wrote:

> I have been using Python mode with the Python shell configured for
> IPython (as explained in the comments in python.el) for a while with
> Emacs 24.2.92 and now with 24.3rc2. It has worked perfectly fine in
> 24.2.92, but in 24.3rc2 I get frequent display problems which
> unfortunately I have not yet been able to make reproducible. The
> trouble always starts with the display of a Python
> traceback. Somewhere in the middle of the traceback, terminal escape
> characters (used by IPython for coloring) are shown instead of being
> executed. Here is an example (a screen capture is attached):
>
> /Users/hinsen/Programs/MMTK/main_python_path/MMTK/Trajectory.pyc in __getattr__(self, name)
>     254             var = self.trajectory.file.variables[name]
>     255         except KeyError:
> --> 256             raise AttributeError("no variable named " + name)
>     257         if 'atom_number' in var.dimensions:
>     258             return TrajectoryVariable(self.universe, self, name)
>
> AttributeError: no variable named file
>> /Users/hinsen/Programs/MMTK/main_python_path/MMTK/Trajectory.py(256)__getattr__()
>     255         except KeyError:
> --> 256             raise AttributeError("no variable named " + name)
>     257         if 'atom_number' in var.dimensions:
>
> ipdb>
>
> In GNU Emacs 24.3.1 (x86_64-apple-darwin11.4.2, NS apple-appkit-1138.51)
>  of 2013-03-08 on Konrad-Hinsens-MacBook-Pro.local
> Windowing system distributor `Apple', version 10.3.1138
> Configured using:
>  `configure '--with-ns''
>
> Important settings:
>   value of $LC_ALL: en_US.UTF-8
>   value of $LANG: en_US.UTF-8
>   locale-coding-system: utf-8-unix
>   default enable-multibyte-characters: t
>
> Major mode: Inferior Python
>
> Minor modes in effect:
>   compilation-shell-minor-mode: t
>   global-auto-revert-mode: t
>   recentf-mode: t
>   show-paren-mode: t
>   shell-dirtrack-mode: t
>   diff-auto-refine-mode: t
>   global-undo-tree-mode: t
>   undo-tree-mode: t
>   yas-global-mode: t
>   yas-minor-mode: t
>   mouse-wheel-mode: t
>   menu-bar-mode: t
>   file-name-shadow-mode: t
>   global-font-lock-mode: t
>   font-lock-mode: t
>   auto-composition-mode: t
>   auto-encryption-mode: t
>   auto-compression-mode: t
>   line-number-mode: t
>   transient-mark-mode: t

bug#13906: 24.3; Display problems in Python shell

[Fabián Ezequiel Gallina]

On 03/08/2013 03:15 PM, Glenn Morris wrote:
> Any ideas about recent changes which might have caused this?
>
The most relevant change introduced after Oct 10 2012 is in revno 
111207, but it is so small that it is unlikely it broken the thing.

FWIW I'm using the pdb tracking feature extensively on GNU/Linux and 
never experienced such problems, BUT notice OSX comint processes tend to 
work rather weird when compared to other systems, and that could be 
related to libedit. See:

     + http://debbugs.gnu.org/cgi/bugreport.cgi?bug=10295#49
     + http://debbugs.gnu.org/cgi/bugreport.cgi?bug=10295#52

My feeling is that, if this is a regression, we should check changes 
that happened in comint rather than in python.el itself.



Regards,
Fabián.

bug#13906: 24.3; Display problems in Python shell

[Glenn Morris]

Fabián Ezequiel Gallina wrote:

> The most relevant change introduced after Oct 10 2012 is in revno
> 111207, but it is so small that it is unlikely it broken the thing.
>
> FWIW I'm using the pdb tracking feature extensively on GNU/Linux and
> never experienced such problems, BUT notice OSX comint processes tend
> to work rather weird when compared to other systems, and that could be
> related to libedit. See:

Thanks for checking, I can well believe this could be some more Mac OS X
oddness. If you don't see it on GNU/Linux, we won't worry about this for
24.3

> My feeling is that, if this is a regression, we should check changes
> that happened in comint rather than in python.el itself.

There have been no comint changes since 24.2.92.

bug#13906: 24.3; Display problems in Python shell

[Andreas Röhler]

Am 08.03.2013 20:03, schrieb Glenn Morris:
> Fabián Ezequiel Gallina wrote:
>
>> The most relevant change introduced after Oct 10 2012 is in revno
>> 111207, but it is so small that it is unlikely it broken the thing.
>>
>> FWIW I'm using the pdb tracking feature extensively on GNU/Linux and
>> never experienced such problems, BUT notice OSX comint processes tend
>> to work rather weird when compared to other systems, and that could be
>> related to libedit. See:
>
> Thanks for checking, I can well believe this could be some more Mac OS X
> oddness. If you don't see it on GNU/Linux, we won't worry about this for
> 24.3
>
>> My feeling is that, if this is a regression, we should check changes
>> that happened in comint rather than in python.el itself.
>
> There have been no comint changes since 24.2.92.
>
>
>
>

Looks like a broken filter.
Code arrives, while the filter doesn't work, letting chars pass.

Might it be possible to have some example code which triggers the bug?
Also having a look at ipython-settings might be of interest.

Always learning from python.el, :)

Andreas

bug#13906:

[Fabián Ezequiel Gallina]

Almost 10 months happened without OP's insight on this and it remained
not reproducible (for me at least). Closing for the sake of keeping the
tracker clean. Feel free to reopen (with a recipe, hopefully) in case
this still happens.


Regards,
Fabián.