bug#5321: Interaction problem between Emacs and terminal paste functions

bug#5321: Interaction problem between Emacs and terminal paste functions

[James Mills]

When using emacs from the terminal, pasting a largish (~>600K) amount
of text via the terminals paste functions results in an incomplete
paste of the text.

I've tried this in gnome-terminal, konsole, and xterm.

To recreate:

1) Visit http://cnn.com
2) View Source, and copy it
3) Open a terminal and start emacs (emacs -nw --no-splash)
4) Paste via the terminal's paste function (not emacs-specific *yank*)

The result (in my case) is the last 50 or so lines of the HTML.

Following the same procedure in vim/joe/nano/pico, and even echo and
cat result in the HTML in its entirety.

I've tried this in GNU Emacs 22.1.1, GNU Emacs 23.0.60.1, and GNU Emacs 21.3.1.

I've tried this on Ubuntu 8.04 and RHEL3 WS (remotely).

I popped into #emacs, and someone there was nice enough to verify that
they saw the same symptom using non-html text.

This is *not* a problem in the GUI versions of emacs.


Thanks so much.
James W. Mills
jameswmills@gmail.com

bug#5321: - Interaction problem between Emacs and terminal paste functions

[James Mills]

All,

I would like to post a more easily tested scenario for this bug.
Additionally, I have tested it on:

version  23.1.90.1 on OS X
version 23.1.50.1 on Ubuntu 10.04 (emacs-snapshot)

I wrote a script that prints out 1024 lines of output.  It looks like this:

LINE 0
LINE 1
LINE 2
...
LINE 1023

If you copy this 1024 line output, and paste it into emacs running in
a terminal (not the GUI), you will not see all 1024 lines.  In fact,
toward the end, you will get random garbage.  For example, my last
attempt printed:

LINE 464
LINE 465
LINE 466
LIN6
LINE 507
LINE 508
LINE 629
LINE 630
LINE 631E 67
L 8

This does not happen in ANY other editor I have tried that uses the
terminal.  But if course, I don't really want to use any other editor,
which is why I am pinging this report with additional test info. ;)
The test takes seconds to run, and I would sure appreciate some
movement on this bug.

Thanks!
James

bug#5321: - Interaction problem between Emacs and terminal paste functions

[Glenn Morris]

James Mills wrote:

> version  23.1.90.1 on OS X
> version 23.1.50.1 on Ubuntu 10.04 (emacs-snapshot)

These are ancient pretests for what became the 23.2 release.
These should not be used any more - use 23.2 instead.

(Your issue may well still be present in 23.2, I did not test.)

bug#5321: - Interaction problem between Emacs and terminal paste functions

[James Mills]

Thanks Glenn, I'll build 23.2 up on a few systems here and post back.

~james

On Fri, Oct 29, 2010 at 2:12 PM, Glenn Morris <rgm@gnu.org> wrote:
> James Mills wrote:
>
>> version  23.1.90.1 on OS X
>> version 23.1.50.1 on Ubuntu 10.04 (emacs-snapshot)
>
> These are ancient pretests for what became the 23.2 release.
> These should not be used any more - use 23.2 instead.
>
> (Your issue may well still be present in 23.2, I did not test.)
>



-- 
you've gotta live light enough to see the humor
and long enough to see some change
~ Ani DiFranco

bug#5321: - Interaction problem between Emacs and terminal paste functions

[Johan Bockgård]

Glenn Morris <rgm@gnu.org> writes:

> James Mills wrote:
>
>> version  23.1.90.1 on OS X
>> version 23.1.50.1 on Ubuntu 10.04 (emacs-snapshot)
>
> These are ancient pretests for what became the 23.2 release.
> These should not be used any more - use 23.2 instead.
>
> (Your issue may well still be present in 23.2, I did not test.)

This sounds like http://debbugs.gnu.org/cgi/bugreport.cgi?bug=6571

(Fixed in trunk.)

bug#5321: - Interaction problem between Emacs and terminal paste functions

[Andreas Schwab]

James Mills <jameswmills@gmail.com> writes:

> I wrote a script that prints out 1024 lines of output.  It looks like this:
>
> LINE 0
> LINE 1
> LINE 2
> ...
> LINE 1023
>
> If you copy this 1024 line output, and paste it into emacs running in
> a terminal (not the GUI), you will not see all 1024 lines.  In fact,
> toward the end, you will get random garbage.  For example, my last
> attempt printed:
>
> LINE 464
> LINE 465
> LINE 466
> LIN6
    ^ byte 4096

Apparently the pty buffer of your system has a size of 4096 bytes.  If
the terminal keeps stuffing more bytes into the master side of the pty
that buffer overflows and bytes are dropped until the process at the
other side of the pty had a chance to read some.  This is unlikely to be
fixable inside Emacs.

Andreas.

-- 
Andreas Schwab, schwab@linux-m68k.org
GPG Key fingerprint = 58CA 54C7 6D53 942B 1756  01D3 44D5 214B 8276 4ED5
"And now for something completely different."

bug#5321: - Interaction problem between Emacs and terminal paste functions

[James Mills]

> Apparently the pty buffer of your system has a size of 4096 bytes.  If
> the terminal keeps stuffing more bytes into the master side of the pty
> that buffer overflows and bytes are dropped until the process at the
> other side of the pty had a chance to read some.  This is unlikely to be
> fixable inside Emacs.

Andreas,

If this were the case, then why would other editors on the same
systems in the same terminal emulators not exhibit this behavior?  All
other tested editors (vi, vim, nano, etc) pasted the entire buffer.

Thanks!
~james

bug#5321: - Interaction problem between Emacs and terminal paste functions

[Andreas Schwab]

James Mills <jameswmills@gmail.com> writes:

> If this were the case, then why would other editors on the same
> systems in the same terminal emulators not exhibit this behavior?

Timing.

Andreas.

-- 
Andreas Schwab, schwab@linux-m68k.org
GPG Key fingerprint = 58CA 54C7 6D53 942B 1756  01D3 44D5 214B 8276 4ED5
"And now for something completely different."

bug#5321: - Interaction problem between Emacs and terminal paste functions

[Jan Djärv]

Andreas Schwab skrev 2010-10-29 22.49:
> James Mills<jameswmills@gmail.com>  writes:
>
>> If this were the case, then why would other editors on the same
>> systems in the same terminal emulators not exhibit this behavior?
>
> Timing.
>

Not really, see http://debbugs.gnu.org/cgi/bugreport.cgi?bug=6571.  A 
candidate for emacs 23 backport perhaps?

	Jan d.

bug#5321: - Interaction problem between Emacs and terminal paste functions

[James Mills]

On Sat, Oct 30, 2010 at 2:33 AM, Jan Djärv <jan.h.d@swipnet.se> wrote:
>
>
> Andreas Schwab skrev 2010-10-29 22.49:
>>
>> James Mills<jameswmills@gmail.com>  writes:
>>
>>> If this were the case, then why would other editors on the same
>>> systems in the same terminal emulators not exhibit this behavior?
>>
>> Timing.
>>
>
> Not really, see http://debbugs.gnu.org/cgi/bugreport.cgi?bug=6571.  A
> candidate for emacs 23 backport perhaps?
>
>        Jan d.

Johan, Jan, you were absolutely right!

The head works fine, and this bug can be marked as a duplicate of the
newer bug 6571.  I would love to see a backport of this, but am happy
to build my own for now :)

Thanks to everyone for the helpful feedback!

~james

bug#5321: - Interaction problem between Emacs and terminal paste functions

[Stefan Monnier]

> Not really, see
> http://debbugs.gnu.org/cgi/bugreport.cgi?bug=6571.  A candidate for emacs 23
> backport perhaps?

Indeed, please backport it to emacs-23.


        Stefan

bug#5321: - Interaction problem between Emacs and terminal paste functions

[Jan Djärv]

2010-10-31 19:53, Stefan Monnier skrev:
>> Not really, see
>> http://debbugs.gnu.org/cgi/bugreport.cgi?bug=6571.  A candidate for emacs 23
>> backport perhaps?
>
> Indeed, please backport it to emacs-23.
>

Done.

	Jan D.