23.0.60; TRAMP fails to copy a gzip'ed file

23.0.60; TRAMP fails to copy a gzip'ed file

[Peter Dyballa]

Hello!

Visiting /var/log on a remote server with TRAMP and SSH protocol I  
want to copy a gzip'ed messages log file. I can view it remotely.  
When I copy from the remote dired buffer to a local one, TRAMP writes  
of:

	compressing tramp.29438xtJ.gz...done
	Wrote /tmp/tramp.29438xtJ.gz
	Wrote /var/tmp/vServer/messages-20080221.gz
	Copy: 1 of 1
	Copy: 1 file
	uncompressing messages-20080221.gz...

Remote and local size are equal. When I visit the local copy in  
dired, jka-compr produces a giant temporary file  
(#messages-20080221.gz#), in which the first 355 lines look OK while  
the following 166,000 are pure rubbish, and this error message in  
*jka-compr-error*:

	Error while executing "gzip -c -q -d < /var/tmp/vServer/ 
messages-20080221.gz"
	
	
	gzip: stdin: unexpected end of file

This also happens when I launch GNU Emacs with -Q ...
In any case y in dired mode says: 'gzip compressed data, was  
"messages-20080221", from Unix'


In GNU Emacs 23.0.60.1 (powerpc-apple-darwin8.11.0, X toolkit, Xaw3d  
scroll bars)
  of 2008-03-09 on Latsche.local
Windowing system distributor `The XFree86 Project, Inc', version  
11.0.40400000
configured using `configure  '--without-pop' '--without-sound' '-- 
with-xft' '--with-libotf' '--with-dbus' '--with-x-toolkit=athena' '-- 
enable-font-backend' '--enable-locallisppath=/Library/Application  
Support/Emacs/calendar23:/Library/Application Support/Emacs/caml:/ 
Library/Application Support/Emacs:/sw/share/emacs21/site-lisp/elib'  
'PKG_CONFIG_PATH=/sw/lib/freetype219/lib/pkgconfig:/sw/lib/ 
fontconfig2/lib/pkgconfig:/sw/lib/pkgconfig:/sw/lib/system-openssl/ 
lib/pkgconfig:/sw/share/pkgconfig:/usr/lib/pkgconfig:/usr/local/lib/ 
pkgconfig:/usr/local/clamXav/lib/pkgconfig:/usr/X11R6/lib/pkgconfig'  
'CPPFLAGS=-no-cpp-precomp -D__BIND_NOSTATIC -I/sw/lib/fontconfig2/ 
include -I/sw/lib/freetype219/include -I/sw/lib/freetype219/include/ 
freetype2 -idirafter /usr/X11R6/include' 'CFLAGS=-ggdb -gfull - 
bind_at_load -Wno-pointer-sign -pipe -fPIC -mcpu=7450 -mtune=7450 - 
mno-powerpc64 -fast -mpim-altivec -ftree-vectorize -freorder-blocks- 
and-partition -fno-crossjumping' 'LDFLAGS=-bind_at_load -dead_strip - 
multiply_defined suppress -L/sw/lib/fontconfig2/lib -L/sw/lib/ 
freetype219/lib''

Important settings:
   value of $LC_ALL: C
   value of $LC_COLLATE: nil
   value of $LC_CTYPE: de_DE.UTF-8
   value of $LC_MESSAGES: nil
   value of $LC_MONETARY: nil
   value of $LC_NUMERIC: nil
   value of $LC_TIME: nil
   value of $LANG: de_DE.UTF-8
   value of $XMODIFIERS: nil
   locale-coding-system: utf-8-unix
   default-enable-multibyte-characters: t

Major mode: Debugger

Minor modes in effect:
   TeX-PDF-mode: t
   shell-dirtrack-mode: t
   show-paren-mode: t
   display-time-mode: t
   desktop-save-mode: t
   tooltip-mode: t
   mouse-wheel-mode: t
   menu-bar-mode: t
   file-name-shadow-mode: t
   global-font-lock-mode: t
   font-lock-mode: t
   blink-cursor-mode: t
   global-auto-composition-mode: t
   auto-composition-mode: t
   auto-compression-mode: t
   column-number-mode: t
   line-number-mode: t
   transient-mark-mode: t


--
Mit friedvollen Grüßen

   Pete

Die Zeit wird kommen, da unsere Nachkommen sich wundern werden, wie  
wir so wunderbare Dinge einfach gewusst haben konnten.
                         (Ein Optimist nach Lucius Annæus Seneca)

Re: 23.0.60; TRAMP fails to copy a gzip'ed file

[Michael Albinus]

Peter Dyballa <Peter_Dyballa@gmx.de> writes:

> Hello!

Hi,

> Visiting /var/log on a remote server with TRAMP and SSH protocol I
> want to copy a gzip'ed messages log file. I can view it remotely.
> When I copy from the remote dired buffer to a local one, TRAMP writes
> of:
>
> 	compressing tramp.29438xtJ.gz...done
> 	Wrote /tmp/tramp.29438xtJ.gz
> 	Wrote /var/tmp/vServer/messages-20080221.gz
> 	Copy: 1 of 1
> 	Copy: 1 file
> 	uncompressing messages-20080221.gz...
>
> Remote and local size are equal. When I visit the local copy in
> dired, jka-compr produces a giant temporary file
> (#messages-20080221.gz#), in which the first 355 lines look OK while
> the following 166,000 are pure rubbish, and this error message in
> *jka-compr-error*:

I've tried to reproduce it locally, everything is fine here. Using
emacs -Q ("GNU Emacs 23.0.60.14 (i686-pc-linux-gnu, GTK+ Version
2.12.0) of 2008-02-22 on arthur"). Remote debug.log.1.gz file is
568308 bytes, 108211 lines. That is smaller than your file, but not
sooo different.

Have you checked that your local file systems are large enough to keep
the file; especially the /tmp directory? What happens if you apply
cksum on both the remote file and its local copy?

For further analysis I would need the debug buffer of Tramp. Before
you start, please perform "(setq tramp-verbose 9)". Make sure that
there are no sensitive data in the copied file; I'll read it.

Btw, does it work if you use the "scp" method instead of "ssh"?

Best regards, Michael.

Re: 23.0.60; TRAMP fails to copy a gzip'ed file

[Peter Dyballa]

[-- Attachment #1: Type: text/plain, Size: 1264 bytes --]


Am 10.03.2008 um 16:41 schrieb Michael Albinus:

>
> Have you checked that your local file systems are large enough to keep
> the file; especially the /tmp directory?

Yes. Actually it's saved in /var/tmp with HFS+, Mac OS X, I could  
also try an UFS partition. The HFS+ slice has some GB free, the UFS  
volume has almost 100 MB free.

> What happens if you apply
> cksum on both the remote file and its local copy?

On the remote Linux server it's: 1268136719 956556 messages-20080221.gz
In HFS+ it's: 2116220391 956556 messages-20080221.gz
In UFS it's: 2116220391 956556 messages-20080221.gz

>
> For further analysis I would need the debug buffer of Tramp. Before
> you start, please perform "(setq tramp-verbose 9)". Make sure that
> there are no sensitive data in the copied file; I'll read it.

I think I can give you root access if you send me your public key ...

>
> Btw, does it work if you use the "scp" method instead of "ssh"?


Yes. That's the way I fetched it for review. (It also worked with a  
copy of GNU Emacs 23.0.60 from a week ago? But then I had to try it  
successfully in a -Q session!)

--
Mit friedvollen Grüßen

   Pete

Chicago, n.:
         Where the dead still vote ... early and often!


[-- Attachment #2: debug-tatnam --]
[-- Type: application/octet-stream, Size: 19164 bytes --]

17:00:11 tramp-get-file-property (8) # /var/log/messages-20080221.gz file-attributes-integer (nil 1 0 0 (18350 32204) (18364 65099) (18364 65109) 956556 -rw-r----- nil (82 5718) (-1 0))
17:00:11 tramp-get-file-property (8) # /var/log/messages-20080221.gz file-attributes-integer (nil 1 0 0 (18350 32204) (18364 65099) (18364 65109) 956556 -rw-r----- nil (82 5718) (-1 0))
17:00:11 tramp-get-file-property (8) # /var/log/messages-20080221.gz file-exists-p t
17:00:11 tramp-get-connection-property (7) # remote-encoding mimencode -b
17:00:11 tramp-get-connection-property (7) # local-decoding base64-decode-region
17:00:11 tramp-get-file-property (8) # /var/log file-directory-p undef
17:00:11 tramp-get-connection-property (7) # test test
17:00:11 tramp-get-connection-property (7) # process-name nil
17:00:11 tramp-get-connection-property (7) # last-cmd-time (18389 22998 458438)
17:00:11 tramp-get-connection-property (7) # process-name nil
17:00:11 tramp-get-connection-property (7) # remote-echo nil
17:00:11 tramp-send-command (6) # echo are you awake
17:00:11 tramp-get-connection-property (7) # process-name nil
17:00:11 tramp-get-connection-property (7) # chunksize 0
17:00:11 tramp-set-connection-property (7) # last-cmd-time (18389 23307 316935)
17:00:11 tramp-get-connection-property (7) # process-buffer nil
17:00:11 tramp-get-connection-property (7) # check-remote-echo nil
17:00:11 tramp-get-connection-property (7) # check-remote-echo nil
17:00:11 tramp-get-connection-property (7) # check-remote-echo nil
17:00:11 tramp-get-connection-property (7) # check-remote-echo nil
17:00:11 tramp-wait-for-regexp (6) # 
are you awake

///b87701c69c5ac62933450358c6f74828
17:00:11 tramp-get-connection-property (7) # process-name nil
17:00:11 tramp-get-connection-property (7) # remote-echo nil
17:00:11 tramp-send-command (6) # test -d /var/log 2>/dev/null; echo tramp_exit_status $? 
17:00:11 tramp-get-connection-property (7) # process-name nil
17:00:11 tramp-get-connection-property (7) # chunksize 0
17:00:11 tramp-set-connection-property (7) # last-cmd-time (18389 23307 400259)
17:00:11 tramp-get-connection-property (7) # process-buffer nil
17:00:11 tramp-get-connection-property (7) # check-remote-echo nil
17:00:11 tramp-get-connection-property (7) # check-remote-echo nil
17:00:11 tramp-get-connection-property (7) # check-remote-echo nil
17:00:11 tramp-get-connection-property (7) # check-remote-echo nil
17:00:11 tramp-get-connection-property (7) # check-remote-echo nil
17:00:11 tramp-get-connection-property (7) # check-remote-echo nil
17:00:11 tramp-wait-for-regexp (6) # 
tramp_exit_status 0

///b87701c69c5ac62933450358c6f74828
17:00:11 tramp-get-connection-property (7) # process-buffer nil
17:00:11 tramp-set-file-property (8) # /var/log file-directory-p t
17:00:11 tramp-get-file-property (8) # /var/log/ file-executable-p undef
17:00:11 tramp-get-connection-property (7) # test test
17:00:11 tramp-get-connection-property (7) # process-name nil
17:00:11 tramp-get-connection-property (7) # last-cmd-time (18389 23307 400259)
17:00:11 tramp-get-connection-property (7) # process-name nil
17:00:11 tramp-get-connection-property (7) # remote-echo nil
17:00:11 tramp-send-command (6) # test -x /var/log/ 2>/dev/null; echo tramp_exit_status $? 
17:00:11 tramp-get-connection-property (7) # process-name nil
17:00:11 tramp-get-connection-property (7) # chunksize 0
17:00:11 tramp-set-connection-property (7) # last-cmd-time (18389 23307 579764)
17:00:11 tramp-get-connection-property (7) # process-buffer nil
17:00:11 tramp-get-connection-property (7) # check-remote-echo nil
17:00:11 tramp-get-connection-property (7) # check-remote-echo nil
17:00:11 tramp-get-connection-property (7) # check-remote-echo nil
17:00:11 tramp-get-connection-property (7) # check-remote-echo nil
17:00:11 tramp-wait-for-regexp (6) # 
tramp_exit_status 0

///b87701c69c5ac62933450358c6f74828
17:00:11 tramp-get-connection-property (7) # process-buffer nil
17:00:11 tramp-set-file-property (8) # /var/log/ file-executable-p t
17:00:11 tramp-get-file-property (8) # /var/log/messages-20080221.gz file-exists-p t
17:00:11 tramp-handle-file-local-copy (5) # Encoding remote file /ssh:root@tatnam.tisdom.de:/var/log/messages-20080221.gz...
17:00:11 tramp-get-connection-property (7) # process-name nil
17:00:11 tramp-get-connection-property (7) # last-cmd-time (18389 23307 579764)
17:00:11 tramp-get-connection-property (7) # process-name nil
17:00:11 tramp-get-connection-property (7) # remote-echo nil
17:00:11 tramp-send-command (6) # mimencode -b < /var/log/messages-20080221.gz 2>/dev/null; echo tramp_exit_status $? 
17:00:11 tramp-get-connection-property (7) # process-name nil
17:00:11 tramp-get-connection-property (7) # chunksize 0
17:00:11 tramp-set-connection-property (7) # last-cmd-time (18389 23307 723888)
17:00:11 tramp-get-connection-property (7) # process-buffer nil
17:00:11 tramp-get-connection-property (7) # check-remote-echo nil
17:00:11 tramp-get-connection-property (7) # check-remote-echo nil
17:00:11 tramp-get-connection-property (7) # check-remote-echo nil
17:00:11 tramp-get-connection-property (7) # check-remote-echo nil
17:00:11 tramp-get-connection-property (7) # check-remote-echo nil
17:00:11 tramp-get-connection-property (7) # check-remote-echo nil
17:00:11 tramp-get-connection-property (7) # check-remote-echo nil
17:00:11 tramp-get-connection-property (7) # check-remote-echo nil
17:00:11 tramp-get-connection-property (7) # check-remote-echo nil
17:00:11 tramp-get-connection-property (7) # check-remote-echo nil
17:00:11 tramp-get-connection-property (7) # check-remote-echo nil
17:00:11 tramp-get-connection-property (7) # check-remote-echo nil
17:00:11 tramp-get-connection-property (7) # check-remote-echo nil
17:00:11 tramp-get-connection-property (7) # check-remote-echo nil
17:00:11 tramp-get-connection-property (7) # check-remote-echo nil
17:00:11 tramp-get-connection-property (7) # check-remote-echo nil
17:00:11 tramp-get-connection-property (7) # check-remote-echo nil
17:00:11 tramp-get-connection-property (7) # check-remote-echo nil
17:00:11 tramp-get-connection-property (7) # check-remote-echo nil
17:00:11 tramp-get-connection-property (7) # check-remote-echo nil
17:00:11 tramp-get-connection-property (7) # check-remote-echo nil
17:00:11 tramp-get-connection-property (7) # check-remote-echo nil
17:00:11 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:12 tramp-get-connection-property (7) # check-remote-echo nil
17:00:13 tramp-get-connection-property (7) # check-remote-echo nil
17:00:13 tramp-get-connection-property (7) # check-remote-echo nil
17:00:13 tramp-get-connection-property (7) # check-remote-echo nil
17:00:13 tramp-get-connection-property (7) # check-remote-echo nil
17:00:13 tramp-get-connection-property (7) # check-remote-echo nil
17:00:13 tramp-get-connection-property (7) # check-remote-echo nil
17:00:13 tramp-get-connection-property (7) # check-remote-echo nil
17:00:13 tramp-get-connection-property (7) # check-remote-echo nil
17:00:13 tramp-get-connection-property (7) # check-remote-echo nil
17:00:13 tramp-get-connection-property (7) # check-remote-echo nil
17:00:13 tramp-get-connection-property (7) # check-remote-echo nil
17:00:13 tramp-get-connection-property (7) # check-remote-echo nil
17:00:13 tramp-get-connection-property (7) # check-remote-echo nil
17:00:13 tramp-get-connection-property (7) # check-remote-echo nil
17:00:13 tramp-get-connection-property (7) # check-remote-echo nil
17:00:13 tramp-get-connection-property (7) # check-remote-echo nil
17:00:13 tramp-get-connection-property (7) # check-remote-echo nil
17:00:13 tramp-get-connection-property (7) # check-remote-echo nil
17:00:13 tramp-get-connection-property (7) # check-remote-echo nil
17:00:13 tramp-get-connection-property (7) # check-remote-echo nil
17:00:13 tramp-get-connection-property (7) # check-remote-echo nil
17:00:13 tramp-get-connection-property (7) # check-remote-echo nil
17:00:13 tramp-get-connection-property (7) # check-remote-echo nil
17:00:13 tramp-get-connection-property (7) # check-remote-echo nil
17:00:13 tramp-get-connection-property (7) # check-remote-echo nil
17:00:13 tramp-get-connection-property (7) # check-remote-echo nil
17:00:14 tramp-get-connection-property (7) # check-remote-echo nil
17:00:14 tramp-get-connection-property (7) # check-remote-echo nil
17:00:14 tramp-get-connection-property (7) # check-remote-echo nil
17:00:14 tramp-get-connection-property (7) # check-remote-echo nil
17:00:14 tramp-get-connection-property (7) # check-remote-echo nil
17:00:14 tramp-get-connection-property (7) # check-remote-echo nil
17:00:14 tramp-get-connection-property (7) # check-remote-echo nil
17:00:14 tramp-get-connection-property (7) # check-remote-echo nil
17:00:14 tramp-get-connection-property (7) # check-remote-echo nil
17:00:14 tramp-get-connection-property (7) # check-remote-echo nil
17:00:14 tramp-get-connection-property (7) # check-remote-echo nil
17:00:14 tramp-get-connection-property (7) # check-remote-echo nil
17:00:14 tramp-get-connection-property (7) # check-remote-echo nil
17:00:14 tramp-get-connection-property (7) # check-remote-echo nil
17:00:14 tramp-get-connection-property (7) # check-remote-echo nil
17:00:14 tramp-get-connection-property (7) # check-remote-echo nil
17:00:14 tramp-get-connection-property (7) # check-remote-echo nil
17:00:14 tramp-get-connection-property (7) # check-remote-echo nil
17:00:15 tramp-get-connection-property (7) # check-remote-echo nil
17:00:15 tramp-get-connection-property (7) # check-remote-echo nil
17:00:15 tramp-get-connection-property (7) # check-remote-echo nil
17:00:15 tramp-get-connection-property (7) # check-remote-echo nil
17:00:15 tramp-get-connection-property (7) # check-remote-echo nil
17:00:15 tramp-get-connection-property (7) # check-remote-echo nil
17:00:15 tramp-get-connection-property (7) # check-remote-echo nil
17:00:15 tramp-get-connection-property (7) # check-remote-echo nil
17:00:15 tramp-get-connection-property (7) # check-remote-echo nil
17:00:15 tramp-get-connection-property (7) # check-remote-echo nil
17:00:15 tramp-get-connection-property (7) # check-remote-echo nil
17:00:15 tramp-get-connection-property (7) # check-remote-echo nil
17:00:16 tramp-get-connection-property (7) # check-remote-echo nil
17:00:16 tramp-get-connection-property (7) # check-remote-echo nil
17:00:16 tramp-get-connection-property (7) # check-remote-echo nil
17:00:16 tramp-get-connection-property (7) # check-remote-echo nil
17:00:16 tramp-get-connection-property (7) # check-remote-echo nil
17:00:16 tramp-get-connection-property (7) # check-remote-echo nil
17:00:16 tramp-get-connection-property (7) # check-remote-echo nil
17:00:16 tramp-get-connection-property (7) # check-remote-echo nil
17:00:16 tramp-get-connection-property (7) # check-remote-echo nil
17:00:16 tramp-get-connection-property (7) # check-remote-echo nil
17:00:16 tramp-get-connection-property (7) # check-remote-echo nil
17:00:16 tramp-get-connection-property (7) # check-remote-echo nil
17:00:17 tramp-get-connection-property (7) # check-remote-echo nil
17:00:17 tramp-get-connection-property (7) # check-remote-echo nil
17:00:17 tramp-get-connection-property (7) # check-remote-echo nil
17:00:17 tramp-get-connection-property (7) # check-remote-echo nil
17:00:17 tramp-get-connection-property (7) # check-remote-echo nil
17:00:17 tramp-get-connection-property (7) # check-remote-echo nil
17:00:17 tramp-get-connection-property (7) # check-remote-echo nil
17:00:17 tramp-get-connection-property (7) # check-remote-echo nil
17:00:17 tramp-get-connection-property (7) # check-remote-echo nil
17:00:17 tramp-get-connection-property (7) # check-remote-echo nil
17:00:17 tramp-get-connection-property (7) # check-remote-echo nil
17:00:17 tramp-get-connection-property (7) # check-remote-echo nil
17:00:18 tramp-get-connection-property (7) # check-remote-echo nil
17:00:18 tramp-get-connection-property (7) # check-remote-echo nil
17:00:18 tramp-get-connection-property (7) # check-remote-echo nil
17:00:18 tramp-get-connection-property (7) # check-remote-echo nil
17:00:18 tramp-get-connection-property (7) # check-remote-echo nil
17:00:18 tramp-get-connection-property (7) # check-remote-echo nil
17:00:18 tramp-get-connection-property (7) # check-remote-echo nil
17:00:18 tramp-get-connection-property (7) # check-remote-echo nil
17:00:18 tramp-get-connection-property (7) # check-remote-echo nil
17:00:18 tramp-get-connection-property (7) # check-remote-echo nil
17:00:19 tramp-get-connection-property (7) # check-remote-echo nil
17:00:19 tramp-get-connection-property (7) # check-remote-echo nil
17:00:19 tramp-get-connection-property (7) # check-remote-echo nil
17:00:19 tramp-get-connection-property (7) # check-remote-echo nil
17:00:19 tramp-get-connection-property (7) # check-remote-echo nil
17:00:19 tramp-get-connection-property (7) # check-remote-echo nil
17:00:19 tramp-get-connection-property (7) # check-remote-echo nil
17:00:19 tramp-get-connection-property (7) # check-remote-echo nil
17:00:19 tramp-get-connection-property (7) # check-remote-echo nil
17:00:19 tramp-get-connection-property (7) # check-remote-echo nil
17:00:20 tramp-get-connection-property (7) # check-remote-echo nil
17:00:20 tramp-get-connection-property (7) # check-remote-echo nil
17:00:20 tramp-get-connection-property (7) # check-remote-echo nil
17:00:20 tramp-get-connection-property (7) # check-remote-echo nil
17:00:20 tramp-get-connection-property (7) # check-remote-echo nil
17:00:20 tramp-get-connection-property (7) # check-remote-echo nil
17:00:20 tramp-get-connection-property (7) # check-remote-echo nil
17:00:20 tramp-get-connection-property (7) # check-remote-echo nil
17:00:20 tramp-get-connection-property (7) # check-remote-echo nil
17:00:20 tramp-get-connection-property (7) # check-remote-echo nil
17:00:20 tramp-get-connection-property (7) # check-remote-echo nil
17:00:20 tramp-get-connection-property (7) # check-remote-echo nil
17:00:21 tramp-get-connection-property (7) # check-remote-echo nil
17:00:21 tramp-get-connection-property (7) # check-remote-echo nil
17:00:21 tramp-get-connection-property (7) # check-remote-echo nil
17:00:21 tramp-get-connection-property (7) # check-remote-echo nil
17:00:21 tramp-get-connection-property (7) # check-remote-echo nil
17:00:21 tramp-get-connection-property (7) # check-remote-echo nil
17:00:21 tramp-get-connection-property (7) # check-remote-echo nil
17:00:21 tramp-get-connection-property (7) # check-remote-echo nil
17:00:22 tramp-get-connection-property (7) # check-remote-echo nil
17:00:22 tramp-get-connection-property (7) # check-remote-echo nil
17:00:22 tramp-get-connection-property (7) # check-remote-echo nil
17:00:22 tramp-get-connection-property (7) # check-remote-echo nil
17:00:22 tramp-wait-for-regexp (6) # 
H4sICEv+vEcAA21lc3NhZ2VzLTIwMDgwMjIxAMz9bXMkuZHlj76/n4L3nWQ2XR0AAoFA2d1r
pqfZ0cxI6u2Wdu78ZTJZksyqShXJ5GQmu7v06W9EZkZ1MdwP4ER4srG7MyP1rM5xevwSgXAA

17:00:22 tramp-handle-insert-file-contents (4) # Inserting local temp file `/tmp/tramp.29438M8o.gz'...done
17:00:23 tramp-flush-file-property (8) # /var/log/
17:00:23 tramp-get-file-property (8) # /var/log/messages-20080221.gz file-exists-p t
17:00:23 tramp-get-file-property (8) # /var/log/messages-20080221.gz file-attributes-integer (nil 1 0 0 (18350 32204) (18364 65099) (18364 65109) 956556 -rw-r----- nil (82 5718) (-1 0))

Re: 23.0.60; TRAMP fails to copy a gzip'ed file

[Michael Albinus]

Peter Dyballa <Peter_Dyballa@gmx.de> writes:

> I think I can give you root access if you send me your public key ...

OK, I'll do so. It will take a couple of days; tonight and tomorrow
evening I'm out of town.

> Yes. That's the way I fetched it for review. (It also worked with a
> copy of GNU Emacs 23.0.60 from a week ago? But then I had to try it
> successfully in a -Q session!)

Tramp has been touched in the trunk last time 3 weeks ago. Strange.

Best regards, Michael.

Re: 23.0.60; TRAMP fails to copy a gzip'ed file

[Stefan Monnier]

>> What happens if you apply
>> cksum on both the remote file and its local copy?

> On the remote Linux server it's: 1268136719 956556 messages-20080221.gz
> In HFS+ it's: 2116220391 956556 messages-20080221.gz
> In UFS it's: 2116220391 956556 messages-20080221.gz

Can you compare the two files to see which bytes are different?


        Stefan

Re: 23.0.60; TRAMP fails to copy a gzip'ed file

[Peter Dyballa]

Am 10.03.2008 um 16:41 schrieb Michael Albinus:

> For further analysis I would need the debug buffer of Tramp.

Sorry that I sent before 1 MB to all! Some distraction, and then you  
just press the send button while still recovering ...


I used a smaller file, 16 K, gzip'ed and copied it: the same error.  
One byte, gzip'ed to 24 bytes, could be transferred OK. Almost 1 K  
text (a shell script) still OK.

Beyond 10 K it gets interesting. Creating the files with split and  
either gzip'ing from dired or from command line (actually the second  
chunk) I can view them in remote dired buffer OK. The local copies  
are unusable: start at "point=11965 of 12288 (97%)" the contents is  
false.

So I made a final test: split file -b 11964, gzip'ed, and copied: all  
OK! So we know the magic border ...


The remote site is: Linux tatnam 2.6.9-023stab046.2-smp #1 SMP Mon  
Dec 10 15:04:55 MSK 2007 i686 i686 i386 GNU/Linux, a stripped down  
SuSE 9 Linux (with YAST2). /proc/version has:

	Linux version 2.6.9-023stab046.2-smp (root@rhel4-64) (gcc version  
3.4.5 20051201 (Red Hat 3.4.5-2)) #1 SMP Mon Dec 10 15:04:55 MSK 2007

Anyway, it's a virtual machine, all can be hoax as the Xeon  
processors. Secure SHell: OpenSSH_3.7.1p2, SSH protocols 1.5/2.0,  
OpenSSL 0.9.7b 10 Apr 2003


--
Mit friedvollen Grüßen

   Pete

To be is to do.
			– I. Kant
To do is to be.
			– A. Sartre
Yabba-Dabba-Doo!
			– F. Flintstone

Re: 23.0.60; TRAMP fails to copy a gzip'ed file

[Michael Albinus]

Peter Dyballa <Peter_Dyballa@freenet.de> writes:

>> For further analysis I would need the debug buffer of Tramp. Before
>> you start, please perform "(setq tramp-verbose 9)". Make sure that
>> there are no sensitive data in the copied file; I'll read it.

> 17:00:11 tramp-send-command (6) # mimencode -b < /var/log/messages-20080221.gz 2>/dev/null; echo tramp_exit_status $? 

[...]

> 17:00:22 tramp-wait-for-regexp (6) # 
> H4sICEv+vEcAA21lc3NhZ2VzLTIwMDgwMjIxAMz9bXMkuZHlj76/n4L3nWQ2XR0AAoFA2d1r
> pqfZ0cxI6u2Wdu78ZTJZksyqShXJ5GQmu7v06W9EZkZ1MdwP4ER4srG7MyP1rM5xevwSgXAA
> 
> 17:00:22 tramp-handle-insert-file-contents (4) # Inserting local temp file `/tmp/tramp.29438M8o.gz'...done

That looks very strange. Just 2 lines as the result of mimencode.

Could you, please, apply the following commands on the remote machine:

  mimencode -b </var/log/messages-20080221.gz | mimencode -u -b >/tmp/123.gz
  cksum /var/log/messages-20080221.gz
  cksum /tmp/123.gz

/tmp/123.gz shall be identical to /var/log/messages-20080221.gz. If yes,
I would like to see another trace, but with "(setq tramp-verbose 10)".
You might send it to me off the list; it will be huge.

Best regards, Michael.

Re: 23.0.60; TRAMP fails to copy a gzip'ed file

[Peter Dyballa]

Am 11.03.2008 um 12:23 schrieb Michael Albinus:

> Could you, please, apply the following commands on the remote machine:
>
>   mimencode -b </var/log/messages-20080221.gz | mimencode -u -b >/ 
> tmp/123.gz
>   cksum /var/log/messages-20080221.gz
>   cksum /tmp/123.gz
>
> /tmp/123.gz shall be identical to /var/log/messages-20080221.gz. If  
> yes,
> I would like to see another trace, but with "(setq tramp-verbose 10)".
> You might send it to me off the list; it will be huge.


The output of cksum is in both cases the same: 1268136719 956556  
<file name>.

I have prepared 2 files, one with uncompressed 11964 bytes, the other  
with 11965 bytes uncompressed. I'll try the verbose test with the  
bigger file ...

--
Mit friedvollen Grüßen

   Pete

Know thyself. Need help, call GOOGLE.

Re: 23.0.60; TRAMP fails to copy a gzip'ed file

[Michael Albinus]

Peter Dyballa <Peter_Dyballa@freenet.de> writes:

> The output of cksum is in both cases the same: 1268136719 956556
> <file name>.
>
> I have prepared 2 files, one with uncompressed 11964 bytes, the other
> with 11965 bytes uncompressed. I'll try the verbose test with the
> bigger file ...

Just one check: does the problem happen only with large compressed
files, or does it happen also with large uncompressed files?

If it doesn't in the latter case, then it might be a problem of saving
the binary data from the temporary buffer. Maybe something because of
the unicode merge (wild guess, I know).

Best regards, Michael.

Re: 23.0.60; TRAMP fails to copy a gzip'ed file

[Peter Dyballa]

Am 11.03.2008 um 15:16 schrieb Michael Albinus:

> Peter Dyballa <Peter_Dyballa@freenet.de> writes:
>
>> The output of cksum is in both cases the same: 1268136719 956556
>> <file name>.
>>
>> I have prepared 2 files, one with uncompressed 11964 bytes, the other
>> with 11965 bytes uncompressed. I'll try the verbose test with the
>> bigger file ...
>
> Just one check: does the problem happen only with large compressed
> files, or does it happen also with large uncompressed files?
>
> If it doesn't in the latter case, then it might be a problem of saving
> the binary data from the temporary buffer. Maybe something because of
> the unicode merge (wild guess, I know).
>

There might be even more bugs! Yesterday I built my test files on  
command line with split. In dired i gzip'ed them – und two lines  
became one! Today I tried to gunzip the two files to test  
uncompressed transfer – and again two lines became one in dired. At  
both times only one file was gzip'ed or gunzip'ed.

Uncompresses text (LOG) files up to almost 16 MB are transferred  
fine. My check was simple: viewing the original file in dired and  
viewing the copy in dired. Then doing a compare-windows.

I also fetched the files with sftp and invoked diff on the command  
line, diff between the copied and the sftp'ed file. The differences  
found were new log entries.


How does v(iewing) a remote gzip'ed file in dired work? This never  
showed a(n obvious) problem ...

I again could observe that the remote server delivers data at varying  
rates from less than 10 kB/sec to up to 120 kB/sec. Sftp showed a  
more stable and higher transfer rate.

I'm off now for some hours!

--
Mit friedvollen Grüßen

   Pete

People say that if you play Microsoft CD's backwards, you hear  
satanic things, but that's nothing, because if you play them  
forwards, they install MS Windows.

Re: 23.0.60; TRAMP fails to copy a gzip'ed file

[Dan Nicolaescu]

Peter Dyballa <Peter_Dyballa@freenet.de> writes:

  > Am 11.03.2008 um 15:16 schrieb Michael Albinus:
  > 
  > > Peter Dyballa <Peter_Dyballa@freenet.de> writes:
  > >
  > >> The output of cksum is in both cases the same: 1268136719 956556
  > >> <file name>.
  > >>
  > >> I have prepared 2 files, one with uncompressed 11964 bytes, the other
  > >> with 11965 bytes uncompressed. I'll try the verbose test with the
  > >> bigger file ...
  > >
  > > Just one check: does the problem happen only with large compressed
  > > files, or does it happen also with large uncompressed files?
  > >
  > > If it doesn't in the latter case, then it might be a problem of saving
  > > the binary data from the temporary buffer. Maybe something because of
  > > the unicode merge (wild guess, I know).
  > >
  > 
  > There might be even more bugs! Yesterday I built my test files on
  > command line with split. In dired i gzip'ed them – und two lines
  > became one! Today I tried to gunzip the two files to test
  > uncompressed transfer – and again two lines became one in dired. At
  > both times only one file was gzip'ed or gunzip'ed.
  > 
  > Uncompresses text (LOG) files up to almost 16 MB are transferred
  > fine. My check was simple: viewing the original file in dired and
  > viewing the copy in dired. Then doing a compare-windows.
  > 
  > I also fetched the files with sftp and invoked diff on the command
  > line, diff between the copied and the sftp'ed file. The differences
  > found were new log entries.

Can you please try doing this with an emacs built with --without-x and
without passing any other CFLAGS, LDFLAGS, etc.

Re: 23.0.60; TRAMP fails to copy a gzip'ed file

[Peter Dyballa]

Am 11.03.2008 um 17:18 schrieb Dan Nicolaescu:

> Can you please try doing this with an emacs built with --without-x and
> without passing any other CFLAGS, LDFLAGS, etc.


	In GNU Emacs 23.0.60.1 (powerpc-apple-darwin8.11.0)
	 of 2008-03-11 on Latsche.local
	configured using `configure  '--without-pop' '--without-sound' '-- 
without-x' '--enable-locallisppath=/Library/Application Support/Emacs/ 
calendar23:/Library/Application Support/Emacs/caml:/Library/ 
Application Support/Emacs:/sw/share/emacs21/site-lisp/elib'  
'PKG_CONFIG_PATH=/sw/lib/freetype219/lib/pkgconfig:/sw/lib/ 
fontconfig2/lib/pkgconfig:/sw/lib/pkgconfig:/sw/lib/system-openssl/ 
lib/pkgconfig:/sw/share/pkgconfig:/usr/lib/pkgconfig:/usr/local/lib/ 
pkgconfig:/usr/local/clamXav/lib/pkgconfig:/usr/X11R6/lib/pkgconfig'  
'LDFLAGS=' 'CPPFLAGS=''
	
	Important settings:
	  value of $LC_ALL: nil
	  value of $LC_COLLATE: nil
	  value of $LC_CTYPE:
	  value of $LC_MESSAGES: nil
	  value of $LC_MONETARY: nil
	  value of $LC_NUMERIC: nil
	  value of $LC_TIME: nil
	  value of $LANG:
	  value of $XMODIFIERS: nil
	  locale-coding-system: nil
	  default-enable-multibyte-characters: t
	
	Major mode: Dired by name

shows the same behaviour. The magic limit seems to be today: 11601  
bytes. One byte more and gzip reports an error when gunzip'ing the  
local copy for viewing in dired. Compare-windows runs until  
point=11523 of 11566 (100%). In the remote file this position is:  
point=11523 of 11602 (99%).

--
Greetings
                                  <]
    Pete      o        __o         |__    o           recumbo
     ___o    /I       -\<,         |o \  -\),-%       ergo sum!
___/\ /\___./ \___...O/ O____.....`-O-'-()--o_________________

Re: 23.0.60; TRAMP fails to copy a gzip'ed file

[Peter Dyballa]

Am 11.03.2008 um 16:12 schrieb Peter Dyballa:

> There might be even more bugs! Yesterday I built my test files on  
> command line with split. In dired i gzip'ed them – und two lines  
> became one! Today I tried to gunzip the two files to test  
> uncompressed transfer – and again two lines became one in dired. At  
> both times only one file was gzip'ed or gunzip'ed.


This bug also shows when only one file is changed. For my tests  
yesterday I gzip'ed the files from split in dired. After the file had  
been compressed and its file name was gone, its line in the dired  
buffer vanished – and no new line with <file name>.gz appeared. Could  
be setting file-precious-flag or tramp-verbose to non-default values  
caused this. Today, in non-windows Emacs, when I had set (setq tramp- 
verbose 10) and I compressed a remote file, it re-appeared with its  
gzip'ed name – and the next file on the line below disappeared. This  
behaviour could be repeated.

Today, this morning, the magic border seems to be raised above 11601  
bytes ...

--
Mit friedvollen Grüßen

   Pete

$ sumascii BILL GATES
   B   I   L   L   G   A   T   E   S
  66+ 73+ 76+ 76+ 71+ 65+ 84+ 69+ 83 = 663

  and add 3 because he's Bill Gates the third.