bug#18751: 25.0.50; Unable to copy hidden (dot) files from remote shared server (Linux) to local machine (OSX).

bug#18751: 25.0.50; Unable to copy hidden (dot) files from remote shared server (Linux) to local machine (OSX).

[Keith David Bershatsky]

Using tramp / dired-mode to access a remote shared Centos linux server -- e.g., `(find-file "/ssh:lawlist@12.34.56.789:/home/lawlist/")` -- I have not been able to subsequently copy files / directories recursively from the remote server to the local machine with `dired-do-copy`.  The variable `dired-recursive-copies` is set to `always` -- i.e., `(setq dired-recursive-copies 'always)`.

What happens is that the directory selected gets copied from the remote to the local, but nothing inside the directory gets copied over -- i.e., an empty folder is created on the local machine (which has the name of the folder that was copied), but nothing else happens except the following error message:

Copy '/ssh:lawlist@12.34.56.789:/home/lawlist/wcnsql' to '/Users/HOME/Desktop/wcnsql' failed:
(file-error Opening input file no such file or directory /ssh:lawlist@12.34.56.789:/home/lawlist/wcnsql/.www.my.cnf)

The permissions for the file at issue is:  `-rw-r--r--` (aka 644).  The owner / group is 718.  The file at issue is NOT a symbolic link.

Thanks,

Keith

;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;

In GNU Emacs 25.0.50.1 (x86_64-apple-darwin10.8.0, NS appkit-1038.36 Version 10.6.8 (Build 10K549))
 of 2014-10-01 on MP.local
Repository revision: 117996 dmantipov@yandex.ru-20141001132108-zdsxru2390mqyjlu
Windowing system distributor `Apple', version 10.3.1038
Configured using:
 `configure --with-ns'

Configured features:
ACL LIBXML2 ZLIB

Important settings:
  locale-coding-system: utf-8-unix

Major mode: Dired by name

Minor modes in effect:
  sd-mode: t
  sb-mode: t
  hl-mode: t
  tb-mode: t
  shell-dirtrack-mode: t
  cm-mode: t
  bc-mode: t
  as-mode: t
  ds-mode: t
  ml-mode: t
  font-lock-mode: t
  buffer-read-only: t

Recent input:
<down-mouse-3> <mouse-3> <s-down> <up> <up> <up> c 
<S-s-left> ~ / D e s k t o p <return> <escape> x r 
e p o r t - e m a c s - b u g <return>

Recent messages:
Tramp: Sending command `exec ssh -l lawlist  -o ControlPath=/var/folders/rJ/rJIVeQSJE6G3jvy-iIQi5k+++TI/-Tmp-/tramp.2638Qnq.%r@%h:%p -o ControlMaster=auto -e none 12.34.56.789'
Tramp: Waiting for prompts from remote shell...
Tramp: Sending Password
Tramp: Waiting for prompts from remote shell...done
Tramp: Found remote shell prompt on `12.34.56.789'
Tramp: Opening connection for lawlist@12.34.56.789 using ssh...done
Copying /ssh:lawlist@12.34.56.789:/home/lawlist/wcnsql/.www.my.cnf to /Users/HOME/Desktop/wcnsql/.www.my.cnf...failed
Copy `/ssh:lawlist@12.34.56.789:/home/lawlist/wcnsql' to `/Users/HOME/Desktop/wcnsql' failed:
(file-error Opening input file no such file or directory /ssh:lawlist@12.34.56.789:/home/lawlist/wcnsql/.www.my.cnf)


Load-path shadows:
/Users/HOME/.0.data/.0.emacs/.0.apel_flim_simi/md4 hides /Users/HOME/.0.data/.0.emacs/Emacs_10_01_2014.app/Contents/Resources/lisp/md4
/Users/HOME/.0.data/.0.emacs/.0.apel_flim_simi/hex-util hides /Users/HOME/.0.data/.0.emacs/Emacs_10_01_2014.app/Contents/Resources/lisp/hex-util
/Users/HOME/.0.data/.0.emacs/.0.apel_flim_simi/sasl hides /Users/HOME/.0.data/.0.emacs/Emacs_10_01_2014.app/Contents/Resources/lisp/net/sasl
/Users/HOME/.0.data/.0.emacs/.0.apel_flim_simi/sasl-ntlm hides /Users/HOME/.0.data/.0.emacs/Emacs_10_01_2014.app/Contents/Resources/lisp/net/sasl-ntlm
/Users/HOME/.0.data/.0.emacs/.0.apel_flim_simi/sasl-digest hides /Users/HOME/.0.data/.0.emacs/Emacs_10_01_2014.app/Contents/Resources/lisp/net/sasl-digest
/Users/HOME/.0.data/.0.emacs/.0.apel_flim_simi/sasl-cram hides /Users/HOME/.0.data/.0.emacs/Emacs_10_01_2014.app/Contents/Resources/lisp/net/sasl-cram
/Users/HOME/.0.data/.0.emacs/.0.apel_flim_simi/ntlm hides /Users/HOME/.0.data/.0.emacs/Emacs_10_01_2014.app/Contents/Resources/lisp/net/ntlm
/Users/HOME/.0.data/.0.emacs/.0.apel_flim_simi/hmac-md5 hides /Users/HOME/.0.data/.0.emacs/Emacs_10_01_2014.app/Contents/Resources/lisp/net/hmac-md5
/Users/HOME/.0.data/.0.emacs/.0.apel_flim_simi/hmac-def hides /Users/HOME/.0.data/.0.emacs/Emacs_10_01_2014.app/Contents/Resources/lisp/net/hmac-def
/Users/HOME/.0.data/.0.emacs/.0.wl/rfc2368 hides /Users/HOME/.0.data/.0.emacs/Emacs_10_01_2014.app/Contents/Resources/lisp/mail/rfc2368
/Users/HOME/.0.data/.0.emacs/.0.wl/utf7 hides /Users/HOME/.0.data/.0.emacs/Emacs_10_01_2014.app/Contents/Resources/lisp/gnus/utf7
/Users/HOME/.0.data/.0.emacs/.0.apel_flim_simi/smime hides /Users/HOME/.0.data/.0.emacs/Emacs_10_01_2014.app/Contents/Resources/lisp/gnus/smime
/Users/HOME/.0.data/.0.emacs/.0.apel_flim_simi/pgg hides /Users/HOME/.0.data/.0.emacs/Emacs_10_01_2014.app/Contents/Resources/lisp/obsolete/pgg
/Users/HOME/.0.data/.0.emacs/.0.apel_flim_simi/pgg-pgp5 hides /Users/HOME/.0.data/.0.emacs/Emacs_10_01_2014.app/Contents/Resources/lisp/obsolete/pgg-pgp5
/Users/HOME/.0.data/.0.emacs/.0.apel_flim_simi/pgg-pgp hides /Users/HOME/.0.data/.0.emacs/Emacs_10_01_2014.app/Contents/Resources/lisp/obsolete/pgg-pgp
/Users/HOME/.0.data/.0.emacs/.0.apel_flim_simi/pgg-parse hides /Users/HOME/.0.data/.0.emacs/Emacs_10_01_2014.app/Contents/Resources/lisp/obsolete/pgg-parse
/Users/HOME/.0.data/.0.emacs/.0.apel_flim_simi/pgg-gpg hides /Users/HOME/.0.data/.0.emacs/Emacs_10_01_2014.app/Contents/Resources/lisp/obsolete/pgg-gpg
/Users/HOME/.0.data/.0.emacs/.0.apel_flim_simi/pgg-def hides /Users/HOME/.0.data/.0.emacs/Emacs_10_01_2014.app/Contents/Resources/lisp/obsolete/pgg-def

Features:
(shadow mime-setup mail-mime-setup semi-setup mime-image modb-standard
elmo-imap4 emacsbug tramp-cache tramp-sh lawlist-desktop frameset
lawlist-colors reporter lawlist-dv lawlist-mc rect lawlist-ztree
lawlist-wl elmo-nntp wl-demo wl-news wl-address wl-thread wl wl-e21
wl-draft elmo-pop3 wl-template elmo-net elmo-cache elmo-map elmo-dop
wl-folder wl-spam wl-action wl-summary wl-refile wl-message wl-mime
pgg mime-pgp wl-util pp elmo-flag elmo-localdir mime-play filename
mime-edit eword-encode pgg-parse pccl pccl-20 pgg-def signature
sendmail elmo-mime mmelmo-buffer mmelmo-imap mime-view mime-conf
calist semi-def mmimap mime-parse mmbuffer mmgeneric elmo-filter
elmo-multi elmo-spam elsp-header elsp-generic elmo elmo-signal
wl-highlight wl-vars wl-version elmo-msgdb modb modb-generic
modb-entity luna mime elmo-util emu invisible inv-23 poem poem-e20
poem-e20_3 eword-decode std11 elmo-date elmo-vars elmo-version
w3m-load mime-w3m w3m browse-url doc-view jka-compr image-mode
w3m-hist w3m-fb bookmark-w3m w3m-ems w3m-ccl ccl w3m-favicon w3m-image
w3m-proc w3m-util lawlist-dired dired-aux lawlist-vr-hr lawlist-ws
disp-table lawlist-calculator lawlist-flyspell lawlist-yasnippet
lawlist-tex-mode skeleton compare-w lawlist-txt-mode lawlist-tabbar
lawlist-github ido view tramp tramp-compat tramp-loaddefs trampver
shell help-mode grep compile epa epg epg-config diff-mode autorevert
filenotify find-lisp log-edit add-log thingatpt log-view pcvs-util
conf-mode time-stamp vc-git vc vc-dispatcher ediff-merg ediff-wind
ediff-diff ediff-mult ediff-help ediff-init ediff-util ediff rx ert
ewoc debug eieio-base lorg-calendar org-element lorg-search org-agenda
lawlist-toodledo url-http url-auth url-gw url url-proxy url-privacy
url-expand url-methods url-history url-cookie url-domsuf url-util
url-parse auth-source eieio eieio-core password-cache url-vars mailcap
json xml lawlist-org lawlist-calendar derived org byte-opt bytecomp
byte-compile cconv org-macro org-footnote org-pcomplete pcomplete
org-list org-faces org-entities org-version ob-emacs-lisp ob ob-tangle
org-src ob-ref ob-lob ob-table ob-keys ob-exp ob-comint comint
ansi-color ring ob-core ob-eval org-compat org-macs org-loaddefs
cal-menu calendar cal-loaddefs noutline outline gnus-sum gnus-group
gnus-undo gnus-start gnus-cloud nnimap nnmail mail-source tls utf7 mel
path-util mime-def alist mcharset mcs-20 mcs-e20 pcustom pces pces-e20
pces-20 broken poe pym static apel-ver product netrc nnoo parse-time
gnus-spec gnus-int gnus-range message dired format-spec rfc822 mml
mml-sec mm-decode mm-bodies mm-encode gmm-utils mailheader gnus-win
lawlist-frame lawlist-bbdb gnus gnus-ems nnheader gnus-util mail-utils
wid-edit mail-parse rfc2231 rfc2047 rfc2045 ietf-drums mm-util
mail-prsvr mailabbrev cl timezone lawlist-init pcase cl-macs gv advice
help-fns easy-mmode edmacro kmacro cl-loaddefs cl-lib savehist server
ps-print ps-def lpr find-func saveplace easymenu time-date tooltip
electric uniquify ediff-hook vc-hooks lisp-float-type mwheel ns-win
tool-bar dnd fontset image regexp-opt fringe tabulated-list newcomment
elisp-mode lisp-mode prog-mode register page menu-bar rfn-eshadow
timer select scroll-bar mouse jit-lock font-lock syntax facemenu
font-core frame cham georgian utf-8-lang misc-lang vietnamese tibetan
thai tai-viet lao korean japanese hebrew greek romanian slovak czech
european ethiopic indian cyrillic chinese case-table epa-hook
jka-cmpr-hook help simple abbrev minibuffer nadvice loaddefs button
faces cus-face macroexp files text-properties overlay sha1 md5 base64
format env code-pages mule custom widget hashtable-print-readable
backquote make-network-process cocoa ns multi-tty emacs)

Memory information:
((conses 16 1087128 55740)
 (symbols 48 62211 0)
 (miscs 40 118 454)
 (strings 32 146674 25097)
 (string-bytes 1 4671187)
 (vectors 16 43088)
 (vector-slots 8 781617 28898)
 (floats 8 1193 100)
 (intervals 56 5562 0)
 (buffers 976 13))

bug#18751: 25.0.50; Unable to copy hidden (dot) files from remote shared server (Linux) to local machine (OSX).

[Michael Albinus]

Keith David Bershatsky <esq@lawlist.com> writes:

Hi Keith,

> Copy '/ssh:lawlist@12.34.56.789:/home/lawlist/wcnsql' to '/Users/HOME/Desktop/wcnsql' failed:
> (file-error Opening input file no such file or directory /ssh:lawlist@12.34.56.789:/home/lawlist/wcnsql/.www.my.cnf)

Could you, please, apply (setq tramp-verbose 9) prior the test? This
shall create a Tramp debug buffer including Tramp's file cache
operations. Please show this buffer; it might tell us what happens.

> Thanks,
>
> Keith

Best regards, Michael.

bug#18751: 25.0.50; Unable to copy hidden (dot) files from remote shared server (Linux) to local machine (OSX).

[Keith David Bershatsky]

Michael:

Here is the long buffer readout using `(setq tramp-verbose 9)`.

;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;

;; GNU Emacs: 25.0.50.1 Tramp: 2.2.11-pre -*- mode: outline; -*-
21:15:16.657257 tramp-get-file-property (8) # /home/lawlist file-directory-p undef
21:15:16.657445 tramp-get-connection-property (7) # test test
21:15:16.657561 tramp-get-connection-property (7) # process-name nil
21:15:16.657660 tramp-get-connection-property (7) # process-name nil
21:15:16.657760 tramp-get-connection-property (7) # process-buffer nil
21:15:16.658742 tramp-maybe-open-connection (3) # Opening connection for lawlist@12.34.56.789 using ssh...
21:15:16.676361 tramp-get-connection-property (7) # process-name nil
21:15:16.676474 tramp-get-connection-property (7) # process-buffer nil
21:15:16.680559 tramp-set-connection-property (7) # vector [ssh lawlist 12.34.56.789 /home/lawlist nil]
21:15:16.680893 tramp-maybe-open-connection (6) # /bin/sh -i
21:15:16.681041 tramp-get-connection-property (7) # vector [ssh lawlist 12.34.56.789 /home/lawlist nil]
21:15:16.681246 tramp-get-connection-property (7) # check-remote-echo nil
21:15:16.681374 tramp-get-connection-property (7) # check-remote-echo nil
21:15:16.714731 tramp-get-connection-property (7) # check-remote-echo nil
21:15:16.714887 tramp-get-connection-property (7) # check-remote-echo nil
21:15:16.714995 tramp-wait-for-regexp (6) # 
#$ 
21:15:16.715148 tramp-get-file-property (8) #  gateway nil
21:15:16.715260 tramp-get-connection-property (7) # temp-file undef
21:15:16.715517 tramp-set-connection-property (7) # temp-file /var/folders/rJ/rJIVeQSJE6G3jvy-iIQi5k+++TI/-Tmp-/tramp.411Ule
21:15:16.875485 tramp-maybe-open-connection (3) # Sending command `exec ssh -l lawlist  -o ControlPath=/var/folders/rJ/rJIVeQSJE6G3jvy-iIQi5k+++TI/-Tmp-/tramp.411Ule.%r@%h:%p -o ControlMaster=auto -e none 12.34.56.789'
21:15:16.875623 tramp-get-connection-property (7) # process-name nil
21:15:16.875718 tramp-get-connection-property (7) # remote-echo nil
21:15:16.875801 tramp-send-command (6) # exec ssh -l lawlist  -o ControlPath=/var/folders/rJ/rJIVeQSJE6G3jvy-iIQi5k+++TI/-Tmp-/tramp.411Ule.%r@%h:%p -o ControlMaster=auto -e none 12.34.56.789
21:15:16.875892 tramp-get-connection-property (7) # process-name nil
21:15:16.875982 tramp-get-connection-property (7) # chunksize nil
21:15:16.876066 tramp-set-connection-property (7) # last-cmd-time (21569 59732 876037 0)
21:15:16.876165 tramp-get-connection-property (7) # process-buffer nil
21:15:16.876409 tramp-set-connection-property (7) # first-password-request t
21:15:16.889899 tramp-process-actions (3) # Waiting for prompts from remote shell...
21:15:17.907068 tramp-process-one-action (5) # Looking for regexp "\(.*ogin\( .*\)?: *\)\'" from remote shell
21:15:17.907227 tramp-get-connection-property (7) # check-remote-echo nil
21:15:17.907310 tramp-get-connection-property (7) # check-remote-echo nil
21:15:17.907431 tramp-process-one-action (5) # Looking for regexp "\(^.*\(\(?:adgangskode\|contrase\(?:\(?:ny\|ñ\)a\)\|geslo\|h\(?:\(?:asł\|esl\)o\)\|iphasiwedi\|jelszó\|l\(?:ozinka\|ösenord\)\|m\(?:ot de passe\|ật khẩu\)\|pa\(?:rola\|s\(?:ahitza\|s\(?: phrase\|ord\|phrase\|wor[dt]\)\|vorto\)\)\|s\(?:alasana\|enha\|laptažodis\)\|wachtwoord\|лозинка\|пароль\|ססמה\|كلمة السر\|गुप्तशब्द\|शब्दकूट\|গুপ্তশব্দ\|পাসওয়ার্ড\|ਪਾਸਵਰਡ\|પાસવર્ડ\|ପ୍ରବେଶ ସଙ୍କେତ\|கடவுச்சொல்\|సంకేతపదము\|ಗುಪ್ತಪದ\|അടയാളവാക്ക്\|රහස්පදය\|ពាក្យសម្ងាត់\|パスワード\|
 密[码碼]\|암호\)\).*:

bug#18751: 25.0.50; Unable to copy hidden (dot) files from remote shared server (Linux) to local machine (OSX).

[Michael Albinus]

Keith David Bershatsky <esq@lawlist.com> writes:

> Michael:

Hi Keith,

> Here is the long buffer readout using `(setq tramp-verbose 9)`.

Unfortunately, it doesn't tell us what happens. All we see is

> 21:16:07.550834 tramp-do-copy-or-rename-file (0) # Copying /ssh:lawlist@12.34.56.789:/home/lawlist/wcnsql/.www.my.cnf to /Users/HOME/Desktop/wcnsql/.www.my.cnf...
> 21:16:07.583433 tramp-do-copy-or-rename-file (0) # Copying /ssh:lawlist@12.34.56.789:/home/lawlist/wcnsql/.www.my.cnf to /Users/HOME/Desktop/wcnsql/.www.my.cnf...failed

The traces before these two lines look ok.

Could I ask you to rerun the test with tramp-verbose 10? I wanted to
avoid this cos the traces are much longer, but maybe we could see
something there ...

Thanks, and best regards, Michael.

bug#18751: 25.0.50; Unable to copy hidden (dot) files from remote shared server (Linux) to local machine (OSX).

[Keith David Bershatsky]

Michael:

Here is the readout for `(setq tramp-verbose 10)`.

Keith

;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;

;; GNU Emacs: 25.0.50.1 Tramp: 2.2.11-pre -*- mode: outline; -*-
20:31:44.022062 tramp-get-file-property (8) # /home/lawlist file-directory-p undef
20:31:44.022277 tramp-get-connection-property (7) # test test
20:31:44.022398 tramp-get-connection-property (7) # process-name nil
20:31:44.022501 tramp-get-connection-property (7) # process-name nil
20:31:44.022602 tramp-get-connection-property (7) # process-buffer nil
20:31:44.023704 tramp-maybe-open-connection (3) # Opening connection for lawlist@12.34.56.789 using ssh...
20:31:44.039812 tramp-get-connection-property (7) # process-name nil
20:31:44.039925 tramp-get-connection-property (7) # process-buffer nil
20:31:44.043919 tramp-set-connection-property (7) # vector [ssh lawlist 12.34.56.789 /home/lawlist nil]
20:31:44.044177 tramp-maybe-open-connection (6) # /bin/sh -i
20:31:44.044306 tramp-get-connection-property (7) # vector [ssh lawlist 12.34.56.789 /home/lawlist nil]
20:31:44.044499 tramp-get-connection-property (7) # check-remote-echo nil
20:31:44.044624 tramp-get-connection-property (7) # check-remote-echo nil
20:31:44.044806 tramp-accept-process-output (10) # *tramp/ssh lawlist@12.34.56.789* run
20:31:44.064434 tramp-accept-process-output (10) # 
#$ 
20:31:44.064571 tramp-get-connection-property (7) # check-remote-echo nil
20:31:44.064674 tramp-get-connection-property (7) # check-remote-echo nil
20:31:44.064782 tramp-wait-for-regexp (6) # 
#$ 
20:31:44.064933 tramp-get-file-property (8) #  gateway nil
20:31:44.065067 tramp-get-connection-property (7) # temp-file undef
20:31:44.065323 tramp-set-connection-property (7) # temp-file /var/folders/rJ/rJIVeQSJE6G3jvy-iIQi5k+++TI/-Tmp-/tramp.372gCz
20:31:44.220363 tramp-maybe-open-connection (3) # Sending command `exec ssh -l lawlist  -o ControlPath=/var/folders/rJ/rJIVeQSJE6G3jvy-iIQi5k+++TI/-Tmp-/tramp.372gCz.%r@%h:%p -o ControlMaster=auto -e none 12.34.56.789'
20:31:44.220507 tramp-get-connection-property (7) # process-name nil
20:31:44.220602 tramp-get-connection-property (7) # remote-echo nil
20:31:44.220685 tramp-send-command (6) # exec ssh -l lawlist  -o ControlPath=/var/folders/rJ/rJIVeQSJE6G3jvy-iIQi5k+++TI/-Tmp-/tramp.372gCz.%r@%h:%p -o ControlMaster=auto -e none 12.34.56.789
20:31:44.220779 tramp-get-connection-property (7) # process-name nil
20:31:44.220874 tramp-get-connection-property (7) # chunksize nil
20:31:44.220959 tramp-set-connection-property (7) # last-cmd-time (21571 12448 220930 0)
20:31:44.221054 tramp-send-string (10) # exec ssh -l lawlist  -o ControlPath=/var/folders/rJ/rJIVeQSJE6G3jvy-iIQi5k+++TI/-Tmp-/tramp.372gCz.%r@%h:%p -o ControlMaster=auto -e none 12.34.56.789
20:31:44.221141 tramp-get-connection-property (7) # process-buffer nil
20:31:44.221379 tramp-set-connection-property (7) # first-password-request t
20:31:44.237299 tramp-process-actions (3) # Waiting for prompts from remote shell...
20:31:44.253941 tramp-accept-process-output (10) # *tramp/ssh lawlist@12.34.56.789* run
20:31:45.255000 tramp-accept-process-output (10) # 
20:31:45.255105 tramp-process-one-action (5) # Looking for regexp "\(.*ogin\( .*\)?: *\)\'" from remote shell
20:31:45.255188 tramp-get-connection-property (7) # check-remote-echo nil
20:31:45.255268 tramp-get-connection-property (7) # check-remote-echo nil
20:31:45.255387 tramp-process-one-action (5) # Looking for regexp "\(^.*\(\(?:adgangskode\|contrase\(?:\(?:ny\|ñ\)a\)\|geslo\|h\(?:\(?:asł\|esl\)o\)\|iphasiwedi\|jelszó\|l\(?:ozinka\|ösenord\)\|m\(?:ot de passe\|ật khẩu\)\|pa\(?:rola\|s\(?:ahitza\|s\(?: phrase\|ord\|phrase\|wor[dt]\)\|vorto\)\)\|s\(?:alasana\|enha\|laptažodis\)\|wachtwoord\|лозинка\|пароль\|ססמה\|كلمة السر\|गुप्तशब्द\|शब्दकूट\|গুপ্তশব্দ\|পাসওয়ার্ড\|ਪਾਸਵਰਡ\|પાસવર્ડ\|ପ୍ରବେଶ ସଙ୍କେତ\|கடவுச்சொல்\|సంకేతపదము\|ಗುಪ್ತಪದ\|അടയാളവാക്ക്\|රහස්පදය\|ពាក្យសម្ងាត់\|パスワード\|
 密[码碼]\|암호\)\).*:

bug#18751: 25.0.50; Unable to copy hidden (dot) files from remote shared server (Linux) to local machine (OSX).

[Michael Albinus]

Keith David Bershatsky <esq@lawlist.com> writes:

> Michael:

Hi Keith,

> Here is the readout for `(setq tramp-verbose 10)`.

Thanks.

However, there's still nothing between the last two lines:

> 20:32:26.751224 tramp-do-copy-or-rename-file (0) # Copying /ssh:lawlist@12.34.56.789:/home/lawlist/wcnsql/.www.my.cnf to /Users/HOME/Desktop/wcnsql/.www.my.cnf...
> 20:32:26.784378 tramp-do-copy-or-rename-file (0) # Copying /ssh:lawlist@12.34.56.789:/home/lawlist/wcnsql/.www.my.cnf to /Users/HOME/Desktop/wcnsql/.www.my.cnf...failed

Given the amount of traces Tramp shall write when it is in verbosity 10,
I have the impression that it isn't Tramp which fails.

Do you have a chance to debug `tramp-do-copy-or-rename-file', step by
step? Just in order to know at which place it fails.

> Keith

Best regards, Michael.

bug#18751: 25.0.50; Unable to copy hidden (dot) files from remote shared server (Linux) to local machine (OSX).

[Keith David Bershatsky]

Evaluating `(tramp-do-copy-or-rename-file 'copy filename new-filename t t t)` is working well on all individual files, including `.www.my.cnf`.

`dired-do-copy` is working well on all individual files, and on multiple marked files.

However, `dired-do-copy` cannot handle any remote directory on the remote server with files inside it.  Placing the cursor on any directory on the remote server and issuing the command `dired-do-copy` results in only that folder being copied to the local machine, but noting inside it gets copied over.

Keith

;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;

At Sun, 19 Oct 2014 10:57:52 +0200,
Michael Albinus wrote:
> 
> Keith David Bershatsky <esq@lawlist.com> writes:
> 
> > Michael:
> 
> Hi Keith,
> 
> > Here is the readout for `(setq tramp-verbose 10)`.
> 
> Thanks.
> 
> However, there's still nothing between the last two lines:
> 
> > 20:32:26.751224 tramp-do-copy-or-rename-file (0) # Copying /ssh:lawlist@12.34.56.789:/home/lawlist/wcnsql/.www.my.cnf to /Users/HOME/Desktop/wcnsql/.www.my.cnf...
> > 20:32:26.784378 tramp-do-copy-or-rename-file (0) # Copying /ssh:lawlist@12.34.56.789:/home/lawlist/wcnsql/.www.my.cnf to /Users/HOME/Desktop/wcnsql/.www.my.cnf...failed
> 
> Given the amount of traces Tramp shall write when it is in verbosity 10,
> I have the impression that it isn't Tramp which fails.
> 
> Do you have a chance to debug `tramp-do-copy-or-rename-file', step by
> step? Just in order to know at which place it fails.
> 
> > Keith
> 
> Best regards, Michael.

bug#18751: 25.0.50; Unable to copy hidden (dot) files from remote shared server (Linux) to local machine (OSX).

[Michael Albinus]

Keith David Bershatsky <esq@lawlist.com> writes:

Hi Keith,

> Evaluating `(tramp-do-copy-or-rename-file 'copy filename new-filename
> t t t)` is working well on all individual files, including
> `.www.my.cnf`.
>
> `dired-do-copy` is working well on all individual files, and on
> multiple marked files.
>
> However, `dired-do-copy` cannot handle any remote directory on the
> remote server with files inside it.  Placing the cursor on any
> directory on the remote server and issuing the command `dired-do-copy`
> results in only that folder being copied to the local machine, but
> noting inside it gets copied over.

Thanks for this precision. Now I'm able to reproduce the problem, even
with older Emacs versions.

As far as I could debug, sometimes Tramp is not involved. You could see
it when you instrument the test via

(trace-function-background 'find-file-name-handler)

When you copy a remote directory from dired, there are entries in
*trace-output* like this:

--8<---------------cut here---------------start------------->8---
1 -> (find-file-name-handler "/ssh:localhost:/home/albinus/.emacs.d" copy-directory)
1 <- find-file-name-handler: nil
--8<---------------cut here---------------end--------------->8---

But the result shall be

--8<---------------cut here---------------start------------->8---
1 <- find-file-name-handler: tramp-file-name-handler
--8<---------------cut here---------------end--------------->8---

No idea what's up. I need more debugging; unfortunately I have to start
for a business trip just now. When time permits, I'll continue next days.

> Keith

Best regards, Michael.

bug#18751: 25.0.50; Unable to copy hidden (dot) files from remote shared server (Linux) to local machine (OSX).

[Michael Albinus]

Michael Albinus <michael.albinus@gmx.de> writes:

Hi Keith,

>> Evaluating `(tramp-do-copy-or-rename-file 'copy filename new-filename
>> t t t)` is working well on all individual files, including
>> `.www.my.cnf`.
>>
>> `dired-do-copy` is working well on all individual files, and on
>> multiple marked files.
>>
>> However, `dired-do-copy` cannot handle any remote directory on the
>> remote server with files inside it.  Placing the cursor on any
>> directory on the remote server and issuing the command `dired-do-copy`
>> results in only that folder being copied to the local machine, but
>> noting inside it gets copied over.
>
> Thanks for this precision. Now I'm able to reproduce the problem, even
> with older Emacs versions.

Finally, I could fix it. I've committed the following patch to the
emacs-24 branch (shall appear in the trunk in a few days):

--8<---------------cut here---------------start------------->8---
*** /home/albinus/src/emacs-24/lisp/net/tramp-sh.el.~117655~	2014-11-03 15:37:00.228854359 +0100
--- /home/albinus/src/emacs-24/lisp/net/tramp-sh.el	2014-11-03 15:22:10.311994500 +0100
***************
*** 2061,2071 ****
  KEEP-DATE is non-nil if NEWNAME should have the same timestamp as FILENAME."
    (with-temp-buffer
      ;; We must disable multibyte, because binary data shall not be
!     ;; converted.
      (set-buffer-multibyte nil)
      (let ((coding-system-for-read 'binary)
! 	  (jka-compr-inhibit t))
!       (insert-file-contents-literally filename))
      ;; We don't want the target file to be compressed, so we let-bind
      ;; `jka-compr-inhibit' to t.
      (let ((coding-system-for-write 'binary)
--- 2061,2075 ----
  KEEP-DATE is non-nil if NEWNAME should have the same timestamp as FILENAME."
    (with-temp-buffer
      ;; We must disable multibyte, because binary data shall not be
!     ;; converted.  `insert-file-contents-literally' does not support
!     ;; file name handlers for GNU Emacs; we must create a local copy
!     ;; therefore.
      (set-buffer-multibyte nil)
      (let ((coding-system-for-read 'binary)
! 	  (jka-compr-inhibit t)
! 	  (tmpfile (file-local-copy filename)))
!       (insert-file-contents-literally (or tmpfile filename))
!       (when tmpfile (delete-file tmpfile)))
      ;; We don't want the target file to be compressed, so we let-bind
      ;; `jka-compr-inhibit' to t.
      (let ((coding-system-for-write 'binary)
--8<---------------cut here---------------end--------------->8---

Could you, please, check it?

Best regards, Michael.

bug#18751: 25.0.50; Unable to copy hidden (dot) files from remote shared server (Linux) to local machine (OSX).

[Keith David Bershatsky]

Yes, that did indeed fix the issue.  Good job!  I verified it worked using a version of Emacs Trunk built on November 5, 2014.

GNU Emacs 25.0.50.1 (x86_64-apple-darwin10.8.0, NS appkit-1038.36 Version 10.6.8 (Build 10K549)) of 2014-11-05 on MP.local

Thank you very much for your help -- greatly appreciated!

Keith

;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;

> Finally, I could fix it. I've committed the following patch to the
> emacs-24 branch (shall appear in the trunk in a few days):
> 
* * *
> 
> Could you, please, check it?
> 
> Best regards, Michael.

bug#18751: 25.0.50; Unable to copy hidden (dot) files from remote shared server (Linux) to local machine (OSX).

[Michael Albinus]

Keith David Bershatsky <esq@lawlist.com> writes:

> Yes, that did indeed fix the issue.  Good job!  I verified it worked
> using a version of Emacs Trunk built on November 5, 2014.

Thanks for the confirmation. I'm closing the bug.

> Keith

Best regards, Michael.