TRAMP: Problems copying files in emacs-28.0.50 on Windows 10

TRAMP: Problems copying files in emacs-28.0.50 on Windows 10

[H. Dieter Wilhelm]

Hello Emacs

GNU Emacs 28.0.50 (build 1, x86_64-w64-mingw32) of 2021-01-15

I'm able to visit files from a remote directory with the plink
method. (By the way, a completion of methods seems not to work on
Windows.)  Now I'm trying to copy - from a local dired buffer - an
archive to another dired buffer of a remote directory.  It isn't working
and yields the following error message:

Tramp: Opening connection for Prod using plinkx...done
Copying e:/2021-08-11_shard.tar.gz to /plinkx:Prod:/home/vt1/uidg1626/2021-08-11_shard.tar.gz...failed
Copy: ‘e:/2021-08-11_shard.tar.gz’ to ‘/plinkx:Prod:/home/vt1/uidg1626/2021-08-11_shard.tar.gz’ failed:
(file-error Unlocking file Invalid argument e:/plinkx:Prod:/home/vt1/uidg1626/2021-08-11_shard.tar.gz)

(Buffer *tramp/plinkx Prod* remains empty)

Do you have some advice for me or is this a bug?

Thank you

      Dieter

-- 
Best wishes
H. Dieter Wilhelm
Zwingenberg, Germany

Re: TRAMP: Problems copying files in emacs-28.0.50 on Windows 10

[Michael Albinus]

"H. Dieter Wilhelm" <dieter@duenenhof-wilhelm.de> writes:

> Hello Emacs

Hi Dieter,

> GNU Emacs 28.0.50 (build 1, x86_64-w64-mingw32) of 2021-01-15

Yes, it is a pity that there's no newer prebuild Emacs for MS Windows.

> I'm able to visit files from a remote directory with the plink
> method. (By the way, a completion of methods seems not to work on
> Windows.)  Now I'm trying to copy - from a local dired buffer - an
> archive to another dired buffer of a remote directory.  It isn't working
> and yields the following error message:
>
> Tramp: Opening connection for Prod using plinkx...done
> Copying e:/2021-08-11_shard.tar.gz to /plinkx:Prod:/home/vt1/uidg1626/2021-08-11_shard.tar.gz...failed
> Copy: ‘e:/2021-08-11_shard.tar.gz’ to ‘/plinkx:Prod:/home/vt1/uidg1626/2021-08-11_shard.tar.gz’ failed:
> (file-error Unlocking file Invalid argument e:/plinkx:Prod:/home/vt1/uidg1626/2021-08-11_shard.tar.gz)
>
> (Buffer *tramp/plinkx Prod* remains empty)
>
> Do you have some advice for me or is this a bug?

I can reproduce it with that Emacs snapshot from January, although the
error message is different. However, with a recent Emacs 28.0.60 build
it works for me. Bothe cases I have called "emacs -Q".

There have been several fixes for Tramp on MS Windows this
year. Therefore, I recommend you install Tramp 2.5.1.3 from GNU ELPA.

According to the method completion, I have no problem with the latter
Emacs, once Tramp is loaded.

> Thank you
>
>       Dieter

Best regards, Michael.

RE: [External] : Re: TRAMP: Problems copying files in emacs-28.0.50 on Windows 10

[Drew Adams]

> Yes, it is a pity that there's no newer prebuild Emacs for MS Windows.

A pity indeed, alas.

Re: TRAMP: Problems copying files in emacs-28.0.50 on Windows 10

[H. Dieter Wilhelm]

Hi Michael,

Michael Albinus <michael.albinus@gmx.de> writes:
> "H. Dieter Wilhelm" <dieter@duenenhof-wilhelm.de> writes:

>> GNU Emacs 28.0.50 (build 1, x86_64-w64-mingw32) of 2021-01-15
> Yes, it is a pity that there's no newer prebuild Emacs for MS Windows.

Lately I read that some volunteer intended to compile newer Windows
builds, hopefully soon...

...
>> Windows.)  Now I'm trying to copy - from a local dired buffer - an
>> archive to another dired buffer of a remote directory.  It isn't working
>> and yields the following error message:
...

...
> There have been several fixes for Tramp on MS Windows this
> year. Therefore, I recommend you install Tramp 2.5.1.3 from GNU ELPA.

Oh dear, of course, Gnu Elpa!  This workaround for Tramp never occurred
to me! :-)

OK, installed 2.5.1.3 but it didn't work from emacs -Q!  I copied again
the error messages into the tramp.org file (on Windows) and here's what
came out under Gnu-Linux:

[2021-10-10 Sun]
GNU Emacs 28.0.50 (build 1, x86_64-w64-mingw32) of 2021-01-15
Windows 10, remote is Red Hat Enterprise Linux Server release 7.9 (Maipo)
installed: tramp-2.5.1.3, then emacs -Q 

Copy: €d:/tmp/tramp/2021-08-11_shard.tar.gz€ to €/plinkx:Prod:/home/vt1/uidg1626/2021-08-11_shard.tar.gz€ failed:
(file-error Writing to process Invalid argument *tramp/plinkx Prod*)

*tramp/plinkx Prod*:
FATAL ERROR: Incoming packet was garbled on decryption

Re: TRAMP: Problems copying files in emacs-28.0.50 on Windows 10

[Michael Albinus]

"H. Dieter Wilhelm" <dieter@duenenhof-wilhelm.de> writes:

> Hi Michael,

Hi Dieter,

> OK, installed 2.5.1.3 but it didn't work from emacs -Q!  I copied again
> the error messages into the tramp.org file (on Windows) and here's what
> came out under Gnu-Linux:
>
> [2021-10-10 Sun]
> GNU Emacs 28.0.50 (build 1, x86_64-w64-mingw32) of 2021-01-15
> Windows 10, remote is Red Hat Enterprise Linux Server release 7.9 (Maipo)
> installed: tramp-2.5.1.3, then emacs -Q

I'm not sure that installed ELPA packages are activated when you run
"emacs -Q". Likely, you must load Tramp in your *scratch* buffer (or you
don't use "-Q" while testing).

Verify your Tramp version with "C-h v tramp-version".

If this still doesn't work, the usual recipe: set tramp-verbose to 6,
rerun the test, and show the Tramp debug buffer.

>> According to the method completion, I have no problem with the latter
>> Emacs, once Tramp is loaded.
>
> Unfortunately method completion is still not working for me. (With emacs
> -Q for / s TAB and / p TAB)

As said, Emacs knows Tramp methods for completion only when you have
loaded Tramp.

(Also this with Tramp 2.5.1.3, because there have been changes last months.)

>       Dieter

Best regards, Michael.

Re: TRAMP: Problems copying files in emacs-28.0.50 on Windows 10

[H. Dieter Wilhelm]

Michael Albinus <michael.albinus@gmx.de> writes:
>> installed: tramp-2.5.1.3, then emacs -Q
>
> I'm not sure that installed ELPA packages are activated when you run
> "emacs -Q". Likely, you must load Tramp in your *scratch* buffer (or you
> don't use "-Q" while testing).

Please tell me what you mean exactly by loading Tramp in the *scratch*
buffer?

I know about installing a package from a tar file or I can load
individual lisp files but not a whole directory full of lisp files...

> Verify your Tramp version with "C-h v tramp-version".

I did that and Emacs answered me: 2.5.1-pre.  I assumed that this must
surely be 2.5.1.3.  But what you wrote about emacs -Q is more
reasonable.

I'll loaded all 20 tramp 2.5.1.3 sources from their Elpa folder and the
remote copy operation is working now with emacs -Q. Hurrah!

>> Unfortunately method completion is still not working for me. (With emacs
>> -Q for / s TAB and / p TAB)
>
> As said, Emacs knows Tramp methods for completion only when you have
> loaded Tramp.
>
> (Also this with Tramp 2.5.1.3, because there have been changes last months.)

Right, also completion is working with 2.5.1.3. :-)

Using Tramp is so much more convenient than to open a terminal, then scp
files, then ssh into the remote machine and then operate on the files!
All in one go with Tramp, great stuff!

Thank you very much Michael

      Dieter

PS: The only thing where I'm a bit confused is why - in emacs -Q - Tramp
isn't asking me to save the passwords in an .authinfo file?  Did you
change a customisation in 2.5.1.3 compared to 2.5.1-pre?

-- 
Best wishes
H. Dieter Wilhelm
Zwingenberg, Germany

Re: TRAMP: Problems copying files in emacs-28.0.50 on Windows 10

[Michael Albinus]

[-- Attachment #1: Type: text/plain, Size: 1328 bytes --]

"H. Dieter Wilhelm" <dieter@duenenhof-wilhelm.de> writes:

Hi Dieter,

> Michael Albinus <michael.albinus@gmx.de> writes:
>>> installed: tramp-2.5.1.3, then emacs -Q
>>
>> I'm not sure that installed ELPA packages are activated when you run
>> "emacs -Q". Likely, you must load Tramp in your *scratch* buffer (or you
>> don't use "-Q" while testing).
>
> Please tell me what you mean exactly by loading Tramp in the *scratch*
> buffer?

I meant adapting the load-path, and requiring Tramp then. However, if
you have installed the Tramp ELPA package, you can simply call

# emacs -Q -l ~/.emacs.d/elpa/tramp-2.5.1.3/tramp-autoloads

> I'll loaded all 20 tramp 2.5.1.3 sources from their Elpa folder and the
> remote copy operation is working now with emacs -Q. Hurrah!

Great!

>> As said, Emacs knows Tramp methods for completion only when you have
>> loaded Tramp.
>>
>> (Also this with Tramp 2.5.1.3, because there have been changes last months.)
>
> Right, also completion is working with 2.5.1.3. :-)

Great, again!

> PS: The only thing where I'm a bit confused is why - in emacs -Q - Tramp
> isn't asking me to save the passwords in an .authinfo file?  Did you
> change a customisation in 2.5.1.3 compared to 2.5.1-pre?

Excellent question, I've fixed this two days ago :-) In tramp.el, please
apply the following patch:


[-- Warning: decoded text below may be mangled, UTF-8 assumed --]
[-- Attachment #2: Type: text/x-patch, Size: 724 bytes --]

*** /home/albinus/.emacs.d/elpa/tramp-2.5.1.3/tramp.el.~1~	2021-10-05 15:12:19.990118237 +0200
--- /home/albinus/.emacs.d/elpa/tramp-2.5.1.3/tramp.el	2021-10-11 09:20:41.165536304 +0200
***************
*** 4854,4860 ****
    (save-restriction
      (with-tramp-progress-reporter
  	proc 3 "Waiting for prompts from remote shell"
!       (let (exit)
  	(if timeout
  	    (with-timeout (timeout (setq exit 'timeout))
  	      (while (not exit)
--- 4854,4861 ----
    (save-restriction
      (with-tramp-progress-reporter
  	proc 3 "Waiting for prompts from remote shell"
!       (let ((enable-recursive-minibuffers t)
! 	    exit)
  	(if timeout
  	    (with-timeout (timeout (setq exit 'timeout))
  	      (while (not exit)

[-- Attachment #3: Type: text/plain, Size: 72 bytes --]


> Thank you very much Michael
>
>       Dieter

Best regards, Michael.

Re: TRAMP: Problems copying files in emacs-28.0.50 on Windows 10

[Michael Albinus]

Michael Albinus <michael.albinus@gmx.de> writes:

Hi Dieter,

>> PS: The only thing where I'm a bit confused is why - in emacs -Q - Tramp
>> isn't asking me to save the passwords in an .authinfo file?  Did you
>> change a customisation in 2.5.1.3 compared to 2.5.1-pre?
>
> Excellent question, I've fixed this two days ago :-) In tramp.el, please
> apply the following patch:

Sorry, I'm stupid. This fix is not related. Tramp does not use
auth-source when Emacs is called with -Q.

Best regards, Michael.

Re: TRAMP: Problems copying files in emacs-28.0.50 on Windows 10

[H. Dieter Wilhelm]

Hi Michael

Michael Albinus <michael.albinus@gmx.de> writes:
>>> I'm not sure that installed ELPA packages are activated when you run
>>> "emacs -Q". Likely, you must load Tramp in your *scratch* buffer (or you
>>> don't use "-Q" while testing).
>>
>> Please tell me what you mean exactly by loading Tramp in the *scratch*
>> buffer?
>
> I meant adapting the load-path, and requiring Tramp then. However, if
> you have installed the Tramp ELPA package, you can simply call
>
> # emacs -Q -l ~/.emacs.d/elpa/tramp-2.5.1.3/tramp-autoloads

Ah I see now what you meant, thanks for the clarification.  :-)

>> I'll loaded all 20 tramp 2.5.1.3 sources from their Elpa folder and the
>> remote copy operation is working now with emacs -Q. Hurrah!

I jubilated a bit too early in the case of the plinkx method. Even
though it seems to work for config files, for the following archive, of
about 1.4 MB, it failed:

----------------------------------------------------------------------
Tramp: 2.5.1.3
PuTTY: 0.76
GNU Emacs 28.0.50 (build 1, x86_64-w64-mingw32) of 2021-01-15

Copying d:/tmp/tramp/2021-08-11_shard.tar.gz to /plinkx:Prod:/home/vt1/uidg1626/2021-08-11_shard.tar.gz...failed
Copy: ‘d:/tmp/tramp/2021-08-11_shard.tar.gz’ to ‘/plinkx:Prod:/home/vt1/uidg1626/2021-08-11_shard.tar.gz’ failed:
(file-error Writing to process Invalid argument *tramp/plinkx Prod*)

*tramp/plinkx Prod*
FATAL ERROR: Incoming packet was garbled on decryption
----------------------------------------------------------------------

With the (default) pscp method above file transfer is working though.

Let's see how the pscp method'll fare in the long run. :-)

Thanks

    Dieter
    
-- 
Best wishes
H. Dieter Wilhelm
Zwingenberg, Germany

Re: TRAMP: Problems copying files in emacs-28.0.50 on Windows 10

[Michael Albinus]

"H. Dieter Wilhelm" <dieter@duenenhof-wilhelm.de> writes:

> Hi Michael

Hi Dieter,

> I jubilated a bit too early in the case of the plinkx method. Even
> though it seems to work for config files, for the following archive, of
> about 1.4 MB, it failed:
>
> ----------------------------------------------------------------------
> Tramp: 2.5.1.3
> PuTTY: 0.76
> GNU Emacs 28.0.50 (build 1, x86_64-w64-mingw32) of 2021-01-15
>
> Copying d:/tmp/tramp/2021-08-11_shard.tar.gz to /plinkx:Prod:/home/vt1/uidg1626/2021-08-11_shard.tar.gz...failed
> Copy: ‘d:/tmp/tramp/2021-08-11_shard.tar.gz’ to ‘/plinkx:Prod:/home/vt1/uidg1626/2021-08-11_shard.tar.gz’ failed:
> (file-error Writing to process Invalid argument *tramp/plinkx Prod*)
>
> *tramp/plinkx Prod*
> FATAL ERROR: Incoming packet was garbled on decryption
> ----------------------------------------------------------------------

Please write a bug report, including the traces as described in the
Tramp manual.

> Thanks
>
>     Dieter

Best regards, Michael.

Re: TRAMP: Problems copying files in emacs-28.0.50 on Windows 10

[H. Dieter Wilhelm]

>> *tramp/plinkx Prod*
>> FATAL ERROR: Incoming packet was garbled on decryption
>> ----------------------------------------------------------------------
>
> Please write a bug report, including the traces as described in the
> Tramp manual.

Done, I've send a 5 MB monster email to tramp-devel@gnu.org.

Is it necessary to get a bug number in debbugs?

   Dieter
-- 
Best wishes
H. Dieter Wilhelm
Zwingenberg, Germany

Re: TRAMP: Problems copying files in emacs-28.0.50 on Windows 10

[Michael Albinus]

"H. Dieter Wilhelm" <dieter@duenenhof-wilhelm.de> writes:

Hi Dieter,

>> Please write a bug report, including the traces as described in the
>> Tramp manual.
>
> Done, I've send a 5 MB monster email to tramp-devel@gnu.org.

I've seen, thanks!

> Is it necessary to get a bug number in debbugs?

It doesn't matter, it will land either case on my desk :-)

Just a question before I start to analyze: does the problem also happen
when you set tramp-inline-compress-start-size to nil?

>    Dieter

Best regards, Michael.

Re: TRAMP: Problems copying files in emacs-28.0.50 on Windows 10

[H. Dieter Wilhelm]

Michael Albinus <michael.albinus@gmx.de> writes:

> Just a question before I start to analyze: does the problem also happen
> when you set tramp-inline-compress-start-size to nil?

I removed any old Tramp connections and buffers. Set
tramp-inline-compress-start-size to nil (was roughly 4000 something, I
think) but I ended up with - probably - the same error and messages.

     Dieter
-- 
Best wishes
H. Dieter Wilhelm
Zwingenberg, Germany

Re: TRAMP: Problems copying files in emacs-28.0.50 on Windows 10

[Michael Albinus]

"H. Dieter Wilhelm" <dieter@duenenhof-wilhelm.de> writes:

> I removed any old Tramp connections and buffers. Set
> tramp-inline-compress-start-size to nil (was roughly 4000 something, I
> think) but I ended up with - probably - the same error and messages.

Thanks. I'll analyze the traces then, rather tomorrow.

>      Dieter

Best regards, Michael.

Re: TRAMP: Problems copying files in emacs-28.0.50 on Windows 10

[Stefan Monnier via Users list for the GNU Emacs text editor]

> I'm not sure that installed ELPA packages are activated when you run
> "emacs -Q".

They're not.


        Stefan

Re: TRAMP: Problems copying files in emacs-28.0.50 on Windows 10

[Michael Albinus]

Stefan Monnier via Users list for the GNU Emacs text editor
<help-gnu-emacs@gnu.org> writes:

>> I'm not sure that installed ELPA packages are activated when you run
>> "emacs -Q".
>
> They're not.

Thanks, I've added a short note to the Tramp manual how to activate the
Tramp ELPA package with 'emacs -Q'. This is needed when reporting bugs.

In short, I recommend to call

# emacs -Q -l ~/.emacs.d/elpa/tramp-<version>/tramp-autoloads

>         Stefan

Best regards, Michael.