Tramp prompt (?) issue

Tramp prompt (?) issue

[Emanuel Berg via Users list for the GNU Emacs text editor]

Tramp doesn't seem to work at all for me [1].

I tried to get to two different systems [2], one with
a password, one with RSA.

Both are accessible for me thru the ssh shell command
no problem.

I tried with the modified tramp-shell-prompt-pattern
below (I got it from someone else) as well as the
default value.

I tried with -q and -Q.

All same. What happens is

  Waiting for prompts from remote shell...

then nothing, so I do C-g.

(require 'tramp)
(setq tramp-verbose 10)

(setq tramp-shell-prompt-pattern
      "^[^$>\n]*[#$%>] *\\(\[[0-9;]*[a-zA-Z] *\\)*")

(setq tramp-default-method "ssh")

(find-file "/ssh:embe8573@polhem.it.uu.se:darn.txt")
(find-file "/ssh:incal@srv.dataswamp.org:darn.txt")


[1] GNU Emacs 26.1 (build 2, x86_64-pc-linux-gnu) of
    2019-09-23, modified by Debian
    
    tramp-version: 2.3.3.26.1

[2] SunOS polhem.it.uu.se 5.10 Generic_150401-59
    i86pc i386 i86pc Solaris

    OpenBSD srv.dataswamp.org 6.7 GENERIC#2 amd64

-- 
underground experts united
http://user.it.uu.se/~embe8573
https://dataswamp.org/~incal

Re: Tramp prompt (?) issue

[Michael Albinus]

Emanuel Berg via Users list for the GNU Emacs text editor
<help-gnu-emacs@gnu.org> writes:

Hi Emanuel,

> Tramp doesn't seem to work at all for me [1].
>
> I tried to get to two different systems [2], one with
> a password, one with RSA.
>
> Both are accessible for me thru the ssh shell command
> no problem.
>
> I tried with the modified tramp-shell-prompt-pattern
> below (I got it from someone else) as well as the
> default value.
>
> I tried with -q and -Q.
>
> All same. What happens is
>
>   Waiting for prompts from remote shell...
>
> then nothing, so I do C-g.
>
> (require 'tramp)
> (setq tramp-verbose 10)

This shall result in Tramp debug buffer(s). Please send them to me, for
analysis. Since the buffer(s) might be large, you could send them off-list.

> [2] SunOS polhem.it.uu.se 5.10 Generic_150401-59
>     i86pc i386 i86pc Solaris
>
>     OpenBSD srv.dataswamp.org 6.7 GENERIC#2 amd64

This calls for trouble. Both SunOS and *BSD are known for problems in
connection with Tramp. Let's see, whether this happens here.

Best regards, Michael.

Re: Tramp prompt (?) issue

[Emanuel Berg via Users list for the GNU Emacs text editor]

Michael Albinus wrote:

> This shall result in Tramp debug buffer(s).
> Please send them to me, for analysis. Since the
> buffer(s) might be large, you could send them
> off-list.

https://dataswamp.org/~incal/tramp-debug/

-- 
underground experts united
http://user.it.uu.se/~embe8573
https://dataswamp.org/~incal

Re: Tramp prompt (?) issue

[Michael Albinus]

Emanuel Berg via Users list for the GNU Emacs text editor
<help-gnu-emacs@gnu.org> writes:

Hi Emanuel,

>> This shall result in Tramp debug buffer(s).
>> Please send them to me, for analysis. Since the
>> buffer(s) might be large, you could send them
>> off-list.
>
> https://dataswamp.org/~incal/tramp-debug/

Thanks. This is what the traces tell:

debug-tramp-ssh-embe8573-at-polhem-it-uu-se:

--8<---------------cut here---------------start------------->8---
18:31:22.517331 tramp-send-command (6) # exec ssh -l embe8573  -o ControlMaster=auto -o ControlPath='tramp.%C' -o ControlPersist=no -e none polhem.it.uu.se
18:31:29.116423 tramp-accept-process-output (10) # *tramp/ssh embe8573@polhem.it.uu.se* run nil

Last login: Wed Jul 29 05:43:23 2020 from c-fd84225c.021-
Z
--8<---------------cut here---------------end--------------->8---

There is no recognizable prompt, but just "Z".

ssh-incal-at-srv-dataswamp-org:

--8<---------------cut here---------------start------------->8---
18:31:31.106181 tramp-send-command (6) # exec ssh -l incal  -o ControlMaster=auto -o ControlPath='tramp.%C' -o ControlPersist=no -e none srv.dataswamp.org
18:31:35.379880 tramp-accept-process-output (10) # *tramp/ssh incal@srv.dataswamp.org* run nil
Last login: Wed Jul 29 00:18:25 2020 from 92.34.132.253
OpenBSD 6.7 (GENERIC) #2: Thu Jun  4 09:29:37 MDT 2020

Welcome to OpenBSD: The proactively secure Unix-like operating system.
     _       _
  __| | __ _| |_ __ _ _____      ____ _ _ __ ___  _ __   ___  _ __ __ _
 / _` |/ _` | __/ _` / __\ \ /\ / / _` | '_ ` _ \| '_ \ / _ \| '__/ _` |
| (_| | (_| | || (_| \__ \\ V  V / (_| | | | | | | |_) | (_) | | | (_| |
 \__,_|\__,_|\__\__,_|___/ \_/\_/ \__,_|_| |_| |_| .__(_)___/|_|  \__, |
                                                 |_|              |___/
If you're not paranoid on the Internet, you're in trouble.
        -- Michael W. Lucas, "Absolute OpenBSD"

For help type 'man 7 dataswamp'.

2020-07-05: OS upgraded to OpenBSD 6.7
%                                                                               \r [44m[37mswamp[39m[49m [32m~[39m [?2004h
--8<---------------cut here---------------end--------------->8---

Again, the same. No recognizable prompt.

Could you pls follow the recommendation of the Tramp manual how to
provide a proper prompt on the remote shell? Something like

--8<---------------cut here---------------start------------->8---
[[ $TERM == "dumb" ]] && PS1='$ '
--8<---------------cut here---------------end--------------->8---

in the remote shell init file.

Best regards, Michael.

Re: Tramp prompt (?) issue

[Tim Visher]

Emmanuel:

On Wed, Jul 29, 2020 at 2:19 PM Michael Albinus <michael.albinus@gmx.de>
wrote:

> Emanuel Berg via Users list for the GNU Emacs text editor
> <help-gnu-emacs@gnu.org> writes:
>
> Hi Emanuel,
>
> >> This shall result in Tramp debug buffer(s).
> >> Please send them to me, for analysis. Since the
> >> buffer(s) might be large, you could send them
> >> off-list.
> >
> > https://dataswamp.org/~incal/tramp-debug/
>
> Thanks. This is what the traces tell:
>
> …
>
> Welcome to OpenBSD: The proactively secure Unix-like operating system.
>      _       _
>   __| | __ _| |_ __ _ _____      ____ _ _ __ ___  _ __   ___  _ __ __ _
>  / _` |/ _` | __/ _` / __\ \ /\ / / _` | '_ ` _ \| '_ \ / _ \| '__/ _` |
> | (_| | (_| | || (_| \__ \\ V  V / (_| | | | | | | |_) | (_) | | | (_| |
>  \__,_|\__,_|\__\__,_|___/ \_/\_/ \__,_|_| |_| |_| .__(_)___/|_|  \__, |
>                                                  |_|              |___/
> If you're not paranoid on the Internet, you're in trouble.
>         -- Michael W. Lucas, "Absolute OpenBSD"
>
> For help type 'man 7 dataswamp'.
> …


Based on the above I think you may be helped by my little blog post here:
https://blog.twonegatives.com/post/615830090370187264/effective-emacs-how-to-have-your-fancy-prompt-and

Re: Tramp prompt (?) issue

[Emanuel Berg via Users list for the GNU Emacs text editor]

Michael Albinus wrote:

> [[ $TERM == "dumb" ]] && PS1='$ '

I tried this but it is the same issue, both systems:

[[ $TERM == "dumb" ]] && PROMPT='$ ' && PS1=$PROMPT

-- 
underground experts united
http://user.it.uu.se/~embe8573
https://dataswamp.org/~incal

Re: Tramp prompt (?) issue

[Emanuel Berg via Users list for the GNU Emacs text editor]

> I tried this but it is the same issue, both systems:
>
> [[ $TERM == "dumb" ]] && PROMPT='$ ' && PS1=$PROMPT

Here are the debug logs from this attempt: 

  https://dataswamp.org/~incal/tramp-debug/2/

And the file that sets PROMPT and PS1:

  https://dataswamp.org/~incal/conf/.zsh/prompt

-- 
underground experts united
http://user.it.uu.se/~embe8573
https://dataswamp.org/~incal

Re: Tramp prompt (?) issue

[Michael Albinus]

Emanuel Berg via Users list for the GNU Emacs text editor
<help-gnu-emacs@gnu.org> writes:

Hi Emanuel,

>> I tried this but it is the same issue, both systems:
>>
>> [[ $TERM == "dumb" ]] && PROMPT='$ ' && PS1=$PROMPT
>
> Here are the debug logs from this attempt:
>
>   https://dataswamp.org/~incal/tramp-debug/2/
>
> And the file that sets PROMPT and PS1:
>
>   https://dataswamp.org/~incal/conf/.zsh/prompt

Ah, you didn't say that it is zsh on the remote side. This case, you
shall add to your remote ~/.zshrc

--8<---------------cut here---------------start------------->8---
[[ $TERM == "dumb" ]] && unsetopt zle && PS1='$ ' && return
--8<---------------cut here---------------end--------------->8---

Best regards, Michael.

Re: Tramp prompt (?) issue

[Emanuel Berg via Users list for the GNU Emacs text editor]

Michael Albinus wrote:

> [[ $TERM == "dumb" ]] && unsetopt zle && PS1='$ ' &&
> return

On the OpenBSD system, that did it - it now
works! Great!

Still seemingly the same on the SunOS system tho...

https://dataswamp.org/~incal/tramp-debug/3/debug-tramp-ssh-embe8573-polhem-it-uu-se

-- 
underground experts united
http://user.it.uu.se/~embe8573
https://dataswamp.org/~incal

Re: Tramp prompt (?) issue

[Michael Albinus]

Emanuel Berg via Users list for the GNU Emacs text editor
<help-gnu-emacs@gnu.org> writes:

Hi Emanuel,

> Still seemingly the same on the SunOS system tho...
>
> https://dataswamp.org/~incal/tramp-debug/3/debug-tramp-ssh-embe8573-polhem-it-uu-se

The traces show

--8<---------------cut here---------------start------------->8---
13:47:55.167220 tramp-send-command (6) # exec ssh -l embe8573  -o ControlMaster=auto -o ControlPath='tramp.%C' -o ControlPersist=no -e none polhem.it.uu.se
13:48:10.524605 tramp-accept-process-output (10) # *tramp/ssh embe8573@polhem.it.uu.se* run nil
Last login: Thu Jul 30 13:46:58 2020 from c-fd84225c.021-
Z
--8<---------------cut here---------------end--------------->8---

That means, the  "ssh ..." command returns with the last login message,
and then with three characters "ESC Z ESC". I have no idea what they are
good for, and why there is no prompt.

Which shell do you use on that machine? Is it also zsh? Have you applied
the change I've recommended last message on that machine?

What do you see, if you call manually

--8<---------------cut here---------------start------------->8---
# ssh -l embe8573  -o ControlMaster=auto -o ControlPath='tramp.%C' -o ControlPersist=no -e none polhem.it.uu.se
--8<---------------cut here---------------end--------------->8---

Best regards, Michael.

Re: Tramp prompt (?) issue

[Emanuel Berg via Users list for the GNU Emacs text editor]

Michael Albinus wrote:

> Which shell do you use on that machine? Is it also
> zsh?

It is zsh. I don't know/remember how I managed to do
that, this was 10+ years ago, but the default shell
is/was bash, that much I remember.

Because there is no chsh tho, otherwise I would have
tried setting it back to bash.

But maybe this is a SunOS, and not a zsh issue...?

> Have you applied the change I've recommended last
> message on that machine?

Yes, of course, this

  [[ $TERM == "dumb" ]] && unsetopt zle && PS1='$ ' && return

is in

  http://user.it.uu.se/~embe8573/conf/.zshrc

(wierd place for that file, but yes, the ~/.zshrc is
a link to that, this I also don't remember the reason
why I did)

> What do you see, if you call manually
>
> # ssh -l embe8573 -o ControlMaster=auto -o
> ControlPath='tramp.%C' -o ControlPersist=no -e none
> polhem.it.uu.se

$ sudo ssh -l embe8573 -o ControlMaster=auto -o ControlPath='tramp.%C' -o ControlPersist=no -e none polhem.it.uu.se
Password: ***
Last login: Fri Jul 31 21:48:18 2020 from c-fd84225c.021-
.Z. ls

That last line looks like ^ then [ then Z then ^ then
[, or char by char, ESCAPE, LATIN CAPITAL LETTER Z,
and ESCAPE again.

Nothing happens, I do C-g and can type again but if
I type a command again, nothing happens.

Thanks for the enthusiasm BTW :)

-- 
underground experts united
http://user.it.uu.se/~embe8573
https://dataswamp.org/~incal

Re: Tramp prompt (?) issue

[2QdxY4RzWzUUiLuE]

On 2020-07-31 at 21:57:38 +0200,
Emanuel Berg via Users list for the GNU Emacs text editor <help-gnu-emacs@gnu.org> wrote:

> Michael Albinus wrote:

> > What do you see, if you call manually
> >
> > # ssh -l embe8573 -o ControlMaster=auto -o
> > ControlPath='tramp.%C' -o ControlPersist=no -e none
> > polhem.it.uu.se
> 
> $ sudo ssh -l embe8573 -o ControlMaster=auto -o ControlPath='tramp.%C' -o ControlPersist=no -e none polhem.it.uu.se
> Password: ***
> Last login: Fri Jul 31 21:48:18 2020 from c-fd84225c.021-
> .Z. ls

I've been half following this thread, because I've also had weird issues
with tramp over the years, but it's been a long time, and I have nothing
new to add on that front.

With that disclaimer out of the way, why are you running ssh under root
and/or sudo, and do you get different results if you don't?  Are you
running emacs as root, or under sudo, or as a regular user?  I ask
because very often root has an entirely separate set of rules for remote
access, on both client and server, and sudo can add its own permission
and environment related issues.

HTH,
Dan

Re: Tramp prompt (?) issue

[Emanuel Berg via Users list for the GNU Emacs text editor]

2QdxY4RzWzUUiLuE wrote:

>>> What do you see, if you call manually # ssh -l
>>> embe8573 -o ControlMaster=auto -o
>>> ControlPath='tramp.%C' -o ControlPersist=no -e
>>> none polhem.it.uu.se
>>
>>  $ sudo ssh -l embe8573 -o ControlMaster=auto -o
>> ControlPath='tramp.%C' -o ControlPersist=no -e none
>> polhem.it.uu.se Password: *** Last login: Fri Jul
>> 31 21:48:18 2020 from c-fd84225c.021- .Z. ls
>
> [...]

> With that disclaimer out of the way, why are you
> running ssh under root and/or sudo, and do you get
> different results if you don't? Are you running emacs
> as root, or under sudo, or as a regular user? I ask
> because very often root has an entirely separate set
> of rules for remote access, on both client and
> server, and sudo can add its own permission and
> environment related issues.

You are right, let's try it without 'sudo' ...

The same, it seems.

$ ssh -l embe8573 -o ControlMaster=auto -o
  ControlPath='tramp.%C' -o ControlPersist=no -e none
  polhem.it.uu.se

Password: ***
Last login: Fri Jul 31 21:49:36 2020 from c-fd84225c.021-
.Z

. = ESC

-- 
underground experts united
http://user.it.uu.se/~embe8573
https://dataswamp.org/~incal

Re: Tramp prompt (?) issue

[Michael Albinus]

Emanuel Berg via Users list for the GNU Emacs text editor
<help-gnu-emacs@gnu.org> writes:

Hi Emanuel,

> $ sudo ssh -l embe8573 -o ControlMaster=auto -o ControlPath='tramp.%C'
> -o ControlPersist=no -e none polhem.it.uu.se
> Password: ***
> Last login: Fri Jul 31 21:48:18 2020 from c-fd84225c.021-
> .Z. ls
>
> That last line looks like ^ then [ then Z then ^ then
> [, or char by char, ESCAPE, LATIN CAPITAL LETTER Z,
> and ESCAPE again.

Exactly what I have observed.

This is not a prompt Tramp will recognize (unless you modify
`tramp-shell-prompt-pattern'). So I recommend you try to fix the
response of your remote shell, somehow. As a first step, you might
remove all remote zsh init files temporarily.

Best regards, Michael.

Re: Tramp prompt (?) issue

[Emanuel Berg via Users list for the GNU Emacs text editor]

Re: Tramp prompt (?) issue
Michael Albinus wrote:

> This is not a prompt Tramp will recognize (unless
> you modify `tramp-shell-prompt-pattern').
> So I recommend you try to fix the response of your
> remote shell, somehow. As a first step, you might
> remove all remote zsh init files temporarily.

OK, done.

I actually removed every file with 'rm -rf *'.

What the second step? Try again? If so, that'll have
to wait as it is still deleting files... :)

-- 
underground experts united
http://user.it.uu.se/~embe8573
https://dataswamp.org/~incal

Re: Tramp prompt (?) issue

[Emanuel Berg via Users list for the GNU Emacs text editor]

>> This is not a prompt Tramp will recognize (unless
>> you modify `tramp-shell-prompt-pattern').
>> So I recommend you try to fix the response of your
>> remote shell, somehow. As a first step, you might
>> remove all remote zsh init files temporarily.
>
> OK, done.
>
> I actually removed every file with 'rm -rf *'.

Heh, actually you have to do 'rm -rf .*' to get rid
of the config files and directories...

But I think it worked!

Now I get, with [1]

  $ mic-debug
  Password: ***
  Last login: Sat Aug  1 11:53:20 2020 from c-fd84225c.021-
  Oracle Corporation      SunOS 5.10      Generic Patch   January 2005
  polhem> ls -a
  .   ..
  polhem> exit
  logout
  Connection to polhem.it.uu.se closed.

Let's try with tramp:

  (find-file "/-:embe8573@polhem.it.uu.se:darn.txt")

nope, still doesn't work [2] :(


[1] https://dataswamp.org/~incal/conf/.zsh/remote-mic (lines 7-21)

[2] https://dataswamp.org/~incal/tramp-debug/4/debug-tramp-ssh-embe8573-at-polhem-it-uu-se

-- 
underground experts united
http://user.it.uu.se/~embe8573
https://dataswamp.org/~incal

Re: Tramp prompt (?) issue

[Michael Albinus]

Emanuel Berg via Users list for the GNU Emacs text editor
<help-gnu-emacs@gnu.org> writes:

Hi Emanuel,

> Let's try with tramp:
>
>   (find-file "/-:embe8573@polhem.it.uu.se:darn.txt")
>
> nope, still doesn't work [2] :(
>
> [2]
> https://dataswamp.org/~incal/tramp-debug/4/debug-tramp-ssh-embe8573-at-polhem-it-uu-se

There are still the characters "ESC Z ESC" at the end of your
login. Have you deleted the prompt setting line I gave you, together
with the init files? This line is still needed for zsh.

Best regards, Michael.

Re: Tramp prompt (?) issue

[Emanuel Berg via Users list for the GNU Emacs text editor]

Michael Albinus wrote:

> There are still the characters "ESC Z ESC" at the
> end of your login. Have you deleted the prompt
> setting line I gave you, together with the init
> files? This line is still needed for zsh.

OK, but still no luck.

  [[ $TERM == "dumb" ]] && unsetopt zle && PS1='$ ' && return

in

  http://user.it.uu.se/~embe8573/.zshrc

Tramp log:

  https://dataswamp.org/~incal/tramp-debug/6/debug-tramp-ssh-embe8573-polhem-it-uu-se

-- 
underground experts united
http://user.it.uu.se/~embe8573
https://dataswamp.org/~incal

Re: Tramp prompt (?) issue

[Emanuel Berg via Users list for the GNU Emacs text editor]

>> There are still the characters "ESC Z ESC" at the
>> end of your login. Have you deleted the prompt
>> setting line I gave you, together with the init
>> files? This line is still needed for zsh.
>
> [...]

Now, after doing nothing, just removing all the
files, the shell at SunOS has switched from zsh, back
to bash!

So now we don't need to care about zsh...

Still DNC tho :(

commands/settings:

  (find-file "/-:embe8573@polhem.it.uu.se:darn.txt")

  ;; ...

  (require 'tramp)
  (setq tramp-default-method "ssh")
  (setq tramp-verbose 10)

Tramp log:

  https://dataswamp.org/~incal/tramp-debug/7/debug-tramp-ssh-embe8573-polhem-it-uu-se

bash version:

  GNU bash, version 4.3.30(1) (i386-pc-solaris2.10)
  <http://user.it.uu.se/~embe8573/public_html/bash-version>

SunOS version:

  SunOS polhem.it.uu.se 5.10 Generic_150401-59 i86pc i386 i86pc
  <http://user.it.uu.se/~embe8573/public_html/sunos-version>

Emacs version:

  GNU Emacs 26.1 (build 2, x86_64-pc-linux-gnu) of
  2019-09-23, modified by Debian

Tramp version:

  2.3.3.26.1

BTW I'm very happy Tramp works to the OpenBSD system!
I have, directly because of this huge workflow
improvement, been able to write an IRC bot in Python!
Thanks a lot for all the help!

  https://dataswamp.org/~incal/bot/sth.py

-- 
underground experts united
http://user.it.uu.se/~embe8573
https://dataswamp.org/~incal

Re: Tramp prompt (?) issue

[Michael Albinus]

Emanuel Berg via Users list for the GNU Emacs text editor
<help-gnu-emacs@gnu.org> writes:

Hi Emanuel,

> Now, after doing nothing, just removing all the
> files, the shell at SunOS has switched from zsh, back
> to bash!
>
> So now we don't need to care about zsh...
>
> Still DNC tho :(
>
> commands/settings:
>
>   (find-file "/-:embe8573@polhem.it.uu.se:darn.txt")
>
>   ;; ...
>
>   (require 'tramp)
>   (setq tramp-default-method "ssh")
>   (setq tramp-verbose 10)
>
> Tramp log:
>
>   https://dataswamp.org/~incal/tramp-debug/7/debug-tramp-ssh-embe8573-polhem-it-uu-se

There are still just the three characters "ESC Z ESC", returning from the
remote side. Maybe, it isn't a problem of the shell, but what is called
remotely by ssh.

Let's try to control this. Pls eval the following:

--8<---------------cut here---------------start------------->8---
(add-to-list 'tramp-methods
             `("myssh"
               (tramp-login-program        "ssh")
               (tramp-login-args           (("-l" "%u") ("-p" "%p") ("%c")
				            ("-e" "none") ("-t" "-t") ("%h")
					    ("\"%l -i\"")))
               (tramp-async-args           (("-q")))
               (tramp-remote-shell         ,tramp-default-remote-shell)
               (tramp-remote-shell-login   ("-l"))
               (tramp-remote-shell-args    ("-c"))))
--8<---------------cut here---------------end--------------->8---

This declares a new Tramp method "myssh", which is similar to "ssh", but
calls the remote shell directly. Please open then

--8<---------------cut here---------------start------------->8---
(find-file "/myssh:embe8573@polhem.it.uu.se:darn.txt")
--8<---------------cut here---------------end--------------->8---

Do not use the default method "-" while we're testing.

Best regards, Michael.

Re: Tramp prompt (?) issue

[Emanuel Berg via Users list for the GNU Emacs text editor]

Michael Albinus wrote:

> There are still just the three characters "ESC
> Z ESC", returning from the remote side. Maybe, it
> isn't a problem of the shell, but what is called
> remotely by ssh.
>
> Let's try to control this. Pls eval the following:
>
> (add-to-list 'tramp-methods
>              `("myssh"
>                (tramp-login-program        "ssh")
>                (tramp-login-args           (("-l" "%u") ("-p" "%p") ("%c")
> 				            ("-e" "none") ("-t" "-t") ("%h")
> 					    ("\"%l -i\"")))
>                (tramp-async-args           (("-q")))
>                (tramp-remote-shell         ,tramp-default-remote-shell)
>                (tramp-remote-shell-login   ("-l"))
>                (tramp-remote-shell-args    ("-c"))))

I don't have any `tramp-default-remote-shell' :(

Only:

  tramp-default-host
  tramp-default-host-alist
  tramp-default-method
  tramp-default-method-alist
  tramp-default-method-marker
  tramp-default-proxies-alist
  tramp-default-user
  tramp-default-user-alist

https://dataswamp.org/~incal/emacs-init/tramp-my.el

-- 
underground experts united
http://user.it.uu.se/~embe8573
https://dataswamp.org/~incal

Re: Tramp prompt (?) issue

[Michael Albinus]

Emanuel Berg via Users list for the GNU Emacs text editor
<help-gnu-emacs@gnu.org> writes:

Hi Emanuel,

>> Let's try to control this. Pls eval the following:
>>
>> (add-to-list 'tramp-methods
>>              `("myssh"
>>                (tramp-login-program        "ssh")
>>                (tramp-login-args           (("-l" "%u") ("-p" "%p") ("%c")
>> 				            ("-e" "none") ("-t" "-t") ("%h")
>> 					    ("\"%l -i\"")))
>>                (tramp-async-args           (("-q")))
>>                (tramp-remote-shell         ,tramp-default-remote-shell)
>>                (tramp-remote-shell-login   ("-l"))
>>                (tramp-remote-shell-args    ("-c"))))
>
> I don't have any `tramp-default-remote-shell' :(
>
> Only:
>
>   tramp-default-host
>   tramp-default-host-alist
>   tramp-default-method
>   tramp-default-method-alist
>   tramp-default-method-marker
>   tramp-default-proxies-alist
>   tramp-default-user
>   tramp-default-user-alist

Ah, right. You use an older Tramp version. 2.3.3.26.1, you've said it.
So you might try instead

--8<---------------cut here---------------start------------->8---
(add-to-list 'tramp-methods
  '("myssh"
    (tramp-login-program        "ssh")
    (tramp-login-args           (("-l" "%u") ("-p" "%p") ("%c")
				 ("-e" "none") ("-t" "-t") ("%h")
                                 ("\"/bin/sh -i\"")))
    (tramp-async-args           (("-q")))
    (tramp-remote-shell         "/bin/sh")
    (tramp-remote-shell-login   ("-l"))
    (tramp-remote-shell-args    ("-c"))))
--8<---------------cut here---------------end--------------->8---

Btw, another test worth a try would be to use method "sshx" instead of
"ssh". Does this make a difference?

Best regards, Michael.

Re: Tramp prompt (?) issue

[Emanuel Berg via Users list for the GNU Emacs text editor]

Michael Albinus wrote:

> (add-to-list 'tramp-methods
>   '("myssh"
>     (tramp-login-program        "ssh")
>     (tramp-login-args           (("-l" "%u") ("-p" "%p") ("%c")
> 				 ("-e" "none") ("-t" "-t") ("%h")
>                                  ("\"/bin/sh -i\"")))
>     (tramp-async-args           (("-q")))
>     (tramp-remote-shell         "/bin/sh")
>     (tramp-remote-shell-login   ("-l"))
>     (tramp-remote-shell-args    ("-c"))))
>
>
> Btw, another test worth a try would be to use
> method "sshx" instead of "ssh". Does this make
> a difference?

Unfortunately no, both result in these messages:

  Tramp: Opening connection for embe8573@polhem.it.uu.se using myssh...
  Tramp: Sending command ‘exec ssh -l embe8573  -o ControlMaster=auto -o ControlPath='tramp.%C' -o ControlPersist=no -e none -t -t polhem.it.uu.se "/bin/sh -i"’
  Tramp: Waiting for prompts from remote shell...
  Tramp: Sending Password
  Tramp: Waiting for prompts from remote shell...done
  Tramp: Found remote shell prompt on ‘polhem.it.uu.se’
  Tramp: Opening connection for embe8573@polhem.it.uu.se using myssh...failed
  tramp-file-name-handler: ‘tramp-histfile-override’ uses invalid file ‘~/.tramp_history’

https://dataswamp.org/~incal/emacs-init/tramp-my.el

-- 
underground experts united
http://user.it.uu.se/~embe8573
https://dataswamp.org/~incal

Re: Tramp prompt (?) issue

[Michael Albinus]

Emanuel Berg via Users list for the GNU Emacs text editor
<help-gnu-emacs@gnu.org> writes:

>> (add-to-list 'tramp-methods
>>   '("myssh"
>>     (tramp-login-program        "ssh")
>>     (tramp-login-args           (("-l" "%u") ("-p" "%p") ("%c")
>> 				 ("-e" "none") ("-t" "-t") ("%h")
>>                                  ("\"/bin/sh -i\"")))
>>     (tramp-async-args           (("-q")))
>>     (tramp-remote-shell         "/bin/sh")
>>     (tramp-remote-shell-login   ("-l"))
>>     (tramp-remote-shell-args    ("-c"))))
>>
>>
>> Btw, another test worth a try would be to use
>> method "sshx" instead of "ssh". Does this make
>> a difference?
>
> Unfortunately no, both result in these messages:
>
>   Tramp: Opening connection for embe8573@polhem.it.uu.se using myssh...
>   Tramp: Sending command ‘exec ssh -l embe8573 -o ControlMaster=auto
> -o ControlPath='tramp.%C' -o ControlPersist=no -e none -t -t
> polhem.it.uu.se "/bin/sh -i"’
>   Tramp: Waiting for prompts from remote shell...
>   Tramp: Sending Password
>   Tramp: Waiting for prompts from remote shell...done
>   Tramp: Found remote shell prompt on ‘polhem.it.uu.se’
>   Tramp: Opening connection for embe8573@polhem.it.uu.se using myssh...failed
>   tramp-file-name-handler: ‘tramp-histfile-override’ uses invalid file
> ‘~/.tramp_history’

But this is progress! Pls produce a debug file, and show me. And if both
approaches behave similar, take "sshx".

Best regards, Michael.

Re: Tramp prompt (?) issue

[Emanuel Berg via Users list for the GNU Emacs text editor]

Re: Tramp prompt (?) issue
Michael Albinus wrote:

>> Unfortunately no, both result in these messages:
>>
>>   Tramp: Opening connection for
>> embe8573@polhem.it.uu.se using myssh...
>>   Tramp: Sending command ‘exec ssh -l embe8573 -o ControlMaster=auto
>> -o ControlPath='tramp.%C' -o ControlPersist=no -e none -t -t
>> polhem.it.uu.se "/bin/sh -i"’
>>   Tramp: Waiting for prompts from remote shell...
>>   Tramp: Sending Password
>>   Tramp: Waiting for prompts from remote shell...done
>>   Tramp: Found remote shell prompt on ‘polhem.it.uu.se’
>>   Tramp: Opening connection for
>> embe8573@polhem.it.uu.se using myssh...failed
>>   tramp-file-name-handler:
>> ‘tramp-histfile-override’ uses invalid file
>> ‘~/.tramp_history’
>
> But this is progress! Pls produce a debug file [...]

Everything in time - always.

  https://dataswamp.org/~incal/tramp-debug/10/debug-tramp-ssh-embe8573-polhem-it-uu-se

-- 
underground experts united
http://user.it.uu.se/~embe8573
https://dataswamp.org/~incal

Re: Tramp prompt (?) issue

[Michael Albinus]

Emanuel Berg via Users list for the GNU Emacs text editor
<help-gnu-emacs@gnu.org> writes:

Hi Emanuel,

>>> Unfortunately no, both result in these messages:
>>>
>>>   Tramp: Opening connection for
>>> embe8573@polhem.it.uu.se using myssh...
>>>   Tramp: Sending command ‘exec ssh -l embe8573 -o ControlMaster=auto
>>> -o ControlPath='tramp.%C' -o ControlPersist=no -e none -t -t
>>> polhem.it.uu.se "/bin/sh -i"’
>>>   Tramp: Waiting for prompts from remote shell...
>>>   Tramp: Sending Password
>>>   Tramp: Waiting for prompts from remote shell...done
>>>   Tramp: Found remote shell prompt on ‘polhem.it.uu.se’
>>>   Tramp: Opening connection for
>>> embe8573@polhem.it.uu.se using myssh...failed
>>>   tramp-file-name-handler:
>>> ‘tramp-histfile-override’ uses invalid file
>>> ‘~/.tramp_history’
>>
>> But this is progress! Pls produce a debug file [...]
>
> Everything in time - always.
>
>   https://dataswamp.org/~incal/tramp-debug/10/debug-tramp-ssh-embe8573-polhem-it-uu-se

Still the mysterious "ESC Z ESC" sequence in the way. You haven't used
the "sshx" method, as indicated. Pls repeat the test.

Best regards, Michael.

Re: Tramp prompt (?) issue

[Emanuel Berg via Users list for the GNU Emacs text editor]

Michael Albinus wrote:

> Still the mysterious "ESC Z ESC" sequence in the
> way. You haven't used the "sshx" method, as
> indicated. Pls repeat the test.

The shell says I don't have it (sshx). No luck in the
Debian repos, either. Were do you get it?
Emacs messages:

  Tramp: Waiting for prompts from remote shell...failed
  Tramp: Opening connection for embe8573@polhem.it.uu.se using mysshx...failed
  tramp-file-name-handler: Tramp failed to connect.  If this happens repeatedly, try
      ‘M-x tramp-cleanup-this-connection’

(Yes, I tried that. Same.)

Drop the "x" [1] and what I get is:

  Tramp: Opening connection for embe8573@polhem.it.uu.se using myssh...
  Tramp: Sending command ‘exec ssh -l embe8573  -o ControlMaster=auto -o ControlPath='tramp.%C' -o ControlPersist=no -e none -t -t polhem.it.uu.se "/bin/sh -i"’
  Tramp: Waiting for prompts from remote shell...
  Tramp: Sending Password
  Tramp: Waiting for prompts from remote shell...done
  Tramp: Found remote shell prompt on ‘polhem.it.uu.se’
  Tramp: Opening connection for embe8573@polhem.it.uu.se using myssh...failed
  tramp-file-name-handler: ‘tramp-histfile-override’ uses invalid file ‘~/.tramp_history’

Log file:

  https://dataswamp.org/~incal/tramp-debug/11/debug-tramp-myssh-embe8573-polhem-it-uu-se


[1] https://dataswamp.org/~incal/emacs-init/tramp-my.el

-- 
underground experts united
http://user.it.uu.se/~embe8573
https://dataswamp.org/~incal

Re: Tramp prompt (?) issue

[tomas]

[-- Attachment #1: Type: text/plain, Size: 612 bytes --]

On Mon, Aug 17, 2020 at 11:51:46PM +0200, Emanuel Berg via Users list for the GNU Emacs text editor wrote:
> Michael Albinus wrote:
> 
> > Still the mysterious "ESC Z ESC" sequence in the
> > way. You haven't used the "sshx" method, as
> > indicated. Pls repeat the test.
> 
> The shell says I don't have it (sshx). No luck in the
> Debian repos, either. Were do you get it?
> Emacs messages:

sshx is a Tramp "connection method", not an external program.
It uses ssh, although in a different way than the Tramp "ssh"
method (cf. Tramp manual, "4.2 Inline methods" or thereabouts).

Cheers
 - t

[-- Attachment #2: Digital signature --]
[-- Type: application/pgp-signature, Size: 198 bytes --]

Re: Tramp prompt (?) issue

[Michael Albinus]

Emanuel Berg via Users list for the GNU Emacs text editor
<help-gnu-emacs@gnu.org> writes:

Hi Emanuel,

>> Still the mysterious "ESC Z ESC" sequence in the
>> way. You haven't used the "sshx" method, as
>> indicated. Pls repeat the test.
>
> The shell says I don't have it (sshx). No luck in the
> Debian repos, either. Were do you get it?

Ahh, that's a misunderstanding. I meant the Tramp method "sshx", like in
"/sshx:embe8573@polhem.it.uu.se:". It uses the "-t -t" ssh arguments as
in your "myssh" method, I believe this is the crucial point to pass your
remote login. Anyway, you're using "myssh" now, which is OK.

>   Tramp: Found remote shell prompt on ‘polhem.it.uu.se’
>   Tramp: Opening connection for embe8573@polhem.it.uu.se using myssh...failed
>   tramp-file-name-handler: ‘tramp-histfile-override’ uses invalid file ‘~/.tramp_history’

Let's analyze the traces at this point.

23:47:49.482582 tramp-send-command (6) # (cd ~/) 2>/dev/null; echo tramp_exit_status $?
23:47:49.489821 tramp-wait-for-regexp (6) #
tramp_exit_status 1
#$

OK, your remote shell cannot expand "~/". This is what Tramp checks here.

`tramp-histfile-override' is declared as "~/.tramp_history". Tramp
recognizes that it cannot work because of the tilde, and errs out.

Please give that variable another value, either an absolute file name,
or set it to nil. Rerun your test, still using Tramp's method "myssh"
(or "sshx", just to see whether it works).

Best regards, Michael.

Re: Tramp prompt (?) issue

[Emanuel Berg via Users list for the GNU Emacs text editor]

tomas wrote:

>> The shell says I don't have it (sshx). No luck in
>> the Debian repos, either. Were do you get it?
>> Emacs messages:
>
> sshx is a Tramp "connection method", not an
> external program. It uses ssh, although in
> a different way than the Tramp "ssh" method (cf.
> Tramp manual, "4.2 Inline methods" or thereabouts).

But I get an error message that says I don't have it
just like it would with a shell tool.

This message is also wierd BTW, it is displayed in
a buffer of its own and then it disappears...

-- 
underground experts united
http://user.it.uu.se/~embe8573
https://dataswamp.org/~incal

Re: Tramp prompt (?) issue

[tomas]

[-- Attachment #1: Type: text/plain, Size: 802 bytes --]

On Tue, Aug 18, 2020 at 12:37:01PM +0200, Emanuel Berg via Users list for the GNU Emacs text editor wrote:
> tomas wrote:
> 
> >> The shell says I don't have it (sshx). No luck in
> >> the Debian repos, either. Were do you get it?
> >> Emacs messages:
> >
> > sshx is a Tramp "connection method", not an
> > external program. It uses ssh, although in
> > a different way than the Tramp "ssh" method (cf.
> > Tramp manual, "4.2 Inline methods" or thereabouts).
> 
> But I get an error message that says I don't have it
> just like it would with a shell tool.
> 
> This message is also wierd BTW, it is displayed in
> a buffer of its own and then it disappears...

This is indeed strange. Perhaps setting `tramp-verbose' to 4 or
higher and repeating sheds some light?

Cheers
 - t

[-- Attachment #2: Digital signature --]
[-- Type: application/pgp-signature, Size: 198 bytes --]

Re: Tramp prompt (?) issue

[Michael Albinus]

<tomas@tuxteam.de> writes:

Hi Emanuel,

>> >> The shell says I don't have it (sshx). No luck in
>> >> the Debian repos, either. Were do you get it?
>> >> Emacs messages:
>> >
>> > sshx is a Tramp "connection method", not an
>> > external program. It uses ssh, although in
>> > a different way than the Tramp "ssh" method (cf.
>> > Tramp manual, "4.2 Inline methods" or thereabouts).
>>
>> But I get an error message that says I don't have it
>> just like it would with a shell tool.
>>
>> This message is also wierd BTW, it is displayed in
>> a buffer of its own and then it disappears...
>
> This is indeed strange. Perhaps setting `tramp-verbose' to 4 or
> higher and repeating sheds some light?

Which Tramp message do you get?

> Cheers
>  - t

Best regards, Michael.

Re: Tramp prompt (?) issue

[Emanuel Berg via Users list for the GNU Emacs text editor]

Michael Albinus wrote:

> Which Tramp message do you get?

If you mean the log, this is the most recent attempt:
 
  https://dataswamp.org/~incal/tramp-debug/11/debug-tramp-myssh-embe8573-polhem-it-uu-se

Here is the command that works. Well, it doesn't work
because of the old problem, but it displays the
password prompt so it gets further, at least.

I don't know if I made some mistake doing the "x"
version?

;;; -*- lexical-binding: t -*-
;;;
;;; this file:
;;;   http://user.it.uu.se/~embe8573/emacs-init/tramp-my.el
;;;   https://dataswamp.org/~incal/emacs-init/tramp-my.el

(require 'tramp)

(setq tramp-default-method "ssh")
(setq tramp-verbose 10)

(add-to-list 'tramp-methods
  '("myssh"
    (tramp-login-program "ssh")
    (tramp-login-args (("-l" "%u")
                       ("-p" "%p")
                       ("%c")
                       ("-e" "none")
                       ("-t" "-t")
                       ("%h")
                       ("\"/bin/sh -i\"") ))
    (tramp-async-args (("-q")))
    (tramp-remote-shell "/bin/sh")
    (tramp-remote-shell-login ("-l"))
    (tramp-remote-shell-args  ("-c")) ))

;; (find-file  "/myssh:embe8573@polhem.it.uu.se:darn.txt")
;; (find-file "/mysshx:embe8573@polhem.it.uu.se:darn.txt")

-- 
underground experts united
http://user.it.uu.se/~embe8573
https://dataswamp.org/~incal

Re: Tramp prompt (?) issue

[Emanuel Berg via Users list for the GNU Emacs text editor]

Maybe the error occurred because
`tramp-login-program' was set to "sshx", a "program"
that doesn't exist?

-- 
underground experts united
http://user.it.uu.se/~embe8573
https://dataswamp.org/~incal

Re: Tramp prompt (?) issue

[Emanuel Berg via Users list for the GNU Emacs text editor]

Michael Albinus wrote:

> `tramp-histfile-override' is declared as
> "~/.tramp_history". Tramp recognizes that it cannot
> work because of the tilde, and errs out.

That's it!

  (setq tramp-histfile-override nil)

and now it works!

-- 
underground experts united
http://user.it.uu.se/~embe8573
https://dataswamp.org/~incal

Re: Tramp prompt (?) issue

[Michael Albinus]

Emanuel Berg via Users list for the GNU Emacs text editor
<help-gnu-emacs@gnu.org> writes:

> Maybe the error occurred because
> `tramp-login-program' was set to "sshx", a "program"
> that doesn't exist?

Sure, the login program is "ssh".

Best regards, Michael.

Re: Tramp prompt (?) issue

[Michael Albinus]

Emanuel Berg via Users list for the GNU Emacs text editor
<help-gnu-emacs@gnu.org> writes:

Hi Emanuel,

>> `tramp-histfile-override' is declared as
>> "~/.tramp_history". Tramp recognizes that it cannot
>> work because of the tilde, and errs out.
>
> That's it!
>
>   (setq tramp-histfile-override nil)
>
> and now it works!

Hooray!

Have you used the (existing) "sshx" method, or one of the "my*" approaches?

Best regards, Michael.

Re: Tramp prompt (?) issue

[Emanuel Berg via Users list for the GNU Emacs text editor]

Michael Albinus wrote:

>> That's it!
>>
>>   (setq tramp-histfile-override nil)
>>
>> and now it works!
>
> Hooray!
>
> Have you used the (existing) "sshx" method, or one of
> the "my*" approaches?

Sorry for the delay. Everything in time...

At the SunOS system, with no files there whatsoever,
and $ ps -p $$ # indicates bash, these settings and
the command last works:

;;; -*- lexical-binding: t -*-
;;;
;;; this file:
;;;   http://user.it.uu.se/~embe8573/emacs-init/tramp-my.el
;;;   https://dataswamp.org/~incal/emacs-init/tramp-my.el

(require 'tramp)

(setq tramp-default-method "ssh")
(setq tramp-histfile-override nil)
(setq tramp-verbose 10)

(add-to-list 'tramp-methods
  '("myssh"
    (tramp-login-program "ssh")
    (tramp-login-args (("-l" "%u")
                       ("-p" "%p")
                       ("%c")
                       ("-e" "none")
                       ("-t" "-t")
                       ("%h")
                       ("\"/bin/sh -i\"") ))
    (tramp-async-args (("-q")))
    (tramp-remote-shell "/bin/sh")
    (tramp-remote-shell-login ("-l"))
    (tramp-remote-shell-args  ("-c")) ))

;; (find-file "/myssh:embe8573@polhem.it.uu.se:darn.txt")

-- 
underground experts united
http://user.it.uu.se/~embe8573
https://dataswamp.org/~incal

Re: Tramp prompt (?) issue

[Emanuel Berg via Users list for the GNU Emacs text editor]

>>> That's it!
>>>
>>>   (setq tramp-histfile-override nil)
>>>
>>> and now it works!
>>
>> Hooray!
>>
>> Have you used the (existing) "sshx" method, or one of
>> the "my*" approaches?
>
> Sorry for the delay. Everything in time...
>
> At the SunOS system, with no files there
> whatsoever, and $ ps -p $$ # indicates bash, these
> settings [...]

Right, now that we know tramp-histfile-override was
a/the problem, maybe we should see what settings did
not influence the outcome? Let's see what happens
with _only_ that setting? 1s

-- 
underground experts united
http://user.it.uu.se/~embe8573
https://dataswamp.org/~incal

Re: Tramp prompt (?) issue

[Emanuel Berg via Users list for the GNU Emacs text editor]

> Right, now that we know tramp-histfile-override was
> a/the problem, maybe we should see what settings
> did not influence the outcome? Let's see what
> happens with _only_ that setting? 1s

Nope, same. Without messing with the individual
tramp-methods' settings, this is as minimal as it
gets:

;;; -*- lexical-binding: t -*-
;;;
;;; this file:
;;;   http://user.it.uu.se/~embe8573/emacs-init/tramp-my.el
;;;   https://dataswamp.org/~incal/emacs-init/tramp-my.el

(require 'tramp)

(setq tramp-histfile-override nil)

(add-to-list 'tramp-methods
  '("myssh"
    (tramp-login-program "ssh")
    (tramp-login-args (("-l" "%u")
                       ("-p" "%p")
                       ("%c")
                       ("-e" "none")
                       ("-t" "-t")
                       ("%h")
                       ("\"/bin/sh -i\"") ))
    (tramp-async-args (("-q")))
    (tramp-remote-shell "/bin/sh")
    (tramp-remote-shell-login ("-l"))
    (tramp-remote-shell-args  ("-c")) ))

;; (find-file "/myssh:embe8573@polhem.it.uu.se:darn.txt")

-- 
underground experts united
http://user.it.uu.se/~embe8573
https://dataswamp.org/~incal

Re: Tramp prompt (?) issue

[Emanuel Berg via Users list for the GNU Emacs text editor]

Are you (Mr. Albinus) happy with the data I gave you?
Would you like more?

Can you improve the software from this or was it all
on the part of the ignorant user (me)?

Can you make a very short summary please of what we
did? I know there was a possible zsh issue. To the
OpenBSD system we got it working with zsh, to the
SunOS we got it working with bash. Did we try with
zsh? Or was zsh not even the problem? What was
the problem? Was it one problem or several?

TIA

-- 
underground experts united
http://user.it.uu.se/~embe8573
https://dataswamp.org/~incal

Re: Tramp prompt (?) issue

[Michael Albinus]

Emanuel Berg via Users list for the GNU Emacs text editor
<help-gnu-emacs@gnu.org> writes:

Hi Emanuel,

> Are you (Mr. Albinus) happy with the data I gave you?
> Would you like more?
>
> Can you improve the software from this or was it all
> on the part of the ignorant user (me)?

Don't know. I wanted to know whether sshx works for you (because it is
similar to the myssh method I was proposing). Unfortunately, sshx didn't
work for you.

Improving Tramp: likely not. The problem was related to a remote SunOS
machine, which isn't much used these days. So I won't change Tramp with
the risk to introduce other errors. SunOS is famous to be problematic
with Tramp, see the comments in the code.

I'm happy we found a working solution for you.

> Can you make a very short summary please of what we
> did? I know there was a possible zsh issue. To the
> OpenBSD system we got it working with zsh, to the
> SunOS we got it working with bash. Did we try with
> zsh? Or was zsh not even the problem? What was
> the problem? Was it one problem or several?

Honestly, I've lost the history. Sorry.

> TIA

Best regards, Michael.