bug#10173: 24.0.50; TRAMP sudo method not working on OS X

bug#10173: 24.0.50; TRAMP sudo method not working on OS X

[MICHAEL W DUGGAN]

bzr trunk revno 106562, recently bootstrapped

emacs -Q
C-x C-f /sudo::/

Fails.  Result in *Messages* buffer.  See output below for details.

In GNU Emacs 24.0.50.2 (x86_64-apple-darwin10.8.0, NS apple-appkit-1038.36)
of 2011-07-23 on MICHAEL-W-DUGGANs-MacBook-Pro.local
Windowing system distributor `Apple', version 10.3.1038
configured using `configure  '--with-ns''

Important settings:
  value of $LC_ALL: nil
  value of $LC_COLLATE: nil
  value of $LC_CTYPE: nil
  value of $LC_MESSAGES: nil
  value of $LC_MONETARY: nil
  value of $LC_NUMERIC: nil
  value of $LC_TIME: nil
  value of $LANG: en_US.UTF-8
  value of $XMODIFIERS: nil
  locale-coding-system: utf-8-unix
  default enable-multibyte-characters: t

Major mode: Fundamental

Minor modes in effect:
  shell-dirtrack-mode: t
  tooltip-mode: t
  mouse-wheel-mode: t
  tool-bar-mode: t
  menu-bar-mode: t
  file-name-shadow-mode: t
  global-font-lock-mode: t
  font-lock-mode: t
  blink-cursor-mode: t
  auto-composition-mode: t
  auto-encryption-mode: t
  auto-compression-mode: t
  line-number-mode: t
  transient-mark-mode: t

Recent input:
C-x C-f / s u d o : : / <return> C-x b <return> ESC 
x r e p o r t - e m <tab> <return>

Recent messages:
For information about GNU Emacs and the GNU system, type C-h C-a.
Loading tramp-sh...done
Tramp: Opening connection for root@mac.laptop.md5i.com using sudo...

Opening connection for root@mac.laptop.md5i.com using sudo... \
Tramp: Opening connection for root@mac.laptop.md5i.com using sudo...done
ls does not support --dired; see `dired-use-ls-dired' for more details.
byte-code: `\stat -c '("%N" %s)' /' returns with error

Load-path shadows:
None found.

Features:
(shadow sort mail-extr message rfc822 mml easymenu mml-sec mm-decode
mm-bodies mm-encode mail-parse rfc2231 rfc2047 rfc2045 ietf-drums
mailabbrev mail-utils gmm-utils mailheader emacsbug dired tramp-cache
tramp-sh shell pcomplete comint ring tramp tramp-compat auth-source
eieio byte-opt bytecomp byte-compile cconv macroexp assoc gnus-util
mm-util mail-prsvr password-cache format-spec advice help-fns
advice-preload tramp-loaddefs regexp-opt time-date tooltip ediff-hook
vc-hooks lisp-float-type mwheel ns-win tool-bar dnd fontset image fringe
lisp-mode register page menu-bar rfn-eshadow timer select scroll-bar
mouse jit-lock font-lock syntax facemenu font-core frame cham georgian
utf-8-lang misc-lang vietnamese tibetan thai tai-viet lao korean
japanese hebrew greek romanian slovak czech european ethiopic indian
cyrillic chinese case-table epa-hook jka-cmpr-hook help simple abbrev
minibuffer loaddefs button faces cus-face files text-properties overlay
sha1 md5 base64 format env code-pages mule custom widget
hashtable-print-readable backquote make-network-process dbusbind ns
multi-tty emacs)

bug#10173: 24.0.50; TRAMP sudo method not working on OS X

[Michael Albinus]

MICHAEL W DUGGAN <md5i@md5i.com> writes:

> bzr trunk revno 106562, recently bootstrapped
>
> emacs -Q
> C-x C-f /sudo::/
>
> Fails.  Result in *Messages* buffer.  See output below for details.
>
> Recent messages:
> For information about GNU Emacs and the GNU system, type C-h C-a.
> Loading tramp-sh...done
> Tramp: Opening connection for root@mac.laptop.md5i.com using sudo...
>
> Opening connection for root@mac.laptop.md5i.com using sudo... \
> Tramp: Opening connection for root@mac.laptop.md5i.com using sudo...done
> ls does not support --dired; see `dired-use-ls-dired' for more details.
> byte-code: `\stat -c '("%N" %s)' /' returns with error

This command is a test about the features of your installed stat
command. It shouldn't return an error.

Could you, please, rerun the test? After starting emacs, apply

  (setq tramp-verbose 6)

The test results in a Tramp debug buffer, which shall show us details.

Best regards, Michael.

bug#10173: 24.0.50; TRAMP sudo method not working on OS X

[Michael Welsh Duggan]

[-- Attachment #1: Type: text/plain, Size: 1028 bytes --]

Michael Albinus <michael.albinus@gmx.de> writes:

> MICHAEL W DUGGAN <md5i@md5i.com> writes:
>
>> bzr trunk revno 106562, recently bootstrapped
>>
>> emacs -Q
>> C-x C-f /sudo::/
>>
>> Fails.  Result in *Messages* buffer.  See output below for details.
>>
>> Recent messages:
>> For information about GNU Emacs and the GNU system, type C-h C-a.
>> Loading tramp-sh...done
>> Tramp: Opening connection for root@mac.laptop.md5i.com using sudo...
>>
>> Opening connection for root@mac.laptop.md5i.com using sudo... \
>> Tramp: Opening connection for root@mac.laptop.md5i.com using sudo...done
>> ls does not support --dired; see `dired-use-ls-dired' for more details.
>> byte-code: `\stat -c '("%N" %s)' /' returns with error
>
> This command is a test about the features of your installed stat
> command. It shouldn't return an error.
>
> Could you, please, rerun the test? After starting emacs, apply
>
>   (setq tramp-verbose 6)
>
> The test results in a Tramp debug buffer, which shall show us details.

Here are the results:


[-- Attachment #2: tramp.txt --]
[-- Type: text/plain, Size: 767 bytes --]

;; GNU Emacs: 24.0.50.2 Tramp: 2.2.2-pre -*- mode: outline; -*-
08:43:48.435323 tramp-maybe-open-connection (3) # Opening connection for root@mac.laptop.md5i.com using sudo...
08:43:48.443636 tramp-maybe-open-connection (6) # /bin/sh -i
08:43:48.545132 tramp-wait-for-regexp (6) # 
#$ 
08:43:48.545790 tramp-maybe-open-connection (3) # Sending command `exec sudo -u root -s -H -p Password:'
08:43:48.545979 tramp-send-command (6) # exec sudo -u root -s -H -p Password:
08:43:48.546638 tramp-process-actions (3) # Waiting for prompts from remote shell
08:43:48.648495 tramp-process-one-action (5) # Looking for regexp "\(.*ogin\( .*\)?: *\)\'" from remote shell
08:43:48.648894 tramp-process-one-action (5) # Looking for regexp "\(^.*\([pP]assword\|[pP]assphrase\).*:

bug#10173: 24.0.50; TRAMP sudo method not working on OS X

[Michael Welsh Duggan]

[-- Attachment #1: Type: text/plain, Size: 48 bytes --]

Here is the man page for stat on that machine:


[-- Attachment #2: stat.txt --]
[-- Type: text/plain, Size: 11872 bytes --]

STAT(1)                   BSD General Commands Manual                  STAT(1)

N\bNA\bAM\bME\bE
     r\bre\bea\bad\bdl\bli\bin\bnk\bk, s\bst\bta\bat\bt -- display file status

S\bSY\bYN\bNO\bOP\bPS\bSI\bIS\bS
     s\bst\bta\bat\bt [-\b-F\bFL\bLn\bnq\bq] [-\b-f\bf _\bf_\bo_\br_\bm_\ba_\bt | -\b-l\bl | -\b-r\br | -\b-s\bs | -\b-x\bx] [-\b-t\bt _\bt_\bi_\bm_\be_\bf_\bm_\bt] [_\bf_\bi_\bl_\be _\b._\b._\b.]
     r\bre\bea\bad\bdl\bli\bin\bnk\bk [-\b-n\bn] [_\bf_\bi_\bl_\be _\b._\b._\b.]

D\bDE\bES\bSC\bCR\bRI\bIP\bPT\bTI\bIO\bON\bN
     The s\bst\bta\bat\bt utility displays information about the file pointed to by _\bf_\bi_\bl_\be.
     Read, write or execute permissions of the named file are not required,
     but all directories listed in the path name leading to the file must be
     searchable.  If no argument is given, s\bst\bta\bat\bt displays information about the
     file descriptor for standard input.

     When invoked as r\bre\bea\bad\bdl\bli\bin\bnk\bk, only the target of the symbolic link is
     printed.  If the given argument is not a symbolic link, r\bre\bea\bad\bdl\bli\bin\bnk\bk will
     print nothing and exit with an error.

     The information displayed is obtained by calling lstat(2) with the given
     argument and evaluating the returned structure.

     The options are as follows:

     -\b-F\bF      As in ls(1), display a slash (`/') immediately after each path-
             name that is a directory, an asterisk (`*') after each that is
             executable, an at sign (`@') after each symbolic link, a percent
             sign (`%') after each whiteout, an equal sign (`=') after each
             socket, and a vertical bar (`|') after each that is a FIFO.  The
             use of -\b-F\bF implies -\b-l\bl.

     -\b-f\bf _\bf_\bo_\br_\bm_\ba_\bt
             Display information using the specified format.  See the _\bF_\bO_\bR_\bM_\bA_\bT_\bS
             section for a description of valid formats.

     -\b-L\bL      Use stat(2) instead of lstat(2).  The information reported by
             s\bst\bta\bat\bt will refer to the target of _\bf_\bi_\bl_\be, if file is a symbolic
             link, and not to _\bf_\bi_\bl_\be itself.

     -\b-l\bl      Display output in l\bls\bs -\b-l\blT\bT format.

     -\b-n\bn      Do not force a newline to appear at the end of each piece of out-
             put.

     -\b-q\bq      Suppress failure messages if calls to stat(2) or lstat(2) fail.
             When run as r\bre\bea\bad\bdl\bli\bin\bnk\bk, error messages are automatically sup-
             pressed.

     -\b-r\br      Display raw information.  That is, for all the fields in the _\bs_\bt_\ba_\bt
             structure, display the raw, numerical value (for example, times
             in seconds since the epoch, etc.).

     -\b-s\bs      Display information in ``shell output'', suitable for initializ-
             ing variables.

     -\b-t\bt _\bt_\bi_\bm_\be_\bf_\bm_\bt
             Display timestamps using the specified format.  This format is
             passed directly to strftime(3).

     -\b-x\bx      Display information in a more verbose way as known from some
             Linux distributions.

   F\bFo\bor\brm\bma\bat\bts\bs
     Format strings are similar to printf(3) formats in that they start with
     %\b%, are then followed by a sequence of formatting characters, and end in a
     character that selects the field of the _\bs_\bt_\br_\bu_\bc_\bt _\bs_\bt_\ba_\bt which is to be for-
     matted.  If the %\b% is immediately followed by one of n\bn, t\bt, %\b%, or @\b@, then a
     newline character, a tab character, a percent character, or the current
     file number is printed, otherwise the string is examined for the follow-
     ing:

     Any of the following optional flags:

     #\b#       Selects an alternate output form for octal and hexadecimal out-
             put.  Non-zero octal output will have a leading zero, and non-
             zero hexadecimal output will have ``0x'' prepended to it.

     +\b+       Asserts that a sign indicating whether a number is positive or
             negative should always be printed.  Non-negative numbers are not
             usually printed with a sign.

     -\b-       Aligns string output to the left of the field, instead of to the
             right.

     0\b0       Sets the fill character for left padding to the `0' character,
             instead of a space.

     space   Reserves a space at the front of non-negative signed output
             fields.  A `+\b+' overrides a space if both are used.

     Then the following fields:

     _\bs_\bi_\bz_\be    An optional decimal digit string specifying the minimum field
             width.

     _\bp_\br_\be_\bc    An optional precision composed of a decimal point `.\b.' and a deci-
             mal digit string that indicates the maximum string length, the
             number of digits to appear after the decimal point in floating
             point output, or the minimum number of digits to appear in
             numeric output.

     _\bf_\bm_\bt     An optional output format specifier which is one of D\bD, O\bO, U\bU, X\bX,
             F\bF, or S\bS.  These represent signed decimal output, octal output,
             unsigned decimal output, hexadecimal output, floating point out-
             put, and string output, respectively.  Some output formats do not
             apply to all fields.  Floating point output only applies to
             _\bt_\bi_\bm_\be_\bs_\bp_\be_\bc fields (the a\ba, m\bm, and c\bc fields).

             The special output specifier S\bS may be used to indicate that the
             output, if applicable, should be in string format.  May be used
             in combination with:

             a\bam\bmc\bc     Display date in strftime(3) format.

             d\bdr\br      Display actual device name.

             g\bgu\bu      Display group or user name.

             p\bp       Display the mode of _\bf_\bi_\bl_\be as in l\bls\bs -\b-l\blT\bTd\bd.

             N\bN       Displays the name of _\bf_\bi_\bl_\be.

             T\bT       Displays the type of _\bf_\bi_\bl_\be.

             Y\bY       Insert a `` -> '' into the output.  Note that the default
                     output format for Y\bY is a string, but if specified explic-
                     itly, these four characters are prepended.

     _\bs_\bu_\bb     An optional sub field specifier (high, middle, low).  Only
             applies to the p\bp, d\bd, r\br, and T\bT output formats.  It can be one of
             the following:

             H\bH       ``High'' -- specifies the major number for devices from r\br
                     or d\bd, the ``user'' bits for permissions from the string
                     form of p\bp, the file ``type'' bits from the numeric forms
                     of p\bp, and the long output form of T\bT.

             L\bL       ``Low'' -- specifies the minor number for devices from r\br
                     or d\bd, the ``other'' bits for permissions from the string
                     form of p\bp, the ``user'', ``group'', and ``other'' bits
                     from the numeric forms of p\bp, and the l\bls\bs -\b-F\bF style output
                     character for file type when used with T\bT (the use of L\bL
                     for this is optional).

             M\bM       ``Middle'' -- specifies the ``group'' bits for permis-
                     sions from the string output form of p\bp, or the ``suid'',
                     ``sgid'', and ``sticky'' bits for the numeric forms of p\bp.

     _\bd_\ba_\bt_\bu_\bm   A required field specifier, being one of the following:

             d\bd       Device upon which _\bf_\bi_\bl_\be resides.

             i\bi       _\bf_\bi_\bl_\be's inode number.

             p\bp       File type and permissions.

             l\bl       Number of hard links to _\bf_\bi_\bl_\be.

             u\bu, g\bg    User ID and group ID of _\bf_\bi_\bl_\be's owner.

             r\br       Device number for character and block device special
                     files.

             a\ba, m\bm, c\bc, B\bB
                     The time _\bf_\bi_\bl_\be was last accessed or modified, of when the
                     inode was last changed, or the birth time of the inode.

             z\bz       The size of _\bf_\bi_\bl_\be in bytes.

             b\bb       Number of blocks allocated for _\bf_\bi_\bl_\be.

             k\bk       Optimal file system I/O operation block size.

             f\bf       User defined flags for _\bf_\bi_\bl_\be.

             v\bv       Inode generation number.

             The following four field specifiers are not drawn directly from
             the data in _\bs_\bt_\br_\bu_\bc_\bt _\bs_\bt_\ba_\bt, but are:

             N\bN       The name of the file.

             T\bT       The file type, either as in l\bls\bs -\b-F\bF or in a more descrip-
                     tive form if the _\bs_\bu_\bb field specifier H\bH is given.

             Y\bY       The target of a symbolic link.

             Z\bZ       Expands to ``major,minor'' from the _\br_\bd_\be_\bv field for char-
                     acter or block special devices and gives size output for
                     all others.

     Only the %\b% and the field specifier are required.  Most field specifiers
     default to U\bU as an output form, with the exception of p\bp which defaults to
     O\bO, a\ba, m\bm, and c\bc which default to D\bD, and Y\bY, T\bT, and N\bN which default to S\bS.

E\bEX\bXI\bIT\bT S\bST\bTA\bAT\bTU\bUS\bS
     The s\bst\bta\bat\bt and r\bre\bea\bad\bdl\bli\bin\bnk\bk utilities exit 0 on success, and >0 if an error
     occurs.

E\bEX\bXA\bAM\bMP\bPL\bLE\bES\bS
     Given a symbolic link _\bf_\bo_\bo that points from _\b/_\bt_\bm_\bp_\b/_\bf_\bo_\bo to _\b/, you would use
     s\bst\bta\bat\bt as follows:

           > stat -F /tmp/foo
           lrwxrwxrwx 1 jschauma cs 1 Apr 24 16:37:28 2002 /tmp/foo@ -> /

           > stat -LF /tmp/foo
           drwxr-xr-x 16 root wheel 512 Apr 19 10:57:54 2002 /tmp/foo/

     To initialize some shell variables, you could use the -\b-s\bs flag as follows:

           > csh
           % eval set `stat -s .cshrc`
           % echo $st_size $st_mtimespec
           1148 1015432481

           > sh
           $ eval $(stat -s .profile)
           $ echo $st_size $st_mtimespec
           1148 1015432481

     In order to get a list of the kind of files including files pointed to if
     the file is a symbolic link, you could use the following format:

           $ stat -f "%N: %HT%SY" /tmp/*
           /tmp/bar: Symbolic Link -> /tmp/foo
           /tmp/output25568: Regular File
           /tmp/blah: Directory
           /tmp/foo: Symbolic Link -> /

     In order to get a list of the devices, their types and the major and
     minor device numbers, formatted with tabs and linebreaks, you could use
     the following format:

           stat -f "Name: %N%n%tType: %HT%n%tMajor: %Hr%n%tMinor: %Lr%n%n" /dev/*
           [...]
           Name: /dev/wt8
                   Type: Block Device
                   Major: 3
                   Minor: 8

           Name: /dev/zero
                   Type: Character Device
                   Major: 2
                   Minor: 12

     In order to determine the permissions set on a file separately, you could
     use the following format:

           > stat -f "%Sp -> owner=%SHp group=%SMp other=%SLp" .
           drwxr-xr-x -> owner=rwx group=r-x other=r-x

     In order to determine the three files that have been modified most
     recently, you could use the following format:

           > stat -f "%m%t%Sm %N" /tmp/* | sort -rn | head -3 | cut -f2-
           Apr 25 11:47:00 2002 /tmp/blah
           Apr 25 10:36:34 2002 /tmp/bar
           Apr 24 16:47:35 2002 /tmp/foo

S\bSE\bEE\bE A\bAL\bLS\bSO\bO
     file(1), ls(1), lstat(2), readlink(2), stat(2), printf(3), strftime(3)

H\bHI\bIS\bST\bTO\bOR\bRY\bY
     The s\bst\bta\bat\bt utility appeared in NetBSD 1.6 and FreeBSD 4.10.

A\bAU\bUT\bTH\bHO\bOR\bRS\bS
     The s\bst\bta\bat\bt utility was written by Andrew Brown <atatat@NetBSD.org>.  This
     man page was written by Jan Schaumann <jschauma@NetBSD.org>.

BSD                               May 8, 2003                              BSD

[-- Attachment #3: Type: text/plain, Size: 42 bytes --]


-- 
Michael Welsh Duggan
(md5i@md5i.com)

bug#10173: 24.0.50; TRAMP sudo method not working on OS X

[Michael Welsh Duggan]

As a followup, on the Mac, stat -f '("%N" %z)' does almost the same
thing.  The difference is that under GNU/Linux, %N is surrounding the
filename by backtick-quote, and on the Mac it does not.  Now, tramp
might be running in an environment where it does not on the GNU/Linux
system as well.  I have only tried this on the command line.

-- 
Michael Welsh Duggan
(md5i@md5i.com)

bug#10173: 24.0.50; TRAMP sudo method not working on OS X

[Michael Albinus]

Michael Welsh Duggan <md5i@md5i.com> writes:

> As a followup, on the Mac, stat -f '("%N" %z)' does almost the same
> thing.  The difference is that under GNU/Linux, %N is surrounding the
> filename by backtick-quote, and on the Mac it does not.  Now, tramp
> might be running in an environment where it does not on the GNU/Linux
> system as well.  I have only tried this on the command line.

Tramp does only one check whether stat(1) returns the correct
string. When it doesn't work, it uses other commands. Therefore, it
isn't mandatory to parse different stat(1) result syntaces.

The problem in your case is that Tramp hasn't suppressed the "wrong"
(better: unexpected) string in your case. This was fixed already by:

2011-07-04  Michael Albinus  <michael.albinus@gmx.de>

[...]

(tramp-send-command-and-read): New optional argument NOERROR.
(tramp-open-connection-setup-interactive-shell)
(tramp-get-remote-path, tramp-get-remote-stat): Use it.

Your Emacs build reports:

In GNU Emacs 24.0.50.2 (x86_64-apple-darwin10.8.0, NS apple-appkit-1038.36)
of 2011-07-23 on MICHAEL-W-DUGGANs-MacBook-Pro.local

It should contain that patch. Maybe you haven't synced your Emacs tree
with the trunk before the build?

Could you, please, check whether you find the quoted entry in
lisp/ChangeLog? If not, a simple upgrade shall solve the problem for
you.

Best regards, Michael.

bug#10173: 24.0.50; TRAMP sudo method not working on OS X

[Michael Welsh Duggan]

Michael Albinus <michael.albinus@gmx.de> writes:

> Michael Welsh Duggan <md5i@md5i.com> writes:
>
>> As a followup, on the Mac, stat -f '("%N" %z)' does almost the same
>> thing.  The difference is that under GNU/Linux, %N is surrounding the
>> filename by backtick-quote, and on the Mac it does not.  Now, tramp
>> might be running in an environment where it does not on the GNU/Linux
>> system as well.  I have only tried this on the command line.
>
> Tramp does only one check whether stat(1) returns the correct
> string. When it doesn't work, it uses other commands. Therefore, it
> isn't mandatory to parse different stat(1) result syntaces.
>
> The problem in your case is that Tramp hasn't suppressed the "wrong"
> (better: unexpected) string in your case. This was fixed already by:
>
> 2011-07-04  Michael Albinus  <michael.albinus@gmx.de>
>
> [...]
>
> (tramp-send-command-and-read): New optional argument NOERROR.
> (tramp-open-connection-setup-interactive-shell)
> (tramp-get-remote-path, tramp-get-remote-stat): Use it.
>
> Your Emacs build reports:
>
> In GNU Emacs 24.0.50.2 (x86_64-apple-darwin10.8.0, NS apple-appkit-1038.36)
> of 2011-07-23 on MICHAEL-W-DUGGANs-MacBook-Pro.local

Thank you.  The way the Mac deals with applications is still strange to
me.  When I "installed" the newly built version of emacs, it didn't end
up where I expected, and as a result I was running an older copy of
Emacs.  The problem I was seeing is now gone.  You can close the
report.

-- 
Michael Welsh Duggan
(md5i@md5i.com)

bug#10173: 24.0.50; TRAMP sudo method not working on OS X

[Michael Albinus]

Michael Welsh Duggan <md5i@md5i.com> writes:

> Thank you.  The way the Mac deals with applications is still strange to
> me.  When I "installed" the newly built version of emacs, it didn't end
> up where I expected, and as a result I was running an older copy of
> Emacs.  The problem I was seeing is now gone.  You can close the
> report.

Thanks for checking, I've closed the bug.

Best regards, Michael.