tramp/ange-ftp: error in creation of dir's

tramp/ange-ftp: error in creation of dir's

[Martin Steffen]

Hi, 

I came to use tramp/ange-ftp again. I have ftp access to some storage, and
tramp comes in handy.  Now it seems some erroneous behavior:

    I cannot create directories in dired mode via
    tramp/ange-ftp ("direct-create-directory")

    I am using tramp with tramp-default-method = "ftp"

Otherwise, I can login, copy files etc, only the creation of
directories does not work. The error message is


mkdir /Volume_1/x
ftp> 550 /Volume_1/x: No such file or directory.

     

Note that it's not a problem of missing access permissions. In
the command buffer of tramps, which runs the ftp-session, 
I can type in

     ftp>  mkdir somefolder

and it works ok.
----------------------------
I use emacs-version 22.1.1
      tramp-version 2.0.55
----------------------------


Actually, when looking at the command-message buffer, it seems that during
the ftp-session there is something's going wrong, during directory browsing
(with dired). So, the ftp-buffer complains all the time, that the
respective director is not there (see the protocol below). That's strange,
as in the dired-buffer, it seems to work, i.e., I can browse the directory
tree, open files, change them, and store them back. Only in the ftp-command
buffer, tramp/ange-ftp complains that those directories are not there:


ls -al /tmp/ange-ftp3480Z7F
ftp> 227 Entering Passive Mode (192,168,1,4,207,17)
150 Opening ASCII mode data connection for directory listing.
226 Transfer complete.
quote mdtm /Volume_1/
ftp> 550 /Volume_1: No such file or directory.
quote mdtm /Volume_1/
ftp> 550 /Volume_1: No such file or directory.
ftp> quote mdtm /Volume_1/
550 /Volume_1: No such file or directory.
quote mdtm /Volume_1/
ftp> 550 /Volume_1: No such file or directory.
ftp> quote mdtm /Volume_1/testfolder/


Any help is welcome. Thanks. Martin

Re: tramp/ange-ftp: error in creation of dir's

[Michael Albinus]

Martin Steffen <msteffen@ifi.uio.no> writes:

> Hi, 

Hi,

> Otherwise, I can login, copy files etc, only the creation of
> directories does not work. The error message is
>
> mkdir /Volume_1/x
> ftp> 550 /Volume_1/x: No such file or directory.

[...]

> Actually, when looking at the command-message buffer, it seems that during
> the ftp-session there is something's going wrong, during directory browsing
> (with dired). So, the ftp-buffer complains all the time, that the
> respective director is not there (see the protocol below). That's strange,
> as in the dired-buffer, it seems to work, i.e., I can browse the directory
> tree, open files, change them, and store them back. Only in the ftp-command
> buffer, tramp/ange-ftp complains that those directories are not there:
>
> ls -al /tmp/ange-ftp3480Z7F
> ftp> 227 Entering Passive Mode (192,168,1,4,207,17)
> 150 Opening ASCII mode data connection for directory listing.
> 226 Transfer complete.
> quote mdtm /Volume_1/
> ftp> 550 /Volume_1: No such file or directory.

Does it mean you are able to browse the directory "/Volume_1" in
dired? Strange.

Could you, please, provide the ange-ftp buffer for a whole session,
including browsing through the directory "/Volume_1" as well as
creation of files, editing files, creation of directories inside this
directory?

Best regards, Michael.

Re: tramp/ange-ftp: error in creation of dir's

[Michael Albinus]

msteffen@ifi.uio.no writes:

>> Does it mean you are able to browse the directory "/Volume_1" in
>> dired? Strange.
>
> Yes. If I don't look at the *FTP command buffer* which
> runs the session, the dired seems to work as I
> would expect, including browsing the tree, visiting
> files and storing them back. Also ``renaming'' files seem
> to work.  But the "+"-key, bound to dired-create-directory,
> does not work (and that's where I started to look at the
> command buffer).

Since it works for me with the same configuration (GNU Emacs 22.1 /
Tramp 2.0.55), I believe this is related to either your FTP client or
server. But we'll see. Btw, which versions of FTP client and server
are involved?

> As another observation: changing the tramp-method from
> "ftp" to "smb" (samba), then the dired-create-directory
> works (only that I like to avoid that protocol, as
> I get problems with long file-names).

No surprise. Internally, a complete different machinery is working for
you. And which problems with long file names are you running into?

> Martin

Best regards, Michael.

PS: keeping h-g-e@gnu.org in Cc; other people might be interested in
the result.

Re: tramp/ange-ftp: error in creation of dir's

[Martin Steffen]

>>>>> "Michael" == Michael Albinus <michael.albinus@gmx.de> writes:


    >> As another observation: changing the tramp-method from "ftp" to
    >> "smb" (samba), then the dired-create-directory works (only that I
    >> like to avoid that protocol, as I get problems with long
    >> file-names).

    Michael> No surprise. Internally, a complete different machinery is
    Michael> working for you. And which problems with long file names are
    Michael> you running into?


Well, the problems are that it abbreviates the file-names. 
So, concretely.

I wanted to copy a whole batch of files, all with similar file names
(photos, whose file names carry the date-hour-minutes etc which makes the
file names long), So I marked all of them in dired, copied all of them over
the net in a batch to the file-server, using "smb" as protocol. But that
breaks, as some of the files in the target system get the same file-name
via abbreviation, which results in name clash and the copy-batch stops at
that point.


    Michael> Best regards, Michael.

    Michael> PS: keeping h-g-e@gnu.org in Cc; other people might be
    Michael> interested in the result.

ok. I will post the infos about FTP-version, the protocol the evening then.

Cheers, and thanks, Martin

Re: tramp/ange-ftp: error in creation of dir's

[Michael Albinus]

Martin Steffen <msteffen@ifi.uio.no> writes:

>     Michael> No surprise. Internally, a complete different machinery is
>     Michael> working for you. And which problems with long file names are
>     Michael> you running into?
>
> Well, the problems are that it abbreviates the file-names. 
> So, concretely.
>
> I wanted to copy a whole batch of files, all with similar file names
> (photos, whose file names carry the date-hour-minutes etc which makes the
> file names long), So I marked all of them in dired, copied all of them over
> the net in a batch to the file-server, using "smb" as protocol. But that
> breaks, as some of the files in the target system get the same file-name
> via abbreviation, which results in name clash and the copy-batch stops at
> that point.

Is this the SMB server which abbreviates the filenames? Or is it
because of Tramp, which cannot handle such filenames (maybe containing
spaces, or so)?

> Cheers, and thanks, Martin

Best regards, Michael.

Re: tramp/ange-ftp: error in creation of dir's

[Martin Steffen]

>>>>> "Michael" == Michael Albinus <michael.albinus@gmx.de> writes:

    >> work, i.e., I can browse the directory tree, open files, change
    >> them, and store them back. Only in the ftp-command buffer,
    >> tramp/ange-ftp complains that those directories are not there:
    >> 
    >> ls -al /tmp/ange-ftp3480Z7F
    ftp> 227 Entering Passive Mode (192,168,1,4,207,17)
    >> 150 Opening ASCII mode data connection for directory listing.  226
    >> Transfer complete.  quote mdtm /Volume_1/
    ftp> 550 /Volume_1: No such file or directory.

    Michael> Does it mean you are able to browse the directory "/Volume_1"
    Michael> in dired? Strange.

    Michael> Could you, please, provide the ange-ftp buffer for a whole

Hi,

so, here is the FTP-Buffer. Note that it contains 2 parts, one that is
``automatically'' done when I am operating in dired mode. The very last
part reflects the interaction, when _I_ myself use the FTP-buffer as
interactive shell to operate the ftp-protocol.

The file structure is /Volume_1 at the root.  When I logon to
the directory 

      msteffen@192.164.1.4:

I get the root / of the file system displayed in dired (as I would
expect). Getting into the displayed directory /Volume_1 
in the dired gets me there, as exected. The next command, the 
attempted creation of "testdir", fails.  So I can browse fine,
but creating directories does not work (the same happens
when trying to delete an empty directory).

I appended also the error stack of the debugger, to see the different
ange-ftp/tramp function calls.

The version of the FTP server is indicated in the protocol, I
guess. Anyway, the host is a NAS (network attached server, a D-Link
DNS-323) and I cannot login to it, it's accessible basically via FTP (and
samba and UPnP).

----------------- FTP BUFFER PROTOCOL -----------
ftp> open 192.168.1.4
Connected to 192.168.1.4 (192.168.1.4).
220 sputstore FTP server (Version wu-2.6.2(52) Tue Jan 2 14:13:26 CST 2007) ready.
user "msteffen" Turtle Power!
ftp> 331 Password required for msteffen.
230-Welcome to my FTP site.
230-Now is the time ==> Mon Nov 19 18:59:49 2007
230-The host name is sputstore
230-You are msteffen
230-There are 1 person in my site, now.
230-
230-
230 User msteffen logged in.
hash
ftp> Hash mark printing on (1024 bytes/hash mark).
pwd
ftp> 257 "/" is current directory.
cd /
ftp> 250 CWD command successful.
ls -al /tmp/ange-ftp3919p4c
ftp> 227 Entering Passive Mode (192,168,1,4,252,97)
150 Opening ASCII mode data connection for directory listing.
226 Transfer complete.
quote mdtm /
ftp> 550 /mnt: not a plain file.
quote mdtm /
ftp> 550 /mnt: not a plain file.
ftp> cd /Volume_1/
250 CWD command successful.
ls -al /tmp/ange-ftp3919YEK
ftp> 227 Entering Passive Mode (192,168,1,4,19,212)
150 Opening ASCII mode data connection for directory listing.
226 Transfer complete.
quote mdtm /Volume_1/
ftp> 550 /Volume_1: No such file or directory.
quote mdtm /Volume_1/
ftp> 550 /Volume_1: No such file or directory.
ftp> mkdir /Volume_1/testdir
550 /Volume_1/testdir: No such file or directory.
mkdir /Volume_1/testdir
ftp> 550 /Volume_1/testdir: No such file or directory.

----------->>> from here: my own interaction <<<--------------

ftp> pwd
257 "/Volume_1" is current directory.
ftp> mkdir testdir
257 "/mnt/HD_a2/testdir" new directory created.
ftp> 

----------------- FTP BUFFER PROTOCOLL END
--------------------------------------------------
----------------- error stack of the emacs lisp debuffer

Debugger entered--Lisp error: (ftp-error #("FTP Error: Could not make directory /192.168.1.4:/Volume_1/testdir: 550 /Volume_1/testdir: No such file or directory." 0 68 nil 68 117 (fontified nil rear-nonsticky t field output inhibit-line-move-field-capture t)))
  signal(ftp-error (#("FTP Error: Could not make directory /192.168.1.4:/Volume_1/testdir: 550 /Volume_1/testdir: No such file or directory." 0 68 nil 68 117 (fontified nil rear-nonsticky t field output inhibit-line-move-field-capture t))))
  ange-ftp-error("192.168.1.4" "msteffen" #("Could not make directory /192.168.1.4:/Volume_1/testdir: 550 /Volume_1/testdir: No such file or directory." 0 57 nil 57 106 (inhibit-line-move-field-capture t field output rear-nonsticky t fontified nil)))
  ange-ftp-make-directory("/192.168.1.4:/Volume_1/testdir" nil)
  apply(ange-ftp-make-directory ("/192.168.1.4:/Volume_1/testdir" nil))
  ange-ftp-hook-function(make-directory "/192.168.1.4:/Volume_1/testdir" nil)
  apply(ange-ftp-hook-function make-directory ("/192.168.1.4:/Volume_1/testdir" nil))
  tramp-ftp-file-name-handler(make-directory "/192.168.1.4:/Volume_1/testdir" nil)
  apply(tramp-ftp-file-name-handler make-directory ("/192.168.1.4:/Volume_1/testdir" nil))
  tramp-file-name-handler(make-directory "/192.168.1.4:/Volume_1/testdir" nil)
  make-directory("/192.168.1.4:/Volume_1/testdir")
  dired-create-directory("/192.168.1.4:/Volume_1/testdir")
  call-interactively(dired-create-directory)

.


Cheers, 

Martin

Re: tramp/ange-ftp: error in creation of dir's

[Michael Albinus]

Martin Steffen <msteffen@ifi.uio.no> writes:

> Hi,

Hi,

> so, here is the FTP-Buffer. Note that it contains 2 parts, one that is
> ``automatically'' done when I am operating in dired mode. The very last
> part reflects the interaction, when _I_ myself use the FTP-buffer as
> interactive shell to operate the ftp-protocol.
>
> The file structure is /Volume_1 at the root.  When I logon to
> the directory 
>
>       msteffen@192.164.1.4:
>
> I get the root / of the file system displayed in dired (as I would
> expect). Getting into the displayed directory /Volume_1 
> in the dired gets me there, as exected. The next command, the 
> attempted creation of "testdir", fails.  So I can browse fine,
> but creating directories does not work (the same happens
> when trying to delete an empty directory).

OK. Could you, please, run a native test from the command line:

# ftp 192.164.1.4

Provide user name / password as requested. Afterwards, please apply the
following commands which we have seen in the ange-ftp buffer. This is a
test to see whether it is ange-ftp or your FTP server which behaves
unfriendly:

ftp> hash
ftp> pwd
ftp> cd /
ftp> ls -al
ftp> quote mdtm /
ftp> cd /Volume_1/
ftp> ls -al
ftp> quote mdtm /Volume_1/
ftp> mkdir /Volume_1/testdir
ftp> bye

Please show the session listing of all these commands. I suspect it is
the FTP server which runs into problems. Maybe because of this from your
test:

> ftp> pwd
> 257 "/Volume_1" is current directory.
> ftp> mkdir testdir
> 257 "/mnt/HD_a2/testdir" new directory created.

Looks like "/Volume_1" is a link or so, because "testdir" has been
created on another physical location.

> The version of the FTP server is indicated in the protocol, I
> guess. Anyway, the host is a NAS (network attached server, a D-Link
> DNS-323) and I cannot login to it, it's accessible basically via FTP (and
> samba and UPnP).

Ah. Samba on FAT32 likely. This could explain why the smb based copy
results in shortened file names.

Off topic: looks like it is possible to run native Linux on a D-Link
DNS-323. I did something similar with my Linksys NSLU2, and I'm happy
with it.

> Cheers, 
>
> Martin

Best regards, Michael.

Re: tramp/ange-ftp: error in creation of dir's

[Martin Steffen]

Hi.
>>>>> "Michael" == Michael Albinus <michael.albinus@gmx.de> writes:


    >> expect). Getting into the displayed directory /Volume_1 in the dired
    >> gets me there, as exected. The next command, the attempted creation
    >> of "testdir", fails.  So I can browse fine, but creating directories
    >> does not work (the same happens when trying to delete an empty
    >> directory).

    Michael> OK. Could you, please, run a native test from the command
    Michael> line:

So, here is the log of the commands, you
gave:

---------------------------------------------------------------
[msteffen@localhost ~]$ ftp 192.168.1.4
Connected to 192.168.1.4 (192.168.1.4).
220 sputstore FTP server (Version wu-2.6.2(52) Tue Jan 2 14:13:26 CST 2007) ready.
Name (192.168.1.4:msteffen): 
331 Password required for msteffen.
Password:
230-Welcome to my FTP site.
230-Now is the time ==> Tue Nov 20 21:57:17 2007
230-The host name is sputstore
230-You are msteffen
230-There are 1 person in my site, now.
230-
230-
230 User msteffen logged in.
Remote system type is UNIX.
Using binary mode to transfer files.
ftp> hash
Hash mark printing on (1024 bytes/hash mark).
ftp> pwd
257 "/" is current directory.
ftp> cd /
250 CWD command successful.
ftp> ls -al
227 Entering Passive Mode (192,168,1,4,216,113)
150 Opening ASCII mode data connection for directory listing.
total 14
drwxr-xr-x   4 root root     1024 Nov 19  2007 .
drwxr-xr-x  18 root root     1024 Nov 19  2007 ..
drwxrwxrwx   8 root root     4096 Nov 19 20:12 Volume_1
drwxr-xr-x   2 root root     1024 Feb 14  2007 web_page
226 Transfer complete.
ftp> quote mdtm /
550 /mnt: not a plain file.
ftp> cd /Volume_1
250 CWD command successful.
ftp> ls -al
227 Entering Passive Mode (192,168,1,4,67,17)
150 Opening ASCII mode data connection for directory listing.
total 66
drwxrwxrwx   8 root root     4096 Nov 19  2007 .
drwxr-xr-x   4 root root     1024 Nov 19  2007 ..
drwxrwxrwx   2 root root     4096 Nov 17  2007 .lpd
drwxrwxrwx   4 root root     4096 Nov 19  2007 Music
-rwxrwxrwx   1 root root        2 Nov 18  2007 XXX
drwxrwxrwx   3 root root     4096 Nov 17  2007 sputnik
drwxrwxrwx   2 root root     4096 Nov 19  2007 testdir
drwxrwxrwx   2 root root     4096 Nov 18  2007 testfolder
226 Transfer complete.
ftp> quote mdtm /Volume_1/
550 /Volume_1: No such file or directory.
ftp> mkdir /Volume_1/testdir
550 /Volume_1/testdir: No such file or directory.
ftp> bye
221-You have transferred 0 bytes in 0 files.
221-Total traffic for this session was 986 bytes in 0 transfers.
221-Thank you for using the FTP service on sputstore.
221 Goodbye.
[msteffen@localhost ~]$ 
-------------------------------------

    Michael> # ftp 192.164.1.4



    ftp> pwd
    >> 257 "/Volume_1" is current directory.
    ftp> mkdir testdir
    >> 257 "/mnt/HD_a2/testdir" new directory created.

yes, that looks strange.

    Michael> Looks like "/Volume_1" is a link or so, because "testdir" has
    Michael> been created on another physical location.


    Michael> Ah. Samba on FAT32 likely. This could explain why the smb
    Michael> based copy results in shortened file names.

Well, strangely enough, the DNS-323 is BSD-based, as I heared

    Michael> Off topic: looks like it is possible to run native Linux on a
    Michael> D-Link DNS-323. I did something similar with my Linksys NSLU2,
    Michael> and I'm happy with it.

[Off topic as well: Yes, I have seen that. Not sure whether I dare to do
that at the current stage.... Actually, the thing works fine (for instance
it connected in a blink to my noxon internet radio via UNpP AV). The only
thing I need to find out a decent way of using it for backups]

cheers, Martin

Re: tramp/ange-ftp: error in creation of dir's

[Michael Albinus]

Martin Steffen <msteffen@ifi.uio.no> writes:

> Hi.

Hi,

> ftp> quote mdtm /Volume_1/
> 550 /Volume_1: No such file or directory.
> ftp> mkdir /Volume_1/testdir
> 550 /Volume_1/testdir: No such file or directory.

Hmm, the same output as in the ange-ftp log. That is consistent. I
wouldn't blame ange-ftp, when your FTP server isn't able to create a new
directory over a link.

Have you tried (in Emacs) to go to "192.164.1.4:/mnt/HD_a2/" directly?
And if it works, is it possible to create a directory there?

Otherwise, an option might be to create directories on your FTP server
outside of Emacs, for example with the FTP client on the shell.
Transferring files seems to work, if I understand you correctly.

I'm not intimate enough with ange-ftp to change the command sequence it
sends over the wire. I fear I would break other configurations then.

> cheers, Martin

Best regards, Michael.

Re: tramp/ange-ftp: error in creation of dir's

[Martin Steffen]

>>>>> "Michael" == Michael Albinus <michael.albinus@gmx.de> writes:

    Michael> Martin Steffen <msteffen@ifi.uio.no> writes:

    >> Hi.

    Michael> Hi,

    ftp> quote mdtm /Volume_1/
    >> 550 /Volume_1: No such file or directory.
    ftp> mkdir /Volume_1/testdir
    >> 550 /Volume_1/testdir: No such file or directory.

    Michael> Hmm, the same output as in the ange-ftp log. That is
    Michael> consistent. I wouldn't blame ange-ftp, when your FTP server
    Michael> isn't able to create a new directory over a link.

ok, make sense. I try to fiddle a little more myself, or find out what's
known about DNS's ftp-server.

Thanks, 

Martin