all messages for Emacs-related lists mirrored at yhetil.org
 help / color / mirror / code / Atom feed
From: Eli Zaretskii <eliz@gnu.org>
To: "Drew Adams" <drew.adams@oracle.com>
Cc: emacs-devel@gnu.org, michael.albinus@gmx.de,
	monnier@iro.umontreal.ca, jasonr@gnu.org
Subject: Re: testing for a remote file to include file on a Windows mapped	drive
Date: Tue, 22 Apr 2008 02:27:40 -0400	[thread overview]
Message-ID: <E1JoBye-0003wH-UH@fencepost.gnu.org> (raw)
In-Reply-To: <004e01c8a433$680933a0$0200a8c0@us.oracle.com> (drew.adams@oracle.com)

> From: "Drew Adams" <drew.adams@oracle.com>
> Cc: <jasonr@gnu.org>, <michael.albinus@gmx.de>, <monnier@iro.umontreal.ca>,
>         <emacs-devel@gnu.org>
> Date: Mon, 21 Apr 2008 21:43:26 -0700
> 
> > > > > Whether I access a local Windows drive (even a slow one) or 
> > > > > a Windows mapped network drive that happens to be in India,
> > > > > there is a world of difference.
> > > > 
> > > > No one in their right minds will mount a drive half the 
> > > > globe away via NFS or similar networking filesystem.
> > > > They will always use something like Tramp or ftp.  So
> > > > this problem simply does not exist in practice.
> > >
> > > I didn't say anything about NFS or similar; I mentioned 
> > > Windows mapped network drives.
> > 
> > Same same.  Note that I did say ``or similar networking filesystem''.
> 
> So it makes no sense to map a Windows network drive to a remote UNIX file system
> with SMB.

Only if the drive is ``half the globe away''.

> > > However, accessing a mapped network drive is typically
> > > much slower than accessing a local hard drive (please -
> > > no comments about USB sticks).
> > 
> > That is simply not true in general, even before situations like USB
> > sticks are concerned.  Of course, if you are in the US and the drive
> > is in Asia, that could be true, but that is a very unusual situation.
> 
> According to the network engineers I spoke with today, it is true in general.
> It's about the network properties (software and hardware), not necessarily the
> distance. It makes sense to me, but I'm no networking expert. You win.

I hope this is not just about winning.  Network access is indeed
slower than local hard disk access, but only by small factors (again,
unless the network is extremely slow, which is not what one sees
normally).  By contrast, access to files for which file-remote-p
returns non-nil now is several orders of magnitude slower (10 seconds
is not unusual, vs fraction of a second for a networked file).

Here's a random example, from an XP SP2 machine where I'm typing this.
W: is a networked drive mounted via a corporate network, while D: is a
local drive.  `ls' is a Windows port of GNU ls from Coreutils 6.9:

  D:\usr>timep ls -l test
  total 0
  -rw-rw-rw- 1 P0009057 Domain Users 0 2008-04-22 08:49 foobar
  drwxrwxrwx 1 P0009057 Domain Users 0 2008-04-22 08:54 tdir1
  drwxrwxrwx 1 P0009057 Domain Users 0 2008-04-22 08:54 tdir10
  drwxrwxrwx 1 P0009057 Domain Users 0 2008-04-22 08:54 tdir2
  drwxrwxrwx 1 P0009057 Domain Users 0 2008-04-22 08:54 tdir3
  drwxrwxrwx 1 P0009057 Domain Users 0 2008-04-22 08:54 tdir4
  drwxrwxrwx 1 P0009057 Domain Users 0 2008-04-22 08:54 tdir5
  drwxrwxrwx 1 P0009057 Domain Users 0 2008-04-22 08:54 tdir6
  drwxrwxrwx 1 P0009057 Domain Users 0 2008-04-22 08:54 tdir7
  drwxrwxrwx 1 P0009057 Domain Users 0 2008-04-22 08:54 tdir8
  drwxrwxrwx 1 P0009057 Domain Users 0 2008-04-22 08:54 tdir9

  real    00h00m00.031s
  user    00h00m00.015s
  sys     00h00m00.015s

  D:\usr>timep ls -l w:/
  total 0
  drwxrwxrwx 1 P0009057       None         0 2007-02-14 20:13 Accounting
  drwxrwxrwx 1 P0009057       None         0 2008-04-16 08:25 CTI
  drwxrwxrwx 1 Administrators Domain Users 0 2004-07-21 12:54 Management
  drwxrwxrwx 1 Administrators Domain Users 0 2007-03-25 11:45 Marketing
  drwxrwxrwx 1 P0009057       None         0 2008-02-20 10:41 Nob
  drwxrwxrwx 1 Administrators Domain Users 0 2007-06-20 13:53 Projects
  drwxrwxrwx 1 Administrators Domain Users 0 2008-03-24 14:46 RealTime
  drwxrwxrwx 1 P0009057       None         0 2007-06-28 11:22 SIMTECH
  drwxrwxrwx 1 P0009057       None         0 2007-10-24 15:48 Telecom Solutions
  drwxrwxrwx 1 Administrators Domain Users 0 2003-10-26 16:19 TSG-QA
  drwxrwxrwx 1 Administrators Domain Users 0 2008-04-06 11:44 TSG_Marketing Material

  real    00h00m00.109s
  user    00h00m00.015s
  sys     00h00m00.031s

This is a 3-fold slowdown for a networked volume, and accessing 11
directories with a plethora of file I/O APIs still takes a fraction of
a second.

By contrast, just typing "plink fencepost.gnu.org 'ls -l test'" to
produce a listing of a directory on a drive ``half a globe away'' from
where I physically sit takes 4 seconds, and that's even without the
Tramp overhead that could well double or even triple that time.  So
access to what we now call ``remote'' files is 2 orders of magnitude
slower than accessing a local file.

Given these numbers, I fail to see how the same simple predicate can
satisfy the need for detecting both types of ``remote'' files.




  reply	other threads:[~2008-04-22  6:27 UTC|newest]

Thread overview: 135+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2008-01-25 18:47 testing for a remote file to include file on a Windows mapped drive Drew Adams
2008-01-25 18:54 ` Drew Adams
2008-01-25 20:33   ` testing for a remote file to include file on a Windows mappeddrive Drew Adams
2008-01-25 22:18     ` Jason Rumney
2008-01-25 23:37       ` Drew Adams
2008-01-26  2:56         ` Stefan Monnier
2008-01-26  7:30           ` Drew Adams
2008-01-26  9:54             ` Eli Zaretskii
2008-01-26 11:29           ` Michael Albinus
2008-01-26 15:23             ` Jason Rumney
2008-01-26 16:55             ` Drew Adams
2008-01-26 19:24             ` Stefan Monnier
2008-01-26 22:15               ` Michael Albinus
2008-01-26 22:31                 ` Eli Zaretskii
2008-01-27 11:18                   ` Michael Albinus
2008-01-27 17:28                     ` Eli Zaretskii
2008-01-27 18:22                       ` Andreas Schwab
2008-01-27 19:04                       ` Michael Albinus
2008-01-27  1:36                 ` Drew Adams
2008-01-27 20:46                   ` Stefan Monnier
2008-04-20 18:28                   ` testing for a remote file to include file on a Windows mapped drive Drew Adams
2008-04-20 19:37                     ` Stefan Monnier
2008-04-20 20:03                       ` Lennart Borgman (gmail)
2008-04-20 20:28                         ` Stefan Monnier
2008-04-20 21:13                         ` Eli Zaretskii
2008-04-20 21:16                           ` Lennart Borgman (gmail)
2008-04-20 21:31                         ` Jason Rumney
2008-04-20 20:24                       ` Drew Adams
2008-04-20 21:19                         ` Eli Zaretskii
2008-04-20 22:20                           ` Drew Adams
2008-04-20 21:21                         ` Stefan Monnier
2008-04-20 22:20                           ` Drew Adams
2008-04-21  0:59                             ` Stefan Monnier
2008-04-21  7:18                               ` Drew Adams
2008-04-21  7:28                                 ` Jason Rumney
2008-04-21  7:47                                   ` Drew Adams
2008-04-21 19:37                                     ` Eli Zaretskii
2008-04-21 22:11                                       ` Drew Adams
2008-04-22  3:36                                         ` Eli Zaretskii
2008-04-22  4:43                                           ` Drew Adams
2008-04-22  6:27                                             ` Eli Zaretskii [this message]
2008-04-22 14:09                                               ` testing for a remote file to include file on a Windowsmapped drive Drew Adams
2008-04-22 15:47                                                 ` Eli Zaretskii
2008-04-21 17:08                                   ` testing for a remote file to include file on a Windows mapped drive Drew Adams
2008-04-21  7:46                                 ` Michael Albinus
2008-04-21  7:55                                   ` Drew Adams
2008-04-21  9:03                                     ` Michael Albinus
2008-04-21  8:57                                   ` Andreas Schwab
2008-04-21  9:11                                     ` Michael Albinus
2008-04-21  9:18                                       ` Andreas Schwab
2008-04-21  9:44                                         ` Michael Albinus
2008-04-21  9:59                                           ` Andreas Schwab
2008-04-21 14:36                                       ` Stefan Monnier
2008-04-21 17:09                                         ` Drew Adams
2008-04-21 17:45                                           ` Stefan Monnier
2008-04-21 18:52                                             ` Drew Adams
2008-04-21 19:21                                               ` Stefan Monnier
2008-04-21 22:39                                                 ` Drew Adams
2008-04-21 14:33                                   ` Stefan Monnier
2008-04-21 15:13                                     ` Michael Albinus
2008-04-21 16:17                                       ` Stefan Monnier
2008-04-21 20:29                                         ` Michael Albinus
2008-04-22  2:48                                           ` Stefan Monnier
2008-04-21 19:35                                     ` Eli Zaretskii
2008-04-22  2:46                                       ` Stefan Monnier
2008-04-22  3:40                                         ` Eli Zaretskii
2008-04-22  5:46                                           ` Stefan Monnier
2008-04-22  6:50                                             ` Eli Zaretskii
2008-04-22 15:17                                         ` Michael Albinus
2008-04-29  7:50                                           ` Stefan Monnier
2008-04-29 18:15                                             ` Eli Zaretskii
2008-04-29 20:39                                               ` Stefan Monnier
2008-04-30  3:16                                                 ` Eli Zaretskii
2008-04-30  4:26                                                   ` Stefan Monnier
2008-04-30  6:23                                                     ` Drew Adams
2008-04-30  7:34                                                       ` Stefan Monnier
2008-04-30 13:57                                                         ` Drew Adams
2008-05-05 15:33                                                           ` Michael Albinus
2008-05-05 15:47                                                             ` Drew Adams
2008-05-05 15:57                                                               ` Michael Albinus
2008-05-05 16:12                                                                 ` Drew Adams
2008-05-05 18:31                                                             ` Stefan Monnier
2008-05-05 15:20                                             ` Michael Albinus
2008-05-05 18:26                                               ` Stefan Monnier
2008-04-21 19:29                                   ` Eli Zaretskii
2008-04-22 15:40                                     ` Michael Albinus
2008-01-27 20:43                 ` testing for a remote file to include file on a Windows mappeddrive Stefan Monnier
2008-01-29 15:46                   ` Michael Albinus
2008-01-30  6:15                     ` Richard Stallman
2008-01-30  7:43                       ` Michael Albinus
2008-01-30 14:24                         ` Stefan Monnier
2008-01-30 15:04                           ` Michael Albinus
2008-01-30 15:48                             ` Stefan Monnier
2008-01-30 16:04                               ` Michael Albinus
2008-01-30 17:49                                 ` Stefan Monnier
2008-01-30 16:04                           ` David Kastrup
2008-01-30 17:52                             ` Stefan Monnier
2008-01-30 19:50                               ` Michael Albinus
2008-01-30 21:33                                 ` Stefan Monnier
2008-01-31  9:07                                   ` Michael Albinus
2008-02-01 19:09                                     ` Stefan Monnier
2008-02-03 13:36                                       ` Michael Albinus
2008-02-04 21:55                                         ` Stefan Monnier
2008-02-05 15:52                                           ` Michael Albinus
2008-02-05 16:34                                             ` Stefan Monnier
2008-02-05 20:58                                               ` Michael Albinus
2008-02-05 22:21                                                 ` Stefan Monnier
2008-02-05 22:32                                                   ` Michael Albinus
2008-02-05 22:17                                               ` url-handler-file-remote-p (was: testing for a remote file to include file on a Windows mappeddrive) Michael Albinus
2008-02-06 14:44                                                 ` url-handler-file-remote-p Stefan Monnier
2008-02-06 20:37                                                   ` url-handler-file-remote-p Michael Albinus
2008-01-30 14:29                       ` testing for a remote file to include file on a Windows mappeddrive Stefan Monnier
2008-01-30 14:45                         ` Stefan Monnier
2008-01-31  1:05                         ` Richard Stallman
2008-01-31  1:56                           ` Stefan Monnier
2008-01-31 18:51                             ` Richard Stallman
2008-01-26 15:15           ` Jason Rumney
2008-04-21  4:25         ` Eric Hanchrow
2008-04-21  7:58           ` Andreas Schwab
2008-04-21  8:15             ` testing for a remote file to include file on aWindows mappeddrive Drew Adams
2008-04-21  8:48               ` Andreas Schwab
2008-04-21 17:08                 ` Drew Adams
2008-04-21 14:15               ` Stefan Monnier
2008-04-21 17:09                 ` Drew Adams
2008-04-21 17:52                   ` Stefan Monnier
2008-04-21 18:52                     ` Drew Adams
2008-04-21 19:24                       ` Stefan Monnier
2008-01-26  8:52   ` testing for a remote file to include file on a Windows mapped drive Eli Zaretskii
2008-01-25 22:11 ` Stefan Monnier
2008-01-26  8:50   ` Eli Zaretskii
2008-01-26 10:07 ` Eli Zaretskii
2008-01-26 16:55   ` Drew Adams
2008-01-26 17:26     ` Eli Zaretskii
2008-01-26 17:57       ` Drew Adams
2008-01-26 18:58         ` Eli Zaretskii

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=E1JoBye-0003wH-UH@fencepost.gnu.org \
    --to=eliz@gnu.org \
    --cc=drew.adams@oracle.com \
    --cc=emacs-devel@gnu.org \
    --cc=jasonr@gnu.org \
    --cc=michael.albinus@gmx.de \
    --cc=monnier@iro.umontreal.ca \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
Code repositories for project(s) associated with this external index

	https://git.savannah.gnu.org/cgit/emacs.git
	https://git.savannah.gnu.org/cgit/emacs/org-mode.git

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.