From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.org!.POSTED!not-for-mail From: Christoph Michelbach Newsgroups: gmane.emacs.bugs Subject: bug#31862: 26.1; [feature request] Improve copying over a network connection in dired Date: Sat, 16 Jun 2018 20:23:26 +0200 Message-ID: <1529173406.941.8.camel@gmail.com> NNTP-Posting-Host: blaine.gmane.org Mime-Version: 1.0 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Trace: blaine.gmane.org 1529173330 24847 195.159.176.226 (16 Jun 2018 18:22:10 GMT) X-Complaints-To: usenet@blaine.gmane.org NNTP-Posting-Date: Sat, 16 Jun 2018 18:22:10 +0000 (UTC) To: 31862@debbugs.gnu.org Original-X-From: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane.org@gnu.org Sat Jun 16 20:22:06 2018 Return-path: Envelope-to: geb-bug-gnu-emacs@m.gmane.org Original-Received: from lists.gnu.org ([208.118.235.17]) by blaine.gmane.org with esmtp (Exim 4.84_2) (envelope-from ) id 1fUFpt-0006I1-OB for geb-bug-gnu-emacs@m.gmane.org; Sat, 16 Jun 2018 20:22:05 +0200 Original-Received: from localhost ([::1]:52430 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1fUFrz-0007SG-0n for geb-bug-gnu-emacs@m.gmane.org; Sat, 16 Jun 2018 14:24:15 -0400 Original-Received: from eggs.gnu.org ([2001:4830:134:3::10]:34315) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1fUFrn-0007Rr-0v for bug-gnu-emacs@gnu.org; Sat, 16 Jun 2018 14:24:03 -0400 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1fUFrm-0001YB-60 for bug-gnu-emacs@gnu.org; Sat, 16 Jun 2018 14:24:03 -0400 Original-Received: from debbugs.gnu.org ([208.118.235.43]:44104) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1fUFrm-0001Y0-1B for bug-gnu-emacs@gnu.org; Sat, 16 Jun 2018 14:24:02 -0400 Original-Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1fUFrl-0002UO-SM for bug-gnu-emacs@gnu.org; Sat, 16 Jun 2018 14:24:01 -0400 X-Loop: help-debbugs@gnu.org Resent-From: Christoph Michelbach Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Sat, 16 Jun 2018 18:24:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: report 31862 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: X-Debbugs-Original-To: bug-gnu-emacs@gnu.org Original-Received: via spool by submit@debbugs.gnu.org id=B.15291734219538 (code B ref -1); Sat, 16 Jun 2018 18:24:01 +0000 Original-Received: (at submit) by debbugs.gnu.org; 16 Jun 2018 18:23:41 +0000 Original-Received: from localhost ([127.0.0.1]:52001 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1fUFrR-0002Tm-3a for submit@debbugs.gnu.org; Sat, 16 Jun 2018 14:23:41 -0400 Original-Received: from eggs.gnu.org ([208.118.235.92]:43252) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1fUFrP-0002TZ-6H for submit@debbugs.gnu.org; Sat, 16 Jun 2018 14:23:39 -0400 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1fUFrJ-00016C-6z for submit@debbugs.gnu.org; Sat, 16 Jun 2018 14:23:34 -0400 Original-Received: from lists.gnu.org ([2001:4830:134:3::11]:59085) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1fUFrJ-000164-2S for submit@debbugs.gnu.org; Sat, 16 Jun 2018 14:23:33 -0400 Original-Received: from eggs.gnu.org ([2001:4830:134:3::10]:34223) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1fUFrG-0007Oy-Ck for bug-gnu-emacs@gnu.org; Sat, 16 Jun 2018 14:23:32 -0400 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1fUFrF-00014s-H4 for bug-gnu-emacs@gnu.org; Sat, 16 Jun 2018 14:23:30 -0400 Original-Received: from mail-wm0-x22c.google.com ([2a00:1450:400c:c09::22c]:38310) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1fUFrF-00014X-9f for bug-gnu-emacs@gnu.org; Sat, 16 Jun 2018 14:23:29 -0400 Original-Received: by mail-wm0-x22c.google.com with SMTP id 69-v6so8847999wmf.3 for ; Sat, 16 Jun 2018 11:23:29 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=message-id:subject:from:to:date:mime-version :content-transfer-encoding; bh=BnsHjInBr+tdxqxuuz9uGycDw2UsA4xc+r53HvMeAT0=; b=KswPqBHBtWrS1L6bTgODYe7cXMEQJj0V0Ti3vt/SpDLLZieodQTlo7gtiifnMO3MtX CYxGF5HIejelHmgvZG0JS2WiNZFD1Mv0+dZ7vcPfQ4pQr3UmX6sofxMFe47TR5WJwGkr G9oVqmupHLWBwOOf4jx5HVHNeb/TKUFlsD4jqtzP78hIRlMWB6mGhNnsR33HM6d0lhCb QUEH8qMmh6L1lrPfcp5QzDXfBnG5gRlLZoiYD3Sxe9BV0I71OWPBrZ4svlceXHbg5A5E 3EIH/uwEsf0MnMgrQntSu8VPSi7eLCvZovA9LvqlIdMovhwe8/7J3lXTpB1JxwFJzmLO euMQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:message-id:subject:from:to:date:mime-version :content-transfer-encoding; bh=BnsHjInBr+tdxqxuuz9uGycDw2UsA4xc+r53HvMeAT0=; b=GFv32Qbd7zAbTZOJVIIMkka9eQ42WDuLCTF+SozefUEp76cQjIhtkn9klGCj7OYnEG 7a2pSYZVdREJcKm/PuxwoPoof+oZeXNj/CL+lPyzPiKvpNAu/cRfawK96VJdAIaV+VnJ Mvvoq5kiaiGQwNR3gi74aO13RqzJMcLzbZsDTH2bLg+DNIomeir9xmlURmY++nmKsDjs HhGFyYM5EEdkubeOk5voyThmw4rEcjmNewaJPYXtcBWDGv7NZ2mMiEk4vFIib/NN8CYg DZq3cnMZIuTGS8Iqhz9mz9/CRNN44Th17Tk2K1MlP+N4suBvVdTyuvcaGqnlcz781XUb qDRA== X-Gm-Message-State: APt69E2+6v3k++car9KLmm0fVy8REnjeJDDFTqys4tOcYkPQLTONc5Qh 3aQRqiRH53M83ClG6VxFI/492A== X-Google-Smtp-Source: ADUXVKKmvjxFbFXXVLXGMVKLyYUI1ad0PTYZoqLTNGhbkSIN7bvEgsyE0QjQDKLcTm1+c4ibbR1VTw== X-Received: by 2002:a1c:f45:: with SMTP id 66-v6mr4392953wmp.124.1529173407877; Sat, 16 Jun 2018 11:23:27 -0700 (PDT) Original-Received: from ?IPv6:2a02:8071:21b0:3d00:197e:8105:a299:fab6? ([2a02:8071:21b0:3d00:197e:8105:a299:fab6]) by smtp.googlemail.com with ESMTPSA id p38-v6sm24163004wrc.11.2018.06.16.11.23.26 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sat, 16 Jun 2018 11:23:27 -0700 (PDT) X-Mailer: Evolution 3.18.5.2-0ubuntu3.2 X-detected-operating-system: by eggs.gnu.org: Genre and OS details not recognized. X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6.x X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 208.118.235.43 X-BeenThere: bug-gnu-emacs@gnu.org List-Id: "Bug reports for GNU Emacs, the Swiss army knife of text editors" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane.org@gnu.org Original-Sender: "bug-gnu-emacs" Xref: news.gmane.org gmane.emacs.bugs:147534 Archived-At: I noticed that copying many files via dired takes a lot of time when it's done over a network connection. This seems to be because every single file is compressed and then transmitted in sequence. To illustrate the problem: Create files on a server using these commands: mkdir /tmp/dir cd /tmp/dir dd if=/dev/urandom bs=1K count=10000 of=bigFile mkdir smallFiles cd smallFiles for i in {0..9999}; do dd if=/dev/urandom bs=1K count=1 of="smallFile""$i"; done Then copy the files over to your local machine using dired. Copying the big file took 5 seconds (including user interaction) via my network connection. Copying the small files with the same amount of data took almost 20 minutes. Can't you simply compress and transfer several small files at once (up to some limit so the server doesn't run out of RAM)? Of course copying small files takes longer than copying a big one of the same size as the small ones combined but this disparity is just way out of proportion.