From mboxrd@z Thu Jan 1 00:00:00 1970 From: Ludovic =?UTF-8?Q?Court=C3=A8s?= Subject: bug#35181: Hydra offloads often get stuck while exporting build requisites Date: Tue, 09 Apr 2019 12:56:20 +0200 Message-ID: <87a7gzh2gb.fsf@gnu.org> References: <87mul17oo2.fsf@netris.org> <87imvp7ogv.fsf@netris.org> <20190407173105.GB1337@macbook41> <87ef6d6mdn.fsf@netris.org> <87pnpw29kp.fsf@gnu.org> <87k1g456nc.fsf@netris.org> Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Return-path: Received: from eggs.gnu.org ([209.51.188.92]:53878) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1hDoR5-00035s-3S for bug-guix@gnu.org; Tue, 09 Apr 2019 06:57:04 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1hDoR4-0005HQ-8b for bug-guix@gnu.org; Tue, 09 Apr 2019 06:57:03 -0400 Received: from debbugs.gnu.org ([209.51.188.43]:37058) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1hDoR4-0005HH-0j for bug-guix@gnu.org; Tue, 09 Apr 2019 06:57:02 -0400 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1hDoR3-0001hI-Rq for bug-guix@gnu.org; Tue, 09 Apr 2019 06:57:01 -0400 Sender: "Debbugs-submit" Resent-Message-ID: In-Reply-To: <87k1g456nc.fsf@netris.org> (Mark H. Weaver's message of "Mon, 08 Apr 2019 21:06:04 -0400") List-Id: Bug reports for GNU Guix List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-guix-bounces+gcggb-bug-guix=m.gmane.org@gnu.org Sender: "bug-Guix" To: Mark H Weaver Cc: 35181@debbugs.gnu.org Mark H Weaver skribis: > Also of note: So far, all known instances of this problem have occurred > while transferring a large directory, as opposed to a tarball. > > We have several packages with source tarballs _much_ larger than these > problematic source checkouts, and which are updated more much > frequently, and yet I've *never* seen an instance of this problem while > exporting a plain file to a build slave. For example, the upstream > IceCat and Firefox ESR tarballs are ~270 megabytes compressed, whereas > 'font-google-material-design-icons-3.0.1' source is only ~176 megabytes > _uncompressed_. > > I have no explanation for why the superficial form of the store item > should matter here, but maybe it's a clue. I know that plain > non-executable files in the store are handled somewhat differently in > the Nix model than directories or executable files, the latter > associated with the word "recursive", and requiring an additional layer > of encoding for purposes of serialization, but I'm not sufficiently > familiar with the details or relevant code. > > Ludovic, can you think of a reason why the file/directory distinction > could be relevant to this issue? No, I can=E2=80=99t see why it could make a difference. Ludo=E2=80=99.