From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp10.migadu.com ([2001:41d0:8:6d80::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms9.migadu.com with LMTPS id qLbcFFWQe2QhUAEASxT56A (envelope-from ) for ; Sat, 03 Jun 2023 21:11:17 +0200 Received: from aspmx1.migadu.com ([2001:41d0:8:6d80::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp10.migadu.com with LMTPS id +KEGFFWQe2ToRAEAG6o9tA (envelope-from ) for ; Sat, 03 Jun 2023 21:11:17 +0200 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id BF6CF1BF95 for ; Sat, 3 Jun 2023 21:11:16 +0200 (CEST) Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1q5WeV-0001AH-VR; Sat, 03 Jun 2023 15:11:03 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1q5WeU-00019G-JO for guix-patches@gnu.org; Sat, 03 Jun 2023 15:11:02 -0400 Received: from debbugs.gnu.org ([209.51.188.43]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1q5WeU-0002Ar-BT for guix-patches@gnu.org; Sat, 03 Jun 2023 15:11:02 -0400 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1q5WeT-0002tP-VC for guix-patches@gnu.org; Sat, 03 Jun 2023 15:11:01 -0400 X-Loop: help-debbugs@gnu.org Subject: [bug#62153] [PATCH 0/2] Add Docker layered image for pack and system Resent-From: Oleg Pykhalov Original-Sender: "Debbugs-submit" Resent-CC: guix-patches@gnu.org Resent-Date: Sat, 03 Jun 2023 19:11:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 62153 X-GNU-PR-Package: guix-patches X-GNU-PR-Keywords: patch To: Greg Hogan Cc: 62153@debbugs.gnu.org Received: via spool by 62153-submit@debbugs.gnu.org id=B62153.168581942811066 (code B ref 62153); Sat, 03 Jun 2023 19:11:01 +0000 Received: (at 62153) by debbugs.gnu.org; 3 Jun 2023 19:10:28 +0000 Received: from localhost ([127.0.0.1]:44315 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1q5Wdw-0002sP-BI for submit@debbugs.gnu.org; Sat, 03 Jun 2023 15:10:28 -0400 Received: from mail-lj1-f170.google.com ([209.85.208.170]:38064) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1q5Wdr-0002s3-Fb for 62153@debbugs.gnu.org; Sat, 03 Jun 2023 15:10:27 -0400 Received: by mail-lj1-f170.google.com with SMTP id 38308e7fff4ca-2b1b1dd208dso3267291fa.0 for <62153@debbugs.gnu.org>; Sat, 03 Jun 2023 12:10:23 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1685819417; x=1688411417; h=mime-version:user-agent:message-id:in-reply-to:date:references :subject:cc:to:from:from:to:cc:subject:date:message-id:reply-to; bh=2dz+7HlpM0CpG71xUvwWd7jmSIkaK4R84zQ2Wkw9A80=; b=UR8qPywuD0uv0EXU+JQnO0ehm1MsfQDZ9pOdqOtUn/qFH1f5jS7vhCbcXnzICl6qiV nbQ3a8lJcEhszkoU+IChn0uOt3Wx71/f7ON+ZJRODAAFkRgcvrur2uoHd6pwIRrk7Gd2 CCRXhdm7YEytEdoltJL1djvhvVzu03/33g+bUJLixhAXFd0UA6UZyq1svCrjq4J0yKOC TEp01iBUkY7dcO/5re4jM8yYQTAKnkGFZfk9hU7DEKdYLrP7YL7rHYLrJJOC3gquQuUc 5PFErMHk8QalG5O/iO72aRRzib9Ha7e4bZTePqkDUVjRnQgToCQVxbOAH7UOGJFwe2Es Z3+w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1685819417; x=1688411417; h=mime-version:user-agent:message-id:in-reply-to:date:references :subject:cc:to:from:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=2dz+7HlpM0CpG71xUvwWd7jmSIkaK4R84zQ2Wkw9A80=; b=HRe84FqWgQGHYrytVjUPat+T40/rD3iq0vQtUB19gtYc4owW2R2cV2fAroZ0ZSFCHu iO9V2YYDEAXxFKdEGmRxRjEVm7PiYe2+XSjXalDWGnCq6OZTIA4lN+rphgeb1LsXY9zF yeVnxlOq9txW07BY73VrAUHgYL+e1auFimhE8jICQm76L/Q5H1rJ26qpcZAQwwlaazX+ o3BHy6TsWtnHYr5oec3kI6V/NlsRj1wwmm9fvR8Kmuf1HmbZd1Nzgxn/2VLKlHb1Tw15 b4ob1I6niGVUXCunK7BYSeGgVZriTTWVibytq1RCDvRKfs+FmZNhi6M3tco3EAadB1Bk 8h4Q== X-Gm-Message-State: AC+VfDyESb7Q1Ja+prVFMLB5Q7PJzHtxYnZ94TGbYD+iREZFeLr6nuUd syGGzjEVMx8PtPP27u5RPfTbvravKtk= X-Google-Smtp-Source: ACHHUZ4qeOdboX6LlMaql8rK2BYOAtGIOk2AZ+Hr2XHBdm3jEkEbmEqoYQYy/rVLG6H/oe0wPXgQDA== X-Received: by 2002:ac2:43b1:0:b0:4f6:19bf:1a32 with SMTP id t17-20020ac243b1000000b004f619bf1a32mr692111lfl.4.1685819417109; Sat, 03 Jun 2023 12:10:17 -0700 (PDT) Received: from localhost ([88.201.161.72]) by smtp.gmail.com with ESMTPSA id c21-20020ac244b5000000b004eb2ac90f36sm553957lfm.207.2023.06.03.12.10.16 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sat, 03 Jun 2023 12:10:16 -0700 (PDT) From: Oleg Pykhalov References: <20230313003012.14325-1-go.wigust@gmail.com> <87cz2gd4mm.fsf@gmail.com> Date: Sat, 03 Jun 2023 22:10:15 +0300 In-Reply-To: (Greg Hogan's message of "Fri, 2 Jun 2023 13:02:38 -0400") Message-ID: <87y1l0icq0.fsf_-_@gmail.com> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.2 (gnu/linux) MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha512; protocol="application/pgp-signature" X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-BeenThere: guix-patches@gnu.org List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-patches-bounces+larch=yhetil.org@gnu.org Sender: guix-patches-bounces+larch=yhetil.org@gnu.org X-Migadu-Country: US X-Migadu-Flow: FLOW_IN ARC-Seal: i=1; s=key1; d=yhetil.org; t=1685819476; a=rsa-sha256; cv=none; b=skOoV7zcqv+RVayyRfFLppDnH5BvVdi1nzOd8mTSQGWuxDvOnSieUae6knjUSClK8Q598w fx7BqUsCVEolwyglSuibrKtfeDMWCzBErzvuns8W6Of3aNMWfYwWqTIXorxTaTJbKpgjHx WR5202vytmHMiSeoNAfYRuD+FtEUbXhxjJCFTZUzc2vQA26mrcb9Df5KCXyQsj6+bzrQRZ rRTFU3JBlluSm6WdZwjs1t74V/kzaDmHxkcCkGG3iOhmwXxKT+EufKMEb3sGYvqI+qSnvM R8FWoqtgdBHx59HZ/a2ZeCr4RdhvdWqCujD100Z3ZS4QbXopZq1NNpw3TDYSng== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=fail ("headers rsa verify failed") header.d=gmail.com header.s=20221208 header.b=UR8qPywu; dmarc=fail reason="SPF not aligned (relaxed)" header.from=gmail.com (policy=none); spf=pass (aspmx1.migadu.com: domain of "guix-patches-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-patches-bounces+larch=yhetil.org@gnu.org" ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1685819476; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:resent-cc:resent-from:resent-sender: resent-message-id:in-reply-to:in-reply-to:references:references: list-id:list-help:list-unsubscribe:list-subscribe:list-post: dkim-signature; bh=2dz+7HlpM0CpG71xUvwWd7jmSIkaK4R84zQ2Wkw9A80=; b=om+aOzVCPA9fc+1DjwUW+f/PLegPvA7ECqmLXiZL2x3rqPz2m4ln8RyY51n8ofidgkb2ck e83o+uKgNwh0SZpO7OvYwCURtnbyQNF4OQ08zAN4v60rRM1zUfFP6LlFgkSoniTgTxBvSs upwb65EXAM04wASZ3BLZqLiEEhpfUZ4t0/LeXDHcU2PtP4P1U+bfjyA/f82Xz3NWGug3K9 XDzBTWmoPNkdQzZ7I0pXTdKOohXIUe4x+nvOiWsauvhMF6JAYyPmLYU0NudnRmG1fI8fWn evdCM/LvBKMEvFKLOW4BIAj4dBkQgrLjEBF35Cvxo1JrrVwqzQrcUV/6+bmfeg== Authentication-Results: aspmx1.migadu.com; dkim=fail ("headers rsa verify failed") header.d=gmail.com header.s=20221208 header.b=UR8qPywu; dmarc=fail reason="SPF not aligned (relaxed)" header.from=gmail.com (policy=none); spf=pass (aspmx1.migadu.com: domain of "guix-patches-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-patches-bounces+larch=yhetil.org@gnu.org" X-Migadu-Scanner: scn0.migadu.com X-Migadu-Spam-Score: -5.78 X-Spam-Score: -5.78 X-Migadu-Queue-Id: BF6CF1BF95 X-TUID: 6yi2gG3jO2Jy --=-=-= Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Greg Hogan writes: > On Wed, May 31, 2023 at 9:14=E2=80=AFAM Oleg Pykhalov wrote: > [...] >> Do you mean use layered images by default without ability to build all >> in a single layer? Current layered implementation is slow to build >> because it needs to calculate a size of each layer, pack, and compress. >> So if user wants a faster build, a non-layered image is still an option. >> >> Regards, >> Oleg. > > I am trying out your patch, and wanted to benchmark the runtime > difference between docker and docker-layered packs, but the latter > looks to be failing with any compression other than the default gzip. > In particular, I was looking to disable compression with > '--compression=3Dnone'. I'll send a fixed v4 revision for '--compression=3Dnone'. Unfortunately, because we cannot append to an existing compressed tarball: tar: Cannot update compressed archives Try 'tar --help' or 'tar --usage' for more information. adding more compression types requires to write a handler for every compressor separately in guix/docker.scm file: =2D-8<---------------cut here---------------start------------->8--- (if layered-image? (begin (invoke "tar" "-rf" "image.tar" "config.json") (if compressor (begin (apply invoke `(,@compressor "image.tar")) (copy-file "image.tar.gz" image)) (copy-file "image.tar" image))) =2D-8<---------------cut here---------------end--------------->8--- I would like to vote that addional compressors could be added later if needed. Regards, Oleg. --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQJIBAEBCgAyFiEEcjhxI46s62NFSFhXFn+OpQAa+pwFAmR7kBgUHGdvLndpZ3Vz dEBnbWFpbC5jb20ACgkQFn+OpQAa+pxoKA//fUia6BxwXHIQNdFmQueeIVN7RUvr gx19n9Qpe3rmkqRwdXqqk9V81daqSYtEwm9/vpvo2HO85yliUxkMUOiHRQLJxOPQ X0Vx1v871DyXkdg4D9Jh1/GE6sjqcT8Jka5u8pFB5LAPVto12tqy+0+lMxP4AcqX X6GxWuEClj6yB+nqtE/00xul6qDF1YaHAeOrMJjpYf4y1dwBYw9WFQwJJvVuXxdE WukW6F9qTqj9qXrG0+EkamWQjWcmKrSkv7+aTskIK/xdEuXor2OSOC2o6Tff7K7p GeePvEdDIGetiV5bNVU4EwewvJH/oF/FFZcPdvBx0DCUJ8AeVMEzwqnWExTW/UXe pTqQH3dwTNhnh1tDhAAEKXhcBuOntmiCp5knArmCCirpzyW+c7rZ/F8JVC5vZJTf PS3x9O+R3ZkueoimoQzSd/JGPSH1eh2O8SMNy42QB1w4j3SLEkv0ShsswCbkdMhk OXy/wjqo9GJRRMRNTYAxeu7OLDOwM5RrhBX3s2g0Nu+6YEa3ISDU7s4qEBbQHNFW lD0dplzXNZudhLab/xTP/ptgqsh7SoaYszsRitz+noT35DuaJt7wwm7Qp+rn55ve PqMd+P94YCrzq8RslsUfpEE+VBJKxJbFnNTZdkaDqAI/HCwWSSe9gzag3zsYpQDx 8blQqUJbYRIXBiE= =xQTj -----END PGP SIGNATURE----- --=-=-=--