From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp1 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms11 with LMTPS id GFKENC10015uLQAA0tVLHw (envelope-from ) for ; Sun, 31 May 2020 09:09:01 +0000 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp1 with LMTPS id ct0yMC10014bcQAAbx9fmQ (envelope-from ) for ; Sun, 31 May 2020 09:09:01 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 6CCD29407C5 for ; Sun, 31 May 2020 09:09:01 +0000 (UTC) Received: from localhost ([::1]:33582 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1jfJxk-0007rf-1O for larch@yhetil.org; Sun, 31 May 2020 05:09:00 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:44516) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1jfJxd-0007rZ-GI for help-guix@gnu.org; Sun, 31 May 2020 05:08:53 -0400 Received: from mail-qv1-xf33.google.com ([2607:f8b0:4864:20::f33]:38519) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1jfJxc-0004Cb-HP for help-guix@gnu.org; Sun, 31 May 2020 05:08:53 -0400 Received: by mail-qv1-xf33.google.com with SMTP id ec10so534505qvb.5 for ; Sun, 31 May 2020 02:08:52 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=eAOJnAa6A3pg8HOztXku1XtC8r3p7gTkCf9kzE3kqoA=; b=UgjBJV8Q2zsSH04RaB0K2dZ8sdclg6RNfAoDtfHsMrUuscAk0JYZaCm593q/w99wo7 u6ARi8hSWeRFAcLupN+/nlkCUjXeEGS51doaUGWXdDfXed7cbn9c/ec8/EVvOXa0BTk9 QJKs3StJ0DaFokoxsjrlGNymGe2vB5uYoIl1UG4FzhOc6oC34m96twCMMXCEW/dzhsU8 etTX8eAyNy40FtOLslASTzIkW37QQ3CR/Ty1umZ9SzBUwKcp5kIf8hC/DSiZ0L7kcbl/ wfuNwH5/JVAZeg//uI6kmi8IKVkqkxFXBfpZU/rpuGvNXUtcuLpUYizrPrDgSyZ4cEV0 SJQQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=eAOJnAa6A3pg8HOztXku1XtC8r3p7gTkCf9kzE3kqoA=; b=ROw28q8Hkmi+L+B0wp15FrZDtQdyZy/vKC/z1kAVCC9lnyRA70dEx2TSeXQpbVA1w6 bwkoPMwZVVWEUZnUyVxEX4rBWFdUoDd+kY7g2LYEuGroGkvM1KupXTcZhCIqOjx/Lw79 SD0Lagm8v+fCCOEh8dg+snHz8N/omuhT86jSesjBDjzyz9gzsOAWNP9ivIU5HUdZv0Ug n5zfSAaVO4iIW3QGgeHuioZKrKipCZK6aA7LKEySn3Sv0VWkGbN7XSm5a9tUNJ0NmdpU 9/NO7XdImRNTKSPnxdwIiMecHYrbLemrqFJDU9zRQ7IY+H7d1X22kNj/Qp9uhBZsFt4Y jdvg== X-Gm-Message-State: AOAM532saOWm83KxNvHgbEzhaE6RrKN4hrmnmbIPPXTMJsNFaJkfG18k mJ33HmQD50UBgAaXLqfvYa3VqxvbM/aw/rqoqvg= X-Google-Smtp-Source: ABdhPJw0HMbBGlZRM//mtUo7JaIUMa9+ex6GhAE2GIX+lS/OfeCGG7dW1/kPJrLjJFvgu5mvplhpRG9NEP+duTtE0fE= X-Received: by 2002:ad4:536a:: with SMTP id e10mr15371218qvv.246.1590916131488; Sun, 31 May 2020 02:08:51 -0700 (PDT) MIME-Version: 1.0 References: <87h7vyxqrz.fsf@gmail.com> <87367glo7c.fsf@gmail.com> In-Reply-To: <87367glo7c.fsf@gmail.com> From: zimoun Date: Sun, 31 May 2020 11:08:39 +0200 Message-ID: Subject: Re: Guix Docker image inflation To: Chris Marusich Content-Type: text/plain; charset="UTF-8" Received-SPF: pass client-ip=2607:f8b0:4864:20::f33; envelope-from=zimon.toutoune@gmail.com; helo=mail-qv1-xf33.google.com X-detected-operating-system: by eggs.gnu.org: No matching host in p0f cache. That's all we know. X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001 autolearn=_AUTOLEARN X-Spam_action: no action X-BeenThere: help-guix@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: help-guix , Stephen Scheck Errors-To: help-guix-bounces+larch=yhetil.org@gnu.org Sender: "Help-Guix" X-Scanner: scn0 Authentication-Results: aspmx1.migadu.com; dkim=fail (rsa verify failed) header.d=gmail.com header.s=20161025 header.b=UgjBJV8Q; dmarc=fail reason="SPF not aligned (relaxed)" header.from=gmail.com (policy=none); spf=pass (aspmx1.migadu.com: domain of help-guix-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=help-guix-bounces@gnu.org X-Spam-Score: 0.09 X-TUID: kgvK2bkqhkd8 Hi Chris, On Sun, 31 May 2020 at 06:32, Chris Marusich wrote: > I would guess that the size difference between A and B is approximately > the same as the difference between A and C. It'll be different, of > course, but generally the size difference between A and C should not > grow linearly with time, since "guix pull" is only going to install at > most the total closure of things necessary to build and run Guix, which > doesn't increase much in size as time goes on. However, when you > daisy-chain the images every day, the image size will grow linearly with > time because the contents of all the previous layers is carried forward. Exactly and it is not specific to Guix but it is how Docker works, if I understand correctly. > - Your script runs "docker commit" while guix-daemon (and other > programs) are still running. To ensure the guix-daemon's database (or > other things) does not become corrupt, consider terminating all > processes before committing the new image. Do you think the GC issue comes from this? Because "docker stop" and then "docker commit" does not change the issue. The GC is still confused by trying to delete items than are not in the store. Roughly speaking, "guix gc" says it removes items of size 0, but then "guix gc --references" says the path does not exist. --8<---------------cut here---------------start------------->8--- / # /root/.config/guix/current/bin/guix gc /root/.config/guix/current/bin/guix gc [...] / # /root/.config/guix/current/bin/guix gc --list-dead | grep hello /root/.config/guix/current/bin/guix gc --list-dead | grep hello finding garbage collector roots... determining live/dead paths... /gnu/store/kg9mirg6xbvzcp0a98v7326n1nvvwgsj-hello-2.10 / # /root/.config/guix/current/bin/guix gc --references /gnu/store/kg9mirg6xbvzcp0a98v7326n1nvvwgsj-hello-2.10 /root/.config/guix/current/bin/guix gc --references /gnu/store/kg9mirg6xbvzcp0a98v7326n1nvvwgsj-hello-2.10 guix gc: error: path `/gnu/store/kg9mirg6xbvzcp0a98v7326n1nvvwgsj-hello-2.10' is not valid --8<---------------cut here---------------end--------------->8--- > I apologize for not reading your thread more closely to begin with. I > took a closer looks, and I think I can explain what is going on now. > Please check the bug report and reply there if anything is unclear. Ah sorry, maybe you always addressed these questions in the bug report. Cheers, simon