From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp12.migadu.com ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id cMFTJbvzC2KtWgEAgWs5BA (envelope-from ) for ; Tue, 15 Feb 2022 19:40:59 +0100 Received: from aspmx1.migadu.com ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp12.migadu.com with LMTPS id ILjJIbvzC2LwJgEAauVa8A (envelope-from ) for ; Tue, 15 Feb 2022 19:40:59 +0100 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 57AD045C64 for ; Tue, 15 Feb 2022 19:40:59 +0100 (CET) Received: from localhost ([::1]:36860 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1nK2ky-0007iP-UR for larch@yhetil.org; Tue, 15 Feb 2022 13:40:58 -0500 Received: from eggs.gnu.org ([209.51.188.92]:57274) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nK2ig-0007fI-Mf; Tue, 15 Feb 2022 13:38:37 -0500 Received: from mira.cbaines.net ([212.71.252.8]:36312) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1nK2iY-00076R-PK; Tue, 15 Feb 2022 13:38:30 -0500 Received: from localhost (unknown [IPv6:2a02:8010:68c1:0:8ac0:b4c7:f5c8:7caa]) by mira.cbaines.net (Postfix) with ESMTPSA id C9A6827BBE9; Tue, 15 Feb 2022 18:38:23 +0000 (GMT) Received: from capella (localhost [127.0.0.1]) by localhost (OpenSMTPD) with ESMTP id 44f3d1a3; Tue, 15 Feb 2022 18:38:23 +0000 (UTC) References: <878rum1pph.fsf@gmail.com> <87h791s5fr.fsf@gnu.org> <87r184l3sg.fsf@gnu.org> User-agent: mu4e 1.6.10; emacs 27.2 From: Christopher Baines To: Mathieu Othacehe Subject: Re: Dropping gzip-compressed substitutes Date: Tue, 15 Feb 2022 18:29:33 +0000 In-reply-to: <87r184l3sg.fsf@gnu.org> Message-ID: <87mtisc6w2.fsf@cbaines.net> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha512; protocol="application/pgp-signature" Received-SPF: pass client-ip=212.71.252.8; envelope-from=mail@cbaines.net; helo=mira.cbaines.net X-Spam_score_int: -18 X-Spam_score: -1.9 X-Spam_bar: - X-Spam_report: (-1.9 / 5.0 requ) BAYES_00=-1.9, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: guix-devel , guix-sysadmin , Maxim Cournoyer Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: "Guix-devel" X-Migadu-Flow: FLOW_IN X-Migadu-Country: US ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1644950459; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:in-reply-to:in-reply-to: references:references:list-id:list-help:list-unsubscribe: list-subscribe:list-post; bh=PQpyS5sIB8TfkMEf+k755MCo8Ng6SZumcEBnuBhJW90=; b=iS0plVnBnhB7iW6dVE2QAxN12Nfxr9aSITzPfZjTTFwxbczhKPkKmxvowFT11U89FYB8Yd jCpJHhn+k69KO23JPaYhuadRboV51RvUFpTXcTEScDElkswwe6C8CYri8ub3YcvsMd77E5 LHlAYhcXN1zA3ZeCvH1wZaxcQRJ+YeKw4AJqtQSh85vD3Sve6IQxFIdUQIto/etwSQvRJO DLqdnLt1mHaTk4NBQG8cRhkHWoFnmYsGf/Fkbk6Lz+wfgOMRz2a0c2qDY8R3GAkp0fgO7o /WFpadHPFSP7zN5KdPtU0GJdRZEGvuFoa9fnu241QRkeroeI8RDZVDumihV8VA== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1644950459; a=rsa-sha256; cv=none; b=cHvpNVpiuaTl7hfpr0LZoGSpCd7V0odffbvPuHJZKNNDlu1Q++P9ife27wAWLRP9ddhVV4 bCr0DMoh7LztSGp/KuPWr3vICfRsP6kF05QYWChEzowbWP6goTo0Lbpbul+5ChvcWm5BNk oIh91iZGG2YrnuN7AABkYq/nWWKZ8gn9sJItOTuIAC4hSBTs30U4t5YZIYtHPHAWv3pB1s b+GlokLb/WrxPP1a+ojdQEZOHLLlYeJmkOCyI6mtiL72KnqpH3/rFu9HmCXGkOzo3PJFwj 88zueyh3fFzBqRanJ1E2wsDPJXDMNk67+EiCeaR/V1jQuvlc1pWcGJTlRiAPNQ== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" X-Migadu-Spam-Score: -5.73 Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" X-Migadu-Queue-Id: 57AD045C64 X-Spam-Score: -5.73 X-Migadu-Scanner: scn0.migadu.com X-TUID: bCbF8aoMFQiZ --=-=-= Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Mathieu Othacehe writes: >> I like Chris Baines=E2=80=99 idea of decoupling nar distribution from nar >> building. If we want to keep nars long enough so that =E2=80=98time-mac= hine=E2=80=99 is >> usable, then storage requirements will keep growing. >> >> Perhaps that means we can regularly copy nars =E2=80=9Celsewhere=E2=80= =9D for long-term >> storage, using nar-herder, rsync, or whatever. The machine that stores >> nars long-term has low requirements compared to the build farm because >> we don=E2=80=99t need to trust it for anything other than storage. If t= hat >> makes things easier (and financially viable), a VPS is good enough. > > Sure, the VPS would also allow us to have a less European-centric > hosting. I did not follow closely the development of the > nar-herder. Chris what improvements this tool would bring compared to a > rsync based approach? There's some discussion of this in the README [1]. 1: https://git.cbaines.net/guix/nar-herder/about/ I think the short answer for the moment though is the nar-herder doesn't do anything that you couldn't do with rsync. I jumped straight in with Guile+SQLite rather than using rsync+files because I think the performance for various operations will scale better this way, and it'll lead on to more advanced functionality, like doing GC like operations, metrics and tagging nars. --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQKlBAEBCgCPFiEEPonu50WOcg2XVOCyXiijOwuE9XcFAmIL8x1fFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldDNF ODlFRUU3NDU4RTcyMEQ5NzU0RTBCMjVFMjhBMzNCMEI4NEY1NzcRHG1haWxAY2Jh aW5lcy5uZXQACgkQXiijOwuE9XeZVRAAtiykaDbCD8EY5R2r2T7bBzsAr2dLOn+u jcApeDVhwWVe6i7QAP67smFAAFA6YhVTWudMxfYAq4WyLp+gZZE6ROfpG/4+8p0g a4P56ufQqeZh+q1q+f4cpFQBG4Ibv3H1h3pGHQBlPkz5nCGqV+pTwVcuzW7Afj70 OSNcG0i9c8mjsYT8QarGc5VCe+9dZf7lVCAmlJmIlXD1fkvDXVnBDbNV2jCFyBl2 LYQ01VAy3ZEMDpA8ieZq6XocYMNL0LQpJSaEcOOLOLwTBwHCbHWXjPjNCZT0AnW/ yPnoEna/FkplIitEA0lRSeCmu5DiQhT8G/Wb/Cv3ZiwUXijchj1XsNR7duoH5/ka 0r3Nvm3Py0xFS1vTuvjcp1AV2LFW7rLi3R+bFJucSD6MRguRsyywv6bMzToQWryl MkD7U1GOqOiKCMebypF4evmGY6v3CstII9gRjigYOqGor+WtXZDUahl5LrYLjfbR awwwjSmV5l0nHAwYvbatK+SIDFDz7ikrCgHIL3+njTw2WuApBcgv50K4Po+8RN86 CZzw7oJrEpPOPCZR1mPcZgGvX3/1MS/VA9RFG4W5tpcpXia0twZhLMdHFyYhHrHL jQ+WZP5kG/ASIQu2s1JYbKx9PtzYSl6pPvhfuUOZ0O9ruwVSAH6nk6GerqmpiUfP ME/cvk9XHzg= =agG8 -----END PGP SIGNATURE----- --=-=-=--