From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp0 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id +JVbGyLpYmF1XQAAgWs5BA (envelope-from ) for ; Sun, 10 Oct 2021 15:22:42 +0200 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp0 with LMTPS id cPxBFSLpYmESYQAA1q6Kng (envelope-from ) for ; Sun, 10 Oct 2021 13:22:42 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 16D382AA1D for ; Sun, 10 Oct 2021 15:22:42 +0200 (CEST) Received: from localhost ([::1]:50890 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1mZYmn-0000C4-8i for larch@yhetil.org; Sun, 10 Oct 2021 09:22:41 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:48220) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mZYme-0000Bf-7k for guix-devel@gnu.org; Sun, 10 Oct 2021 09:22:32 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]:53208) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1mZYme-0007AG-01 for guix-devel@gnu.org; Sun, 10 Oct 2021 09:22:32 -0400 Received: from 91-160-117-201.subs.proxad.net ([91.160.117.201]:59244 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mZYmd-000156-KT; Sun, 10 Oct 2021 09:22:31 -0400 From: =?utf-8?Q?Ludovic_Court=C3=A8s?= To: Mathieu Othacehe Subject: Re: Disarchive update References: <87r1cu1pj5.fsf@inria.fr> <87ee8u4h7v.fsf@gnu.org> X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 19 =?utf-8?Q?Vend=C3=A9miaire?= an 230 de la =?utf-8?Q?R=C3=A9volution?= X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu Date: Sun, 10 Oct 2021 15:22:29 +0200 In-Reply-To: <87ee8u4h7v.fsf@gnu.org> (Mathieu Othacehe's message of "Sat, 09 Oct 2021 10:37:08 +0000") Message-ID: <87k0ilvwtm.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: guix-devel@gnu.org Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: "Guix-devel" X-Migadu-Flow: FLOW_IN ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1633872162; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-unsubscribe:list-subscribe:list-post; bh=C76Ufrm9mE0W1nxJWj9CfNo2ZcR95MoJl2IzKV+0qeI=; b=mLgbYFXaXPbsqwc5q3DWgCY0IcIHLIDDObKFc4xr3syVcUZ88uRzJIe6dRSKMM2cKEEhrk VRsuYGBWUoEm6fIqE8Usmn12L5Fj1YelYVQnBZcWUrPjY1Wgc1I/81cZ9CPkyH4f1MjMQG SEX4kB5RmOI8Y1a4/U7khZhAlIQdEysQmmk5DtLT5dJrzHow2eZ57qL65ZHVI/kTg3a6ef zBjcfSjNUmgz2VFkSTpkqLiGAW6iiVJjzGXw7Ye5yiF6ntIzwUy6zC6rJSPooNBOL6VhcC 1IqH50C2oLFxxhnX0hbfTmkZkEW++Zxnbl5FgdzOKeaK7lY6Q+r0bCxJjus0UA== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1633872162; a=rsa-sha256; cv=none; b=qAl93WCVfpp0TJMXbMAtAg74WcaNzhll9lCG4M7pZ7b+J+eFxBL6NOJY8SRg7/KbGR2kun s8kIKUqC57PBJR8fux1Bv0hqNCec8rXuLCzALZ9LGHjnOwAUYv+vlW3OG8d8J+0qTFIZz0 o4i61TqphGgsCguZPLIKndSNL6DMAbOme7CKGYCuUxhWji5HUYTA3PC9ESfX/JyaQeb9E8 VSevX4xlg6GmepXTzEaMRWMkJrYwVJqfUa+pWDpddr64IqnZIA2um+KvNpSrWbEZDgmj8e uE3Bc3K71zHZZVqqVZyW2z/TcWqjI7T2DWEtSYDZEC45dZo53dFQd6rysNHHRQ== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=none; dmarc=pass (policy=none) header.from=gnu.org; spf=pass (aspmx1.migadu.com: domain of guix-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-devel-bounces@gnu.org X-Migadu-Spam-Score: -2.91 Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=pass (policy=none) header.from=gnu.org; spf=pass (aspmx1.migadu.com: domain of guix-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-devel-bounces@gnu.org X-Migadu-Queue-Id: 16D382AA1D X-Spam-Score: -2.91 X-Migadu-Scanner: scn0.migadu.com X-TUID: TJHDBEM906fw Hi! Mathieu Othacehe skribis: >> https://ci.guix.gnu.org/eval/29213?status=3Dsucceeded > > Nice! It looks like an expensive operation, maybe we should increase its > period to 24 hours or so? Yes, I=E2=80=99ve made it 12 hours now. :-) It shouldn=E2=80=99t be too expensive: there=E2=80=99s one derivation per t= arball disarchive and very few of them get rebuilt between subsequent evaluations; disarchive-collection.drv depends on all of them. However, I think the current model of Cuirass means that those intermediate derivations aren=E2=80=99t retrieved on berlin so we=E2=80=99r= e potentially building things multiple times? >> 2. On berlin, add an mcron job that periodically copies the output of >> the latest =E2=80=9Cdisarchive-collection=E2=80=9D build to a direc= tory, say >> /srv/disarchive. Thus, the database would accumulate tarball >> metadata over time. > > We could add the result as a "build-product" so that it is available at: > https://ci.guix.gnu.org/search/latest/disarchive-collection. The mcron > job could use this URL to fetch the latest archive. That=E2=80=99d be nice! How do we do that again? I was planning on retrieving the derivation file name in the mcron job using the (guix ci) API, but having a build product may simplify things a bit. Thanks for your feedback! Ludo=E2=80=99.