From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp0 ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id CIO5BiHhTGHwcgEAgWs5BA (envelope-from ) for ; Thu, 23 Sep 2021 22:18:41 +0200 Received: from aspmx1.migadu.com ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp0 with LMTPS id SNdgAiHhTGHKdAAA1q6Kng (envelope-from ) for ; Thu, 23 Sep 2021 20:18:41 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id B90EB28AAE for ; Thu, 23 Sep 2021 22:18:40 +0200 (CEST) Received: from localhost ([::1]:53094 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1mTVB1-0002s4-PJ for larch@yhetil.org; Thu, 23 Sep 2021 16:18:39 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:51416) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mTVAY-0002qi-T5 for guix-devel@gnu.org; Thu, 23 Sep 2021 16:18:11 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]:58760) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1mTVAY-0005vd-JT; Thu, 23 Sep 2021 16:18:10 -0400 Received: from [2a01:e0a:1d:7270:af76:b9b:ca24:c465] (port=36046 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mTVAW-0004vS-66; Thu, 23 Sep 2021 16:18:10 -0400 From: =?utf-8?Q?Ludovic_Court=C3=A8s?= To: zimoun Subject: Re: guix weather -m etc/sources-manifest.scm and CI? References: X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 2 =?utf-8?Q?Vend=C3=A9miaire?= an 230 de la =?utf-8?Q?R=C3=A9volution?= X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu Date: Thu, 23 Sep 2021 22:18:06 +0200 In-Reply-To: (zimoun's message of "Wed, 15 Sep 2021 19:03:05 +0200") Message-ID: <87a6k39hc1.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Guix Devel Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: "Guix-devel" X-Migadu-Flow: FLOW_IN ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1632428320; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-unsubscribe:list-subscribe:list-post; bh=CN7Ws5CgjdkAYOWECIOcXgd9RKO8ayr1Eixpc1d0EDU=; b=lV4DuF/2IQN7UBOY03ediyEtqcvC0c5RxFQkRq89nA4ruIwK7sY8WaVE2Rg8T3h5QiH7/Q zeKupwp6Qst58PyREzIaKsBXgiJiFCTjUHGWKSL38veXawcj1ItBYyC4tSeqBevs08xrbq 5eHGyVRGT+iL0uYkbaWqkfpN8IRPFI2S/uG7bwO5G6bhIxNWV84mRMk1FQJZPJagL5jI8l os+XqmvvZLz+dhe237k2pFDmKsQFUN6ErXLi8wgRqDyKNCJa00g7pDFOoGAMLzTTUJv+K7 szkFB5V+HwZ9RBByi/Ts5d/NYjQ983XUTLAkexZcQjLSzG+Vl+J+z7Gj138IdQ== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1632428320; a=rsa-sha256; cv=none; b=Q+yIARSZCcKKJdTLV6l3KEUX5ly2LsrkTdC33oQ9UP8fZOdG6EZ4KstfJrZifbwY/OgpnA VkMlvHqNb9QT+7K56VfB9+2K9eDtEO5YqRSxdm/5HenxbkhEI0+aSG51PsidNjGlJ7t+v1 JKhzyCPgNZo88qwjzoJc3OUldDYlWwrcEjmkLjyCpXpH3d5LxXeUPidzpnVeaaOtyKlSMb dReJrRaQjA+5Dg0ndDv4oEvPzRvAWIf/D0PUiEgxYuZJa/OIXS67fIIdtdbn8kJHHcQAcY uevPQcA6QcZojcDCh+aaDa+fR0BpAFSGYi8TlwBpMLvdRnhQ+PDM7i6sQQImww== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=none; dmarc=pass (policy=none) header.from=gnu.org; spf=pass (aspmx1.migadu.com: domain of guix-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-devel-bounces@gnu.org X-Migadu-Spam-Score: -0.99 Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=pass (policy=none) header.from=gnu.org; spf=pass (aspmx1.migadu.com: domain of guix-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-devel-bounces@gnu.org X-Migadu-Queue-Id: B90EB28AAE X-Spam-Score: -0.99 X-Migadu-Scanner: scn1.migadu.com X-TUID: TDfRFF+EAfdu Hello! zimoun skribis: > Playing with the new 'etc/sources-manifest.scm', using fb32a38, I get: > > $ guix weather -m ~/src/guix/guix/etc/source-manifest.scm > computing 16,831 package derivations for x86_64-linux... > looking for 16,831 store items on https://ci.guix.gnu.org... > https://ci.guix.gnu.org > 74.6% substitutes available (12,556 out of 16,831) > at least 65,367.1 MiB of nars (compressed) > 81,988.1 MiB on disk (uncompressed) > 0.095 seconds per request (1,606.8 seconds in total) > 10.5 requests per second > > 0.0% (0 out of 4,275) of the missing items are queued > 5 queued builds > aarch64-linux: 4 (80.0%) > powerpc64le-linux: 1 (20.0%) > build rate: .00 builds per hour > powerpc64le-linux: 0.00 builds per hour > aarch64-linux: 0.00 builds per hour > i686-linux: 0.00 builds per hour > x86_64-linux: 0.00 builds per hour > looking for 16,831 store items on https://bordeaux.guix.gnu.org... > https://bordeaux.guix.gnu.org > 99.8% substitutes available (16,804 out of 16,831) > 62,195.0 MiB of nars (compressed) > 108,212.7 MiB on disk (uncompressed) > 0.049 seconds per request (829.2 seconds in total) > 20.3 requests per second > (continuous integration information unavailable) > > > The questions are: > > Why ci.guix.gnu.org contains only 75%? And bordeaux almost everything? > (I guess the missing ones on bordeaux are corner cases as icecat, linux-l= ibre). I wonder too! BTW, I meant to send a message here about these two manifests, and then got caught in a crazy patch-review/bug-fix/work loop. The goal of this manifest is to run =E2=80=98weather=E2=80=99 and =E2=80=98build=E2=80=99 so= we can get all the source and check the status at once, as you found out. I set up a Cuirass job the other day=C2=B9, but due to my aforementioned disorganization, I haven=E2=80=99t yet taken the time to investigate its failure. =C2=B9 https://ci.guix.gnu.org/jobset/source > Does it make sense to duplicate the storage of all these origins? It surely does. > PS: about etc/disarchive-manifest.scm, I guess 'all-origins' is missing: > > (let ((origins (all-origins))) > (manifest > (list (manifest-entry > (name "disarchive-collection") > (version (length origins)) > (item (disarchive-collection origins)))))) No, there=E2=80=99s: (include "source-manifest.scm") at the top. So the goal here was to move forward on this front by (1) setting up a CI jobset, and (2) having an mcron job or something that would periodically copy the =E2=80=9Cdisarchives=E2=80=9D in a directory served b= y nginx. We have had all the code and most of the infrastructure for several months, so I thought it=E2=80=99s high time to get our act together. Help welcome! Thanks, Ludo=E2=80=99.