From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp2.migadu.com ([2001:41d0:303:e224::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms13.migadu.com with LMTPS id aFsyMv+jRWdAvAAAe85BDQ:P1 (envelope-from ) for ; Tue, 26 Nov 2024 10:33:36 +0000 Received: from aspmx1.migadu.com ([2001:41d0:303:e224::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp2.migadu.com with LMTPS id aFsyMv+jRWdAvAAAe85BDQ (envelope-from ) for ; Tue, 26 Nov 2024 11:33:35 +0100 X-Envelope-To: larch@yhetil.org Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=debbugs.gnu.org header.s=debbugs-gnu-org header.b=YzNiHQF3; dkim=fail ("headers rsa verify failed") header.d=gnu.org header.s=fencepost-gnu-org header.b=A3SVJqFV; dmarc=pass (policy=none) header.from=gnu.org; spf=pass (aspmx1.migadu.com: domain of "guix-patches-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-patches-bounces+larch=yhetil.org@gnu.org" ARC-Seal: i=1; s=key1; d=yhetil.org; t=1732617215; a=rsa-sha256; cv=none; b=g5Fwoq6X/nqXCb1BUvsIqrj++UeMbyQcogHo84qDF8p+7gIlZ+syXW2jnpCJ+cnhnMts9a Cvx8wCuhcT7ylfrLZY7C2uNdynG0kikLpfr9l2N/R63M2tGTiGpIOeCYKKcyrl8oFt7wKy EN0OA8nTg2CJAsR87BvizAG2Bq2nuQAu8Aq/l9pYqHgRABEimLJ3Vi0Oul5/eXdb9J2n6e L1lvLYL0vHsr/c5vKR0op60vbt3olrFBsxIisqjFqI4OmJ7GxfHux0qbT9BVztjc3WmY/e Vfz14hOEagLieuvn+zVLiJOkFNqSBLolEaJDmM174n6m66O6AcXBL2ZNCMBVAw== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=pass header.d=debbugs.gnu.org header.s=debbugs-gnu-org header.b=YzNiHQF3; dkim=fail ("headers rsa verify failed") header.d=gnu.org header.s=fencepost-gnu-org header.b=A3SVJqFV; dmarc=pass (policy=none) header.from=gnu.org; spf=pass (aspmx1.migadu.com: domain of "guix-patches-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-patches-bounces+larch=yhetil.org@gnu.org" ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1732617215; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding:resent-cc: resent-from:resent-sender:resent-message-id:list-id:list-help: list-unsubscribe:list-subscribe:list-post:dkim-signature; bh=Xpr18fwQvEh6KrKugQjgSeJkJSXBd6d27W+wBIjzuUQ=; b=eMaSD4d38l69lWr578RQSoAQiydN96fLjZKeOawOzIOHlNQGxuGGarzXNKK/fviRcDSrt0 n8BcguKN7ToVeEsf/GMGZhzRN7gUpSC+kfdAbs7gNdlV1kUQoA52sRXYEzPeQ/o/9jnXGq 36ytwH6NFZ6rnynx/p3oSFZFEr8U2hLa1ytwJ8r7N2ZgC9APOashA4cQeib4HGXIGbBaB7 7CyByUBH7matZXv94KseD9s8qlfQTxjW3e+txqnGtqsXWZN+HdritDBWB1KJZPsug3SQoj zlZrzg85tv0E9BwIGF8z0Pux6Z2MeStQrOQInUvrJw6F+UTGWMT7F8Eol4knGQ== Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id F054E18AB1 for ; Tue, 26 Nov 2024 11:33:34 +0100 (CET) Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1tFssc-0004qJ-Jb; Tue, 26 Nov 2024 05:33:14 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1tFssY-0004q8-58 for guix-patches@gnu.org; Tue, 26 Nov 2024 05:33:10 -0500 Received: from debbugs.gnu.org ([2001:470:142:5::43]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1tFssX-0008JL-Rp; Tue, 26 Nov 2024 05:33:09 -0500 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=debbugs.gnu.org; s=debbugs-gnu-org; h=MIME-Version:Date:From:To:Subject; bh=Xpr18fwQvEh6KrKugQjgSeJkJSXBd6d27W+wBIjzuUQ=; b=YzNiHQF32kjHRoOm1xjVU+SH2hDfE447dKcXrtG00XZAu9D6YypFglWSKZzUafs9HlDPEAAw+8J9oLB5ljbv238MXsUgC4tBcC7xso3Uwv1IbwxJQL8lm49CkPQKhs/+3m9WHTk89xeevSV0ROZx1lpWNSn+lMpe6vO+xt3RFYdqaRS5q+AbzA6T9G/ULIEJA6ubkyULUkMWktWt16suYWEWRPVsYk1b6afgk0ppjq/K7TjO/tMqlH/brqL+qNCfVzlHT1dTK6yyPIwvD2lW0buWGyw48YqQlc+lRrqiDnwIaAzH2DkQhYCSHsW1fNMv4z+48oVF9sLVWrXvjuoquA==; Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1tFssQ-0002Nc-5r; Tue, 26 Nov 2024 05:33:02 -0500 X-Loop: help-debbugs@gnu.org Subject: [bug#74542] [PATCH 00/11] Improved tooling for package updates Resent-From: Ludovic =?UTF-8?Q?Court=C3=A8s?= Original-Sender: "Debbugs-submit" Resent-CC: guix@cbaines.net, dev@jpoiret.xyz, ludo@gnu.org, othacehe@gnu.org, zimon.toutoune@gmail.com, me@tobias.gr, guix-patches@gnu.org Resent-Date: Tue, 26 Nov 2024 10:33:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: report 74542 X-GNU-PR-Package: guix-patches X-GNU-PR-Keywords: patch To: 74542@debbugs.gnu.org Cc: Ludovic =?UTF-8?Q?Court=C3=A8s?= , Christopher Baines , Josselin Poiret , Ludovic Court?s , Mathieu Othacehe , Simon Tournier , Tobias Geerinckx-Rice X-Debbugs-Original-To: guix-patches@gnu.org X-Debbugs-Original-Xcc: Christopher Baines , Josselin Poiret , Ludovic Court?s , Mathieu Othacehe , Simon Tournier , Tobias Geerinckx-Rice Received: via spool by submit@debbugs.gnu.org id=B.17326171759131 (code B ref -1); Tue, 26 Nov 2024 10:33:01 +0000 Received: (at submit) by debbugs.gnu.org; 26 Nov 2024 10:32:55 +0000 Received: from localhost ([127.0.0.1]:46104 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1tFssI-0002NB-Nn for submit@debbugs.gnu.org; Tue, 26 Nov 2024 05:32:55 -0500 Received: from lists.gnu.org ([209.51.188.17]:49518) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1tFssH-0002N4-7N for submit@debbugs.gnu.org; Tue, 26 Nov 2024 05:32:54 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1tFssG-0004oy-RE for guix-patches@gnu.org; Tue, 26 Nov 2024 05:32:53 -0500 Received: from fencepost.gnu.org ([2001:470:142:3::e]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1tFssF-0008FV-S6; Tue, 26 Nov 2024 05:32:51 -0500 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-Version:Date:Subject:To:From:in-reply-to: references; bh=Xpr18fwQvEh6KrKugQjgSeJkJSXBd6d27W+wBIjzuUQ=; b=A3SVJqFVJHY6bA hPQVaqBOxgEM6Doic5HZQJoStCLMuPqgpUlRtNSKWVenBiFzrZGAY9TaD54VUVIKnbFCw0CB2FlrO nfQsB7YvoJNxbpO1IBuybDub5danJVU0MAZtEdS16yOHY8y7fy8ATnswzY+3/auWDHWTTSx+eb7XJ roy+mkYydye132MQmkIOusw0ckSgtPPkv30xpDynK0UJxYj2QXuGxMz1qCUJ5dMC9FvWfisQY2IMK YLtCerkLarQ8gdMtAvI6HtavFYUm1dmSQWvulJrrHH3dz07bNzkoGoESw0PhPsYDa3BoY70JWWo+3 L3CoS72rqJ876cS3c1Hg==; From: Ludovic =?UTF-8?Q?Court=C3=A8s?= Date: Tue, 26 Nov 2024 11:32:17 +0100 Message-ID: X-Mailer: git-send-email 2.46.0 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-BeenThere: guix-patches@gnu.org List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-patches-bounces+larch=yhetil.org@gnu.org Sender: guix-patches-bounces+larch=yhetil.org@gnu.org X-Migadu-Flow: FLOW_IN X-Migadu-Country: US X-Migadu-Spam-Score: 1.76 X-Spam-Score: 1.76 X-Migadu-Queue-Id: F054E18AB1 X-Migadu-Scanner: mx12.migadu.com X-TUID: 1np4fBypaSsv Hello Guix! This patch series aims to improve tooling for package upgrades: • By adding a ‘--dependents’ option to ‘guix build’ to build dependent packages (those returned by ‘guix refresh -l’). This was suggested by my colleague Romain Garbage, who also prototyped a variant of this. • By improving individual updaters and updating metadata for some packages. • By adding an “upgrade manifest”, to automatically build the latest version (using the ‘with-latest’ package transformation) of a few security-critical packages along with their dependents at distance 2, as well as some of the leaf packages. The goal is to use this upgrade manifest for a new jobset on ci.guix. The idea is that when someone tries to upgrade one of these things, chances are it will have been built already. I already toyed with this idea here: https://guix.bordeaux.inria.fr/jobset/guix-hpc-cutting-edge https://gitlab.inria.fr/guix-hpc/guix-hpc/-/blob/master/cutting-edge.manifest?ref_type=heads It’s experimental; surely we’ll find that the manifest needs to be tweaked, or that some of the updaters abort to early. But I think it can help, and it’s a good way to use available x86_64 CPU power at ci.guix. According to a recent discussion with Nix hackers on Mastodon¹, mere substitute availability is not perceived as a key factor in what enables them to keep Nixpkgs up-to-date; the primary factor appears to be the bot that sends patches updating packages. Food for thought! Ludo’. ¹ https://toot.aquilenet.fr/@civodul/113527656544893427 Ludovic Courtès (11): transformations: Export ‘package-with-upstream-version’. gnu-maintenance: ‘import-html-release’ doesn’t abort upon HTTP 404. gnu-maintenance: Savannah/Xorg updaters no longer abort on network errors. build: Add ‘--development’ option. packages: Factorize ‘all-packages’. guix build: Add ‘--dependents’. import: gnome: Keep going upon HTTP errors. gnu-maintenance: ‘gnu-ftp’ updater excludes GnuPG-hosted packages. gnu: Update updater properties for GnuPG-related packages. guix build: Validate that the file passed to ‘-m’ returns a manifest. etc: Add upgrade manifest. Makefile.am | 1 + doc/contributing.texi | 4 +- doc/guix.texi | 52 +++++++++++ etc/source-manifest.scm | 13 +-- etc/upgrade-manifest.scm | 98 +++++++++++++++++++++ gnu/packages.scm | 20 ++++- gnu/packages/gnupg.scm | 40 +++------ guix/download.scm | 3 +- guix/gnu-maintenance.scm | 49 +++++++---- guix/import/gnome.scm | 13 ++- guix/scripts/build.scm | 185 ++++++++++++++++++++++++++++++--------- guix/scripts/graph.scm | 10 --- guix/scripts/refresh.scm | 10 --- guix/scripts/weather.scm | 15 ---- guix/transformations.scm | 2 + tests/guix-build.sh | 11 +++ 16 files changed, 386 insertions(+), 140 deletions(-) create mode 100644 etc/upgrade-manifest.scm base-commit: 827ec92f44d1b1daedc5446146801183560e861b -- 2.46.0