From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp0 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms11 with LMTPS id eNfUJoX26l/MKwAA0tVLHw (envelope-from ) for ; Tue, 29 Dec 2020 09:27:33 +0000 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp0 with LMTPS id oFC1IoX26l+mJwAA1q6Kng (envelope-from ) for ; Tue, 29 Dec 2020 09:27:33 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 12CA6940274 for ; Tue, 29 Dec 2020 09:27:33 +0000 (UTC) Received: from localhost ([::1]:59378 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kuBHw-0000wf-2r for larch@yhetil.org; Tue, 29 Dec 2020 04:27:32 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:51236) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1kuBHn-0000wX-Tj for guix-devel@gnu.org; Tue, 29 Dec 2020 04:27:23 -0500 Received: from mira.cbaines.net ([212.71.252.8]:49324) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kuBHi-0000zL-Om for guix-devel@gnu.org; Tue, 29 Dec 2020 04:27:23 -0500 Received: from localhost (92.41.186.20.threembb.co.uk [92.41.186.20]) by mira.cbaines.net (Postfix) with ESMTPSA id 738AC27BC04 for ; Tue, 29 Dec 2020 09:27:16 +0000 (GMT) Received: from capella (localhost [127.0.0.1]) by localhost (OpenSMTPD) with ESMTP id ab2c8358 for ; Tue, 29 Dec 2020 09:27:13 +0000 (UTC) User-agent: mu4e 1.4.13; emacs 27.1 From: Christopher Baines To: guix-devel@gnu.org Subject: Frequently testing fixed output derivations Date: Tue, 29 Dec 2020 09:27:10 +0000 Message-ID: <87pn2t9d3l.fsf@cbaines.net> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha512; protocol="application/pgp-signature" Received-SPF: pass client-ip=212.71.252.8; envelope-from=mail@cbaines.net; helo=mira.cbaines.net X-Spam_score_int: -18 X-Spam_score: -1.9 X-Spam_bar: - X-Spam_report: (-1.9 / 5.0 requ) BAYES_00=-1.9, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: "Guix-devel" X-Migadu-Flow: FLOW_IN X-Migadu-Spam-Score: -4.43 Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of guix-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-devel-bounces@gnu.org X-Migadu-Queue-Id: 12CA6940274 X-Spam-Score: -4.43 X-Migadu-Scanner: scn1.migadu.com X-TUID: mG4mG7/cUfBY --=-=-= Content-Type: text/plain Hey, Something I noticed when looking at things guix.cbaines.net failed to build, is that some failures were because a fixed output derivation had failed (because of a 404 or hash mismatch for example). I've got around to adding a page to the Guix Data Service to list all the fixed output derivations that are related to packages, which also shows the latest build for that particular derivation. It's very slow at the moment, I need to work more on the PostgreSQL query it uses, but I have done most of the builds for all the ~15000 (x86_64-linux) derivations now. If this link loads for you, it should show ~28 derivations that failed to build [1]. 1: https://data.guix-patches.cbaines.net/revision/78fd422cd0e1c894280ef48de8b3a5d42db2eb80/fixed-output-package-derivations?system=x86_64-linux&target=none&latest_build_status=failed&all_results=on There's some nuance here, not all these derivations could cause problems, as a user might have a substitute available for them, but they might cause problems for those building without substitutes (although substitutes should always be fine to use for fixed output derivations). Because the fixed output derivations themselves attempt to fallback to mirrors or fetching via the hash, this isn't yet a good test on whether a file download necessarily works for example. Maybe there could be a way of disabling that functionality for testing. My plan is to improve the performace issues with this page, and schedule builds each week for every derivation (spread out over the week). That way there should be up to date information, making it possible to fix things soon after they break. Chris --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQKlBAEBCgCPFiEEPonu50WOcg2XVOCyXiijOwuE9XcFAl/q9m9fFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldDNF ODlFRUU3NDU4RTcyMEQ5NzU0RTBCMjVFMjhBMzNCMEI4NEY1NzcRHG1haWxAY2Jh aW5lcy5uZXQACgkQXiijOwuE9Xe4UQ/+KW/Uk4s0Brf+WwmcbW8dBjgMwIdeO7j7 RrAkCBlxUZuh9w1iZNzBP54Z4vNKQskig4yDA+sTQAVm/5pdLCAFA3oqEjQYkdMo E7RQTJCbxYQw9LGnEh67EuhUaDdoVmVLTCnQUrRmG+H49MBmHSpudZkFRifFT8AN dzJLZyICEKdPezen8vHK3LNvMUOQINpb7IgJa72o66mjAvtMBo2kGgma7KBPZzOD BOApEPb+Vxixm15W3iFCiUXl8F4eFjYRQMR9YNSNviDY7JuvkvuT8bwoPsL1mC08 c+tJ+dBZ/E5fbcYbIUYgGzh4h4q0kwGqPTg4+8xhQk3x5Sykj8o72gi1HFsGIHPl 1/BEHwOHu9zZsAmvfAJJLLsQTonM51so+5yxebzcIFB/HtvVKh+J12Aibq0ZDbOP +WUVSad2GWlqxir55bpSSydoCxE2szRdwRCqPLH0uklcH8a51BHC7g2+wUbVl38p oBkSzLL2G+djWvw5R2EDJ7slGjZKRIvWz4Ls4ZRydxTHp7+hDkLSYiElIQIMuIDk S0MUFAzklua3AsXuXixkugg1ZboMUQtBo6mbpUZ2qrQFQ7zRZcP4a0dk76arVoT3 KaEgTr+f+1cJ+xpUhqtn9Q1CC7pAw5yPvsq9gnO9cDjlIDdsPzO6PLYeAvLO2BbC SSkl9v+qz6k= =Mb+t -----END PGP SIGNATURE----- --=-=-=--