From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp1 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms11 with LMTPS id IBIlOq3ubF96bQAA0tVLHw (envelope-from ) for ; Thu, 24 Sep 2020 19:08:29 +0000 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp1 with LMTPS id KLQGNq3ubF+8JwAAbx9fmQ (envelope-from ) for ; Thu, 24 Sep 2020 19:08:29 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 882D29402B4 for ; Thu, 24 Sep 2020 19:08:29 +0000 (UTC) Received: from localhost ([::1]:56788 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kLWbU-0004Sc-Fa for larch@yhetil.org; Thu, 24 Sep 2020 15:08:28 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:46404) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1kLWZH-0002hY-LE for guix-devel@gnu.org; Thu, 24 Sep 2020 15:06:11 -0400 Received: from mira.cbaines.net ([212.71.252.8]:58758) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kLWZF-00041o-H4 for guix-devel@gnu.org; Thu, 24 Sep 2020 15:06:11 -0400 Received: from localhost (unknown [46.237.174.91]) by mira.cbaines.net (Postfix) with ESMTPSA id 4F97E27BBE8; Thu, 24 Sep 2020 20:06:06 +0100 (BST) Received: from localhost (localhost [local]) by localhost (OpenSMTPD) with ESMTPA id b378561c; Thu, 24 Sep 2020 19:06:03 +0000 (UTC) References: User-agent: mu4e 1.4.13; emacs 26.3 From: Christopher Baines To: zimoun Subject: Re: Cuirass: "lint -c archival"? In-reply-to: Date: Thu, 24 Sep 2020 20:06:00 +0100 Message-ID: <874knnouzr.fsf@cbaines.net> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha512; protocol="application/pgp-signature" Received-SPF: pass client-ip=212.71.252.8; envelope-from=mail@cbaines.net; helo=mira.cbaines.net X-detected-operating-system: by eggs.gnu.org: First seen = 2020/09/24 15:06:06 X-ACL-Warn: Detected OS = Linux 2.2.x-3.x [generic] [fuzzy] X-Spam_score_int: -18 X-Spam_score: -1.9 X-Spam_bar: - X-Spam_report: (-1.9 / 5.0 requ) BAYES_00=-1.9, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, UNPARSEABLE_RELAY=0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Guix Devel Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: "Guix-devel" X-Scanner: scn0 Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of guix-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-devel-bounces@gnu.org X-Spam-Score: -2.11 X-TUID: yKJfbcSwUetq --=-=-= Content-Type: text/plain zimoun writes: > Does it make sense to add "lint -c archival" when a package is built > by Cuirass? Or on the Guix Data Services? > > The idea behind is then to ask SWH folks to increase the rate limit > for a specific IP (or couple of IPs). Today, the SWH rate is 10 save > requests per hour, i.e., 240 per day (more or less). And the new > chart [1] shows that there are ~2000 builds per day. Ouch! :-) > > [1] > > If it is not possible, then instead does it make sense to add a script > to etc/? If SWH accepts to increase the rate for a specific machine, > the script (fold-packages+save-origin) could run with some delay and > save all the missing Git references. > > Well, I do not know what the GitLab CI in Bordeaux is doing? About > Guix packages because there are already some things saving requests > automatically, I guess. > > WDYT? So, my understanding is that Software Heritage is a potential store for source material for Guix packages. I think the majority of builds Cuirass does are because inputs change, rather than the source of a package. I'm not sure hooking this up to Cuirass would make the most sense, because of the above point. Also, unfortunately, the Guix Data Service doesn't have the ideal data for this, as it doesn't really store the package source information in the way that would be useful for this. Personally though (and I'm rather biased), I think the Guix Data Service might still be an approach. If you take the view on this that the Software Heritage is a means to a store item (which I think is right?), the Guix Data Service knows about those store items (like [1]). 1: https://data.guix.gnu.org/gnu/store/5h4dz6ild4fkida5yfv5fhh59vfd8hvk-python-boolean.py-3.6-checkout It's already storing if substitute servers have a nar for that store item, so I don't think storing if it's available elsewhere is particularly out of place. To make the information actionable though, it would be necessary to store more information about the sources for packages in the Guix Data Service database. This is much more work than just using the existing linter, but it does have the advantage that you'd be able to look at coverage statistics and things like that, which the checker doesn't really afford. Chris --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQKTBAEBCgB9FiEEPonu50WOcg2XVOCyXiijOwuE9XcFAl9s7hhfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldDNF ODlFRUU3NDU4RTcyMEQ5NzU0RTBCMjVFMjhBMzNCMEI4NEY1NzcACgkQXiijOwuE 9XdIRw/7BJp6fv3Qw02s8AOq51p+itdg5UTlyJaNOjECj3LgPq9m6apeBjvsGcNo 36EzD84339M1G7Nzfuc9JzODCK6RstItSuJHKRKdKpGBVlPqvR7ZYCjzlZszabNQ wk6y+MshnLNwtTAA7U0IQFr7pK+up01REQakg0zWOsJCGrrmH1txeCa4PTRWu7oX 3AQzs/D0aAUvTKMN2CNPy9Ou7Mh65jn7S0dn5eygZ8q52oIXnE6Tpr4zsd1kK9Cd Ci21uvuTi2irxcnO5Fv5jIdQqyuLdCZ4/5gO8+WtWvx/gD1DEuC+ZENKiBt8sTg2 jDg4b52y+XB1H7PynFMayOx7vrISmYDSOzNC5U9UCn17EaC8cjdO78NDjRYA6kj3 M1S52RA29XNgdj2nQoS53vvZZWMz4VQUWNlBc3/ng711SqOf6hNDvLPVVPeklftW yCHZmpCUBpcYFH2cPh6t2JyFxXpSBcikug8YID6vF8H2dj3WSYuHrhoIKHayDn3T O+bw391Sh8R54VO6kuJ9QHVHfT9K+UbdJW9inT/DMuaz8+Np9MKn/N3oWOXsk86Q 4mmS72OUoTmJoN9MJXPoqAm4PFbmpwrIxe933XT/Oh0qjfpk7gXUsP7odCeGvJvw Ij3+XVzsSCj0V72wNPbCJTHCvVkcfbRyZMWUNbkftj3i5KEvVtY= =aFtB -----END PGP SIGNATURE----- --=-=-=--