From mboxrd@z Thu Jan 1 00:00:00 1970 From: zimoun Subject: Re: Guix Data Services: whishlist about SWH Date: Tue, 3 Mar 2020 18:11:31 +0100 Message-ID: References: <87y2t2zz2k.fsf@cbaines.net> <87lforhpwz.fsf@gnu.org> Mime-Version: 1.0 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Return-path: Received: from eggs.gnu.org ([2001:470:142:3::10]:34894) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1j9B5A-0005Qu-Su for guix-devel@gnu.org; Tue, 03 Mar 2020 12:11:50 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1j9B59-0004lV-HA for guix-devel@gnu.org; Tue, 03 Mar 2020 12:11:48 -0500 In-Reply-To: <87lforhpwz.fsf@gnu.org> List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+gcggd-guix-devel=m.gmane-mx.org@gnu.org Sender: "Guix-devel" To: =?UTF-8?Q?Ludovic_Court=C3=A8s?= Cc: Guix Devel Hi, On Mon, 24 Feb 2020 at 18:10, Ludovic Court=C3=A8s wrote: > >> Using the Software Heritage (SWH) API [3], does it seems a good idea > >> to add SWH coverage somewhere in the Guix Data Services? > > That=E2=80=99s a great idea! Maybe it=E2=80=99s not a good idea to store= that info in > the database of the Data Service though. (Web browsers could query the > SWH API by themselves actually, though it=E2=80=99d be nice to have a JS-= free > variant.) It is out of my skills. :-) What I have in mind is: 1. Green/red button like SWH stamp! :-) Green for archived in SWH and red for not yet, and maybe orange for scheduled. 2. A chart for the coverage. Well, the point 1. works at the package level and should be done entirely inside the webbrowser (modulo JS-free). However, point 2. cannot be checked on the fly, IMHO and so needs to be stored somewhere in the Data Service. I have no idea where to look to for example start something about the point 1. Clue accepted. ;-) > > I think the first step towards this would be to experiment with fetchin= g > > data from the Software Heritage API. Do you know how you'd fetch data > > about the output from a fixed output derivation (like harfbuzz)? > > The =E2=80=98archival=E2=80=99 linter does that. See also the examples a= t: > > https://guix.gnu.org/blog/2019/connecting-reproducible-deployment-to-a-= long-term-source-code-archive/ Thank you for the pointer. I will try to find my way in the linter code. :-= ) Thinking about connections between Guix/Nix and SWH and discussing with lewo, it could be also nice to "push" for each evaluation of Cuirass all our upstream sources to the SWH listener. Well, the SWH listener is still a work-in-progress but currently it accepts something in the format of 'sources.json'. A patch implementing that is pending [1] and in the near future (after soonish the patch's review) this 'sources.json' will be produced by the Website... Hum? The question is then: what will produce this 'sources.json' file? Cuirass or Data Services? If I understand Cl=C3=A9ment's concern about Cuirass, he is not in favour to add too much Guix only features to Cuirass. So Cuirass does not seem the right place. Well, the Data Service could do that. For each evaluation, it produces this 'sources.json' file and it serves it a a place that the SWH listener could ingest and so schedule some fetching. There is still questions to minimize the resource consumption (more on SWH side than on our side), but that another story. In this case, Guix will be more robust, especially about time travelling. What do you think? [1] https://debbugs.gnu.org/cgi/bugreport.cgi?bug=3D39547#29 [1] https://debbugs.gnu.org/cgi/bugreport.cgi?bug=3D39547#35 All the best, simon