From mboxrd@z Thu Jan 1 00:00:00 1970 From: =?utf-8?Q?Ludovic_Court=C3=A8s?= Subject: Re: More progress with the Guix Data Service Date: Mon, 20 May 2019 17:20:12 +0200 Message-ID: <871s0trw43.fsf@gnu.org> References: <87pnohms3t.fsf@cbaines.net> Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Return-path: Received: from eggs.gnu.org ([209.51.188.92]:50801) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1hSk5K-0005Y7-FH for guix-devel@gnu.org; Mon, 20 May 2019 11:20:19 -0400 In-Reply-To: <87pnohms3t.fsf@cbaines.net> (Christopher Baines's message of "Fri, 17 May 2019 08:56:38 +0100") List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+gcggd-guix-devel=m.gmane.org@gnu.org Sender: "Guix-devel" To: Christopher Baines Cc: guix-devel@gnu.org Hi! Christopher Baines skribis: > Since then, I've made some more progress. There's a new statistics page > [2]. I've got used to using Sqitch [3] to help manage the database > schema, and I've added some basic tests. The URL for [2] is actually: https://prototype-guix-data-service.cbaines.net/statistics (with an =E2=80=98s=E2=80=99.) See, I paid attention! ;-) > As well as listening to the Guix Commits mailing list for emails about > new revisions, more of the information in these emails is now stored, in > particular, the time they were sent, and the branch the email applies > to. This can be seen on the new Branches page [4]. > > 4: https://prototype-guix-data-service.cbaines.net/branches This is really nice. This information could also be gathered directly from the repo though, right? I would expect only patch submission info, and possibly commit notifications, to be grabbed from email, while the rest would be extracted from the repo, thereby hopefully limiting the risk of misinterpreting email. WDYT? > There's now a basic search function on the packages page [5], and the > location, and the licenses for packages is now being stored (which can > be seen on the page for a package, for example [6]). > > 5: https://prototype-guix-data-service.cbaines.net/revision/f52e83470b05b= 2473ea13feb2842a1330c316a00/packages?search_query=3DGuile&field=3Dversion&f= ield=3Dsynopsis&after_name=3D&limit_results=3D1000 > 6: https://prototype-guix-data-service.cbaines.net/revision/f52e83470b05b= 2473ea13feb2842a1330c316a00/package/0ad/0.0.23b-alpha Nice! One thing that be great is a page similar to , but keyed by package, where you get a list of the recent package versions (and/or derivations) and map them to specific commits. > The URL is a bit long, but I think that is now close to being possible > with the Guix data service. I haven't got something working yet to > easily access data for the latest revision, but for a particular > revision, you can request a JSON file containing all the information I > think Repology currently gets about all packages. For example: > > https://prototype-guix-data-service.cbaines.net/revision/f52e83470b05b2= 473ea13feb2842a1330c316a00/packages.json?field=3Dversion&field=3Dsynopsis&f= ield=3Ddescription&field=3Dhome-page&field=3Dlocation&field=3Dlicenses&limi= t_results=3D99999 Awesome. (I advise passing =E2=80=9Climit_results=3D900=E2=80=9D though, b= ecause the URL above gives a pretty big result. ;-)) > This is just the software side of the problem though. If this was to be > used by Repology, it would have to be a more permanent thing, similar to > the Cuirass and Mumi services that are currently setup around Guix. Does > anyone have any thoughts on this? I=E2=80=99d suggest having a Guix service for the whole thing, and making a branch in guix-maintenance.git such that bayfront (say) can run the service. Then we=E2=80=99ll have to reach consensus on guix-sysadmin as to which mac= hine to use depending on the resources it needs, but if you have the config, I=E2=80=99d argue that we can happily run it on bayfront or perhaps berlin.= And we can give you access to the machine so you can reconfigure once in a while. WDYT? Thanks, Ludo=E2=80=99.