From mboxrd@z Thu Jan 1 00:00:00 1970 From: Catonano Subject: Re: jquery 3.1.1 Date: Fri, 20 Jan 2017 23:33:57 +0100 Message-ID: References: <87tw8tmnma.fsf@gnu.org> Mime-Version: 1.0 Content-Type: multipart/alternative; boundary=001a1146b166e6e04705468e3ecf Return-path: Received: from eggs.gnu.org ([2001:4830:134:3::10]:35983) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1cUhky-0006W4-8U for guix-devel@gnu.org; Fri, 20 Jan 2017 17:34:05 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1cUhkx-0000P5-0N for guix-devel@gnu.org; Fri, 20 Jan 2017 17:34:04 -0500 In-Reply-To: <87tw8tmnma.fsf@gnu.org> List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+gcggd-guix-devel=m.gmane.org@gnu.org Sender: "Guix-devel" To: =?UTF-8?Q?Ludovic_Court=C3=A8s?= Cc: guix-devel --001a1146b166e6e04705468e3ecf Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable 2017-01-20 22:23 GMT+01:00 Ludovic Court=C3=A8s : > Hi! > > Catonano skribis: > > > I made a crawler and I let it loose on the jquery 3.1.1 dependencies on > > registry.npmjs.com > > > > It recursevely fetched the dependencies of jquery 3.1.1, then the > > dependencies of the dependencies, then the dependencies of the > dependencies > > of the dependencies... and so on > > > > Until there were no more dependencies to fetch. > > > > It stored all such dependencies in a graph database made by the amazing > > amz3 for their project, Culturia. They wrote about such project several > > times on the guile-users mailing list. > > Neat! > > > It took days to download. And it took me months to produce a working > > version of this code. Because I don't know Guile very well and maybe I'= m > > not that smart overall. > > > > Anyway, now I have a COMPLETE graph of the dependencies of jquery 3.1.1 > > > > It's made of > > 47311 vertices and > > 324569 edges > > Impressive. > > I suppose the data you gathered about the graph could help guide usage > of Jelle=E2=80=99s importer? (=E2=80=A6 which we should consider merging= BTW!) > > I would be honored if my data could help guide usage of Jelle's importer. That was exactly my idea when I started this. The Nodejs stuff can't be treated with brute force. A data oriented approach can help, here. --001a1146b166e6e04705468e3ecf Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
2017-01-20 22:23 GMT+01:00 Ludovic Court=C3=A8s <ludo@gnu.org= >:
<= blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px= #ccc solid;padding-left:1ex">Hi!

Catonano <catonano@gmail.com&g= t; skribis:

> I made a crawler and I let it loose on the jquery 3.1.1 dependencies o= n
> registry.npmjs.com
>
> It recursevely fetched the dependencies of jquery 3.1.1, then the
> dependencies of the dependencies, then the dependencies of the depende= ncies
> of the dependencies... and so on
>
> Until there were no more dependencies to fetch.
>
> It stored all such dependencies in a graph database made by the amazin= g
> amz3 for their project, Culturia. They wrote about such project severa= l
> times on the guile-users mailing list.

Neat!

> It took days to download. And it took me months to produce a working > version of this code. Because I don't know Guile very well and may= be I'm
> not that smart overall.
>
> Anyway, now I have a COMPLETE graph of the dependencies of jquery 3.1.= 1
>
> It's made of
> 47311 vertices and
> 324569 edges

Impressive.

I suppose the data you gathered about the graph could help guide usage
of Jelle=E2=80=99s importer?=C2=A0 (=E2=80=A6 which we should consider merg= ing BTW!)


I would be honored if my data could he= lp guide usage of Jelle's importer.

That was exactly= my idea when I started this. The Nodejs stuff can't be treated with br= ute force.
A data oriented approach can help, here.
--001a1146b166e6e04705468e3ecf--