From mboxrd@z Thu Jan  1 00:00:00 1970
From: ludo@gnu.org (Ludovic =?utf-8?Q?Court=C3=A8s?=)
Subject: Re: GeoIP database redistribution?
Date: Tue, 24 Jan 2017 22:24:35 +0100
Message-ID: <87o9yw5ey4.fsf@gnu.org>
References: <8760l7t5ax.fsf@wasp.i-did-not-set--mail-host-address--so-tickle-me>
	<87k29l63pz.fsf@kirby.i-did-not-set--mail-host-address--so-tickle-me>
	<20170124060621.GA30899@mail.thebird.nl>
	<20170124082002.GF11257@macbook42.flashner.co.il>
Mime-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
Return-path: <guix-devel-bounces+gcggd-guix-devel=m.gmane.org@gnu.org>
Received: from eggs.gnu.org ([2001:4830:134:3::10]:52616)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <ludo@gnu.org>) id 1cW8a3-00048y-9B
	for guix-devel@gnu.org; Tue, 24 Jan 2017 16:24:46 -0500
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <ludo@gnu.org>) id 1cW8Zy-0002Wz-Ov
	for guix-devel@gnu.org; Tue, 24 Jan 2017 16:24:43 -0500
In-Reply-To: <20170124082002.GF11257@macbook42.flashner.co.il> (Efraim
	Flashner's message of "Tue, 24 Jan 2017 10:20:02 +0200")
List-Id: "Development of GNU Guix and the GNU System distribution."
	<guix-devel.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/guix-devel>,
	<mailto:guix-devel-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/guix-devel/>
List-Post: <mailto:guix-devel@gnu.org>
List-Help: <mailto:guix-devel-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/guix-devel>,
	<mailto:guix-devel-request@gnu.org?subject=subscribe>
Errors-To: guix-devel-bounces+gcggd-guix-devel=m.gmane.org@gnu.org
Sender: "Guix-devel" <guix-devel-bounces+gcggd-guix-devel=m.gmane.org@gnu.org>
To: Efraim Flashner <efraim@flashner.co.il>
Cc: guix-devel@gnu.org

Efraim Flashner <efraim@flashner.co.il> skribis:

> On Tue, Jan 24, 2017 at 06:06:21AM +0000, Pjotr Prins wrote:
>> On Mon, Jan 23, 2017 at 07:17:12PM +0100, Marius Bakke wrote:
>> > ng0 <contact.ng0@cryptolab.net> writes:
>> >=20
>> > > I want to slowly package OONI (https://ooni.torproject.org/).
>> > > One of its dependencies, txtorcon, requires python-geoip which
>> > > depends on geoip-c-api. I've got both covered, but both of them
>> > > want (either to download or to be present) for tests (a/the)
>> > > legacy database file of maxmind.
>> > >
>> > > Question 1: Can we distribute the database in a source? I can't
>> > > access the homepage of maxmind for cloudflare reasons.
>> >=20
>> > The database is distributed freely under cc-by-sa4.0:
>> >=20
>> > https://dev.maxmind.com/geoip/legacy/geolite/#License
>> >=20
>> > So packaging it should be fine. :)
>>=20
>> This actually raises the issue of packaging large data files (we are
>> getting into TB's). Could there be a way Guix fetches external
>> datasets as part of the distribution? I think that if it is not
>> executable code and SHA values/pfff values match it would be safe to
>> do.
>>=20
>
> The other thing is that guix downloads the files into ram and then
> writes them into the store, which can be a problem if the source is
> larger than the available memory.

It=E2=80=99s only if the file is added via the =E2=80=98add-to-store=E2=80=
=99 RPC, and not via
=E2=80=98import-path=E2=80=99 or a substitute:

  https://bugs.gnu.org/23666

But yes, that can be a problem.

Ludo=E2=80=99.