all messages for Guix-related lists mirrored at yhetil.org
 help / color / mirror / code / Atom feed
From: Giovanni Biscuolo <g@xelera.eu>
To: "Ludovic Courtès" <ludo@gnu.org>,
	"Hartmut Goebel" <hartmut@goebel-consult.de>
Cc: guix-devel@gnu.org, 33600@debbugs.gnu.org
Subject: Re: Using a CDN or some other mirror?
Date: Tue, 11 Dec 2018 17:38:27 +0100	[thread overview]
Message-ID: <8736r4hvcs.fsf@roquette.mug.biscuolo.net> (raw)
In-Reply-To: <87pnua244k.fsf@gnu.org>

[-- Attachment #1: Type: text/plain, Size: 2785 bytes --]

Hi all,

my two cents...

(I can't still help with a public cache, I hope soon...)

Ludovic Courtès <ludo@gnu.org> writes:

[...]

>> TL;DR: A CDN is a centralized infrastructure, allowing to collect
>> information about valuable vulnerability information of almost all
>> Guix-users and -systems. This is might become a thread to freedom of
>> speech, human rights, democracy and economics. Guix should build on a
>> decentralized infrastructure.

I completely agree with you, decentralization is the solution

unfortunately the **only functioning** way is to avoid current Internet,
since it's broken (https://youbroketheinternet.org/); I see GuixSD as an
integral part of The Project Map™ https://youbroketheinternet.org/map

...but to fix the situation we need a substantial GNUnet(work) effect
and for that we _need_ GuixSD substitutes to be easily and quickly
downloaded (can we avoid this asking potential adopters to be patient or
to build?)

maybe we should divide this task in two steps:

1. distributed substitutes: caching servers hosted by a network of
friendly institutions and companies donated to GNU/GuixSD, with a
haproxy frontend for geolocated load-balancing [1]

2. decentralized substitutes: caching servers on IPFS or better (since
it allows complete anonimity) on GNUnet

> Heck it would be ironic to find myself arguing in favor of centralized
> commercial services.  So I won’t do that.  :-)

I see no problems with commercial services, _unfortunately_ nowadays
this *almost* always means centralized silos, usually exploited for
global surveillance (since Internet is broken)

[...]

> The operator of a substitute server (or caching proxy), in general,
> knows which IPs downloaded vulnerable software.  This is the main
> threat.

on Internet, and on IPFS? (sorry for the ignorance)

on GNUNet filesharing can be completely anonymous, but the performace is
degraded (so we need a large network effect here)

> This can be mitigated by talking to nearby mirrors and not just
> ci.guix.info, a feature we implemented a year ago (see
> <https://gnu.org/s/guix/blog/2017/reproducible-builds-a-status-update/>),
> or by using several substitute servers, or by not using (or not always
> using) substitutes.  Few distros have all these options.
>
> We might also be able to somehow balance requests between several CDNs
> or mirrors.

did someone explored an haproxy (with geolocation) solution?

is there a wip-haproxy attempt?

[...]

HTH
Giovanni


[1] in the next few weeks I'm going to test an haproxy instance with
geolocated ACLs following this directions
https:/www.haproxy.com/blog/use-geoip-database-within-haproxy/

-- 
Giovanni Biscuolo

Xelera IT Infrastructures

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 832 bytes --]

WARNING: multiple messages have this Message-ID (diff)
From: Giovanni Biscuolo <g@xelera.eu>
To: "Ludovic Courtès" <ludo@gnu.org>,
	"Hartmut Goebel" <hartmut@goebel-consult.de>
Cc: guix-devel@gnu.org, 33600@debbugs.gnu.org
Subject: [bug#33600] Using a CDN or some other mirror?
Date: Tue, 11 Dec 2018 17:38:27 +0100	[thread overview]
Message-ID: <8736r4hvcs.fsf@roquette.mug.biscuolo.net> (raw)
In-Reply-To: <87pnua244k.fsf@gnu.org>

[-- Attachment #1: Type: text/plain, Size: 2785 bytes --]

Hi all,

my two cents...

(I can't still help with a public cache, I hope soon...)

Ludovic Courtès <ludo@gnu.org> writes:

[...]

>> TL;DR: A CDN is a centralized infrastructure, allowing to collect
>> information about valuable vulnerability information of almost all
>> Guix-users and -systems. This is might become a thread to freedom of
>> speech, human rights, democracy and economics. Guix should build on a
>> decentralized infrastructure.

I completely agree with you, decentralization is the solution

unfortunately the **only functioning** way is to avoid current Internet,
since it's broken (https://youbroketheinternet.org/); I see GuixSD as an
integral part of The Project Map™ https://youbroketheinternet.org/map

...but to fix the situation we need a substantial GNUnet(work) effect
and for that we _need_ GuixSD substitutes to be easily and quickly
downloaded (can we avoid this asking potential adopters to be patient or
to build?)

maybe we should divide this task in two steps:

1. distributed substitutes: caching servers hosted by a network of
friendly institutions and companies donated to GNU/GuixSD, with a
haproxy frontend for geolocated load-balancing [1]

2. decentralized substitutes: caching servers on IPFS or better (since
it allows complete anonimity) on GNUnet

> Heck it would be ironic to find myself arguing in favor of centralized
> commercial services.  So I won’t do that.  :-)

I see no problems with commercial services, _unfortunately_ nowadays
this *almost* always means centralized silos, usually exploited for
global surveillance (since Internet is broken)

[...]

> The operator of a substitute server (or caching proxy), in general,
> knows which IPs downloaded vulnerable software.  This is the main
> threat.

on Internet, and on IPFS? (sorry for the ignorance)

on GNUNet filesharing can be completely anonymous, but the performace is
degraded (so we need a large network effect here)

> This can be mitigated by talking to nearby mirrors and not just
> ci.guix.info, a feature we implemented a year ago (see
> <https://gnu.org/s/guix/blog/2017/reproducible-builds-a-status-update/>),
> or by using several substitute servers, or by not using (or not always
> using) substitutes.  Few distros have all these options.
>
> We might also be able to somehow balance requests between several CDNs
> or mirrors.

did someone explored an haproxy (with geolocation) solution?

is there a wip-haproxy attempt?

[...]

HTH
Giovanni


[1] in the next few weeks I'm going to test an haproxy instance with
geolocated ACLs following this directions
https:/www.haproxy.com/blog/use-geoip-database-within-haproxy/

-- 
Giovanni Biscuolo

Xelera IT Infrastructures

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 832 bytes --]

  reply	other threads:[~2018-12-11 16:39 UTC|newest]

Thread overview: 72+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2018-12-03 15:43 [PATCH 0/3] Defaulting to ci.guix.info (aka. berlin.guixsd.org) Ludovic Courtès
2018-12-03 16:12 ` Using a CDN or some other mirror? Ludovic Courtès
2018-12-03 20:47   ` Ricardo Wurmus
2018-12-04 10:40   ` Hartmut Goebel
2018-12-04 14:05     ` Ludovic Courtès
2018-12-04 17:03       ` Pjotr Prins
2018-12-04 17:58       ` Thompson, David
2018-12-05  2:32       ` Meiyo Peng
2018-12-05  5:38         ` Leo Famulari
2018-12-05 10:59         ` Pierre Neidhardt
2018-12-05 11:46       ` Hartmut Goebel
2018-12-07 14:05         ` Ludovic Courtès
2018-12-09  9:44           ` Hartmut Goebel
2018-12-04 21:15     ` ng0
2018-12-04 21:50       ` Thompson, David
2018-12-05  9:28         ` ng0
2018-12-09  3:33   ` Chris Marusich
2018-12-09 12:12     ` Hartmut Goebel
2018-12-09 13:58       ` Ludovic Courtès
2018-12-11 16:38         ` Giovanni Biscuolo [this message]
2018-12-11 16:38           ` [bug#33600] " Giovanni Biscuolo
2018-12-14  8:35         ` Hartmut Goebel
2018-12-14  8:35           ` [bug#33600] " Hartmut Goebel
2018-12-14  9:02           ` Pierre Neidhardt
2018-12-14 14:48             ` Compressing nars with lzip or similar Ludovic Courtès
2018-12-14 14:48               ` [bug#33600] " Ludovic Courtès
2018-12-14 15:21               ` Pierre Neidhardt
2018-12-15 12:17                 ` Pierre Neidhardt
2018-12-15 18:06                   ` Ludovic Courtès
2018-12-15 18:06                     ` [bug#33600] " Ludovic Courtès
2019-03-05 11:36                     ` Pierre Neidhardt
2018-12-15 18:04                 ` Ludovic Courtès
2018-12-14 14:45           ` Using a CDN or some other mirror? Ludovic Courtès
2018-12-09 15:59     ` CDN performance Ludovic Courtès
2018-12-11  5:17       ` Meiyo Peng
     [not found]         ` <CAAYZrgbOZYyKhaHzziWfKz-nHVcUWS6WCo4TAq8bbDn9=YMTZA@mail.gmail.com>
2018-12-11  5:59           ` Meiyo Peng
     [not found]             ` <CAAYZrgb431xW1RD0Hf0d15T3AiW5yZWLL6oqHsyanv1qSf8Zuw@mail.gmail.com>
2018-12-11  6:14               ` Meiyo Peng
2018-12-13  7:11         ` Chris Marusich
2018-12-17  6:48           ` Meiyo Peng
2018-12-17  6:48             ` [bug#33600] " Meiyo Peng
2018-12-21 10:22             ` Chris Marusich
2018-12-21 16:04               ` Meiyo Peng
2018-12-21 16:04                 ` [bug#33600] " Meiyo Peng
2018-12-13  8:05       ` Chris Marusich
2018-12-13 10:41         ` Giovanni Biscuolo
2018-12-15  1:40           ` Mark H Weaver
2018-12-19 12:40             ` Giovanni Biscuolo
2018-12-21  0:23               ` Trustworthiness of build farms (was Re: CDN performance) Mark H Weaver
2018-12-21 20:47               ` CDN performance Marius Bakke
2018-12-21 20:47                 ` [bug#33600] " Marius Bakke
2018-12-24 14:47           ` Ricardo Wurmus
2018-12-14 10:26         ` guix.gnu.org sub-domain Ludovic Courtès
2018-12-15 23:20           ` Chris Marusich
2018-12-15 23:20             ` [bug#33600] " Chris Marusich
2019-01-25  4:54             ` Amin Bandali
2018-12-14 10:35         ` CDN performance Ludovic Courtès
2018-12-13  9:21     ` Using a CDN or some other mirror? Giovanni Biscuolo
2018-12-14 12:17       ` Chris Marusich
2018-12-03 18:20 ` [PATCH 0/3] Defaulting to ci.guix.info (aka. berlin.guixsd.org) Amin Bandali
2018-12-04 14:11   ` Ludovic Courtès
2018-12-11  5:41     ` Amin Bandali
2018-12-03 23:44 ` Mark H Weaver
2018-12-04  5:55   ` Ricardo Wurmus
2018-12-04  5:55     ` [bug#33600] " Ricardo Wurmus
2018-12-04  9:03     ` Ludovic Courtès
2018-12-04 10:08       ` Andreas Enge
2018-12-04  8:59   ` Andreas Enge
2018-12-04 10:28     ` Ludovic Courtès
2018-12-04 10:46       ` Andreas Enge
2018-12-04 14:12         ` Ludovic Courtès
2018-12-04  3:40 ` Meiyo Peng
2018-12-04 14:13   ` Ludovic Courtès

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=8736r4hvcs.fsf@roquette.mug.biscuolo.net \
    --to=g@xelera.eu \
    --cc=33600@debbugs.gnu.org \
    --cc=guix-devel@gnu.org \
    --cc=hartmut@goebel-consult.de \
    --cc=ludo@gnu.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
Code repositories for project(s) associated with this external index

	https://git.savannah.gnu.org/cgit/guix.git

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.