From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp11.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms5.migadu.com with LMTPS id WDqeC7lejWLrIgEAbAwnHQ (envelope-from ) for ; Wed, 25 May 2022 00:39:53 +0200 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp11.migadu.com with LMTPS id WEWxC7lejWJeDwAA9RJhRA (envelope-from ) for ; Wed, 25 May 2022 00:39:53 +0200 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id B13572E10B for ; Wed, 25 May 2022 00:39:52 +0200 (CEST) Received: from localhost ([::1]:36264 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1ntdBv-00056N-Sn for larch@yhetil.org; Tue, 24 May 2022 18:39:51 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:58948) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1ntdBO-00056F-L4 for guix-devel@gnu.org; Tue, 24 May 2022 18:39:18 -0400 Received: from mail-pl1-x62b.google.com ([2607:f8b0:4864:20::62b]:37567) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1ntdBM-0001nN-6i for guix-devel@gnu.org; Tue, 24 May 2022 18:39:18 -0400 Received: by mail-pl1-x62b.google.com with SMTP id a17so985010plb.4 for ; Tue, 24 May 2022 15:39:15 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=sweatshoppe-org.20210112.gappssmtp.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=O7oNJ5v/cjaaC7OPflEzpLz44eSCFletJe+Wpukvuus=; b=zj3EgBVYeNZk8iyrEVg5FKhC+ZgexBTgpyaAanUgjzkBLiqUvIAOECVdYYVptsz981 T3hPMFgxnTU5LGpKL9++sbqPNPI9MSWpJAqNoFzWIa3xPZDIHaF+6fEEOciThkXmSD3W gWwqxGi7pKN6+BguUybEH4BmJi2wnEoLty6TNrpC4NVCCKyYFYwHHIzt8grNFh5n2kH8 PYVDPKWfkvXHFSNK05RTtOYonNmNg+Ie2iTYteAQkzDBmGrIM1fqD5oUJPqHvw6ALgDA zSzOy3u5zg3RKakcNtTchxU5pD3SS0JGfGMpcP4l1Z8LcXCSPz0PJUWQZ5KJF8U09WUW PdmQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=O7oNJ5v/cjaaC7OPflEzpLz44eSCFletJe+Wpukvuus=; b=jQ803VXSuBj+gHhIdTuVY6eCQNNEM5Na7MMse5IemebaSYQd48fO1Rw50AfQ2WFB8Z /jXsIHhaq17Dtar1asbK9Btu9dA7Tv+8dUTbKMDPLrabS/EoeqVCVBFkOru5sNYGTPvO omRDbX2dz9VgCC53TkAalo/gLQ1FMGUWzp/CNm5xJvuCsDQQT8VkeJEefgRdEG8WJx15 X3Zcx0CPKLubdzpqdbYYs7Ea6XKf7+WaY7nuqaS+MbpPTY+47arC2mpjRgbBSFjjGr8Y BuuE9rZyPONU0JITx0b1CYFlTk8WRNB3i5k2X+lSKGS2at0DMNPwkwOCziZ0PfXv1fDw Q6iA== X-Gm-Message-State: AOAM533QWcAi/STqGJxFgBSZ68JIP+IHF8S3NR4Q17rDNhX0D2QVt5hZ HBqBv+4KhlLdBNVu2y/i94bVCZsi+qYv1DC6DWi26gLPlr+h7Q== X-Google-Smtp-Source: ABdhPJwFhQyM2HOi+rYBFhLA6x78P8lPTr2OwR6CDE7iDktpRbKL771jWMAsO8q63UFjjS4jCc7l1N93iZP9WB5Hk6M= X-Received: by 2002:a17:90a:5792:b0:1e0:63f3:b3ba with SMTP id g18-20020a17090a579200b001e063f3b3bamr6887474pji.102.1653431954420; Tue, 24 May 2022 15:39:14 -0700 (PDT) MIME-Version: 1.0 References: <87pmk8mbvg.fsf@cbaines.net> In-Reply-To: From: Blake Shaw Date: Tue, 24 May 2022 22:39:03 +0000 Message-ID: Subject: Re: Test US mirror for bordeaux.guix.gnu.org and slow downloading of substitutes To: Christopher Baines Cc: Guix Devel Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Received-SPF: none client-ip=2607:f8b0:4864:20::62b; envelope-from=blake@sweatshoppe.org; helo=mail-pl1-x62b.google.com X-Spam_score_int: -18 X-Spam_score: -1.9 X-Spam_bar: - X-Spam_report: (-1.9 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_NONE=0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: "Guix-devel" X-Migadu-Flow: FLOW_IN X-Migadu-To: larch@yhetil.org X-Migadu-Country: US ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1653431992; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-unsubscribe:list-subscribe:list-post:dkim-signature; bh=O7oNJ5v/cjaaC7OPflEzpLz44eSCFletJe+Wpukvuus=; b=YLw6Uknqxy3gj+NyRHBQ+C/ajvt1+EEyxJawPNR1Gc3IIdvGsBjx/zvd/ZnOuMYZd7pyqT ovrso9dPEkbpJqQB0S+bRi3pQAVeP+0NsTCCrYXOt7xOb8/JWB1dG54MPGgTHb6ox3KZ4d lSn9P13BfRD4+ZDJrPJRN9r0p7+UP4wfqMjDTzLSeDveQoNlkrRpNLwZ3nUGkErJFmH7wU 80mediYWIrUO8l6rXk+XLwO5tMcQxZB2dHeKBC8Z3vEn5ZH4euetkS68HOqHPdq5jdO0hB ndQmtKqVXeEzVGa4SnmLR6gbOOA6MNsiDsrNFZvLdPUvdhXVvTUpsbq+spSw9g== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1653431992; a=rsa-sha256; cv=none; b=axzvEIduuBDBL2Iv1W2wKxOH0OZV+ykVtk/Bat88m8OAVsZYpwj62Al7f/TWR5IdzUXw+P O3ffsOmNBKvdB4OxN8O/2EV5/y+SuDLLqjOySXmbRzJVUXDPO3u5o57Hfo9l6868+XXs2z HfPHN34NfO2EZxuuccZy+VbqvPZLo6TQW8wBTNhMM8hGBsEuTs3xxqLgyT1umLDUNxx/SQ ecSP1Dt9pVXMa7JmTvttP/uNd8j4LkM+Jkg1bYm8XpH88746hFCDkCd3M2Wn+catAjhUrc 0FbNBMyCmxWGZAiQAr1Brr1gHAbe0sWEKavX26Faf9U6Jp3BJnpVtYUSKb1/nA== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=pass header.d=sweatshoppe-org.20210112.gappssmtp.com header.s=20210112 header.b=zj3EgBVY; dmarc=none; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" X-Migadu-Spam-Score: -3.54 Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=sweatshoppe-org.20210112.gappssmtp.com header.s=20210112 header.b=zj3EgBVY; dmarc=none; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" X-Migadu-Queue-Id: B13572E10B X-Spam-Score: -3.54 X-Migadu-Scanner: scn1.migadu.com X-TUID: 8u3VmS1opTIC Hi Christopher, So its strange, I do: wget https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3= q-stellarium-0.21.0 --2022-05-25 05:32:12-- https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-ste= llarium-0.21.0 Resolving bordeaux.guix.gnu.org (bordeaux.guix.gnu.org)... 185.233.100.56, 2a0c:e300::58 Connecting to bordeaux.guix.gnu.org (bordeaux.guix.gnu.org)|185.233.100.56|:443... connected. ...and then it just remains stalled there. wget appears to work fine in generat though, just not with guix. Any idea why this might be happening? Could bordeaux be blocking IPs in Singapore? Best, Blake --- Blake Shaw Director, SWEATSHOPPE sweatshoppe.org --- On Tue, May 24, 2022 at 5:52 AM Blake Shaw wrote: > > Hi Christopher, > > Here in Singapore download speed has gone from bad to worse over the > last two weeks, so bad that I was having to --fallback often and wound > up setting up a cuirass instance to continuously build a collection of > manifests I'm working with (which solved the issue). Not at my machine > atm but will wget stellarium and send the results when I am. > > Best, > Blake > > --- > Blake Shaw > Director, SWEATSHOPPE > sweatshoppe.org > --- > > On Fri, May 20, 2022 at 11:09 PM Christopher Baines wr= ote: > > > > Hey! > > > > So the nar-herder came in to existence at the end of last year (2021) > > and while the main use at the time was addressing the lack of storage o= n > > bayfront, I also hoped to improve the situation regarding mirrors for > > substitutes. > > > > I'm not in a great situation to test this though, as my usual internet > > connection is slow enough that a closer mirror probably won't make much > > difference. > > > > So, one thing that I'd be interested in, is hearing from anyone who > > thinks they get worse download performance from bordeaux.guix.gnu.org o= r > > ci.guix.gnu.org than they get when downloading other > > things. Importantly, it would be good to know roughly where > > (geographically) the machine doing the downloading is, and some data to > > show the difference. > > > > For example, I'm in the United Kingdom in Europe, and this is the outpu= t > > from wget downloading a ~200M file from bordeaux.guix.gnu.org: > > > > =E2=86=92 wget https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwz= wxw64hmcyshic9p3q-stellarium-0.21.0 > > --2022-05-20 16:49:56-- https://bordeaux.guix.gnu.org/nar/lzip/078vr= 3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 > > Resolving bordeaux.guix.gnu.org (bordeaux.guix.gnu.org)... 2a0c:e300:= :58, 185.233.100.56 > > Connecting to bordeaux.guix.gnu.org (bordeaux.guix.gnu.org)|2a0c:e300= ::58|:443... connected. > > HTTP request sent, awaiting response... 200 OK > > Length: 208615205 (199M) [text/plain] > > Saving to: =E2=80=98078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.= 0.6=E2=80=99 > > > > 078vr3r8mn3yrwzwxw64 100%[=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D>] 198.95M 4.24MB/s in 46s > > > > 2022-05-20 16:50:43 (4.31 MB/s) - =E2=80=98078vr3r8mn3yrwzwxw64hmcysh= ic9p3q-stellarium-0.21.0.6=E2=80=99 saved [208615205/208615205] > > > > > > Also, I've setup a US based (Hetzner data center, east coast) mirror of > > bordeaux.guix.gnu.org: > > > > https://bordeaux-us-east-mirror.cbaines.net/ > > > > So, I'd also be interested in seeing how that performs for people, and > > how it compares against bordeaux.guix.gnu.org, which is hosted in Franc= e > > in Europe. > > > > Here's my output from wget: > > > > =E2=86=92 wget https://bordeaux-us-east-mirror.cbaines.net/nar/lzip/0= 78vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 > > --2022-05-20 16:50:44-- https://bordeaux-us-east-mirror.cbaines.net/= nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 > > Resolving bordeaux-us-east-mirror.cbaines.net (bordeaux-us-east-mirro= r.cbaines.net)... 5.161.49.48 > > Connecting to bordeaux-us-east-mirror.cbaines.net (bordeaux-us-east-m= irror.cbaines.net)|5.161.49.48|:443... connected. > > HTTP request sent, awaiting response... 200 OK > > Length: 208615205 (199M) [text/plain] > > Saving to: =E2=80=98078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.= 0.7=E2=80=99 > > > > 078vr3r8mn3yrwzwxw64 100%[=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D>] 198.95M 4.17MB/s in 47s > > > > 2022-05-20 16:51:32 (4.22 MB/s) - =E2=80=98078vr3r8mn3yrwzwxw64hmcysh= ic9p3q-stellarium-0.21.0.7=E2=80=99 saved [208615205/208615205] > > > > > > Now, performance is probably a bit more complicated than just download > > speed. The US mirror holds the narinfo information locally, which shoul= d > > enable it to respond to requests more quickly, reducing latency, but > > this is a little harder to test. > > > > Thanks, > > > > Chris