From mboxrd@z Thu Jan 1 00:00:00 1970 From: Meiyo Peng Subject: Re: CDN performance Date: Sat, 22 Dec 2018 00:04:12 +0800 Message-ID: <87y38isw77.fsf@gmail.com> References: <20181203154335.10366-1-ludo@gnu.org> <87tvju6145.fsf@gnu.org> <87ftv7l6gy.fsf@gmail.com> <871s6qzo6m.fsf_-_@gnu.org> <874lbk63se.fsf@gmail.com> <877egdyk82.fsf@gmail.com> <87d0q01wdx.fsf@gmail.com> <87o99f9o2t.fsf@gmail.com> Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Return-path: Received: from eggs.gnu.org ([2001:4830:134:3::10]:53235) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1gaNHu-00025z-MT for guix-devel@gnu.org; Fri, 21 Dec 2018 11:04:35 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1gaNHq-0004WT-Oc for guix-devel@gnu.org; Fri, 21 Dec 2018 11:04:34 -0500 Received: from mail-pg1-x52b.google.com ([2607:f8b0:4864:20::52b]:46117) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1gaNHq-0004W1-Ec for guix-devel@gnu.org; Fri, 21 Dec 2018 11:04:30 -0500 Received: by mail-pg1-x52b.google.com with SMTP id w7so2686087pgp.13 for ; Fri, 21 Dec 2018 08:04:30 -0800 (PST) In-Reply-To: <87o99f9o2t.fsf@gmail.com> (Chris Marusich's message of "Fri, 21 Dec 2018 02:22:18 -0800") List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+gcggd-guix-devel=m.gmane.org@gnu.org Sender: "Guix-devel" To: Chris Marusich Cc: guix-devel@gnu.org, 33600@debbugs.gnu.org Hi Chris, Thank you for your patience! Chris Marusich writes: > Can you also share what numbers you get when you run measure_get against > berlin.guixsd.org directly? Clearly, the connection from you to > CloudFront is not as performant as it is for others in other parts of > the world, but I wonder if it's still better than accessing berlin > directly. If you could run measure_get against berlin directly and > share the numbers, we can see if it represents any significant > improvement for you. 1. Tested today at home. China Unicom home broadband. 50Mb/s. berlin.guixsd.org: #+BEGIN_EXAMPLE =E2=9E=9C ~ measure_get https://berlin.guixsd.org/nar/gzip/1bq783rbkzv9z= 9zdhivbvfzhsz2s5yac-linux-libre-4.19 % Total % Received % Xferd Average Speed Time Time Time C= urrent Dload Upload Total Spent Left S= peed 54 66.6M 54 36.3M 0 0 14981 0 1:17:45 0:42:25 0:35:20 = 0 url_effective: https://berlin.guixsd.org/nar/gzip/1bq783rbkzv9z9zdhivbvfz= hsz2s5yac-linux-libre-4.19 http_code: 200 num_connects: 1 num_redirects: 0 remote_ip: 141.80.181.40 remote_port: 443 size_download: 38141765 B speed_download: 14981.000 B/s time_appconnect: 3.228601 s time_connect: 2.213136 s time_namelookup: 0.856194 s time_pretransfer: 3.228820 s time_redirect: 0.000000 s time_starttransfer: 3.851583 s time_total: 2545.889968 s curl: (56) GnuTLS recv error (-54): Error in the pull function. =E2=9E=9C ~ measure_get https://berlin.guixsd.org/nar/gzip/1bq783rbkzv9z= 9zdhivbvfzhsz2s5yac-linux-libre-4.19 % Total % Received % Xferd Average Speed Time Time Time C= urrent Dload Upload Total Spent Left S= peed 100 66.6M 100 66.6M 0 0 20415 0 0:57:03 0:57:03 --:--:-- = 25983 url_effective: https://berlin.guixsd.org/nar/gzip/1bq783rbkzv9z9zdhivbvfz= hsz2s5yac-linux-libre-4.19 http_code: 200 num_connects: 1 num_redirects: 0 remote_ip: 141.80.181.40 remote_port: 443 size_download: 69899433 B speed_download: 20415.000 B/s time_appconnect: 2.005881 s time_connect: 0.785257 s time_namelookup: 0.000520 s time_pretransfer: 2.006124 s time_redirect: 0.000000 s time_starttransfer: 3.031582 s time_total: 3423.813489 s #+END_EXAMPLE berlin-mirror.marusich.info: #+BEGIN_EXAMPLE =E2=9E=9C ~ measure_get https://berlin-mirror.marusich.info/nar/gzip/1bq= 783rbkzv9z9zdhivbvfzhsz2s5yac-linux-libre-4.19 % Total % Received % Xferd Average Speed Time Time Time C= urrent Dload Upload Total Spent Left S= peed 100 66.6M 100 66.6M 0 0 1470k 0 0:00:46 0:00:46 --:--:-- = 2368k url_effective: https://berlin-mirror.marusich.info/nar/gzip/1bq783rbkzv9z= 9zdhivbvfzhsz2s5yac-linux-libre-4.19 http_code: 200 num_connects: 1 num_redirects: 0 remote_ip: 13.35.20.87 remote_port: 443 size_download: 69899433 B speed_download: 1505934.000 B/s time_appconnect: 3.343496 s time_connect: 3.164926 s time_namelookup: 3.060655 s time_pretransfer: 3.343581 s time_redirect: 0.000000 s time_starttransfer: 5.766543 s time_total: 46.416495 s =E2=9E=9C ~ measure_get https://berlin-mirror.marusich.info/nar/gzip/1bq= 783rbkzv9z9zdhivbvfzhsz2s5yac-linux-libre-4.19 % Total % Received % Xferd Average Speed Time Time Time C= urrent Dload Upload Total Spent Left S= peed 100 66.6M 100 66.6M 0 0 3182k 0 0:00:21 0:00:21 --:--:-- = 4612k url_effective: https://berlin-mirror.marusich.info/nar/gzip/1bq783rbkzv9z= 9zdhivbvfzhsz2s5yac-linux-libre-4.19 http_code: 200 num_connects: 1 num_redirects: 0 remote_ip: 13.35.20.87 remote_port: 443 size_download: 69899433 B speed_download: 3259170.000 B/s time_appconnect: 0.225982 s time_connect: 0.070428 s time_namelookup: 0.000483 s time_pretransfer: 0.226055 s time_redirect: 0.000000 s time_starttransfer: 0.306621 s time_total: 21.447966 s #+END_EXAMPLE 2. Tested today at my office. China Telecom enterprise broadband. 50Mb/s. berlin.guixsd.org: #+BEGIN_EXAMPLE =E2=9E=9C ~ measure_get https://berlin.guixsd.org/nar/gzip/1bq783rbkzv9z= 9zdhivbvfzhsz2s5yac-linux-libre-4.19 % Total % Received % Xferd Average Speed Time Time Time C= urrent Dload Upload Total Spent Left S= peed 100 66.6M 100 66.6M 0 0 3091k 0 0:00:22 0:00:22 --:--:-- = 3649k url_effective: https://berlin.guixsd.org/nar/gzip/1bq783rbkzv9z9zdhivbvfz= hsz2s5yac-linux-libre-4.19 http_code: 200 num_connects: 1 num_redirects: 0 remote_ip: 141.80.181.40 remote_port: 443 size_download: 69899433 B speed_download: 3166021.000 B/s time_appconnect: 3.288213 s time_connect: 2.733554 s time_namelookup: 2.486754 s time_pretransfer: 3.288320 s time_redirect: 0.000000 s time_starttransfer: 3.780341 s time_total: 22.078489 s =E2=9E=9C ~ measure_get https://berlin.guixsd.org/nar/gzip/1bq783rbkzv9z= 9zdhivbvfzhsz2s5yac-linux-libre-4.19 % Total % Received % Xferd Average Speed Time Time Time C= urrent Dload Upload Total Spent Left S= peed 100 66.6M 100 66.6M 0 0 3499k 0 0:00:19 0:00:19 --:--:-- = 4011k url_effective: https://berlin.guixsd.org/nar/gzip/1bq783rbkzv9z9zdhivbvfz= hsz2s5yac-linux-libre-4.19 http_code: 200 num_connects: 1 num_redirects: 0 remote_ip: 141.80.181.40 remote_port: 443 size_download: 69899433 B speed_download: 3583667.000 B/s time_appconnect: 0.761166 s time_connect: 0.244415 s time_namelookup: 0.000981 s time_pretransfer: 0.761275 s time_redirect: 0.000000 s time_starttransfer: 1.247935 s time_total: 19.505515 s #+END_EXAMPLE berlin-mirror.marusich.info: #+BEGIN_EXAMPLE =E2=9E=9C ~ measure_get https://berlin-mirror.marusich.info/nar/gzip/1bq= 783rbkzv9z9zdhivbvfzhsz2s5yac-linux-libre-4.19 % Total % Received % Xferd Average Speed Time Time Time C= urrent Dload Upload Total Spent Left S= peed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- = 0 49 66.6M 49 32.8M 0 0 19012 0 1:01:16 0:30:13 0:31:03 = 29265 url_effective: https://berlin-mirror.marusich.info/nar/gzip/1bq783rbkzv9z= 9zdhivbvfzhsz2s5yac-linux-libre-4.19 http_code: 200 num_connects: 1 num_redirects: 0 remote_ip: 52.85.158.22 remote_port: 443 size_download: 34488133 B speed_download: 19012.000 B/s time_appconnect: 2.958899 s time_connect: 2.487483 s time_namelookup: 2.271520 s time_pretransfer: 2.959321 s time_redirect: 0.000000 s time_starttransfer: 5.447693 s time_total: 1813.938029 s curl: (92) HTTP/2 stream 0 was not closed cleanly: INTERNAL_ERROR (err 2) #+END_EXAMPLE Although both 13.35.20.0/24 and 52.85.158.0/24 IP ranges are located at Sea= ttle, the result shows that the connection to 13.35.20.0/24 is significantly fast= er. This is pretty normal in China. It's definitely caused by the GFW. Giant internet service providers (e.g. AWS) are the primary targets of the GFW. From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from eggs.gnu.org ([2001:4830:134:3::10]:53456) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1gaNIR-0002YA-8t for guix-patches@gnu.org; Fri, 21 Dec 2018 11:05:08 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1gaNIM-0004w2-PM for guix-patches@gnu.org; Fri, 21 Dec 2018 11:05:06 -0500 Received: from debbugs.gnu.org ([208.118.235.43]:54432) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1gaNIM-0004vj-Ku for guix-patches@gnu.org; Fri, 21 Dec 2018 11:05:02 -0500 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1gaNIM-0007dB-Aq for guix-patches@gnu.org; Fri, 21 Dec 2018 11:05:02 -0500 Subject: [bug#33600] CDN performance Resent-Message-ID: From: Meiyo Peng References: <20181203154335.10366-1-ludo@gnu.org> <87tvju6145.fsf@gnu.org> <87ftv7l6gy.fsf@gmail.com> <871s6qzo6m.fsf_-_@gnu.org> <874lbk63se.fsf@gmail.com> <877egdyk82.fsf@gmail.com> <87d0q01wdx.fsf@gmail.com> <87o99f9o2t.fsf@gmail.com> Date: Sat, 22 Dec 2018 00:04:12 +0800 In-Reply-To: <87o99f9o2t.fsf@gmail.com> (Chris Marusich's message of "Fri, 21 Dec 2018 02:22:18 -0800") Message-ID: <87y38isw77.fsf@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-patches-bounces+kyle=kyleam.com@gnu.org Sender: "Guix-patches" To: Chris Marusich Cc: guix-devel@gnu.org, 33600@debbugs.gnu.org Hi Chris, Thank you for your patience! Chris Marusich writes: > Can you also share what numbers you get when you run measure_get against > berlin.guixsd.org directly? Clearly, the connection from you to > CloudFront is not as performant as it is for others in other parts of > the world, but I wonder if it's still better than accessing berlin > directly. If you could run measure_get against berlin directly and > share the numbers, we can see if it represents any significant > improvement for you. 1. Tested today at home. China Unicom home broadband. 50Mb/s. berlin.guixsd.org: #+BEGIN_EXAMPLE =E2=9E=9C ~ measure_get https://berlin.guixsd.org/nar/gzip/1bq783rbkzv9z= 9zdhivbvfzhsz2s5yac-linux-libre-4.19 % Total % Received % Xferd Average Speed Time Time Time C= urrent Dload Upload Total Spent Left S= peed 54 66.6M 54 36.3M 0 0 14981 0 1:17:45 0:42:25 0:35:20 = 0 url_effective: https://berlin.guixsd.org/nar/gzip/1bq783rbkzv9z9zdhivbvfz= hsz2s5yac-linux-libre-4.19 http_code: 200 num_connects: 1 num_redirects: 0 remote_ip: 141.80.181.40 remote_port: 443 size_download: 38141765 B speed_download: 14981.000 B/s time_appconnect: 3.228601 s time_connect: 2.213136 s time_namelookup: 0.856194 s time_pretransfer: 3.228820 s time_redirect: 0.000000 s time_starttransfer: 3.851583 s time_total: 2545.889968 s curl: (56) GnuTLS recv error (-54): Error in the pull function. =E2=9E=9C ~ measure_get https://berlin.guixsd.org/nar/gzip/1bq783rbkzv9z= 9zdhivbvfzhsz2s5yac-linux-libre-4.19 % Total % Received % Xferd Average Speed Time Time Time C= urrent Dload Upload Total Spent Left S= peed 100 66.6M 100 66.6M 0 0 20415 0 0:57:03 0:57:03 --:--:-- = 25983 url_effective: https://berlin.guixsd.org/nar/gzip/1bq783rbkzv9z9zdhivbvfz= hsz2s5yac-linux-libre-4.19 http_code: 200 num_connects: 1 num_redirects: 0 remote_ip: 141.80.181.40 remote_port: 443 size_download: 69899433 B speed_download: 20415.000 B/s time_appconnect: 2.005881 s time_connect: 0.785257 s time_namelookup: 0.000520 s time_pretransfer: 2.006124 s time_redirect: 0.000000 s time_starttransfer: 3.031582 s time_total: 3423.813489 s #+END_EXAMPLE berlin-mirror.marusich.info: #+BEGIN_EXAMPLE =E2=9E=9C ~ measure_get https://berlin-mirror.marusich.info/nar/gzip/1bq= 783rbkzv9z9zdhivbvfzhsz2s5yac-linux-libre-4.19 % Total % Received % Xferd Average Speed Time Time Time C= urrent Dload Upload Total Spent Left S= peed 100 66.6M 100 66.6M 0 0 1470k 0 0:00:46 0:00:46 --:--:-- = 2368k url_effective: https://berlin-mirror.marusich.info/nar/gzip/1bq783rbkzv9z= 9zdhivbvfzhsz2s5yac-linux-libre-4.19 http_code: 200 num_connects: 1 num_redirects: 0 remote_ip: 13.35.20.87 remote_port: 443 size_download: 69899433 B speed_download: 1505934.000 B/s time_appconnect: 3.343496 s time_connect: 3.164926 s time_namelookup: 3.060655 s time_pretransfer: 3.343581 s time_redirect: 0.000000 s time_starttransfer: 5.766543 s time_total: 46.416495 s =E2=9E=9C ~ measure_get https://berlin-mirror.marusich.info/nar/gzip/1bq= 783rbkzv9z9zdhivbvfzhsz2s5yac-linux-libre-4.19 % Total % Received % Xferd Average Speed Time Time Time C= urrent Dload Upload Total Spent Left S= peed 100 66.6M 100 66.6M 0 0 3182k 0 0:00:21 0:00:21 --:--:-- = 4612k url_effective: https://berlin-mirror.marusich.info/nar/gzip/1bq783rbkzv9z= 9zdhivbvfzhsz2s5yac-linux-libre-4.19 http_code: 200 num_connects: 1 num_redirects: 0 remote_ip: 13.35.20.87 remote_port: 443 size_download: 69899433 B speed_download: 3259170.000 B/s time_appconnect: 0.225982 s time_connect: 0.070428 s time_namelookup: 0.000483 s time_pretransfer: 0.226055 s time_redirect: 0.000000 s time_starttransfer: 0.306621 s time_total: 21.447966 s #+END_EXAMPLE 2. Tested today at my office. China Telecom enterprise broadband. 50Mb/s. berlin.guixsd.org: #+BEGIN_EXAMPLE =E2=9E=9C ~ measure_get https://berlin.guixsd.org/nar/gzip/1bq783rbkzv9z= 9zdhivbvfzhsz2s5yac-linux-libre-4.19 % Total % Received % Xferd Average Speed Time Time Time C= urrent Dload Upload Total Spent Left S= peed 100 66.6M 100 66.6M 0 0 3091k 0 0:00:22 0:00:22 --:--:-- = 3649k url_effective: https://berlin.guixsd.org/nar/gzip/1bq783rbkzv9z9zdhivbvfz= hsz2s5yac-linux-libre-4.19 http_code: 200 num_connects: 1 num_redirects: 0 remote_ip: 141.80.181.40 remote_port: 443 size_download: 69899433 B speed_download: 3166021.000 B/s time_appconnect: 3.288213 s time_connect: 2.733554 s time_namelookup: 2.486754 s time_pretransfer: 3.288320 s time_redirect: 0.000000 s time_starttransfer: 3.780341 s time_total: 22.078489 s =E2=9E=9C ~ measure_get https://berlin.guixsd.org/nar/gzip/1bq783rbkzv9z= 9zdhivbvfzhsz2s5yac-linux-libre-4.19 % Total % Received % Xferd Average Speed Time Time Time C= urrent Dload Upload Total Spent Left S= peed 100 66.6M 100 66.6M 0 0 3499k 0 0:00:19 0:00:19 --:--:-- = 4011k url_effective: https://berlin.guixsd.org/nar/gzip/1bq783rbkzv9z9zdhivbvfz= hsz2s5yac-linux-libre-4.19 http_code: 200 num_connects: 1 num_redirects: 0 remote_ip: 141.80.181.40 remote_port: 443 size_download: 69899433 B speed_download: 3583667.000 B/s time_appconnect: 0.761166 s time_connect: 0.244415 s time_namelookup: 0.000981 s time_pretransfer: 0.761275 s time_redirect: 0.000000 s time_starttransfer: 1.247935 s time_total: 19.505515 s #+END_EXAMPLE berlin-mirror.marusich.info: #+BEGIN_EXAMPLE =E2=9E=9C ~ measure_get https://berlin-mirror.marusich.info/nar/gzip/1bq= 783rbkzv9z9zdhivbvfzhsz2s5yac-linux-libre-4.19 % Total % Received % Xferd Average Speed Time Time Time C= urrent Dload Upload Total Spent Left S= peed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- = 0 49 66.6M 49 32.8M 0 0 19012 0 1:01:16 0:30:13 0:31:03 = 29265 url_effective: https://berlin-mirror.marusich.info/nar/gzip/1bq783rbkzv9z= 9zdhivbvfzhsz2s5yac-linux-libre-4.19 http_code: 200 num_connects: 1 num_redirects: 0 remote_ip: 52.85.158.22 remote_port: 443 size_download: 34488133 B speed_download: 19012.000 B/s time_appconnect: 2.958899 s time_connect: 2.487483 s time_namelookup: 2.271520 s time_pretransfer: 2.959321 s time_redirect: 0.000000 s time_starttransfer: 5.447693 s time_total: 1813.938029 s curl: (92) HTTP/2 stream 0 was not closed cleanly: INTERNAL_ERROR (err 2) #+END_EXAMPLE Although both 13.35.20.0/24 and 52.85.158.0/24 IP ranges are located at Sea= ttle, the result shows that the connection to 13.35.20.0/24 is significantly fast= er. This is pretty normal in China. It's definitely caused by the GFW. Giant internet service providers (e.g. AWS) are the primary targets of the GFW.