From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp1 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms11 with LMTPS id MM6sDtii4l8OdwAA0tVLHw (envelope-from ) for ; Wed, 23 Dec 2020 01:52:24 +0000 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp1 with LMTPS id iFh0Ctii4l/TIgAAbx9fmQ (envelope-from ) for ; Wed, 23 Dec 2020 01:52:24 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 0ED6194042C for ; Wed, 23 Dec 2020 01:52:23 +0000 (UTC) Received: from localhost ([::1]:37868 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1krtK9-00007Z-WD for larch@yhetil.org; Tue, 22 Dec 2020 20:52:22 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:41630) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1krtIY-00071r-Ax for guix-devel@gnu.org; Tue, 22 Dec 2020 20:50:42 -0500 Received: from mx1.riseup.net ([198.252.153.129]:60494) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1krtIT-0006fb-J4; Tue, 22 Dec 2020 20:50:41 -0500 Received: from bell.riseup.net (bell-pn.riseup.net [10.0.1.178]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client CN "*.riseup.net", Issuer "Sectigo RSA Domain Validation Secure Server CA" (not verified)) by mx1.riseup.net (Postfix) with ESMTPS id 4D0x3y0rc5zFtQH; Tue, 22 Dec 2020 17:50:22 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=riseup.net; s=squak; t=1608688231; bh=ylMaMt9N81XVzjrhzgWLLLSohjX9uT8V7k3WjsS2ADk=; h=References:From:To:Cc:Subject:In-reply-to:Date:From; b=c3v9ZFkSppFmi8rF6lViOrjqa4OcDV25gL8d7hRbvWJvinh21NsYXcJGzHsB4XkCl Dkf+/Drnwpf6xC47hmbSf0laSdvA7P4YbpuBEEdK/t47n+fGc06EO7dkRseiGE+X3j b4mSpESgrpb62bVs5EkL+GcrHlo+ioveWfa0fODY= X-Riseup-User-ID: 546192363F75D13B6C6C7C34217FCD50A45ADE61C21462CD079FAE118A9CDE63 Received: from [127.0.0.1] (localhost [127.0.0.1]) by bell.riseup.net (Postfix) with ESMTPSA id 4D0x3x1gk2zJr3q; Tue, 22 Dec 2020 17:50:20 -0800 (PST) Received: from localhost (dinosaur [local]) by dinosaur (OpenSMTPD) with ESMTPA id ec56771e; Wed, 23 Dec 2020 01:50:12 +0000 (UTC) References: <87czz24ilu.fsf@riseup.net> <87lfdpzx18.fsf@gnu.org> From: Peng Mei Yu To: Ludovic =?utf-8?Q?Court=C3=A8s?= Subject: Re: SJTUG's Guix mirror is online now In-reply-to: <87lfdpzx18.fsf@gnu.org> Date: Wed, 23 Dec 2020 09:50:12 +0800 Message-ID: <87a6u5uw8b.fsf@riseup.net> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Received-SPF: pass client-ip=198.252.153.129; envelope-from=pengmeiyu@riseup.net; helo=mx1.riseup.net X-Spam_score_int: -27 X-Spam_score: -2.8 X-Spam_bar: -- X-Spam_report: (-2.8 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, UNPARSEABLE_RELAY=0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: guix-devel@gnu.org Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: "Guix-devel" X-Migadu-Flow: FLOW_IN X-Migadu-Spam-Score: -3.02 Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=riseup.net header.s=squak header.b=c3v9ZFkS; dmarc=pass (policy=none) header.from=riseup.net; spf=pass (aspmx1.migadu.com: domain of guix-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-devel-bounces@gnu.org X-Migadu-Queue-Id: 0ED6194042C X-Spam-Score: -3.02 X-Migadu-Scanner: scn1.migadu.com X-TUID: Rzg5bNItKV5R Hi, Ludovic Court=C3=A8s writes: > Peng Mei Yu skribis: > >> After extensive cooperation with SJTUG's maintainers, we are happy to >> announce that SJTUG's Guix mirror is online now. >> >> The substitute URL is: https://mirrors.sjtug.sjtu.edu.cn/guix > > This is great news! > >> Asia residents, especially China residents, will greatly benefit from >> this mirror. Average download speed is about 3MB/s within China, which >> is a 100 times increase compared to ci.guix.gnu.org. >> >> SJTUG's Guix mirror is maintained by students of Shanghai Jiao Tong >> University Linux User Group (SJTUG). We will continue to cooperate with >> them in the near future to ensure this mirror server is fast and stable. > > So you are rsync=E2=80=99ing from ci, right? Is the mirror running =E2= =80=98guix > publish=E2=80=99 to cope with the =E2=80=9Cweird=E2=80=9D file layout in > /var/cache/guix/publish? No. To deal with software repositories that are not easy to have a full sync, maintainers of SJTUG wrote a cache program. When an HTTP request comes, the program tries to find the requested resource from an S3-like storage server. If the resource is found on the storage server, return an HTTP 302 redirection to storage server. Otherwise, return an HTTP 302 redirection to upstream server and fetch the resource from upstream and store it into the storage server. As I said earlier, this does not work well for Guix because Guix client does not handle HTTP 302 redirection correctly. So we tweaked the program a little bit to offer transparent proxy to Guix client. The program is here: https://github.com/sjtug/mirror-intel By the way, I am still waiting for the rsync account of our CI server. If rsync is offered, we may pull guix-publish' cache and write another program to feed the mirror with a full sync. > If you=E2=80=99re interested, you could write an article for the blog pos= t (in > English, but it=E2=80=99d be a good opportunity to start translating the = web > site into Chinese :-)) about your setup and the choices you made. I don't think there are enough things to write in a blog post but I will consider translating the web site. -- Peng Mei Yu