From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from localhost (localhost [127.0.0.1]) by arlo.cworth.org (Postfix) with ESMTP id 68C696DE0BCA for ; Sun, 21 Aug 2016 02:50:41 -0700 (PDT) X-Virus-Scanned: Debian amavisd-new at cworth.org X-Spam-Flag: NO X-Spam-Score: -0.072 X-Spam-Level: X-Spam-Status: No, score=-0.072 tagged_above=-999 required=5 tests=[AWL=0.240, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.211, SPF_PASS=-0.001] autolearn=disabled Received: from arlo.cworth.org ([127.0.0.1]) by localhost (arlo.cworth.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Geezh8Rvvj3Z for ; Sun, 21 Aug 2016 02:50:39 -0700 (PDT) Received: from resqmta-ch2-04v.sys.comcast.net (resqmta-ch2-04v.sys.comcast.net [69.252.207.36]) by arlo.cworth.org (Postfix) with ESMTPS id 1768B6DE0BBC for ; Sun, 21 Aug 2016 02:50:38 -0700 (PDT) Received: from resomta-ch2-11v.sys.comcast.net ([69.252.207.107]) by resqmta-ch2-04v.sys.comcast.net with SMTP id bPOnb7MXK8PeabPOnb5Oiv; Sun, 21 Aug 2016 09:50:37 +0000 Received: from mail.tremily.us ([73.221.72.168]) by resomta-ch2-11v.sys.comcast.net with SMTP id bPMpb2sQKm7dBbPMpbXFgl; Sun, 21 Aug 2016 09:48:37 +0000 Received: by mail.tremily.us (Postfix, from userid 1000) id B55441E8C4F2; Sun, 21 Aug 2016 02:48:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=tremily.us; s=odin; t=1471772913; bh=NfF9gji03HX4+QxZjXMVh9BBc8iSG89s3FWcCYiWSuk=; h=Date:From:To:Cc:Subject:References:In-Reply-To; b=TYMzwIxE2tnNAj4wWkd/PXJtELyAijyrQxGPdUGxXmYDueIshDbzhWW8B05S43Itf +sBnoX21pXr4UnFMVGnsVgngQK6ioI5lQKEMJM195kUZQv9SQ/05R9oWQmgWa/ukdf nV2OTxhwww63GMy0JQbRXqoflYhjqRjUMP8i5t7E= Date: Sun, 21 Aug 2016 02:48:33 -0700 From: "W. Trevor King" To: notmuch@notmuchmail.org Cc: David Bremner , Steven Allen , Tomi Ollila , Carl Worth , Eric Wong Subject: Re: Mail archives in Git using ssoma (Docker image) Message-ID: <20160821094833.GB2338@odin.tremily.us> References: <20141107190321.GL23609@odin.tremily.us> <20160821043631.GA2338@odin.tremily.us> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="qlTNgmc+xy1dBmNv" Content-Disposition: inline In-Reply-To: <20160821043631.GA2338@odin.tremily.us> OpenPGP: id=39A2F3FA2AB17E5D8764F388FC29BDCDF15F5BE8; url=http://tremily.us/pubkey.txt User-Agent: Mutt/1.5.23 (2014-03-12) X-CMAE-Envelope: MS4wfNtGEPUSDImCRYP7h99YKFOsafZTdwR5OkzVMuAbyRP4AYKhyCnqTwaO99BOohdl35yV007hZiP+aZ3foUdM36E7iJ1iWukOmA/mnmHvVQMHnF3rkTU0 k7XWa9jEc2AMXAFAntihbwYYeYRl6/VdF3xZQp1iwRHjenLl75Bq1/losjXNzfz/znRyfmgrkQZPRElgthU3g0e2vK0gdz3S6chE5OLxJIAdSnyEt/a3sU95 IQiizDaI8u9S3QMuzXVeAT2fUvnp5F48yNf7NPC6TSrVxdXeka3ScsVrLadq5sisAmw6WxQBIBgbj8EryuxfZw== X-BeenThere: notmuch@notmuchmail.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: "Use and development of the notmuch mail system." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 21 Aug 2016 09:50:41 -0000 --qlTNgmc+xy1dBmNv Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sat, Aug 20, 2016 at 09:36:31PM -0700, W. Trevor King wrote: > [2]: git://tremily.us/notmuch-archives.git This is the ssoma archive (with the data in it). I just set up a basic HTTP archive (following [1]) based on a Docker image [2] (Gentoo doesn't package all the Perl dependencies public-inbox needs). Dockerfile for rebuilding the image is in [2]. I'm currently hosting the archives (HTTP only) at [3]. Spinning that up from the Docker image looks like: $ mkdir srv $ git clone --bare git://tremily.us/notmuch-archives.git srv/notmuch $ echo 'Notmuch -- Just an email system' >srv/notmuch.git/description $ git config -f srv/notmuch.git/config publicinbox.http http://tremily.us $ git config -f srv/notmuch.git/config publicinbox.email notmuch@notmuchm= ail.org $ docker run --name notmuch-archives -d -p 80:8080 -v ${PWD}/srv/:/srv/ w= king/public-inbox (although I'm using -p ###:8080 and have an Nginx reverse-proxy in front). It's not updating automatically yet, but that will probably look like: 1. Pull new mbox [4]. 2. Import into notmuch-archives [5]. 3. Re-run public-inbox-index (this could probably be via =E2=80=98docker ex= ec =E2=80=A6=E2=80=99. But I'll have to test that to confirm. And ideally we'd be using ssoma-mda or similar directly, instead of going through mbox, but I'd rather get the official headers on the stored mail than be efficient ;). One shift from Gmane's mid.gmane.org/=E2=80=A6 is that the public-inbox UI Message-ID lookup is per-bucket, and public-inbox seems to be encouraging per-list buckets. And while I feel like I had a good grasp of the ssoma format two years ago, I know very little about Perl and public-inbox. I'm sure you could setup a public-inbox host that is more efficient than what's currently in my Docker image. Cheers, Trevor [1]: http://public-inbox.org/INSTALL [2]: https://hub.docker.com/r/wking/public-inbox/ [3]: http://tremily.us/notmuch/ [4]: https://notmuchmail.org/archives/notmuch.mbox [5]: id:20160821043631.GA2338@odin.tremily.us --=20 This email may be signed or encrypted with GnuPG (http://www.gnupg.org). For more information, see http://en.wikipedia.org/wiki/Pretty_Good_Privacy --qlTNgmc+xy1dBmNv Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQIcBAEBAgAGBQJXuXjuAAoJEBBpoQVgXJg1YjQQAJVbFwoWkG6OYwOFOZeYVh1a 3MPFE+qiEmTELBxKKjhcQaQz93PtFccjfbRQz7ZSSxQ2NP700I+V7HW6zO6chseu K9PfGZwTJpDBNeOtON+TO/qbUMjvb9ISHSey13ufKRGm4RLbR9NcpP6Y0vcSv5oL VXFWSk+ph40/hkxmc8E5Ne6SRoXIgfCwf0W+8/Aokqof3cs5ek0GTH4QnlzQY7xe uHXoUz8CQdWVGGnSrgAwyy/wSHba4/Zc+fWxLAjTvIkoP9m3rkIFxcxPcRNKPFii CtG04UKLqo1IrvgJ0HzCqLqxDTz6+to9X4ZXveVXM0FSUPjZV9H86SKNHTUonbLi LWnQ8GwSxTZRBt16x0pkbRfbbtg5GC4wvgzlhwbG1DGCGkvkn/rEJukxpt9besJj pwcRZT0rnZTWMweeDxnaaGYMnO7VQcWjsKZdNYd+3Cx23bPI1oIVIusmNF5dqSAB fJWD3tQo+pa4R6JzbLh3VRIEfOdYc6Xd139Turjk5TckZ0P167yncttf1kobHQVb 6k6c/0o2yx8eHy7AaZJL1EbTm2//7LNjPAiBTOwb3NcFWFVHeq/P047j7mNLUH+L TYnw7iTMeUf9J4s3URdzZQt6QYYvafRT4zgYWT2kRC/SdQW5eWkUOZQzC25UNzsF xP7M8EKomqGBnEvsVwqP =3ojA -----END PGP SIGNATURE----- --qlTNgmc+xy1dBmNv--