From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on dcvr.yhbt.net X-Spam-Level: X-Spam-ASN: AS3701 140.211.0.0/16 X-Spam-Status: No, score=-3.4 required=3.0 tests=AWL,BAYES_00, RCVD_IN_DNSWL_MED,RCVD_IN_MSPIKE_H3,RCVD_IN_MSPIKE_WL,SPF_HELO_PASS, SPF_PASS shortcircuit=no autolearn=ham autolearn_force=no version=3.4.6 Received: from smtp.gentoo.org (woodpecker.gentoo.org [140.211.166.183]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by dcvr.yhbt.net (Postfix) with ESMTPS id E7C581F572 for ; Mon, 22 Jul 2024 01:27:42 +0000 (UTC) Received: from grubbs.orbis-terrarum.net (localhost [127.0.0.1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by smtp.gentoo.org (Postfix) with ESMTPS id A6A69343052 for ; Mon, 22 Jul 2024 01:27:41 +0000 (UTC) Received: from grubbs.orbis-terrarum.net (localhost [127.0.0.1]) by grubbs.orbis-terrarum.net (Postfix) with ESMTP id 31DBA260182 for ; Mon, 22 Jul 2024 01:27:41 +0000 (UTC) Received: (qmail 531716 invoked by uid 10000); 22 Jul 2024 01:27:41 -0000 Date: Mon, 22 Jul 2024 01:27:41 +0000 From: "Robin H. Johnson" To: meta@public-inbox.org Subject: more debugging for gentoo usage & supporting feature requests Message-ID: MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="35rhS/2a+uFCf0Jd" Content-Disposition: inline List-Id: --35rhS/2a+uFCf0Jd Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hi, I moved the Gentoo instance to a much beefier machine & newer kernel, ingest is a lot faster; but there's still some hiccups. 1. Request for more debugging details about mails: Seems that many of our oldest mails don't get ingested - and there's no output about why. I don't know if -watch actually scanned that folder or not. 1.1. Possibly related: Intended config is that the mail should be ingested regardless of the email address on the headers. Way back in time, the Gentoo lists were renamed a few times, and the files are sorted into the correct folders. I think this impacted any attempted ingest via -mda because there's no other way to override what list a given mail on stdin should be associated with. The headers may be inconsistent, changed style, name, or even be absent in a few cases. 2. What's the intended way for public-inbox-mda to function with no SpamAssassin installed at all? "spamcheck =3D " doesn't seem to do it. 3. As a formal feature request: Change the arguments of: public-inbox-watch=20 - Add --all to mean all lists in the config - no arguments =3D> implicit --all - $LISTNAME/$INBOXPATH =3D> one *OR* more inboxes manually specified. I did a hacky split of the configuration for Gentoo, and things are a LOT more stable with 120 instances; but it's a little wasteful: I'd like to give the high-traffic lists their own instance, and group the low-traffic instances together. Downside of my hacky code is that I have 120 processes that just say "/usr/bin/public-inbox-watch", and I have to be creative to see which list a given process is linked to. 4. Make public-inbox-init NOT attempt to write to any configuration files. Trying to implement segregation of roles: - config files owned by root only; readable by public-inbox users. - source maildirs read-only to user running public-inbox-watch - public-inbox dirs writable to user running public-inbox-watch - public-inbox dirs readable to user running public-inbox-httpd Intent: - public-inbox-httpd CANNOT read or write the source maildirs. - public-inbox-watch CANNOT write the source maildirs. - neither process can write the config file --=20 Robin Hugh Johnson Gentoo Linux: Dev, Infra Lead, Foundation President & Treasurer E-Mail : robbat2@gentoo.org GnuPG FP : 11ACBA4F 4778E3F6 E4EDF38E B27B944E 34884E85 GnuPG FP : 7D0B3CEB E9B85B1F 825BCECF EE05E6F6 A48F6136 --35rhS/2a+uFCf0Jd Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 Comment: Robbat2 @ Orbis-Terrarum Networks - The text below is a digital signature. If it doesn't make any sense to you, ignore it. iQKTBAABCgB9FiEEveu2pS8Vb98xaNkRGTlfI8WIJsQFAmadtYpfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldEJE RUJCNkE1MkYxNTZGREYzMTY4RDkxMTE5Mzk1RjIzQzU4ODI2QzQACgkQGTlfI8WI JsSXVBAApiCQkmjpkaVVxmKV5Udsc5e3koEiEUke/CB71k5Baj4BfjHiNRzbPpWy g4S8gOSRUDH1CADyVojPpJT+Qe1U/2ZrTJSeqLZfFaR57x0CdaEhuJlAdIGcmww6 7SZZHqSbAX8FS2mgIPDdQBAQxKsDqnHkYJk08nkbj9nPZJ5jSY9NW75Zs2KHx/mN UDwtxgkoeI1hKAR+82Pe//Bhf/fWfD9UE3fMX2vvBiOKhd9tSAZSmFyus1AJhkIz Z+Xe15iQhF0rrFPBlqlZCCzhlHQyYq2xMQlZKFvK2D5jKxS9L6WtDdFlqelcXAhz emdI+rGcQg6KetBcN/1yHn2gkDnPJDtvqB6sJ6z6baCsDfilhu9lqgJGlRO4KcrA B6YBbz4PNWJcoy0WHMEoMslfYHJhmoLhdxzfeL8uMvN37zrdyp6iekNv2UZiBrfe q3W0DSkOLWsaLoaI3BOwuPE5995iZiqZ0tYf274gzmkGSNVrpN/rBsIHPzb7gXoo IFLfPQW2BhlF2yT+floPBW2p8AXnk7yzEvdTELdax85BEiZQ9s6ab5eHv/8O4cjg FmT2i70qGDsLxW2ccA1Ozepdkx8u6Vq1jTbeXSBxO0OK6kT8SrcGrvRsjXQN2+uP a++16umymDAYc+GL/5USmq3TA3CNBX8y425f3wZEN9ek6+7LEXY= =xFOY -----END PGP SIGNATURE----- --35rhS/2a+uFCf0Jd--