From: Eric Wong <e@80x24.org>
To: meta@public-inbox.org
Subject: [PATCH 0/5] nntp: round 2 of ->ALL extindex speedups
Date: Sat, 28 Nov 2020 05:09:11 +0000 [thread overview]
Message-ID: <20201128050916.5586-1-e@80x24.org> (raw)
All of the O(n) iterations through newsgroups can either go
through the ->ALL extindex or is broken out into long_response
to not monopolize event loops.
So 50-100K newsgroups ought to be usable...
Further speeding up NEWGROUPS will require some MiscIdx
indexing additions, but that no longer hogs up an event
loop iteration.
One remaining problems is startup time with 50-100K newsgroups;
and that affects everything (especially -mda...)
Eric Wong (5):
nntp: NEWGROUPS uses long_response
nntp: speed up mid_lookup() using ->ALL extindex
nntp: art_lookup: use mid_lookup and simplify
nntp: XPATH uses ->ALL extindex, too
nntpd: remove redundant {groups} shortcut
lib/PublicInbox/NNTP.pm | 125 +++++++++++++++++++++++++--------------
lib/PublicInbox/NNTPD.pm | 8 +--
t/extsearch.t | 4 +-
t/nntp.t | 1 -
4 files changed, 87 insertions(+), 51 deletions(-)
next reply other threads:[~2020-11-28 5:09 UTC|newest]
Thread overview: 6+ messages / expand[flat|nested] mbox.gz Atom feed top
2020-11-28 5:09 Eric Wong [this message]
2020-11-28 5:09 ` [PATCH 1/5] nntp: NEWGROUPS uses long_response Eric Wong
2020-11-28 5:09 ` [PATCH 2/5] nntp: speed up mid_lookup() using ->ALL extindex Eric Wong
2020-11-28 5:09 ` [PATCH 3/5] nntp: art_lookup: use mid_lookup and simplify Eric Wong
2020-11-28 5:09 ` [PATCH 4/5] nntp: XPATH uses ->ALL extindex, too Eric Wong
2020-11-28 5:09 ` [PATCH 5/5] nntpd: remove redundant {groups} shortcut Eric Wong
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
List information: https://public-inbox.org/README
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20201128050916.5586-1-e@80x24.org \
--to=e@80x24.org \
--cc=meta@public-inbox.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).