unofficial mirror of meta@public-inbox.org
 help / color / mirror / Atom feed
* [PATCH 0/7] index + extindex interaction improvements
@ 2020-12-25 10:21 Eric Wong
  2020-12-25 10:21 ` [PATCH 1/7] index: disable --fast-noop on --reindex Eric Wong
                   ` (7 more replies)
  0 siblings, 8 replies; 13+ messages in thread
From: Eric Wong @ 2020-12-25 10:21 UTC (permalink / raw)
  To: meta

Some things which make -index less painful when auto-updating
external indices.

"public-inbox-extindex --all" itself is still painfully slow
with 50K inboxes, but I think that can only be used once for
initialization and -index can be relied on for all incremental
updates.


Eric Wong (7):
  index: disable --fast-noop on --reindex
  extsearchidx: delay SQLite availability checks
  extsearchidx: close DB handles after use if FD constrained
  index: do not attach inbox to extindex unless updated
  index: fix --no-fsync flag propagation to extindex
  v2writable: don't verify tip if reindexing
  index: filter out indexlevel=basic from extindex

 lib/PublicInbox/Admin.pm        |  1 +
 lib/PublicInbox/ExtSearchIdx.pm | 96 +++++++++++++++++++++------------
 lib/PublicInbox/SearchIdx.pm    |  2 +
 lib/PublicInbox/V2Writable.pm   | 36 +++++++++----
 script/public-inbox-index       | 27 ++++++----
 5 files changed, 109 insertions(+), 53 deletions(-)


^ permalink raw reply	[flat|nested] 13+ messages in thread

end of thread, other threads:[~2020-12-26  1:44 UTC | newest]

Thread overview: 13+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2020-12-25 10:21 [PATCH 0/7] index + extindex interaction improvements Eric Wong
2020-12-25 10:21 ` [PATCH 1/7] index: disable --fast-noop on --reindex Eric Wong
2020-12-25 10:21 ` [PATCH 2/7] extsearchidx: delay SQLite availability checks Eric Wong
2020-12-25 10:21 ` [PATCH 3/7] extsearchidx: close DB handles after use if FD constrained Eric Wong
2020-12-25 10:21 ` [PATCH 4/7] index: do not attach inbox to extindex unless updated Eric Wong
2020-12-25 10:21 ` [PATCH 5/7] index: fix --no-fsync flag propagation to extindex Eric Wong
2020-12-25 10:21 ` [PATCH 6/7] v2writable: don't verify tip if reindexing Eric Wong
2020-12-25 10:21 ` [PATCH 7/7] index: filter out indexlevel=basic from extindex Eric Wong
2020-12-25 10:39 ` [PATCH 0/7] index + extindex interaction improvements Eric Wong
2020-12-26  1:44   ` [PATCH 0/3] extindex --watch support Eric Wong
2020-12-26  1:44     ` [PATCH 1/3] default to CORE::warn in $SIG{__WARN__} handlers Eric Wong
2020-12-26  1:44     ` [PATCH 2/3] extindex: --watch for inotify-based updates Eric Wong
2020-12-26  1:44     ` [PATCH 3/3] init: use the return value of rel2abs_collapsed Eric Wong

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).