unofficial mirror of meta@public-inbox.org
 help / color / mirror / Atom feed
From: Eric Wong <e@80x24.org>
To: meta@public-inbox.org
Subject: [PATCH 0/4] cindex: parallelism++, sockets--
Date: Fri, 31 Mar 2023 10:20:02 +0000	[thread overview]
Message-ID: <20230331102006.1028601-1-e@80x24.org> (raw)

I've noticed `git log -p ...' can take a while to generate
diffs, so being able to do prune work is helpful in the
meantime.

I've also noticed PktOp use was excessive so we now share
sockets across processes without an increase in complexity.

Eric Wong (4):
  ipc: support awaitpid in WQ workers
  cindex: do prune work while waiting for `git log -p'
  cindex: share PktOp socket across prune workers
  cindex: share PktOp across indexing workers

 MANIFEST                         |   1 +
 lib/PublicInbox/CidxLogP.pm      |  29 +++++++
 lib/PublicInbox/CodeSearchIdx.pm | 129 ++++++++++++++++++-------------
 lib/PublicInbox/IPC.pm           |  11 +--
 4 files changed, 110 insertions(+), 60 deletions(-)
 create mode 100644 lib/PublicInbox/CidxLogP.pm

             reply	other threads:[~2023-03-31 10:20 UTC|newest]

Thread overview: 5+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2023-03-31 10:20 Eric Wong [this message]
2023-03-31 10:20 ` [PATCH 1/4] ipc: support awaitpid in WQ workers Eric Wong
2023-03-31 10:20 ` [PATCH 2/4] cindex: do prune work while waiting for `git log -p' Eric Wong
2023-03-31 10:20 ` [PATCH 3/4] cindex: share PktOp socket across prune workers Eric Wong
2023-03-31 10:20 ` [PATCH 4/4] cindex: share PktOp across indexing workers Eric Wong

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

  List information: https://public-inbox.org/README

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20230331102006.1028601-1-e@80x24.org \
    --to=e@80x24.org \
    --cc=meta@public-inbox.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).