unofficial mirror of notmuch@notmuchmail.org
 help / color / mirror / code / Atom feed
From: David Bremner <david@tethera.net>
To: Notmuch Mail <notmuch@notmuchmail.org>
Subject: experimental logging branch
Date: Sat, 10 Dec 2011 23:27:02 -0400	[thread overview]
Message-ID: <87obvfu6t5.fsf@zancas.localnet> (raw)

[-- Attachment #1: Type: text/plain, Size: 1743 bytes --]


I have pushed a branch jlog 

  git://pivot.cs.unb.ca/notmuch.git

This uses the jlog library (http://labs.omniti.com/labs/jlog)
to atomically log messages in pub-sub model.

On this branch you can enable logging of tagging operations by 

   notmuch config set log.subscribers 'name1;name2;name3'

the "subscriber names" identify clients (one could imagine one client
deals with general tag syncing, another with nmbug, or so).
  
One can read the log via the jlog api (there are perl bindings) or via
the "notmuch log" command. 

    notmuch log name1 

will print all of the log messages since the last time the queue was
read.

for e.g., tag removal, these lines look like

T-1322702130-26068-3-git-send-email-bremner@debian.org test
T-1322702130-26068-1-git-send-email-bremner@debian.org test
T-7fbe6befcf31881a9bca672f55b93501249a220c.1322859389.git.jani@nikula.org test
T-716da00e176e1dc6af0ba248caee40acee733120.1322859389.git.jani@nikula.org test

An example application would be a cron job that writes all tag changes
to some nmbug like git repo.

There are a few rough edges and I expect to rebase the branch a bit
more, but feel free to have a look at it.  I guess I'm curious if people
think jlog is an acceptable dependency, and whether the whole logging
thing seems worthwhile. 

I did some preliminary tests, and for adding or deleting a tag to 200k
messages, this added about a 5% time penalty. I didn't notice any really
heavy I/O (no SSD here, but i7 cpu). Tests were roughly 95% CPU bound.

There are some preliminary debian packages for jlog at 

      git://pivot.cs.unb.ca/jlog.git

The upstream source for jlog is at 
    
    https://github.com/omniti-labs/jlog




[-- Attachment #2: Type: application/pgp-signature, Size: 315 bytes --]

             reply	other threads:[~2011-12-11  3:27 UTC|newest]

Thread overview: 2+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2011-12-11  3:27 David Bremner [this message]
2011-12-12  0:12 ` experimental logging branch David Bremner

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

  List information: https://notmuchmail.org/

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=87obvfu6t5.fsf@zancas.localnet \
    --to=david@tethera.net \
    --cc=notmuch@notmuchmail.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
Code repositories for project(s) associated with this public inbox

	https://yhetil.org/notmuch.git/

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).