From: Austin Clements <aclements@csail.mit.edu>
To: david@tethera.net, notmuch@notmuchmail.org
Cc: David Bremner <bremner@debian.org>
Subject: Re: [Patch v2 10/11] perf-test: split basic into 00-new and 01-dump-restore
Date: Mon, 10 Dec 2012 23:50:45 -0500 [thread overview]
Message-ID: <87hantnqe2.fsf@awakening.csail.mit.edu> (raw)
In-Reply-To: <1354762908-5788-11-git-send-email-david@tethera.net>
On Wed, 05 Dec 2012, david@tethera.net wrote:
> From: David Bremner <bremner@debian.org>
>
> We rely on subsequent "notmuch new" invocations being relatively fast
> rather than trying to detect if notmuch-new needs to be run.
> ---
> performance-test/00-new | 21 +++++++++++++++++++++
> performance-test/01-dump-restore | 15 +++++++++++++++
> performance-test/README | 8 ++++++--
> performance-test/basic | 20 --------------------
> performance-test/notmuch-perf-test | 3 ++-
> 5 files changed, 44 insertions(+), 23 deletions(-)
> create mode 100755 performance-test/00-new
> create mode 100755 performance-test/01-dump-restore
> delete mode 100755 performance-test/basic
>
> diff --git a/performance-test/00-new b/performance-test/00-new
> new file mode 100755
> index 0000000..02db874
> --- /dev/null
> +++ b/performance-test/00-new
> @@ -0,0 +1,21 @@
> +#!/bin/bash
> +
> +test_description='notmuch new'
> +
> +. ./perf-test-lib.sh
> +
> +uncache_database
> +
> +add_email_corpus
> +
> +print_header
> +
> +time_run 'initial notmuch new' 'notmuch new'
> +
> +cache_database
> +
> +for i in $(seq 2 6); do
> + time_run "notmuch new #$i" 'notmuch new'
> +done
> +
> +time_done
> diff --git a/performance-test/01-dump-restore b/performance-test/01-dump-restore
> new file mode 100755
> index 0000000..09444e3
> --- /dev/null
> +++ b/performance-test/01-dump-restore
> @@ -0,0 +1,15 @@
> +#!/bin/bash
> +
> +test_description='Dump and restore'
> +
> +. ./perf-test-lib.sh
> +
> +add_email_corpus
> +
> +print_header
> +
> +time_run 'notmuch new' 'notmuch new'
> +time_run 'dump *' 'notmuch dump > tags.out'
> +time_run 'restore *' 'notmuch restore < tags.out'
> +
> +time_done
> diff --git a/performance-test/README b/performance-test/README
> index fd5c977..35489a9 100644
> --- a/performance-test/README
> +++ b/performance-test/README
> @@ -51,8 +51,8 @@ Each test script supports the following arguments
> Writing tests
> -------------
>
> -Have a look at "basic" for an example. Sourcing "perf-test-lib.sh" is
> -mandatory. Utility functions include
> +Have a look at "01-dump-restore" for an example. Sourcing
> +"perf-test-lib.sh" is mandatory. Utility functions include
>
> - 'add_email_corpus' unpacks a set of messages and adds them to the database.
> - 'cache_database': makes a snapshot of the current database
> @@ -60,3 +60,7 @@ mandatory. Utility functions include
> database.
> - 'time_done' does the cleanup; comment it out or pass --debug to the
> script to leave the temporary files around.
> +
> +Scripts are run in the order specified in notmuch-perf-test. In the
> +future this order might be chosen automatically so please follow the
> +convention of starting the name with two digits to specify the order.
> diff --git a/performance-test/basic b/performance-test/basic
> deleted file mode 100755
> index 41a7ff1..0000000
> --- a/performance-test/basic
> +++ /dev/null
> @@ -1,20 +0,0 @@
> -#!/bin/bash
> -
> -. ./perf-test-lib.sh
> -
> -uncache_database
> -
> -add_email_corpus
> -
> -print_header
> -
> -time_run 'initial notmuch new' 'notmuch new'
> -
> -cache_database
> -
> -time_run 'second notmuch new' 'notmuch new'
> -time_run 'dump *' 'notmuch dump > tags.out'
> -time_run 'restore *' 'notmuch restore < tags.out'
> -time_run 'tag * +new_tag' "notmuch tag +new_tag '*'"
Did you mean to lose the tag-everything test?
> -
> -time_done
> diff --git a/performance-test/notmuch-perf-test b/performance-test/notmuch-perf-test
> index 1bea345..f93d8a4 100755
> --- a/performance-test/notmuch-perf-test
> +++ b/performance-test/notmuch-perf-test
> @@ -17,7 +17,8 @@ fi
> cd $(dirname "$0")
>
> TESTS="
> - basic
> + 00-new
> + 01-dump-restore
> "
>
> for test in $TESTS; do
> --
> 1.7.10.4
>
> _______________________________________________
> notmuch mailing list
> notmuch@notmuchmail.org
> http://notmuchmail.org/mailman/listinfo/notmuch
next prev parent reply other threads:[~2012-12-11 4:50 UTC|newest]
Thread overview: 15+ messages / expand[flat|nested] mbox.gz Atom feed top
2012-12-06 3:01 Performance test improvements, v2 david
2012-12-06 3:01 ` [Patch v2 01/11] perf-test: propagate non-zero returns from /usr/bin/time david
2012-12-06 3:01 ` [Patch v2 02/11] perf-test: add argument parsing for performance tests david
2012-12-06 3:01 ` [Patch v2 03/11] perf-test: add corpus size to output, compact I/O stats david
2012-12-06 3:01 ` [Patch v2 04/11] perf-test: optionally print description for each group of tests david
2012-12-11 4:31 ` Austin Clements
2012-12-06 3:01 ` [Patch v2 05/11] perf-test: cache unpacked corpus david
2012-12-06 3:01 ` [Patch v2 06/11] perf-test: add caching of xapian database david
2012-12-06 3:01 ` [Patch v2 07/11] perf-test: update README david
2012-12-06 3:01 ` [Patch v2 08/11] perf-test: bump corpus version to 0.3 david
2012-12-06 3:01 ` [Patch v2 09/11] perf-test: unpack tags david
2012-12-06 3:01 ` [Patch v2 10/11] perf-test: split basic into 00-new and 01-dump-restore david
2012-12-11 4:50 ` Austin Clements [this message]
2012-12-06 3:01 ` [Patch v2 11/11] perf-test: use nmbug tags in dump-restore tests david
2012-12-11 4:52 ` Performance test improvements, v2 Austin Clements
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
List information: https://notmuchmail.org/
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=87hantnqe2.fsf@awakening.csail.mit.edu \
--to=aclements@csail.mit.edu \
--cc=bremner@debian.org \
--cc=david@tethera.net \
--cc=notmuch@notmuchmail.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
Code repositories for project(s) associated with this public inbox
https://yhetil.org/notmuch.git/
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).