unofficial mirror of notmuch@notmuchmail.org
 help / color / mirror / code / Atom feed
* A functional (but rudimentary) test suite for notmuch
@ 2010-02-04 20:50 Carl Worth
  2010-02-04 21:27 ` Oliver Charles
  0 siblings, 1 reply; 36+ messages in thread
From: Carl Worth @ 2010-02-04 20:50 UTC (permalink / raw)
  To: notmuch

[-- Attachment #1: Type: text/plain, Size: 2037 bytes --]

I've just pushed out some improvements to make the little notmuch-test
script I had posted earlier into an actual test suite. I've included the
output of a run of the test suite below so that you can get an idea of
what it does so far.

What I'd like to see going forward is that new features get submitted
along with new test cases for the test suite. And it would be great if
everyone submitting patches could get into the habit of running:

	./test/notmuch-test

before submitting.

The test suite is still extremely rudimentary. Here are some things I'd
like to improve about it:

  * Make the test suite more modular. Right now it's just one long shell
    script---so it's not even easy to see where one test ends and the
    next begins.

  * Allow for executing a subset of the test suite, (eg. notmuch-test reply)

    I just wrote a bunch of "notmuch reply" tests and it was annoying to
    have to wait for all of the "notmuch new" tests to run each time.

  * Actually document what it takes to write a test, (what the test can
    assume about the environment in which its running, what functions
    are available to call, etc.)

I hope others find this useful.

-Carl

Testing "notmuch new" in several variations:
 No new messages...			PASS
 Single new message...			PASS
 Multiple new messages...		PASS
 No new messages (non-empty DB)... 	PASS
 New directories...			PASS
 Alternate inode order...		PASS
 Message moved in...			PASS
 Renamed message...			PASS
 Deleted message...			PASS
 Renamed directory...			PASS
 Deleted directory...			PASS
 New directory (at end of list)... 	PASS
 Deleted directory (end of list)... 	PASS
 New symlink to directory...		PASS
 New symlink to a file...		PASS
 New two-level directory...		PASS
 Deleted two-level directory... 	PASS

Testing "notmuch reply" in several variations:
 Basic reply...				PASS
 Multiple recipients...			PASS
 Reply with CC...			PASS
 Reply from alternate address...	PASS
 Support for Reply-To...		PASS
 Un-munging Reply-To...			PASS
Notmuch test suite complete.

[-- Attachment #2: Type: application/pgp-signature, Size: 189 bytes --]

^ permalink raw reply	[flat|nested] 36+ messages in thread

end of thread, other threads:[~2010-04-15 18:08 UTC | newest]

Thread overview: 36+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2010-02-04 20:50 A functional (but rudimentary) test suite for notmuch Carl Worth
2010-02-04 21:27 ` Oliver Charles
2010-02-04 23:29   ` Carl Worth
2010-02-06 15:27     ` Oliver Charles
2010-02-08 15:14       ` Michal Sojka
2010-02-08 15:16         ` [PATCH 1/3] Copy test framework from Git Michal Sojka
2010-02-08 15:16         ` [PATCH 2/3] Update test framework for use with notmuch Michal Sojka
2010-02-08 15:16         ` [PATCH 3/3] Convert the actual tests to the new framework Michal Sojka
2010-02-11 21:42         ` A functional (but rudimentary) test suite for notmuch Carl Worth
2010-02-12 14:47           ` Michal Sojka
2010-02-12 16:33             ` Carl Worth
2010-02-15  8:39               ` Using test-lib.sh under GPLv3? Michal Sojka
2010-02-16 10:27                 ` Jakub Narebski
2010-02-16 13:06                   ` Michal Sojka
2010-02-16 22:07                     ` Avery Pennarun
2010-02-17  0:26                     ` Jakub Narebski
2010-02-16 20:54                 ` Junio C Hamano
2010-02-19  8:19                   ` Michal Sojka
2010-02-19  8:44                     ` Sverre Rabbelier
2010-02-19 10:39                     ` Johannes Schindelin
2010-02-19 17:15                       ` Pierre Habouzit
2010-02-19 19:01                       ` Carl Worth
2010-02-19 21:04                         ` Johannes Schindelin
2010-02-20 19:55                           ` [PATCH] test-lib.sh: Add explicit license detail, with change from GPLv2 to GPLv2+ Carl Worth
2010-02-20 21:28                             ` Junio C Hamano
2010-02-22 19:26                               ` Carl Worth
2010-02-23  3:42                                 ` Junio C Hamano
2010-02-23  3:51                                   ` Tay Ray Chuan
2010-02-23  9:21                                     ` Johannes Schindelin
2010-02-23  6:48                                   ` Matthieu Moy
2010-02-23 18:23                                   ` Carl Worth
2010-02-20 21:49                             ` Tay Ray Chuan
2010-02-20 22:22                             ` Johannes Schindelin
2010-04-06 17:01                             ` Michal Sojka
2010-04-15 18:08                               ` Carl Worth
2010-02-19 17:36                     ` Using test-lib.sh under GPLv3? Johannes Sixt

Code repositories for project(s) associated with this public inbox

	https://yhetil.org/notmuch.git/

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).