all messages for Emacs-related lists mirrored at yhetil.org
 help / color / mirror / code / Atom feed
From: Eli Zaretskii <eliz@gnu.org>
To: "Rüdiger Sonderfeld" <ruediger@c-plusplus.de>
Cc: emacs-devel@gnu.org
Subject: Re: call for more ert tests
Date: Tue, 25 Jun 2013 21:53:01 +0300	[thread overview]
Message-ID: <8338s6hvjm.fsf@gnu.org> (raw)
In-Reply-To: <22873922.rILsHsxLja@descartes>

> From: Rüdiger Sonderfeld <ruediger@c-plusplus.de>
> Cc: Glenn Morris <rgm@gnu.org>
> Date: Tue, 25 Jun 2013 19:18:25 +0200
> 
> But a real test coverage would require tests for the rendered 
> layout.  Which would be hard to write and even worse probably breaking all the 
> time when rendering is improved and thus the output changes.

The fact that the "correct" results change with development is a fact
of life in every project, not just in Emacs.  It is detected very
simply, when the test fails.  Then you analyze the failure, understand
that the expected results are wrong, and modify them to follow suit.
Case closed.

> Therefore having a policy to demand tests for new features might be counter 
> productive.  On the other hand maintainers should at least ask for test cases 
> when they think a new feature could benefit from tests.  Which in my 
> experience, as somebody who is relatively new to contributing to Emacs, does 
> not seem to happen at all.

If you don't have good test coverage, you cannot regress-test, so you
can never be sure that a change you just made doesn't break something.
It's as simple as that, and I'm sure you know it.




  reply	other threads:[~2013-06-25 18:53 UTC|newest]

Thread overview: 60+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2013-06-24 17:31 call for more ert tests Glenn Morris
2013-06-24 18:21 ` Eli Zaretskii
2013-06-24 18:24   ` Lennart Borgman
2013-07-01 11:35     ` Andreas Röhler
2013-07-01 16:14       ` Stefan Merten
2013-07-01 16:35         ` Andreas Röhler
2013-07-01 16:37       ` Eli Zaretskii
2013-07-01 17:35         ` Eli Zaretskii
2013-07-01 18:44           ` Stephen J. Turnbull
2013-07-01 19:32             ` Eli Zaretskii
2013-07-01 20:34         ` Dmitry Gutov
2013-06-24 18:33   ` Sebastian Wiesner
2013-06-24 18:40     ` Eli Zaretskii
2013-06-24 18:55       ` Sebastian Wiesner
2013-06-24 19:16         ` Eli Zaretskii
2013-06-24 19:20           ` Lennart Borgman
2013-06-24 19:35           ` Óscar Fuentes
2013-06-24 19:59             ` John Wiegley
2013-06-25  1:21               ` Leo Liu
2013-06-25  2:44                 ` John Wiegley
2013-06-25  3:02                   ` Stefan Monnier
2013-06-25  2:31             ` Stephen J. Turnbull
2013-06-25 14:38               ` Eli Zaretskii
2013-06-25 11:06             ` Lars Magne Ingebrigtsen
2013-06-25 12:11               ` Juanma Barranquero
2013-06-25 15:15               ` Eli Zaretskii
2013-06-25 19:18                 ` Lars Magne Ingebrigtsen
2013-06-25 20:12                   ` Eli Zaretskii
2013-06-25 20:36                   ` Sebastian Wiesner
2013-06-25 20:44                     ` Lars Magne Ingebrigtsen
2013-06-28 15:01                       ` Ted Zlatanov
2013-06-28 15:39                         ` Juanma Barranquero
2013-06-28 15:41                         ` Dmitry Gutov
2013-06-26  9:03                     ` Julien Danjou
2013-06-26  5:12                   ` Stephen J. Turnbull
2013-06-24 19:46   ` Glenn Morris
2013-06-25 13:33     ` Noah Lavine
2013-06-25 17:18   ` Rüdiger Sonderfeld
2013-06-25 18:53     ` Eli Zaretskii [this message]
2013-06-25 20:29       ` Dmitry Gutov
2013-07-01 11:45   ` Andreas Röhler
2013-07-01 12:43     ` Ted Zlatanov
2013-07-01 14:13       ` Andreas Röhler
2013-06-24 18:29 ` David Engster
2013-06-24 18:38   ` Glenn Morris
2013-06-24 19:04     ` David Engster
2013-06-25 22:15 ` Daniel Hackney
2013-06-26  9:22 ` Stefan Merten
2013-06-26 12:17   ` Bozhidar Batsov
2013-06-26 15:52     ` Eli Zaretskii
2013-06-26 16:03       ` Bozhidar Batsov
2013-06-26 16:22         ` Eli Zaretskii
2013-06-26 19:01           ` Dmitry Gutov
2013-06-26 19:10             ` Michael Albinus
2013-06-26 19:34               ` Dmitry Gutov
2013-06-26 19:56                 ` Michael Albinus
2013-06-26 19:28             ` Eli Zaretskii
2013-06-26 19:46             ` Teemu Likonen
2013-06-26 15:50   ` Eli Zaretskii
2013-06-29 15:11     ` Stefan Merten

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=8338s6hvjm.fsf@gnu.org \
    --to=eliz@gnu.org \
    --cc=emacs-devel@gnu.org \
    --cc=ruediger@c-plusplus.de \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
Code repositories for project(s) associated with this external index

	https://git.savannah.gnu.org/cgit/emacs.git
	https://git.savannah.gnu.org/cgit/emacs/org-mode.git

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.