From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.org!not-for-mail From: =?UTF-8?B?QW5kcmVhcyBSw7ZobGVy?= Newsgroups: gmane.emacs.devel Subject: Re: call for more ert tests Date: Mon, 01 Jul 2013 13:35:54 +0200 Message-ID: <51D1699A.7020402@online.de> References: <838v1zjrnl.fsf@gnu.org> NNTP-Posting-Host: plane.gmane.org Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Trace: ger.gmane.org 1372678498 4159 80.91.229.3 (1 Jul 2013 11:34:58 GMT) X-Complaints-To: usenet@ger.gmane.org NNTP-Posting-Date: Mon, 1 Jul 2013 11:34:58 +0000 (UTC) To: emacs-devel@gnu.org Original-X-From: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Mon Jul 01 13:35:00 2013 Return-path: Envelope-to: ged-emacs-devel@m.gmane.org Original-Received: from lists.gnu.org ([208.118.235.17]) by plane.gmane.org with esmtp (Exim 4.69) (envelope-from ) id 1UtcNn-00048m-Sg for ged-emacs-devel@m.gmane.org; Mon, 01 Jul 2013 13:35:00 +0200 Original-Received: from localhost ([::1]:50038 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1UtcNn-00032q-1i for ged-emacs-devel@m.gmane.org; Mon, 01 Jul 2013 07:34:59 -0400 Original-Received: from eggs.gnu.org ([2001:4830:134:3::10]:44808) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1UtcNh-00031R-2Z for emacs-devel@gnu.org; Mon, 01 Jul 2013 07:34:57 -0400 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1UtcNd-0003DX-4N for emacs-devel@gnu.org; Mon, 01 Jul 2013 07:34:52 -0400 Original-Received: from moutng.kundenserver.de ([212.227.126.171]:53284) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1UtcNc-0003D4-QG for emacs-devel@gnu.org; Mon, 01 Jul 2013 07:34:49 -0400 Original-Received: from purzel.sitgens (brln-4db9a550.pool.mediaWays.net [77.185.165.80]) by mrelayeu.kundenserver.de (node=mreu0) with ESMTP (Nemesis) id 0Md04s-1UcVCX0ICI-00ITtP; Mon, 01 Jul 2013 13:34:47 +0200 User-Agent: Mozilla/5.0 (X11; Linux i686; rv:17.0) Gecko/20130510 Thunderbird/17.0.6 In-Reply-To: X-Provags-ID: V02:K0:BBytphCbDQbN6dYaBvPEtqwqRbC5v35bw2ArQPHBYpt NydYc3yB3SXi7TK9cAtEb8N00zzQ/Pnd/0qL+Ygr8O0AjuW/It cCBGRudmtFPqpmWZC6n5rDAzv+uB9JzeDr4DuXDlPvHveiFyAF xyF94Xw8RFC8mSU/0cQMZw+nArEJqgwwK/F5z26vsgXBKFyiWY vTiBvWxDgpltC5n7gLvhJlbWbfjkT8GCVUNvEAPGm6D+piUDQx pLhy4EWCxWt28UeWPOD9xDtx0vc+R1dQhnU5x4NhLad6d9eFfq tNjBoEHJ4tTrXeANFZZsYoVeh4hUygyunBRaDELa/JEVr+R4zr pxkEfK54TXIj/tmd+rBM= X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.4.x-2.6.x [generic] X-Received-From: 212.227.126.171 X-BeenThere: emacs-devel@gnu.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Emacs development discussions." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Original-Sender: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Xref: news.gmane.org gmane.emacs.devel:161403 Archived-At: Am 24.06.2013 20:24, schrieb Lennart Borgman: > On Mon, Jun 24, 2013 at 8:21 PM, Eli Zaretskii wrote: > >>> From: Glenn Morris >>> Date: Mon, 24 Jun 2013 13:31:50 -0400 >>> >>> One thing that could help reduce this is more unit tests. >>> If you haven't used it, ERT makes it pretty easy to write tests. >>> Of course, many aspects of Emacs's behaviour are not easy to test (GUI >>> stuff, etc.), but many are. See test/automated/ for examples. [2] >>> >>> For example, package.el seems like something that should have a test >>> suite. >>> >>> So if you fix a bug, please consider adding a unit test to make sure it >>> does not come back. Or if you rewrite a lisp package, consider adding >>> tests at the same time to check that obvious functionality still works. >>> >>> I know writing tests is maybe not as interesting as writing shiny new >>> features, but I think it will save work in the long run. >> >> IMO, unless we require every new feature to come with a test and a >> report that no regressions were found by running the existing tests, >> we will never get any better testability than what we have now. >> >> > Maybe writing tests for all bugs that shows up? > That's good. I'm keeping such a thing for python-mode.el http://bazaar.launchpad.net/~python-mode-devs/python-mode/python-mode/view/head:/test/py-bug-numbered-tests.el What's nice about: if some regression occurs, the bug-number leads to the reports and helps fixing. However, IMO a dual system is needed. Having a test for all bugs will be slow from a certain amount. Need to condense that again into some more structured. BTW as all the tests must not be part of Emacs itself, what about dropping the copyright assignment policy, make tests rely on GPL? AFAIS are a lot of hackers around which might help then. Andreas