From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.org!not-for-mail From: =?ISO-8859-1?Q?R=FCdiger?= Sonderfeld Newsgroups: gmane.emacs.devel Subject: Re: call for more ert tests Date: Tue, 25 Jun 2013 19:18:25 +0200 Message-ID: <22873922.rILsHsxLja@descartes> References: <838v1zjrnl.fsf@gnu.org> NNTP-Posting-Host: plane.gmane.org Mime-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable X-Trace: ger.gmane.org 1372180724 20321 80.91.229.3 (25 Jun 2013 17:18:44 GMT) X-Complaints-To: usenet@ger.gmane.org NNTP-Posting-Date: Tue, 25 Jun 2013 17:18:44 +0000 (UTC) To: emacs-devel@gnu.org, Eli Zaretskii Original-X-From: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Tue Jun 25 19:18:45 2013 Return-path: Envelope-to: ged-emacs-devel@m.gmane.org Original-Received: from lists.gnu.org ([208.118.235.17]) by plane.gmane.org with esmtp (Exim 4.69) (envelope-from ) id 1UrWtB-0004yD-3B for ged-emacs-devel@m.gmane.org; Tue, 25 Jun 2013 19:18:45 +0200 Original-Received: from localhost ([::1]:54126 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1UrWtA-0006jW-Iu for ged-emacs-devel@m.gmane.org; Tue, 25 Jun 2013 13:18:44 -0400 Original-Received: from eggs.gnu.org ([2001:4830:134:3::10]:37790) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1UrWt5-0006jC-7i for emacs-devel@gnu.org; Tue, 25 Jun 2013 13:18:42 -0400 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1UrWt2-00057k-2a for emacs-devel@gnu.org; Tue, 25 Jun 2013 13:18:39 -0400 Original-Received: from ptmx.org ([178.63.28.110]:56255) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1UrWsy-00056u-Oo; Tue, 25 Jun 2013 13:18:32 -0400 Original-Received: from localhost (localhost [127.0.0.1]) by ptmx.org (Postfix) with ESMTP id 566F621D60; Tue, 25 Jun 2013 19:18:31 +0200 (CEST) X-Virus-Scanned: Debian amavisd-new at ptmx.org Original-Received: from ptmx.org ([127.0.0.1]) by localhost (ptmx.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Xika2LT7VlgN; Tue, 25 Jun 2013 19:18:29 +0200 (CEST) Original-Received: from descartes.localnet (chello080108246092.7.14.vie.surfer.at [80.108.246.92]) by ptmx.org (Postfix) with ESMTPSA id 60C941FFC3; Tue, 25 Jun 2013 19:18:29 +0200 (CEST) User-Agent: KMail/4.10.3 (Linux/3.8.0-23-generic; KDE/4.10.3; x86_64; ; ) In-Reply-To: <838v1zjrnl.fsf@gnu.org> X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6.x X-Received-From: 178.63.28.110 X-BeenThere: emacs-devel@gnu.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Emacs development discussions." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Original-Sender: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Xref: news.gmane.org gmane.emacs.devel:161034 Archived-At: On Monday 24 June 2013 21:21:50 Eli Zaretskii wrote: > IMO, unless we require every new feature to come with a test and a > report that no regressions were found by running the existing tests, > we will never get any better testability than what we have now. I think one problem is that it's hard to write tests for many Emacs fea= tures=20 and the results might not really help to improve the code quality. E.g= ., the=20 new browser eww. There could certainly be some tests for lower level=20= features. But a real test coverage would require tests for the rendere= d=20 layout. Which would be hard to write and even worse probably breaking = all the=20 time when rendering is improved and thus the output changes. Therefore having a policy to demand tests for new features might be cou= nter=20 productive. On the other hand maintainers should at least ask for test= cases=20 when they think a new feature could benefit from tests. Which in my=20= experience, as somebody who is relatively new to contributing to Emacs,= does=20 not seem to happen at all. An automated test report would certainly improve things. The Gnus folk= s seem=20 to use http://buildbot.net/. Regards R=C3=BCdiger