From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.org!not-for-mail From: "Stephen J. Turnbull" Newsgroups: gmane.emacs.devel Subject: Need for a Emacs regression test suite Date: Sun, 09 Sep 2007 05:22:31 +0900 Message-ID: <87abrwewl4.fsf@uwakimon.sk.tsukuba.ac.jp> References: NNTP-Posting-Host: lo.gmane.org Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Trace: sea.gmane.org 1189282950 25684 80.91.229.12 (8 Sep 2007 20:22:30 GMT) X-Complaints-To: usenet@sea.gmane.org NNTP-Posting-Date: Sat, 8 Sep 2007 20:22:30 +0000 (UTC) Cc: Emacs Devel To: dhruva Original-X-From: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Sat Sep 08 22:22:29 2007 Return-path: Envelope-to: ged-emacs-devel@m.gmane.org Original-Received: from lists.gnu.org ([199.232.76.165]) by lo.gmane.org with esmtp (Exim 4.50) id 1IU6oy-0001ia-GW for ged-emacs-devel@m.gmane.org; Sat, 08 Sep 2007 22:22:24 +0200 Original-Received: from localhost ([127.0.0.1] helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.43) id 1IU6ov-0004QP-UI for ged-emacs-devel@m.gmane.org; Sat, 08 Sep 2007 16:22:21 -0400 Original-Received: from mailman by lists.gnu.org with tmda-scanned (Exim 4.43) id 1IU6ot-0004Q8-0B for emacs-devel@gnu.org; Sat, 08 Sep 2007 16:22:19 -0400 Original-Received: from exim by lists.gnu.org with spam-scanned (Exim 4.43) id 1IU6oq-0004Nk-3T for emacs-devel@gnu.org; Sat, 08 Sep 2007 16:22:18 -0400 Original-Received: from [199.232.76.173] (helo=monty-python.gnu.org) by lists.gnu.org with esmtp (Exim 4.43) id 1IU6op-0004NR-SJ for emacs-devel@gnu.org; Sat, 08 Sep 2007 16:22:15 -0400 Original-Received: from mtps02.sk.tsukuba.ac.jp ([130.158.97.224]) by monty-python.gnu.org with esmtp (Exim 4.60) (envelope-from ) id 1IU6op-0007RQ-DR for emacs-devel@gnu.org; Sat, 08 Sep 2007 16:22:15 -0400 Original-Received: from uwakimon.sk.tsukuba.ac.jp (unknown [130.158.99.156]) by mtps02.sk.tsukuba.ac.jp (Postfix) with ESMTP id E6E74800B; Sun, 9 Sep 2007 05:22:13 +0900 (JST) Original-Received: by uwakimon.sk.tsukuba.ac.jp (Postfix, from userid 1000) id 1616C1A2D5B; Sun, 9 Sep 2007 05:22:32 +0900 (JST) In-Reply-To: X-Mailer: VM 7.17 under 21.5 (beta28) "fuki" (+CVS-20070621) XEmacs Lucid X-Detected-Kernel: Linux 2.6, seldom 2.4 (older, 4) X-BeenThere: emacs-devel@gnu.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: "Emacs development discussions." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Original-Sender: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Errors-To: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Xref: news.gmane.org gmane.emacs.devel:78292 Archived-At: dhruva writes: > Hi, > The various changes getting into Emacs and number of things breaking > sporadically, IMO we need to have a regression suite. A collection > batch mode scripts and macros to test the GUI invocation. > It will take time to build it but would be useful. We can catch > issues during big merges much earlier in the cycle. > We could start small and build up the suite. What does the core team feel? FWIW, XEmacs has a testing framework, the authors are well-documented and few; most of the code is FSF-assigned. The tests themselves have a wider variety of authors as you would expect, but most files list only an FSF copyright. In 2001, Emacs passed more than half of the tests without any adjustments to the tests, a few tweaks to the code were needed. I don't know about now, but it should be a good head start. I'm not willing to do the deskwork of checking assignment status of authors (and don't have access to FSF assignment files anyway), but would help tracking down authors who have not assigned or have ambiguous records, as well as encourage them to do paperwork if necessary.