From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.org!not-for-mail From: "Stephen J. Turnbull" Newsgroups: gmane.emacs.devel Subject: Re: testing framework and package.el Date: Wed, 13 Oct 2010 23:13:25 +0900 Message-ID: <87r5fu2nay.fsf@uwakimon.sk.tsukuba.ac.jp> References: <87tyladfnf.fsf@gmx.de> <4CA5DBA2.4050102@fastmail.net> <87tyl5i737.fsf@gmx.de> <4CA86026.1020000@fastmail.net> <87vd5jvw1q.fsf@gmx.de> <4CA9F483.8020000@fastmail.net> <87lj6dewf7.fsf@stupidchicken.com> <4CAA7CA2.5050302@fastmail.net> <87zkut8d7y.fsf@uwakimon.sk.tsukuba.ac.jp> <4CB2D84E.5010405@fastmail.net> <87d3rg6rl9.fsf@uwakimon.sk.tsukuba.ac.jp> <4CB47254.7000904@fastmail.net> <8739sb71gh.fsf@uwakimon.sk.tsukuba.ac.jp> <4CB58331.9020609@fastmail.net> NNTP-Posting-Host: lo.gmane.org Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Trace: dough.gmane.org 1286979940 1869 80.91.229.12 (13 Oct 2010 14:25:40 GMT) X-Complaints-To: usenet@dough.gmane.org NNTP-Posting-Date: Wed, 13 Oct 2010 14:25:40 +0000 (UTC) Cc: Sebastian Rose , Lennart Borgman , Chong Yidong , Stefan Monnier , emacs-devel Mailinglist To: Christian Ohler Original-X-From: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Wed Oct 13 16:25:38 2010 Return-path: Envelope-to: ged-emacs-devel@m.gmane.org Original-Received: from lists.gnu.org ([199.232.76.165]) by lo.gmane.org with esmtp (Exim 4.69) (envelope-from ) id 1P62Gt-0004RE-Gd for ged-emacs-devel@m.gmane.org; Wed, 13 Oct 2010 16:25:35 +0200 Original-Received: from localhost ([127.0.0.1]:48703 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.43) id 1P62Gs-0005wB-7J for ged-emacs-devel@m.gmane.org; Wed, 13 Oct 2010 10:25:34 -0400 Original-Received: from [140.186.70.92] (port=47043 helo=eggs.gnu.org) by lists.gnu.org with esmtp (Exim 4.43) id 1P623g-0005Er-JJ for emacs-devel@gnu.org; Wed, 13 Oct 2010 10:12:36 -0400 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1P6232-0004av-IX for emacs-devel@gnu.org; Wed, 13 Oct 2010 10:11:50 -0400 Original-Received: from imss12.cc.tsukuba.ac.jp ([130.158.254.161]:34382) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1P6232-0004aW-3c for emacs-devel@gnu.org; Wed, 13 Oct 2010 10:11:16 -0400 Original-Received: from imss12.cc.tsukuba.ac.jp (imss12.cc.tsukuba.ac.jp [127.0.0.1]) by postfix.imss71 (Postfix) with ESMTP id 90AC22AF543; Wed, 13 Oct 2010 23:11:13 +0900 (JST) Original-Received: from mgmt1.sk.tsukuba.ac.jp (unknown [130.158.97.223]) by imss12.cc.tsukuba.ac.jp (Postfix) with ESMTP id 823F42AF542; Wed, 13 Oct 2010 23:11:13 +0900 (JST) Original-Received: from uwakimon.sk.tsukuba.ac.jp (uwakimon.sk.tsukuba.ac.jp [130.158.99.156]) by mgmt1.sk.tsukuba.ac.jp (Postfix) with ESMTP id 8001C3FA04FF; Wed, 13 Oct 2010 23:11:13 +0900 (JST) Original-Received: by uwakimon.sk.tsukuba.ac.jp (Postfix, from userid 1000) id 9916011F97C; Wed, 13 Oct 2010 23:13:25 +0900 (JST) In-Reply-To: <4CB58331.9020609@fastmail.net> X-Mailer: VM 8.1.93a under 21.5 (beta29) "garbanzo" ed3b274cc037 XEmacs Lucid (x86_64-unknown-linux) X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6 (newer, 3) X-BeenThere: emacs-devel@gnu.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: "Emacs development discussions." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Original-Sender: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Errors-To: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Xref: news.gmane.org gmane.emacs.devel:131670 Archived-At: Christian Ohler writes: > On 13/10/10 4:41, Stephen J. Turnbull wrote: > > Christian Ohler writes: > > > > > As long as we don't touch a given test, we know that it's > > > compatible. If we have to modify it to keep it passing, we know > > > that there was an incompatible change. > > > > You are forgetting new tests for old features. > > I was referring to them as "tests written after the fact", sorry for not > being clearer. > > > These *must* be run against old versions to ensure that the > > current version of the feature is still compatible with the old > > one. > > Yes; but this only needs to be done once per test. That assumes that the test doesn't change, and that the test-writer remembers to add/fix the test in old versions of Emacs. If she forgets, then it doesn't need to be done at all, you just have to live with any divergences that *would* have been cuaght by the test. > The old version is not going to change. This is assuming that > tests get merged into all branches where changes are made, > including bugfix branches. I assume this is the part that you want > to avoid. Yes, indeed. I might do it, but I might forget. I doubt very many contributors would be willing to do so at all, unless reminded aggressively. But that sort of implies a "no commits without tests" policy, and I don't think Emacs is ready for that.