From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.org!not-for-mail From: Christian Ohler Newsgroups: gmane.emacs.devel Subject: Re: testing framework and package.el Date: Wed, 13 Oct 2010 21:00:17 +1100 Message-ID: <4CB58331.9020609@fastmail.net> References: <87tyladfnf.fsf@gmx.de> <4CA5DBA2.4050102@fastmail.net> <87tyl5i737.fsf@gmx.de> <4CA86026.1020000@fastmail.net> <87vd5jvw1q.fsf@gmx.de> <4CA9F483.8020000@fastmail.net> <87lj6dewf7.fsf@stupidchicken.com> <4CAA7CA2.5050302@fastmail.net> <87zkut8d7y.fsf@uwakimon.sk.tsukuba.ac.jp> <4CB2D84E.5010405@fastmail.net> <87d3rg6rl9.fsf@uwakimon.sk.tsukuba.ac.jp> <4CB47254.7000904@fastmail.net> <8739sb71gh.fsf@uwakimon.sk.tsukuba.ac.jp> NNTP-Posting-Host: lo.gmane.org Mime-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Trace: dough.gmane.org 1286973235 1430 80.91.229.12 (13 Oct 2010 12:33:55 GMT) X-Complaints-To: usenet@dough.gmane.org NNTP-Posting-Date: Wed, 13 Oct 2010 12:33:55 +0000 (UTC) Cc: Sebastian Rose , emacs-devel Mailinglist , Lennart Borgman , Chong Yidong , Stefan Monnier To: "Stephen J. Turnbull" Original-X-From: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Wed Oct 13 14:33:46 2010 Return-path: Envelope-to: ged-emacs-devel@m.gmane.org Original-Received: from lists.gnu.org ([199.232.76.165]) by lo.gmane.org with esmtp (Exim 4.69) (envelope-from ) id 1P60Wd-0002ng-JW for ged-emacs-devel@m.gmane.org; Wed, 13 Oct 2010 14:33:43 +0200 Original-Received: from localhost ([127.0.0.1]:36270 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.43) id 1P60TU-0001Ar-Lu for ged-emacs-devel@m.gmane.org; Wed, 13 Oct 2010 08:30:28 -0400 Original-Received: from [140.186.70.92] (port=33984 helo=eggs.gnu.org) by lists.gnu.org with esmtp (Exim 4.43) id 1P5zwp-0006Mq-I6 for emacs-devel@gnu.org; Wed, 13 Oct 2010 07:56:47 -0400 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1P5y8G-00062W-MU for emacs-devel@gnu.org; Wed, 13 Oct 2010 06:00:25 -0400 Original-Received: from out1.smtp.messagingengine.com ([66.111.4.25]:47523) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1P5y8G-00062F-Ip for emacs-devel@gnu.org; Wed, 13 Oct 2010 06:00:24 -0400 Original-Received: from compute2.internal (compute2.nyi.mail.srv.osa [10.202.2.42]) by gateway1.messagingengine.com (Postfix) with ESMTP id 884F75F2; Wed, 13 Oct 2010 06:00:23 -0400 (EDT) Original-Received: from frontend2.messagingengine.com ([10.202.2.161]) by compute2.internal (MEProxy); Wed, 13 Oct 2010 06:00:23 -0400 DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d=messagingengine.com; h=message-id:date:from:mime-version:to:cc:subject:references:in-reply-to:content-type:content-transfer-encoding; s=smtpout; bh=Lm1Aje4YzErbk4iMMJ+/klwkb4k=; b=Mw0Uq47rmbWQZButMuiJDXVXtAW22ueQwBAJgFAx4cVr/RjS7Oy0o1IBjazhV3Hmkome7vktqpF11F5vBkP56zY9jrx9nKFFHtS+f+e+o3y7Vb/JE7yCQKVjWu6VAsleXeZbQphgMab/i5m34A1Tc4y0XEMEbB5/wEWunuQHMGY= X-Sasl-enc: BQ2a3GZ4k4i3Gv0edEva7Wp/Yok09IGa2wycqHLLxuAY 1286964023 Original-Received: from ohler-macbookpro.local (unknown [113.197.106.249]) by mail.messagingengine.com (Postfix) with ESMTPSA id AB5815E49B2; Wed, 13 Oct 2010 06:00:20 -0400 (EDT) In-Reply-To: <8739sb71gh.fsf@uwakimon.sk.tsukuba.ac.jp> X-detected-operating-system: by eggs.gnu.org: Genre and OS details not recognized. X-BeenThere: emacs-devel@gnu.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: "Emacs development discussions." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Original-Sender: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Errors-To: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Xref: news.gmane.org gmane.emacs.devel:131663 Archived-At: On 13/10/10 4:41, Stephen J. Turnbull wrote: > Christian Ohler writes: > > > As long as we don't touch a given test, we know that it's > > compatible. If we have to modify it to keep it passing, we know > > that there was an incompatible change. > > You are forgetting new tests for old features. I was referring to them as "tests written after the fact", sorry for not being clearer. > These *must* be run > against old versions to ensure that the current version of the feature > is still compatible with the old one. Yes; but this only needs to be done once per test. The old version is not going to change. This is assuming that tests get merged into all branches where changes are made, including bugfix branches. I assume this is the part that you want to avoid. Christian.