From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.org!not-for-mail From: Eli Zaretskii Newsgroups: gmane.emacs.devel Subject: Re: mark expensive tests Date: Mon, 04 Jan 2016 19:23:19 +0200 Message-ID: <831t9x6yyg.fsf@gnu.org> References: <8337vab7nx.fsf@gnu.org> <0d7fkmdxj1.fsf@fencepost.gnu.org> <566D0BEB.4010707@cs.ucla.edu> <52wpsif21j.fsf@fencepost.gnu.org> <6tpoy9aorv.fsf@fencepost.gnu.org> <83fuz54sfk.fsf@gnu.org> <566F5371.7010506@cs.ucla.edu> <87wprqzb0y.fsf_-_@gmx.de> <83si2d73df.fsf@gnu.org> <87ziwlpbbe.fsf@gmx.de> <83a8ol70fb.fsf@gnu.org> <87vb79p9c1.fsf@gmx.de> Reply-To: Eli Zaretskii NNTP-Posting-Host: plane.gmane.org X-Trace: ger.gmane.org 1451928223 18503 80.91.229.3 (4 Jan 2016 17:23:43 GMT) X-Complaints-To: usenet@ger.gmane.org NNTP-Posting-Date: Mon, 4 Jan 2016 17:23:43 +0000 (UTC) Cc: jwiegley@gmail.com, emacs-devel@gnu.org To: Michael Albinus Original-X-From: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Mon Jan 04 18:23:43 2016 Return-path: Envelope-to: ged-emacs-devel@m.gmane.org Original-Received: from lists.gnu.org ([208.118.235.17]) by plane.gmane.org with esmtp (Exim 4.69) (envelope-from ) id 1aG8r6-0003J6-Vk for ged-emacs-devel@m.gmane.org; Mon, 04 Jan 2016 18:23:41 +0100 Original-Received: from localhost ([::1]:46440 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1aG8r2-000567-UO for ged-emacs-devel@m.gmane.org; Mon, 04 Jan 2016 12:23:36 -0500 Original-Received: from eggs.gnu.org ([2001:4830:134:3::10]:33724) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1aG8qm-00055q-GF for emacs-devel@gnu.org; Mon, 04 Jan 2016 12:23:21 -0500 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1aG8qj-000612-Ak for emacs-devel@gnu.org; Mon, 04 Jan 2016 12:23:20 -0500 Original-Received: from fencepost.gnu.org ([2001:4830:134:3::e]:36982) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1aG8qj-00060y-7O; Mon, 04 Jan 2016 12:23:17 -0500 Original-Received: from 84.94.185.246.cable.012.net.il ([84.94.185.246]:3209 helo=HOME-C4E4A596F7) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_128_CBC_SHA1:128) (Exim 4.82) (envelope-from ) id 1aG8qi-0003lu-Cr; Mon, 04 Jan 2016 12:23:16 -0500 In-reply-to: <87vb79p9c1.fsf@gmx.de> (message from Michael Albinus on Mon, 04 Jan 2016 18:01:50 +0100) X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 2001:4830:134:3::e X-BeenThere: emacs-devel@gnu.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Emacs development discussions." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Original-Sender: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Xref: news.gmane.org gmane.emacs.devel:197616 Archived-At: > From: Michael Albinus > Cc: jwiegley@gmail.com, emacs-devel@gnu.org > Date: Mon, 04 Jan 2016 18:01:50 +0100 > > Eli Zaretskii writes: > > > My main point was that other than a couple of very specific tests, the > > rest of the suite is quite fast, as test suites go. > > If we want to recommend to run the smoke tests at least before > committing, then 2 minutes might be long enough to let people refuse > that. That's why John has proposed a 30 seconds upper limit for the smoke > tests. I'm afraid that arbitrarily selecting 25% of the current test suite will leave too of the functionality much untested. Emacs is a hodge-podge of mostly unrelated functionalities, so I think it won't be easy to come up with a meaningful sanity test. But maybe I'm just missing something. Can you tell how will you select the 30-sec worth of tests? Thanks.