From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.org!not-for-mail From: Michael Albinus Newsgroups: gmane.emacs.bugs Subject: bug#15991: 24.3.50; Wishlist: Make test suite user-friendlier Date: Fri, 27 Jun 2014 20:12:38 +0200 Message-ID: <8738eq8bmx.fsf@gmx.de> References: <83pppk8f91.fsf@gnu.org> <87lhsjvgsa.fsf@gmx.de> <6osimru0uw.fsf@fencepost.gnu.org> <87tx76stnl.fsf@gmx.de> NNTP-Posting-Host: plane.gmane.org Mime-Version: 1.0 Content-Type: text/plain X-Trace: ger.gmane.org 1403892869 15157 80.91.229.3 (27 Jun 2014 18:14:29 GMT) X-Complaints-To: usenet@ger.gmane.org NNTP-Posting-Date: Fri, 27 Jun 2014 18:14:29 +0000 (UTC) Cc: 15991@debbugs.gnu.org To: Glenn Morris Original-X-From: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane.org@gnu.org Fri Jun 27 20:14:22 2014 Return-path: Envelope-to: geb-bug-gnu-emacs@m.gmane.org Original-Received: from lists.gnu.org ([208.118.235.17]) by plane.gmane.org with esmtp (Exim 4.69) (envelope-from ) id 1X0afE-0007fj-Ck for geb-bug-gnu-emacs@m.gmane.org; Fri, 27 Jun 2014 20:14:20 +0200 Original-Received: from localhost ([::1]:51763 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1X0afD-0007Vc-Q0 for geb-bug-gnu-emacs@m.gmane.org; Fri, 27 Jun 2014 14:14:19 -0400 Original-Received: from eggs.gnu.org ([2001:4830:134:3::10]:51142) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1X0af3-0007S5-KB for bug-gnu-emacs@gnu.org; Fri, 27 Jun 2014 14:14:16 -0400 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1X0aew-0005AN-BC for bug-gnu-emacs@gnu.org; Fri, 27 Jun 2014 14:14:09 -0400 Original-Received: from debbugs.gnu.org ([140.186.70.43]:44092) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1X0aew-0005AH-8C for bug-gnu-emacs@gnu.org; Fri, 27 Jun 2014 14:14:02 -0400 Original-Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.80) (envelope-from ) id 1X0aev-0006kx-QH for bug-gnu-emacs@gnu.org; Fri, 27 Jun 2014 14:14:01 -0400 X-Loop: help-debbugs@gnu.org Resent-From: Michael Albinus Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Fri, 27 Jun 2014 18:14:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 15991 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: Original-Received: via spool by 15991-submit@debbugs.gnu.org id=B15991.140389278925883 (code B ref 15991); Fri, 27 Jun 2014 18:14:01 +0000 Original-Received: (at 15991) by debbugs.gnu.org; 27 Jun 2014 18:13:09 +0000 Original-Received: from localhost ([127.0.0.1]:35242 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X0ae0-0006jE-VK for submit@debbugs.gnu.org; Fri, 27 Jun 2014 14:13:08 -0400 Original-Received: from mout.gmx.net ([212.227.15.18]:53754) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1X0adv-0006ia-4M for 15991@debbugs.gnu.org; Fri, 27 Jun 2014 14:13:03 -0400 Original-Received: from detlef.gmx.de ([87.146.53.250]) by mail.gmx.com (mrgmx003) with ESMTPSA (Nemesis) id 0M54L0-1WkYuw3IZq-00zGsS; Fri, 27 Jun 2014 20:12:45 +0200 In-Reply-To: (Glenn Morris's message of "Fri, 27 Jun 2014 11:57:36 -0400") User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/24.4.50 (gnu/linux) X-Provags-ID: V03:K0:ss+krNdbjW/fN55rEyzgHe9zf8sHpbb93v6cf2oF2h+TV2rMbYf Fm984bQbUaCsXr2bEnhEFJfq4lq0vN1eKxCLP9AKCELtpnLANZT1NSCd+H7kYYPJrKmFqnU lAycrfj0PJ/unRvpjcnVIdC7w6YyT/KDj6jHwDXpGKX9f5qcKIAOTev8NTNLU7hGAVz28f/ 3f5yiF0oaDUYXKMZPagqg== X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list X-detected-operating-system: by eggs.gnu.org: GNU/Linux 3.x X-Received-From: 140.186.70.43 X-BeenThere: bug-gnu-emacs@gnu.org List-Id: "Bug reports for GNU Emacs, the Swiss army knife of text editors" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane.org@gnu.org Original-Sender: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane.org@gnu.org Xref: news.gmane.org gmane.emacs.bugs:90904 Archived-At: Glenn Morris writes: >> I believe it is desirable to run the tests unconditionally when invoked >> via make. People call "make check" for a reason. > > I suppose you are right, and this is consistent with how it used to behave. Nope. When you cal "make check" a second time, no test runs again, 'cause the log files exist already. >> Maybe you could even offer the test package name as target. Then one >> could call "make -C test/automated tramp-tests", > > You can already do > > make -C test/automated tramp-tests.log Again, it works only when there is no log file. The second time you call it, nothing happens: ~/src/emacs> make -C test/automated tramp-tests.log make: Entering directory `/usr/local/src/emacs/test/automated' make: `tramp-tests.log' is up to date. make: Leaving directory `/usr/local/src/emacs/test/automated' > I don't think removing the ".log" is worth it. If you want to rerun a test, you must remove the log file manually. Inconvenient. >> There is another issue. By redirecting the output to a file, the >> password prompt for tramp-tests isn't visible anymore. This is a real >> regression, because these tests are intended to run for different remote >> file names. Could you pipe the test output through tee or something like >> this? I don't know how portable this would be, 'tho. > > Not sure I understand. Do you want to interact, ie type a password? > I think tests that require interaction are a Bad Thing. > Are these optional tests that do not normally run? Nope. See the commentary section of tramp-test.el. Try ~/src/emacs> env REMOTE_TEMPORARY_FILE_DIRECTORY=/sudo::/tmp make -C test/automated tramp-tests.log It will ask you for the sudo password, but you don't see the prompt. Best regards, Michael.