From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.org!not-for-mail From: David Engster Newsgroups: gmane.emacs.devel Subject: Re: call for more ert tests Date: Mon, 24 Jun 2013 21:04:24 +0200 Message-ID: <87wqpj1gav.fsf@engster.org> References: <871u7r2wht.fsf@engster.org> <9rmwqf2w1q.fsf@fencepost.gnu.org> NNTP-Posting-Host: plane.gmane.org Mime-Version: 1.0 Content-Type: text/plain X-Trace: ger.gmane.org 1372100684 3928 80.91.229.3 (24 Jun 2013 19:04:44 GMT) X-Complaints-To: usenet@ger.gmane.org NNTP-Posting-Date: Mon, 24 Jun 2013 19:04:44 +0000 (UTC) Cc: emacs-devel@gnu.org To: Glenn Morris Original-X-From: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Mon Jun 24 21:04:46 2013 Return-path: Envelope-to: ged-emacs-devel@m.gmane.org Original-Received: from lists.gnu.org ([208.118.235.17]) by plane.gmane.org with esmtp (Exim 4.69) (envelope-from ) id 1UrC4D-00083R-UC for ged-emacs-devel@m.gmane.org; Mon, 24 Jun 2013 21:04:46 +0200 Original-Received: from localhost ([::1]:33082 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1UrC4D-00067O-Hy for ged-emacs-devel@m.gmane.org; Mon, 24 Jun 2013 15:04:45 -0400 Original-Received: from eggs.gnu.org ([2001:4830:134:3::10]:57976) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1UrC46-00062x-OA for emacs-devel@gnu.org; Mon, 24 Jun 2013 15:04:44 -0400 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1UrC44-0000bn-BC for emacs-devel@gnu.org; Mon, 24 Jun 2013 15:04:38 -0400 Original-Received: from randomsample.de ([83.169.19.17]:37557) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1UrC43-0000bT-Se; Mon, 24 Jun 2013 15:04:36 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=randomsample.de; s=a; h=Content-Type:MIME-Version:Message-ID:Date:References:In-Reply-To:Subject:Cc:To:From; bh=IRhN/8y1FSVns+uV6gs9Vwi29sHUzQqFnm4LhwkHwac=; b=PiwavaC6H2+qq62wCRI0Zfv885neLn1Vek9AL4u5MucSFoNkR0uU+4y96LwFyZZPZdHdCMthCDb4Q62KcKPNDypPbKTrHOTOwjDkyklpx+OAkQ4o/DCPBVZrLLegkaw3; Original-Received: from dslc-082-083-036-213.pools.arcor-ip.net ([82.83.36.213] helo=spaten) by randomsample.de with esmtpsa (TLS1.0:DHE_RSA_AES_128_CBC_SHA1:16) (Exim 4.72) (envelope-from ) id 1UrC42-0003TH-KJ; Mon, 24 Jun 2013 21:04:34 +0200 In-Reply-To: <9rmwqf2w1q.fsf@fencepost.gnu.org> (Glenn Morris's message of "Mon, 24 Jun 2013 14:38:57 -0400") User-Agent: Gnus/5.130008 (Ma Gnus v0.8) Emacs/24.3 (gnu/linux) Mail-Followup-To: Glenn Morris , emacs-devel@gnu.org X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6.x X-Received-From: 83.169.19.17 X-BeenThere: emacs-devel@gnu.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Emacs development discussions." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Original-Sender: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Xref: news.gmane.org gmane.emacs.devel:160974 Archived-At: Glenn Morris writes: > David Engster wrote: >> Glenn Morris writes: >>> [2] I think it is a bit embarrassing that the limited test suite that we >>> have has been broken for months, though. Bugs 13064, 13662. >> >> Couldn't we run the test suite automatically on the Hydra server, so >> that this gets reported as a broken build? > > I guess so. But since we already know the testsuite is broken (and > haven't done anything about fixing it), we would not immediately gain > anything by this. Not immediately, no. But at worst, you can still deactivate the broken tests, so that you will at least notice new regressions quickly. It's better than nothing. > Also, hydra builds has been completely broken for weeks. I'm trying to > get it fixed, but it's not clear what the problem is. > > http://lists.gnu.org/archive/html/hydra-users/2013-06/msg00014.html > > And before it broke we had 4/7 failing builds for a long time, and > no-one seemed very motivated to get them fixed. True, the only real > Emacs issue is the x86_64-darwin one (the rest are hydra problems that > it is hard for us to fix), but I think it reflects the fact that we > don't really seem to care about unit tests that much. Yes, if these things do not get fixed right away, they tend to stay broken for a long time, especially when they affect other platforms like Darwin. It's the same thing on the Gnus Buildbot, where the XEmacs builds are often broken for weeks, because no one cares enough to fix them. However, the Gnus Buildbot does at least send a mail to the one who committed the breakage. It'd be nice if Hydra could do that as well (when it's working again, that is). BTW, if the Hydra things turns out to be not fixable, my offer still stands to set up a Buildbot for Emacs, like I did for CEDET and Gnus, but someone would have to donate space on a server with the necessary horsepower. -David