From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: Phillip Lord Newsgroups: gmane.emacs.devel Subject: Re: Run (some) tests more automagically? Date: Wed, 24 Feb 2021 10:42:01 +0000 Message-ID: <87im6hlpc6.fsf@russet.org.uk> References: <87v9alk0xi.fsf@gnus.org> Mime-Version: 1.0 Content-Type: text/plain Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="5108"; mail-complaints-to="usenet@ciao.gmane.io" User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.0.50 (gnu/linux) Cc: emacs-devel@gnu.org To: Lars Ingebrigtsen Original-X-From: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Wed Feb 24 11:43:48 2021 Return-path: Envelope-to: ged-emacs-devel@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1lEre0-0001E4-9A for ged-emacs-devel@m.gmane-mx.org; Wed, 24 Feb 2021 11:43:48 +0100 Original-Received: from localhost ([::1]:44864 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1lErdz-0005yK-Aj for ged-emacs-devel@m.gmane-mx.org; Wed, 24 Feb 2021 05:43:47 -0500 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]:40728) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1lErd2-0005Y3-9c for emacs-devel@gnu.org; Wed, 24 Feb 2021 05:42:48 -0500 Original-Received: from cloud103.planethippo.com ([78.129.138.110]:44798) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1lErd0-0004t1-Eb for emacs-devel@gnu.org; Wed, 24 Feb 2021 05:42:48 -0500 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=russet.org.uk; s=default; h=Content-Type:MIME-Version:Message-ID: In-Reply-To:Date:References:Subject:Cc:To:From:Sender:Reply-To: Content-Transfer-Encoding:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Id: List-Help:List-Unsubscribe:List-Subscribe:List-Post:List-Owner:List-Archive; bh=yzf0p0+pNDLM2yId9c/+rdOkXCsG0a8boFplWSoqr18=; b=OBCSoQsy9dI9pkKfTVpFhAwOX XiTvhru3pWu61Qp5+cdIDGLvUdQxjw+YVrskvfWgtuPTn7ie9WkolYvszAXjhqS8w789lBikfI5Bd 7Kz/vyUZ8cgzq+p6aKaem0TfH0mweqpqqqpFV2228FpHDT7uoSXkc1RGppTiH59q8KGDvUgpBsh0R JbzViIIOPRI3EB9ikNTuBAw6mJBW1bcP5UksDeJ7/gMB0LUai5pxKZS37xk+NOBejzP3iWL+w4lT+ KDx+Ffd1e/hSWL68Q8SHhjQzUJMCyZpkkfuqQpxQzgLm7LmXN0Ez++e/0Xh9SNcQki5qHv18zmkc6 LfMP7HQpg==; Original-Received: from cpc142648-benw12-2-0-cust627.16-2.cable.virginm.net ([82.10.74.116]:34516 helo=russet.org.uk) by cloud103.planethippo.com with esmtpsa (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.93) (envelope-from ) id 1lErcI-00025A-Ao; Wed, 24 Feb 2021 10:42:02 +0000 In-Reply-To: <87v9alk0xi.fsf@gnus.org> (Lars Ingebrigtsen's message of "Sun, 21 Feb 2021 14:25:29 +0100") X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - cloud103.planethippo.com X-AntiAbuse: Original Domain - gnu.org X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - russet.org.uk X-Get-Message-Sender-Via: cloud103.planethippo.com: authenticated_id: phillip.lord@russet.org.uk X-Authenticated-Sender: cloud103.planethippo.com: phillip.lord@russet.org.uk Received-SPF: none client-ip=78.129.138.110; envelope-from=phillip.lord@russet.org.uk; helo=cloud103.planethippo.com X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, SPF_HELO_NONE=0.001, SPF_NONE=0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: emacs-devel@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Emacs development discussions." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Original-Sender: "Emacs-devel" Xref: news.gmane.io gmane.emacs.devel:265570 Archived-At: Lars Ingebrigtsen writes: > I wonder whether anybody's considered making "make" run some tests. > > It's a recurring issue that we make a change, and then we forget to run > the test suite. I mean, it's not a major problem, because it'll > eventually get run by somebody, but I'd feel more confident in my own > changes if I'd remember to run more tests more often. > > The reason we don't is because we don't want to wait for some minutes > while running the entire suite. > > So here's today's not-thought-out-at-all idea: Since tests for > lisp/foo.el live in test/lisp/foo-tests.el, could we add some Makefile > magic to automatically run foo-tests.el if lisp/foo.el has been changed? > Running just those tests shouldn't take too much time, and would > probably cover 93% of the relevant code changes for foo.el. It is supposed to do this. That was the point of moving all the tests to a standard naming scheme in the first place. make check-maybe It uses out of date log files. I don't remember whether it will skip previously failed tests the second time around which might be a problem. Phil