From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: Lars Ingebrigtsen Newsgroups: gmane.emacs.devel Subject: Run (some) tests more automagically? Date: Sun, 21 Feb 2021 14:25:29 +0100 Message-ID: <87v9alk0xi.fsf@gnus.org> Mime-Version: 1.0 Content-Type: text/plain Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="5363"; mail-complaints-to="usenet@ciao.gmane.io" User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.0.50 (gnu/linux) To: emacs-devel@gnu.org Original-X-From: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Sun Feb 21 14:27:22 2021 Return-path: Envelope-to: ged-emacs-devel@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1lDold-0001Gk-97 for ged-emacs-devel@m.gmane-mx.org; Sun, 21 Feb 2021 14:27:21 +0100 Original-Received: from localhost ([::1]:37282 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1lDolc-0008CD-AA for ged-emacs-devel@m.gmane-mx.org; Sun, 21 Feb 2021 08:27:20 -0500 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]:49790) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1lDojw-0007YE-Rx for emacs-devel@gnu.org; Sun, 21 Feb 2021 08:25:36 -0500 Original-Received: from quimby.gnus.org ([2a01:4f9:2b:f0f::2]:53468) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1lDojv-0006QY-8M for emacs-devel@gnu.org; Sun, 21 Feb 2021 08:25:36 -0500 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnus.org; s=20200322; h=Content-Type:MIME-Version:Message-ID:Date:Subject:To:From: Sender:Reply-To:Cc:Content-Transfer-Encoding:Content-ID:Content-Description: Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID: In-Reply-To:References:List-Id:List-Help:List-Unsubscribe:List-Subscribe: List-Post:List-Owner:List-Archive; bh=Se3B7grHz/JQNRNH/cPcBO6hO0Kb8DrrmfgBoR7wWyc=; b=YZnQtmsSEumCTMOosVMXtvqW9E 3PCtXWxQtHQtOg9YBsMzgvTaM5j/p4MaS2+Z0dHnZcSgnvuYnd5JCgPxQioS7EZMzpRk/aFZ9csM4 mu7CmQxMoQDOgE+0v/LtpukPECYx6HL3YI+rhJvFvL/aaa1Rh/RNiBo3t0zJKtPKpL8A=; Original-Received: from cm-84.212.220.105.getinternet.no ([84.212.220.105] helo=xo) by quimby.gnus.org with esmtpsa (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1lDojq-0008P8-I8 for emacs-devel@gnu.org; Sun, 21 Feb 2021 14:25:32 +0100 Face: iVBORw0KGgoAAAANSUhEUgAAADAAAAAwBAMAAAClLOS0AAAABGdBTUEAALGPC/xhBQAAACBj SFJNAAB6JgAAgIQAAPoAAACA6AAAdTAAAOpgAAA6mAAAF3CculE8AAAAD1BMVEXv4c/BtaeJgHdW UUv///8yXQ++AAAAAWJLR0QEj2jZUQAAAAd0SU1FB+UCFQ0GEaNowHsAAAGkSURBVDjLXVOLFcMg CARdAM0Cigsksv9uBVFjw2sT4/HxDgQkWPauzAIXoJgpI3aCYlv6wAKx9atH5tYqCzexVe9sgDTO 7elcxX79ynLxUzQVdw5Xy5wSM+tf/TgXQC7wb+wvZPoA8zvKnedOhUBNhukBMZkHU7jVFfWTrdLK glBj13c7I4pXiY+7vBGEZdcAnBHiuRK8iqVh80MgllVsPGlTCWU40wSS5wlSNIKm/1eIZfhApnEO 1S2xBX7aFYQly/Axf+V+H+G2OwlaLlxAdD5pSTTkmQz/0jsPTw4ZPoYzrGn9UHDEBTribWvL+Q7X 0V6smGmxul4ghUe73eaR0Iu3fp6NVI84glD7gy9j2sSCSBkk0oiqWz0HtlVY/QVvtbWW1hC4DJcK WbFOgKgeco23Z3cyx8XawNgKe2UAvnyS8qDBIi2JNJWuaaiiRUdOnBkZkRC+VnVa3EXnzC+FF692 13CfzP+7M/j3pIR2o+Zs6+CmCaRzNHbxHBIvtUuU0uwI8pxOCgQ2HhkcsI7Q8tKhhUsB624sKDek GT5AB3S8uPwAvKgswflmujsAAAAldEVYdGRhdGU6Y3JlYXRlADIwMjEtMDItMjFUMTM6MDY6MTcr MDA6MDAxgsZ6AAAAJXRFWHRkYXRlOm1vZGlmeQAyMDIxLTAyLTIxVDEzOjA2OjE3KzAwOjAwQN9+ xgAAAABJRU5ErkJggg== X-Now-Playing: Poppy Ajujdha's _Blue Note Re:imagined (1)_: "Watermelon Man" Received-SPF: pass client-ip=2a01:4f9:2b:f0f::2; envelope-from=larsi@gnus.org; helo=quimby.gnus.org X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: emacs-devel@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Emacs development discussions." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Original-Sender: "Emacs-devel" Xref: news.gmane.io gmane.emacs.devel:265385 Archived-At: I wonder whether anybody's considered making "make" run some tests. It's a recurring issue that we make a change, and then we forget to run the test suite. I mean, it's not a major problem, because it'll eventually get run by somebody, but I'd feel more confident in my own changes if I'd remember to run more tests more often. The reason we don't is because we don't want to wait for some minutes while running the entire suite. So here's today's not-thought-out-at-all idea: Since tests for lisp/foo.el live in test/lisp/foo-tests.el, could we add some Makefile magic to automatically run foo-tests.el if lisp/foo.el has been changed? Running just those tests shouldn't take too much time, and would probably cover 93% of the relevant code changes for foo.el. One disadvantage to doing this (if we find a way) is that "make foo-tests" is often very noisy, so we'd need a way to run tests silently and just report if anything actually fails unexpectedly, I guess. -- (domestic pets only, the antidote for overdose, milk.) bloggy blog: http://lars.ingebrigtsen.no