From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: Lars Ingebrigtsen Newsgroups: gmane.emacs.devel Subject: Re: Tests and linting not coupled to one file Date: Fri, 25 Sep 2020 15:46:16 +0200 Message-ID: <87y2kynf4n.fsf@gnus.org> References: <20200925124646.29315.84502@vcs0.savannah.gnu.org> <20200925124647.83150209D4@vcs0.savannah.gnu.org> Mime-Version: 1.0 Content-Type: text/plain Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="17089"; mail-complaints-to="usenet@ciao.gmane.io" User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.0.50 (gnu/linux) Cc: emacs-devel@gnu.org To: Stefan Kangas Original-X-From: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Fri Sep 25 15:48:48 2020 Return-path: Envelope-to: ged-emacs-devel@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1kLo5e-0004Hb-Sc for ged-emacs-devel@m.gmane-mx.org; Fri, 25 Sep 2020 15:48:46 +0200 Original-Received: from localhost ([::1]:35262 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kLo5d-00020l-Tt for ged-emacs-devel@m.gmane-mx.org; Fri, 25 Sep 2020 09:48:45 -0400 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]:34366) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1kLo3Q-00084l-G0 for emacs-devel@gnu.org; Fri, 25 Sep 2020 09:46:28 -0400 Original-Received: from quimby.gnus.org ([2a01:4f9:2b:f0f::2]:58462) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1kLo3M-0000Q2-BZ for emacs-devel@gnu.org; Fri, 25 Sep 2020 09:46:28 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnus.org; s=20200322; h=Content-Type:MIME-Version:Message-ID:In-Reply-To:Date: References:Subject:Cc:To:From:Sender:Reply-To:Content-Transfer-Encoding: Content-ID:Content-Description:Resent-Date:Resent-From:Resent-Sender: Resent-To:Resent-Cc:Resent-Message-ID:List-Id:List-Help:List-Unsubscribe: List-Subscribe:List-Post:List-Owner:List-Archive; bh=LqQP+RFW0WzXHx88JhPYXVFWC9OIH2gwRozvcEgxVxc=; b=imAjQwOmT/a8YjaAKfPaNiLDCx WrCJdioIHfdRlAd4c1IL8m7wI1f5548GLrrDLysilqd1cYC5Hy3Bzec9Eef6GrVelcvJM5TqX6BbQ quq37RCXFqa82hpnqhY71BngcmrkuMILx5KoovKixUpkLNp3VbMCuSQ7ndLHLyZ6SiNE=; Original-Received: from cm-84.212.202.86.getinternet.no ([84.212.202.86] helo=xo) by quimby with esmtpsa (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1kLo3F-0002to-Ag; Fri, 25 Sep 2020 15:46:19 +0200 Face: iVBORw0KGgoAAAANSUhEUgAAADAAAAAwAgMAAAAqbBEUAAAABGdBTUEAALGPC/xhBQAAACBj SFJNAAB6JgAAgIQAAPoAAACA6AAAdTAAAOpgAAA6mAAAF3CculE8AAAADFBMVEX39fC+tZ9tWU3/ //8CvaVvAAAAAWJLR0QDEQxM8gAAAAd0SU1FB+QJGQ0sCSk1yQkAAAFkSURBVCjPNZLBasMwDIbl UQfWUwvxoHmEPIXzBs6oA81tsJbFT5PCvMNOPaSj1lPul9qaHPTFf6RfUohc4l9mJho9Ccghw578 FlHiEtNCRG+MSJ4Z0DLjXRpuiCkJVEUvBC6ifcJsSmJ6wHlEkidk1iQ4W14MYHZ7wIm9QHfwIitk fpjthNin4s3SLpMU9aerp9DkqA5OGeJq8JLOt+cAt0ul8DYjp9s3AsEFR3TotB0ywe5d6ljNbYKJ iSOzFK1X2tK9h9pSA2jv8KrQqO9N5StApeBiRtOBWPzs4jRyJlKnNjZSw7pJZVYUXUyAo6UR33ZX qbqxtAbsBi1kfIM5xVFz3yEkHZ2BSar7P/W9BQQXdXsufsCN3SkcV3DDxil8RlHEOCikLCvOLypL RWDpZUVTKnDKt34AfLVFtlDCu9ygvlx997A9rYvsF7oRUF10l5wjvBsMvpLfB/3sdMYPOFL9hH8d tb3wT/8JUwAAACV0RVh0ZGF0ZTpjcmVhdGUAMjAyMC0wOS0yNVQxMzo0NDowOSswMDowMHDVrW0A AAAldEVYdGRhdGU6bW9kaWZ5ADIwMjAtMDktMjVUMTM6NDQ6MDkrMDA6MDABiBXRAAAAAElFTkSu QmCC X-Now-Playing: Stephan Mathieu's _FrequencyLib_: "Eyes Closed" In-Reply-To: (Stefan Kangas's message of "Fri, 25 Sep 2020 06:11:32 -0700") Received-SPF: pass client-ip=2a01:4f9:2b:f0f::2; envelope-from=larsi@gnus.org; helo=quimby.gnus.org X-detected-operating-system: by eggs.gnu.org: No matching host in p0f cache. That's all we know. X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: emacs-devel@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Emacs development discussions." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Original-Sender: "Emacs-devel" Xref: news.gmane.io gmane.emacs.devel:256428 Archived-At: Stefan Kangas writes: > I have been thinking about what to with this kinds of expensive > tests/linting. It is of course good that we now run the above > automatically, since it will help us catch bugs. But it isn't very > clean conceptually to add such a test to "custom-tests.el", since it > operates on the entire code base instead of just one file/component. Yes, that's true. > One idea I've had is to create a new directory "test/misc" or something > to keep such tests in. We could arrange for them to be run with > "check-expensive" and continue using ert to get standardized reporting, > etc. > > The custom tests are good candidates here, but there are others. I think that makes sense, but I wonder whether there's much to be gained by doing that. If somebody is looking for "what's that test that checks all the defcustom declaration", would they look in lisp/custom-tests.el or misc/defcustom-tests.el? -- (domestic pets only, the antidote for overdose, milk.) bloggy blog: http://lars.ingebrigtsen.no