From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: phillip.lord@russet.org.uk Newsgroups: gmane.emacs.devel Subject: Re: Emacs 27.1 Windows Binaries -- testing wanted Date: Sat, 22 Aug 2020 13:52:22 +0100 Message-ID: <8373b3870aaea52590ee392bd6ff1ca9@russet.org.uk> References: <83pn7oft7r.fsf@gnu.org> <5fd1bc533b4bfe603d106fb3ee816208@russet.org.uk> <83364keznu.fsf@gnu.org> <87imdgrlpq.fsf@telefonica.net> <83tuwzewxa.fsf@gnu.org> <87eeo3sxw0.fsf@telefonica.net> <47436f6137c965db141e290de6597fd5@russet.org.uk> <464a5bf221d1d77ea13381fb901931fd@russet.org.uk> <25cec7cf-804f-4777-9f88-295f1735e6c5_IMAP_ADDED_MISSING@UPANOVA> <4a785b99c43d27a7e7d7a231db6c8f06@russet.org.uk> <83wo1r9oen.fsf@gnu.org> <83ft8f9d5o.fsf@gnu.org> <83eenz9bir.fsf@gnu.org> Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="15646"; mail-complaints-to="usenet@ciao.gmane.io" User-Agent: Roundcube Webmail/1.4.6 Cc: emacs-devel@gnu.org To: Eli Zaretskii Original-X-From: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Sat Aug 22 14:53:19 2020 Return-path: Envelope-to: ged-emacs-devel@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1k9T1L-0003xa-I7 for ged-emacs-devel@m.gmane-mx.org; Sat, 22 Aug 2020 14:53:19 +0200 Original-Received: from localhost ([::1]:54306 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1k9T1K-0002Hh-E7 for ged-emacs-devel@m.gmane-mx.org; Sat, 22 Aug 2020 08:53:18 -0400 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]:42210) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1k9T0Z-0001qC-CZ for emacs-devel@gnu.org; Sat, 22 Aug 2020 08:52:31 -0400 Original-Received: from cloud103.planethippo.com ([78.129.138.110]:55600) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1k9T0U-0001dn-84; Sat, 22 Aug 2020 08:52:31 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=russet.org.uk; s=default; h=Content-Transfer-Encoding:Content-Type: Message-ID:References:In-Reply-To:Subject:Cc:To:From:Date:MIME-Version:Sender :Reply-To:Content-ID:Content-Description:Resent-Date:Resent-From: Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Id:List-Help: List-Unsubscribe:List-Subscribe:List-Post:List-Owner:List-Archive; bh=QkcuDnoHhswj13imgRoKU2LiYh5bIA69GuOfr88SWc4=; b=EqnK6YL4Kw0lWqL+mvQHOTKFxk g3QEAmJc3mdKAKx7iNZRvucXBGUbLfSD6vAiHmruEZUA+52xtM4NGiCBdE0YZckYLUkedx9uSHl3O dvQ53VLGxLvwtnN6y3m/9Z7tFopYH/TautOwpk3yOpSMLG6e9T79kDh3gnI4fv6VCUqI/zJHUgns0 CDj8FY/UO6FcdoIALhtnXgqjepuTU44rkZja89EEV/YxOk803GbW5pMhMPtsUsGmviTk7K15twLmN mO9yAuflKJJS6pkjm73U4dfjA9zJaF9373J7zPKi3AnHFN3P9PUMLK1p1CWaos7g3ALXy89uShCiZ kZCq9vaA==; Original-Received: from [::1] (port=40134 helo=cloud103.planethippo.com) by cloud103.planethippo.com with esmtpa (Exim 4.93) (envelope-from ) id 1k9T0Q-0000YM-VH; Sat, 22 Aug 2020 13:52:23 +0100 In-Reply-To: <83eenz9bir.fsf@gnu.org> X-Sender: phillip.lord@russet.org.uk X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - cloud103.planethippo.com X-AntiAbuse: Original Domain - gnu.org X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - russet.org.uk X-Get-Message-Sender-Via: cloud103.planethippo.com: authenticated_id: phillip.lord@russet.org.uk X-Authenticated-Sender: cloud103.planethippo.com: phillip.lord@russet.org.uk Received-SPF: none client-ip=78.129.138.110; envelope-from=phillip.lord@russet.org.uk; helo=cloud103.planethippo.com X-detected-operating-system: by eggs.gnu.org: First seen = 2020/08/22 06:21:28 X-ACL-Warn: Detected OS = Linux 3.11 and newer X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, SPF_HELO_NONE=0.001, SPF_NONE=0.001, URIBL_BLOCKED=0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: emacs-devel@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Emacs development discussions." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Original-Sender: "Emacs-devel" Xref: news.gmane.io gmane.emacs.devel:254114 Archived-At: On 2020-08-22 12:15, Eli Zaretskii wrote: >> Date: Sat, 22 Aug 2020 11:53:54 +0100 >> From: phillip.lord@russet.org.uk >> Cc: emacs-devel@gnu.org >> I do not want to display all the output, I want to know what it >> should be. And I don't care about the output from things that work >> as expected only things that do not. All of this is what ert is >> designed for. I might like to tweak the output a little, but as ert >> doesn't have a pluggable interface, that's harder. > > I'm not talking about using ert or not, I'm talking about determining > which of the features should check out and which shouldn't. Are you > going to edit w32-features.el by hand each time you add or remove an > optional library from the build? Or will the list of the features > which should check out be constructed automagically somehow? It would be manual. The list of features changes rarely enough that it's hard to automate this and know that it will work. The automation is as likely to break as a manual system, as a release is not routine enough (for instance, you slightly broke my build script by updating the version number on Emacs-27 before I had done the windows build -- not a complaint, but Emacs releases are not routine). If I think back to the bugs with Emacs binary releases, this would have stopped only a few: harfbuzz and svg failure in this release. It would not have prevented missing dependencies (I have missed all of harfbuzz, lcms and libjansson till late in the day), nor the failed optimization or stripping. But, it would stop regressions of all of those, assuming I can work out how to test for them all. > If the latter, I didn't see you describe how will that happen. If the > former, it means a file in the distribution will depend on the details > of how you build the official binaries, which could be different from > what end-users do on their systems (those who build their own Emacs), > so the tests will fail for them, AFAIU. That is true with all of our tests, I think. json parsing is tested by make check and it will not work on msys2 if the dependencies are not installed. In this case, I am not suggesting adding ert tests to make check, but a manually run test specifically for understanding the features of a binary build. I am guessing anyone running this would be understand what they are doing enough to know why. And I will document the entry function. > It might also mean problems in merging from the release branch to > master, > e.g. if we remove some optional library from master that is still being > used on the release > branch. That problem is there anyway in build-deps.py and it is worse there since it will break a release rather than fail to test it. And I think for configure.ac also no? > I guess what I'm saying is that I don't yet see the overall picture of > how this is supposed to work. Apologies if I'm missing something. I think it is worth the discussion -- releases are far apart and it takes a degree of insight to get this right. Phil