From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: Alan Mackenzie Newsgroups: gmane.emacs.bugs Subject: bug#53526: 29.0.50; macroexp-warn-and-return API change Date: Sun, 30 Jan 2022 13:34:00 +0000 Message-ID: References: Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="23827"; mail-complaints-to="usenet@ciao.gmane.io" Cc: 53526@debbugs.gnu.org To: Stefan Monnier Original-X-From: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org Sun Jan 30 14:36:02 2022 Return-path: Envelope-to: geb-bug-gnu-emacs@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1nEAN7-0005sI-Es for geb-bug-gnu-emacs@m.gmane-mx.org; Sun, 30 Jan 2022 14:36:01 +0100 Original-Received: from localhost ([::1]:53828 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1nEAN5-00046o-JF for geb-bug-gnu-emacs@m.gmane-mx.org; Sun, 30 Jan 2022 08:35:59 -0500 Original-Received: from eggs.gnu.org ([209.51.188.92]:52798) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nEAMA-00046e-W0 for bug-gnu-emacs@gnu.org; Sun, 30 Jan 2022 08:35:04 -0500 Original-Received: from debbugs.gnu.org ([209.51.188.43]:42840) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1nEAMA-00041X-LP for bug-gnu-emacs@gnu.org; Sun, 30 Jan 2022 08:35:02 -0500 Original-Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1nEAMA-00044O-HG for bug-gnu-emacs@gnu.org; Sun, 30 Jan 2022 08:35:02 -0500 X-Loop: help-debbugs@gnu.org Resent-From: Alan Mackenzie Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Sun, 30 Jan 2022 13:35:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 53526 X-GNU-PR-Package: emacs Original-Received: via spool by 53526-submit@debbugs.gnu.org id=B53526.164354965015562 (code B ref 53526); Sun, 30 Jan 2022 13:35:02 +0000 Original-Received: (at 53526) by debbugs.gnu.org; 30 Jan 2022 13:34:10 +0000 Original-Received: from localhost ([127.0.0.1]:35737 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nEALJ-00042v-Lo for submit@debbugs.gnu.org; Sun, 30 Jan 2022 08:34:10 -0500 Original-Received: from colin.muc.de ([193.149.48.1]:43408 helo=mail.muc.de) by debbugs.gnu.org with smtp (Exim 4.84_2) (envelope-from ) id 1nEALH-00042Q-OR for 53526@debbugs.gnu.org; Sun, 30 Jan 2022 08:34:08 -0500 Original-Received: (qmail 84490 invoked by uid 3782); 30 Jan 2022 13:34:00 -0000 Original-Received: from acm.muc.de (p2e5d54eb.dip0.t-ipconnect.de [46.93.84.235]) (using STARTTLS) by colin.muc.de (tmda-ofmipd) with ESMTP; Sun, 30 Jan 2022 14:34:00 +0100 Original-Received: (qmail 25242 invoked by uid 1000); 30 Jan 2022 13:34:00 -0000 Content-Disposition: inline In-Reply-To: X-Submission-Agent: TMDA/1.3.x (Ph3nix) X-Primary-Address: acm@muc.de X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-BeenThere: bug-gnu-emacs@gnu.org List-Id: "Bug reports for GNU Emacs, the Swiss army knife of text editors" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org Original-Sender: "bug-gnu-emacs" Xref: news.gmane.io gmane.emacs.bugs:225595 Archived-At: Hello, Stefan. On Tue, Jan 25, 2022 at 14:10:12 -0500, Stefan Monnier wrote: > >> -(defun macroexp-warn-and-return (msg form &optional category compile-only) > >> +(defun macroexp-warn-and-return (arg msg form &optional category compile-only) > > No, it isn't. All the uses of the function are in lisp/emacs-lisp, and > > I understood the function to be an internal one. > No, its name was changed from "macroexp--" to "macroexp-" in Emacs-28, > specifically to make available for third party packages. It was > announced in etc/NEWS, for example. Are you aware of it being used anywhere else but lisp/emacs-lisp? > While `bindat.el` lives in `lisp/emacs-lisp`, it's an example of > a non-core package that benefits from it. > >> I suspect that the `arg` should be added at the end instead. > > The other functions (like byte-compile-warn-x) which have acquired this > > extra argument need to have it at the start, since there are an > > indeterminate number of &rest args going into a `format'. So it seemed > > better just to do the same with this function, to preserve a sort of > > compatibility. > While I can see the value of this aesthetic argument, I think breaking > backward compatibility was a published API is a more serious problem. Again, does anything else use it? > On the upside, moving it to the end will make it optional, which is good > since in many cases we can use the `form` argument instead (which > `byte-compile-warn-x` doesn't have). > >> While I'm here I also noticed that `byte-compile-form-stack` is a poor > >> name for a variable declared in `macroexp.el`. > > It's an integral part of bytecomp.el. It got moved to macroexp.el > > because it is used (twice) there, and that file is loaded into bootstrap > > emacs before bytecomp.el. > > There is precedent for this "mis"naming, namely > > byte-compile-bound-variables. > `byte-compile-bound-variables` is defined in `bytecomp.el`, not in `macroexp.el`. > And indeed, `byte-compile-bound-variables` is only set/modified by the > byte compiler, so it really belongs there. > I can see that just moving the definition to bytecomp.el and using > (defvar byte-compile-form-stack) in macroexp.el won't work because the > `push` requires the var to have a value. > Still, the current setup is really ugly: that var belongs in > `bytecomp.el`. Well, I suppose it could be defined in bytecomp.el and just declared in macroexp.el. It's not going to get used before it's been initialised in bytecomp.el. > > It started off life with a double hyphen in bytecomp.el. But when it > > started getting used in macroexp.el (during the expansion of a macro) it > > lost the extra hyphen and got moved there. > I'd put a double hyphen there simply because it's not something that we > want to expose as an official API. Just because the bytecompiler's > macroexpansion phase is implemented in a separate file doesn't justify > making the var public. OK, we can mange that. > > It's no big deal, I think, just that there's no completely neat way of > > doing this, so the compromise actually used is pretty arbitrary. > > If the variable were in bytecomp.el, we'd probably need a boundp call > > in the two places we use it in macroexp.el. > It at least deserves a prominent comment explaining why it's there. > > Whilst on the topic of macroexp-warn-and-return (and > > macroexp--wrap-warn), I have to admit having difficulty understanding > > these functions, both how they work and what they're for. > > My impression up till a couple of days ago was that they were ways of > > coping with the old warning position mechanism, and were intended to > > compensate for its deficiencies. > The original motivation was indeed to improve the error messages by > including more relevant line information. This part was made largely > irrelevant with your patch. > But it's still relevant because macros can use it without being tied to > the byte-compiler. Also a nice side-effect is that the warnings are > emitted (mostly) in the order they appear in the code, whereas otherwise > we'd first have the warnings emitted during macroexpansion, then > warnings emitted during the compilation. OK, thanks. > > Now, I'm much less sure. Was I indeed mistaken? If I was, what then is > > the purpose of these functions, which defer warning messages in some > > fashion? If I was right, it would be a good thing to dismantle them, > > since they are complicated and difficult, and no longer needed. As I > > said, I don't really understand them. > I don't see what's difficult about it: it lets you attach a warning to > a piece of code. There's a lot difficult about it. The doc string says, vaguely, "Return code equivalent to FORM labeled with warning MSG.". "Labeled" is not used like this anywhere else in Emacs. Nothing says what the nature of this "labelling" is, or what needs to be done to the resulting code to make it executable, when the "labelling" gets undone, or when the warning gets emitted. Nothing says what "equivalent" means here, either. In what sense is the new code "equivalent", and in what respects is it different? The source code is difficult to read, too. At least, I found it so, having spent several hours on it. macroexp--warn-wrap, an essential part of the mechanism, is entirely lacking any doc string or comment. It performs actions when it is called, and returns code which is going to get executed at some later stage. When? A comment explaining this would be exceptionally helpful. Nothing in the source code says what macroexp-warn-and-return is _for_. I suspect the difficulty in understanding this facility will have strongly dissuaded any external hackers from attempting to use it. > Stefan -- Alan Mackenzie (Nuremberg, Germany).