Lisp parser broken

Lisp parser broken

[Andreas Schwab]

The latest changes in the lisp parser cause cc-vars.el to be misparsed, in
particular the body of the defmacro defcustom-c-stylevar.  Previously the
expression `(a `(` a)) was parsed as (\` (a (\` (\` a)))), now it is
parsed as (\` (a (\` ( (\` a))))).  Note that there is a symbol with an
empty name after the fourth open paren.

Andreas.

-- 
Andreas Schwab, SuSE Labs, schwab@suse.de
SuSE Linux AG, Deutschherrnstr. 15-19, D-90429 Nürnberg
Key fingerprint = 58CA 54C7 6D53 942B 1756  01D3 44D5 214B 8276 4ED5
"And now for something completely different."

Re: Lisp parser broken

[Juanma Barranquero]

On Tue, 18 Feb 2003 16:01:45 +0100, Andreas Schwab <schwab@suse.de> wrote:

> The latest changes in the lisp parser cause cc-vars.el to be misparsed, in
> particular the body of the defmacro defcustom-c-stylevar.  Previously the
> expression `(a `(` a)) was parsed as (\` (a (\` (\` a)))), now it is
> parsed as (\` (a (\` ( (\` a))))).  Note that there is a symbol with an
> empty name after the fourth open paren.

I've checked in patches, including one for cc-vars.el, that allow Emacs
to bootstrap. Not sure mine's the right fix for `defcustom-c-stylevar',
though.


                                                           /L/e/k/t/u

Re: Lisp parser broken

[Andreas Schwab]

Juanma Barranquero <lektu@terra.es> writes:

|> On Tue, 18 Feb 2003 16:01:45 +0100, Andreas Schwab <schwab@suse.de> wrote:
|> 
|> > The latest changes in the lisp parser cause cc-vars.el to be misparsed, in
|> > particular the body of the defmacro defcustom-c-stylevar.  Previously the
|> > expression `(a `(` a)) was parsed as (\` (a (\` (\` a)))), now it is
|> > parsed as (\` (a (\` ( (\` a))))).  Note that there is a symbol with an
|> > empty name after the fourth open paren.
|> 
|> I've checked in patches, including one for cc-vars.el, that allow Emacs
|> to bootstrap. Not sure mine's the right fix for `defcustom-c-stylevar',
|> though.

I still think the bug is in the parser.  The symbol with the empty name
must not be there.  I'll check in the following change shortly if nobody
comes up with a better fix:

2003-02-18  Andreas Schwab  <schwab@suse.de>

	* lread.c (read1): Don't forbid "`" and "," in a symbol.

--- src/lread.c.~1.307.~	2003-02-18 13:07:17.000000000 +0100
+++ src/lread.c	2003-02-18 16:08:19.000000000 +0100
@@ -2458,8 +2458,7 @@ read1 (readcharfun, pch, first_in_list)
 	  char *end = read_buffer + read_buffer_size;
 
 	  while (c > 040
-		 && !index ("\"'`;()[]#", c)
-		 && !(new_backquote_flag && c == ','))
+		 && !index ("\"';()[]#", c))
 	    {
 	      if (end - p < MAX_MULTIBYTE_LENGTH)
 		{

Andreas.

-- 
Andreas Schwab, SuSE Labs, schwab@suse.de
SuSE Linux AG, Deutschherrnstr. 15-19, D-90429 Nürnberg
Key fingerprint = 58CA 54C7 6D53 942B 1756  01D3 44D5 214B 8276 4ED5
"And now for something completely different."

Re: Lisp parser broken

[Juanma Barranquero]

On Tue, 18 Feb 2003 16:56:29 +0100, Andreas Schwab <schwab@suse.de> wrote:

> I'll check in the following change shortly if nobody
> comes up with a better fix:

I have no opinion wrt your fix, but if you install it, revert the tiny
change to cc-vars.el. As I've said, I did it only to make Emacs
bootstrappable again.


                                                           /L/e/k/t/u

Re: Lisp parser broken

[Stefan Monnier]

With the current CVS trunk, I still have trouble with ? syntax:

ELISP> '(?\ ?\-)
*** Read error ***  Invalid read syntax: "?"
ELISP> '(? ?\-)
*** Read error ***  Invalid read syntax: "?"
ELISP> 

Such forms are used everywhere, so we have to allow them in
order not to break backward compatibility.


	Stefan

Re: Lisp parser broken

[Kim F. Storm]

"Stefan Monnier" <monnier+gnu/emacs@rum.cs.yale.edu> writes:

> With the current CVS trunk, I still have trouble with ? syntax:
> 
> ELISP> '(?\ ?\-)
> *** Read error ***  Invalid read syntax: "?"
> ELISP> '(? ?\-)
> *** Read error ***  Invalid read syntax: "?"
> ELISP> 
> 
> Such forms are used everywhere, so we have to allow them in
> order not to break backward compatibility.

Sorry.  I tested the non-trivial cases, and forgot about
the trivial ones.  Fixed now.

Lesson: This is an good candidate for regression testing.

-- 
Kim F. Storm <storm@cua.dk> http://www.cua.dk

Re: Lisp parser broken

[Kim F. Storm]

Andreas Schwab <schwab@suse.de> writes:

> The latest changes in the lisp parser cause cc-vars.el to be misparsed, in
> particular the body of the defmacro defcustom-c-stylevar.  Previously the
> expression `(a `(` a)) was parsed as (\` (a (\` (\` a)))), now it is
> parsed as (\` (a (\` ( (\` a))))).  Note that there is a symbol with an
> empty name after the fourth open paren.
> 

Thank you for tracking this down.
It is fixed now.

-- 
Kim F. Storm <storm@cua.dk> http://www.cua.dk

Re: Lisp parser broken

[Richard Stallman]

I encouraged fixing some absurdities in the handling of backquote ad
comma, but it looks like part of the absurdities may be needed for
handling of the old-style syntax where these were treated as symbol
names.

It is probably best to undo the change for now
and then think about it some more.

Re: Lisp parser broken

[Kim F. Storm]

Richard Stallman <rms@gnu.org> writes:

> I encouraged fixing some absurdities in the handling of backquote ad
> comma, but it looks like part of the absurdities may be needed for
> handling of the old-style syntax where these were treated as symbol
> names.
> 
> It is probably best to undo the change for now
> and then think about it some more.

I think I have corrected the parser to take those absurdities into
account; at least it parses all the existing lisp files ok now.

-- 
Kim F. Storm <storm@cua.dk> http://www.cua.dk