Re: [Emacs-diffs] master 9dcf599: Amend parse-partial-sexp correctly to handle two character comment delimiters

[Stefan Monnier <monnier@IRO.UMontreal.CA>]

What he says,


        Stefan


>>>>> "Alan" == Alan Mackenzie <acm@muc.de> writes:

> Hello, John.
> On Sun, Mar 20, 2016 at 09:47:58AM -0400, Stefan Monnier wrote:
>> What was John's opinion on reusing nth 5?


>> Stefan

> Yes John, what is your opinion on reusing element 5 of the parser state?

> Background:

> The previous edition of `parse-partial-sexp' returned a ten-element list
> which could be used for continuing that parse.  Unfortunately, this list
> was incomplete, leading to errors when the parse had stopped in the
> middle of a two-character comment delimiter.  This is bug #23019.

> My patch, created with Stefan's help, has solved this bug, partly by
> adding another element onto the parser state.  But this new element
> leaves element 5 ("t when just after an escape character") redundant.

> Stefan is in favour of reusing position 5 for this new element, rather
> than adding it at the end of the state (which has just been done).  I am
> against this, though not strongly.  It might have some effects on
> existing code, though this is not particularly likely.

> What do you say?

> -- 
> Alan Mackenzie (Nuremberg, Germany).



>> >>>>> "Alan" == Alan Mackenzie <acm@muc.de> writes:

>> > branch: master
>> > commit 9dcf5998935c8aaa846d7585b81f0dcfe1935b3d
>> > Author: Alan Mackenzie <acm@muc.de>
>> > Commit: Alan Mackenzie <acm@muc.de>

>> >     Amend parse-partial-sexp correctly to handle two character comment delimiters
    
>> >     Do this by adding a new field to the parser state: the syntax of the last
>> >     character scanned, should that be the first char of a (potential) two char
>> >     construct, nil otherwise.
>> >     This should make the parser state complete.
>> >     Also document element 9 of the parser state.  Also refactor the code a bit.
    
>> >     * src/syntax.c (struct lisp_parse_state): Add a new field.
>> >     (SYNTAX_FLAGS_COMSTARTEND_FIRST): New function.
>> >     (internalize_parse_state): New function, extracted from scan_sexps_forward.
>> >     (back_comment): Call internalize_parse_state.
>> >     (forw_comment): Return the syntax of the last character scanned to the caller
>> >     when that character might be the first of a two character construct.
>> >     (Fforward_comment, scan_lists): New dummy variables, passed to forw_comment.
>> >     (scan_sexps_forward): Remove a redundant state parameter.  Access all `state'
>> >     information via the address parameter `state'.  Remove the code which converts
>> >     from external to internal form of `state'.  Access buffer contents only from
>> >     `from' onwards.  Reformulate code at the top of the main loop correctly to
>> >     recognize comment openers when starting in the middle of one.  Call
>> >     forw_comment with extra argument (for return of syntax value of possible first
>> >     char of a two char construct).
>> >     (Fparse_partial_sexp): Document elements 9, 10 of the parser state in the
>> >     doc string.  Clarify the doc string in general.  Call
>> >     internalize_parse_state.  Take account of the new elements when consing up the
>> >     output parser state.
    
>> >     * doc/lispref/syntax.texi: (Parser State): Document element 9 and the new
>> >     element 10.  Minor wording corrections (remove reference to "trivial
>> >     cases").
>> >     (Low Level Parsing): Minor corrections.
    
>> >     * etc/NEWS: Note new element 10, and documentation of element 9 of parser
>> >     state.