[paul@wolfbone.ath.cx: Re: re-builder bug(s)]

[paul@wolfbone.ath.cx: Re: re-builder bug(s)]

[Richard Stallman]

This is the bug report.  Can you fix it for us?

I don't know whether Detlev Zundel is still available,
so I cc'd this to emacs-devel.  If Detlev doesn't fix this,
I hope that someone else will do so.

------- Start of forwarded message -------
To: rms@gnu.org
Cc: emacs-pretest-bug@gnu.org
Subject: Re: re-builder bug(s)
From: paul@wolfbone.ath.cx (P.L.Hayes)
Date: Tue, 06 Mar 2007 07:33:44 +0000
In-Reply-To: <E1HOL51-0005fh-ON@fencepost.gnu.org> (Richard Stallman's message of "Mon\, 05 Mar 2007 16\:50\:51 -0500")
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
X-Spam-Status: No, score=0.1 required=5.0 tests=FORGED_RCVD_HELO 
	autolearn=failed version=3.0.4

Richard Stallman <rms@gnu.org> writes:

> I fixed the bug in the custom type, I think.
>
>     I also find (and I'm not quite sure whether it's a real bug or just
>     something I haven't understood about regexps or re-builder) that
>     expressions such as "\\>" and "$" in the re-builder buffer don't work
>     (and are flagged as "*invalid*" in the modeline) but ".\\>" and ".$",
>
> Would you please send a precise, complete test case for this?

Open a new buffer, put it in text mode and insert a line of text into it:

     C-x b *reb-test* RET M-x text-mode RET
     Kidman's publicist, Catherine Olim, said the star was trying to shake zombies off the bonnet of her Jaguar when the car spun off the road. RET

Try to use re-builder to count the number of words in the buffer:

    M-x re-builder RET
    \\>

As soon as the first `\' is entered between the `"'s, in the
*RE-Builder* buffer, "*invalid*" appears in the modeline.
Now replace the regexp in the *RE-Builder* buffer with another:

    DEL DEL DEL
    .\\>

Success! - the last character of each word in the *reb-test* buffer
has been highlighted and a message, "25 matches" has appeared in the
minibuffer. Likewise, the regexp, "^" will not find the empty string
at the beginning of the buffer but "^." will and "$" will not find the
end of the buffer but ".$" will.
------- End of forwarded message -------

Re: [paul@wolfbone.ath.cx: Re: re-builder bug(s)]

[Detlev Zundel]

[-- Attachment #1: Type: text/plain, Size: 2553 bytes --]

Hi,

> This is the bug report.  Can you fix it for us?
>
> I don't know whether Detlev Zundel is still available,
> so I cc'd this to emacs-devel.  If Detlev doesn't fix this,
> I hope that someone else will do so.
>
> From: paul@wolfbone.ath.cx (P.L.Hayes)
> Subject: Re: re-builder bug(s)
> To: rms@gnu.org
> Cc: emacs-pretest-bug@gnu.org
> Date: Tue, 06 Mar 2007 07:33:44 +0000
>
> Richard Stallman <rms@gnu.org> writes:
>
>> I fixed the bug in the custom type, I think.
>>
>>     I also find (and I'm not quite sure whether it's a real bug or just
>>     something I haven't understood about regexps or re-builder) that
>>     expressions such as "\\>" and "$" in the re-builder buffer don't work
>>     (and are flagged as "*invalid*" in the modeline) but ".\\>" and ".$",
>>
>> Would you please send a precise, complete test case for this?
>
> Open a new buffer, put it in text mode and insert a line of text into it:
>
>      C-x b *reb-test* RET M-x text-mode RET
>      Kidman's publicist, Catherine Olim, said the star was trying to shake zombies off the bonnet of her Jaguar when the car spun off the road. RET
>
> Try to use re-builder to count the number of words in the buffer:
>
>     M-x re-builder RET
>     \\>
>
> As soon as the first `\' is entered between the `"'s, in the
> *RE-Builder* buffer, "*invalid*" appears in the modeline.
> Now replace the regexp in the *RE-Builder* buffer with another:
>
>     DEL DEL DEL
>     .\\>
>
> Success! - the last character of each word in the *reb-test* buffer
> has been highlighted and a message, "25 matches" has appeared in the
> minibuffer. Likewise, the regexp, "^" will not find the empty string
> at the beginning of the buffer but "^." will and "$" will not find the
> end of the buffer but ".$" will.
> ----------

Ok, attached is a patch that changes the behaviour of re-builder when
it comes to what it previously considered empty regexps.  It now
counts words, lines and other zero-width regexps.  

Although I think the new behaviour is consistent in that it now also
counts (up to its defined maximum) the numbers of characters in a
buffer when confronted with an empty regexp (after all
re-search-forward matches), I don't know if that is what users would
expect.

What do you think?

Thanks
  Detlev

-- 
Progress in  mathematics comes from  repeated acts of generalization.
If mathematics is anything, it is the art of chosing the most elegant
generalization for some abstract pattern.  Thus esthetics is central.
                                     -- Douglas Hofstadter

[-- Warning: decoded text below may be mangled, UTF-8 assumed --]
[-- Attachment #2: re-builder.patch --]
[-- Type: text/x-diff, Size: 662 bytes --]

--- lisp/emacs-lisp/re-builder.el	2007-03-08 15:44:12.000000000 +0100
+++ /tmp/re-builder.el	2007-03-09 16:22:18.000000000 +0100
@@ -639,11 +640,13 @@
       (set-buffer reb-target-buffer)
       (reb-delete-overlays)
       (goto-char (point-min))
-      (while (and (re-search-forward re (point-max) t)
+      (while (and (not (eobp))
+		  (re-search-forward re (point-max) t)
 		  (or (not reb-auto-match-limit)
 		      (< matches reb-auto-match-limit)))
 	(if (= 0 (length (match-string 0)))
-	    (error "Empty regular expression!"))
+	    (unless (eobp) 
+	      (forward-char 1)))
 	(let ((i 0)
 	      suffix max-suffix)
 	  (setq matches (1+ matches))

[-- Attachment #3: Type: text/plain, Size: 142 bytes --]

_______________________________________________
Emacs-devel mailing list
Emacs-devel@gnu.org
http://lists.gnu.org/mailman/listinfo/emacs-devel

Re: [paul@wolfbone.ath.cx: Re: re-builder bug(s)]

[P.L.Hayes]

Detlev Zundel <dzu@akk.org> writes:

> Ok, attached is a patch that changes the behaviour of re-builder when
> it comes to what it previously considered empty regexps.  It now
> counts words, lines and other zero-width regexps.  
>
> Although I think the new behaviour is consistent in that it now also
> counts (up to its defined maximum) the numbers of characters in a
> buffer when confronted with an empty regexp (after all
> re-search-forward matches), I don't know if that is what users would
> expect.
>
> What do you think?

That patch works and (as a user) I think either that behaviour or some
message in the modeline other than "*invalid*" would've been
sufficient to preclude my earlier confusion.

Cheers,

Paul.

Re: [paul@wolfbone.ath.cx: Re: re-builder bug(s)]

[Richard Stallman]

Can you please send a change log entry for that change?

Re: [paul@wolfbone.ath.cx: Re: re-builder bug(s)]

[Detlev Zundel]

Hello Richard,

> Can you please send a change log entry for that change?

2007-03-12  Detlev Zundel  <dzu@gnu.org>

        * emacs-lisp/re-builder.el (reb-update-overlays): Do not mark
        zero-width regexps as invalid but rather at least count them
        correctly.

Cheers
  Detlev

-- 
Progress in  mathematics comes from  repeated acts of generalization.
If mathematics is anything, it is the art of chosing the most elegant
generalization for some abstract pattern.  Thus esthetics is central.
                                     -- Douglas Hofstadter

Re: [paul@wolfbone.ath.cx: Re: re-builder bug(s)]

[Richard Stallman]

Thanks.

Eli, will you be able to install this soon?
If not, would someone else please install it?

Re: [paul@wolfbone.ath.cx: Re: re-builder bug(s)]

[Eli Zaretskii]

> From: Richard Stallman <rms@gnu.org>
> CC: paul@wolfbone.ath.cx, emacs-devel@gnu.org, eliz@gnu.org
> Date: Mon, 12 Mar 2007 22:44:01 -0400
> 
> Eli, will you be able to install this soon?

I was waiting for the ChangeLog entry.  Now that it was sent, I will
be able to install by Friday or Saturday.

Re: [paul@wolfbone.ath.cx: Re: re-builder bug(s)]

[Richard Stallman]

    I was waiting for the ChangeLog entry.  Now that it was sent, I will
    be able to install by Friday or Saturday.

If someone else can install it sooner, please do.

Re: [paul@wolfbone.ath.cx: Re: re-builder bug(s)]

[Juanma Barranquero]

On 3/14/07, Richard Stallman <rms@gnu.org> wrote:

> If someone else can install it sooner, please do.

Committed.

             Juanma

Re: [paul@wolfbone.ath.cx: Re: re-builder bug(s)]

[Oliver Scholz]

Richard Stallman <rms@gnu.org> writes:

[...]
> I don't know whether Detlev Zundel is still available,
> so I cc'd this to emacs-devel.  If Detlev doesn't fix this,
> I hope that someone else will do so.

I gave it a shot.


[...]
>>     I also find (and I'm not quite sure whether it's a real bug or just
>>     something I haven't understood about regexps or re-builder) that
>>     expressions such as "\\>" and "$" in the re-builder buffer don't work
>>     (and are flagged as "*invalid*" in the modeline) but ".\\>" and ".$",
>>
>> Would you please send a precise, complete test case for this?
>
> Open a new buffer, put it in text mode and insert a line of text into it:
>
>      C-x b *reb-test* RET M-x text-mode RET
>      Kidman's publicist, Catherine Olim, said the star was trying to shake zombies off the bonnet of her Jaguar when the car spun off the road. RET
>
> Try to use re-builder to count the number of words in the buffer:
>
>     M-x re-builder RET
>     \\>
>
> As soon as the first `\' is entered between the `"'s, in the
> *RE-Builder* buffer, "*invalid*" appears in the modeline.
> Now replace the regexp in the *RE-Builder* buffer with another:
>
>     DEL DEL DEL
>     .\\>
>
> Success! - the last character of each word in the *reb-test* buffer
> has been highlighted and a message, "25 matches" has appeared in the
> minibuffer. Likewise, the regexp, "^" will not find the empty string
> at the beginning of the buffer but "^." will and "$" will not find the
> end of the buffer but ".$" will.

This happens in line 646 and following of re-builder.el.
`reb-update-overlays' `re-search'es the buffer and checks whether the
match is empty, otherwise it updates the match-overlays:

	(if (= 0 (length (match-string 0)))
	    (error "Empty regular expression!"))

So, this "bug" seems to be intentional. I wouldn't know what to do,
anyways. How do you highlight an empty string?


    Oliver
-- 
19 Ventôse an 215 de la Révolution
Liberté, Egalité, Fraternité!

Re: [paul@wolfbone.ath.cx: Re: re-builder bug(s)]

[Richard Stallman]

    This happens in line 646 and following of re-builder.el.
    `reb-update-overlays' `re-search'es the buffer and checks whether the
    match is empty, otherwise it updates the match-overlays:

	    (if (= 0 (length (match-string 0)))
		(error "Empty regular expression!"))

    So, this "bug" seems to be intentional. I wouldn't know what to do,
    anyways. How do you highlight an empty string?

You could put the cursor there and make it look funny, maybe.
Or use an overlay with an after-string.

Or just display a message in the minibuffer to explain the situation.