(rx regexp to remove space and new lines

(rx regexp to remove space and new lines

[Jean Louis]

I would like to construct rx regexp to remove both whitespace
characters and new line "\n" to replace it with only one space " ".

How to do it?

(string-replace (rx (one-or-more (any "\n" "[[:space:]]"))) " " sql)))))



Jean

Take action in Free Software Foundation campaigns:
https://www.fsf.org/campaigns

In support of Richard M. Stallman
https://stallmansupport.org/

Re: (rx regexp to remove space and new lines

[tomas]

[-- Attachment #1: Type: text/plain, Size: 722 bytes --]

On Mon, Sep 12, 2022 at 12:25:58PM +0300, Jean Louis wrote:
> I would like to construct rx regexp to remove both whitespace
> characters and new line "\n" to replace it with only one space " ".
> 
> How to do it?
> 
> (string-replace (rx (one-or-more (any "\n" "[[:space:]]"))) " " sql)))))

This looks about correct, so I don't understand your question. In which way
this does fail? Don't make us solve riddles ;-)

Note that [:space:] includes "\n" (and vertical tabulator and other ilks
of space-y characters), so the (any "\n" "[[:space:]]") seems redundant
and "[[:space:]]" should suffice.

I'm not very fluent on Rx, but I'd double check whether it takes "[[:space:]]"
as syntax.

Cheers
-- 
t

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 195 bytes --]

Re: (rx regexp to remove space and new lines

[Jean Louis]

* tomas@tuxteam.de <tomas@tuxteam.de> [2022-09-12 13:15]:
> On Mon, Sep 12, 2022 at 12:25:58PM +0300, Jean Louis wrote:
> > I would like to construct rx regexp to remove both whitespace
> > characters and new line "\n" to replace it with only one space " ".
> > 
> > How to do it?
> > 
> > (string-replace (rx (one-or-more (any "\n" "[[:space:]]"))) " " sql)))))
> 
> This looks about correct, so I don't understand your question. In which way
> this does fail? Don't make us solve riddles ;-)

(replace-regexp-in-string (rx (one-or-more (any whitespace))) " "
"Hello    there

and    here") ⇒ "Hello there

and here"

new line is not removed with character class `whitespace'.

(replace-regexp-in-string (rx (one-or-more (or "\n" (any whitespace)))) " "
"Hello    there

and    here") ⇒ "Hello there and here"

So now it will work that way.

-- 
Jean

Take action in Free Software Foundation campaigns:
https://www.fsf.org/campaigns

In support of Richard M. Stallman
https://stallmansupport.org/

[SOLVED] Re: (rx regexp to remove space and new lines

[Jean Louis]

If there is better way let me know.

(defun rcd-string-clean-whitespace (s)
  "Return trimmed string S without new lines and whitespaces."
  (replace-regexp-in-string 
   (rx (one-or-more (or "\n" (any whitespace))))
   " "
   (string-trim s)))


-- 
Jean

Take action in Free Software Foundation campaigns:
https://www.fsf.org/campaigns

In support of Richard M. Stallman
https://stallmansupport.org/

Re: [SOLVED] Re: (rx regexp to remove space and new lines

[Michael Heerdegen]

Jean Louis <bugs@gnu.support> writes:

>    (rx (one-or-more (or "\n" (any whitespace))))

It had been mentioned that newlines count as whitespace.  And
(any CHARCLASS) can be simplified to CHARCLASS.  And you probably want
greedy matching.  You get:

  (rx (+ whitespace))

Michael.

Re: [SOLVED] Re: (rx regexp to remove space and new lines

[Jean Louis]

* Michael Heerdegen <michael_heerdegen@web.de> [2022-09-13 05:45]:
> Jean Louis <bugs@gnu.support> writes:
> 
> >    (rx (one-or-more (or "\n" (any whitespace))))
> 
> It had been mentioned that newlines count as whitespace.  And
> (any CHARCLASS) can be simplified to CHARCLASS.  And you probably want
> greedy matching.  You get:
> 
>   (rx (+ whitespace))

That makes sense, but how?

(defun rcd-string-clean-whitespace (s)
  "Return trimmed string S after cleaning whitespaces greedy."
  (replace-regexp-in-string 
   ;; (rx (one-or-more (or "\n" (any whitespace))))
   (rx (one-or-more (+ whitespace)))
   " "
   (string-trim s)))

(rcd-string-clean-whitespace "   hello   there  


and I    am her e") ⇒ "hello there and I am her e"

it works here in this buffer, but in other Emacs buffer it does not
work. This is maybe because whitespace is defined diffrently per
buffer? 

Anyway, in emacs -Q it does not work when I use:
   (rx (one-or-more (+ whitespace)))

Until I understand it, I have to stay with this version:

(defun rcd-string-clean-whitespace (s)
  "Return trimmed string S after cleaning whitespaces greedy."
  (replace-regexp-in-string 
   (rx (one-or-more (or "\n" (any whitespace))))
   ;; (rx (one-or-more (+ whitespace)))
   " "
   (string-trim s)))

as it works in this buffer and in other buffers.

(rcd-string-clean-whitespace "   hello   there  


and I    am her e") ⇒ "hello there and I am her e"

-- 
Jean

Take action in Free Software Foundation campaigns:
https://www.fsf.org/campaigns

In support of Richard M. Stallman
https://stallmansupport.org/

Re: [SOLVED] Re: (rx regexp to remove space and new lines

[Michael Heerdegen]

Jean Louis <bugs@gnu.support> writes:

> it works here in this buffer, but in other Emacs buffer it does not
> work. This is maybe because whitespace is defined diffrently per
> buffer?

Eh - oh, of course, depends on the syntax table, sorry.

But
 
  (rx (+ (or "\n" whitespace)))

should hopefully be correct.

Michael.

Re: [SOLVED] Re: (rx regexp to remove space and new lines

[tomas]

[-- Attachment #1: Type: text/plain, Size: 555 bytes --]

On Tue, Sep 13, 2022 at 12:19:08PM +0200, Michael Heerdegen wrote:
> Jean Louis <bugs@gnu.support> writes:
> 
> > it works here in this buffer, but in other Emacs buffer it does not
> > work. This is maybe because whitespace is defined diffrently per
> > buffer?
> 
> Eh - oh, of course, depends on the syntax table, sorry.

This would be unfortunate. What would correspond to "[[:space:]]", i.e.
the syntax-independent POSIX whitespace?

(Not saying that you aren't right, just not the time to play around at
the moment).

Cheers
-- 
t

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 195 bytes --]

Re: [SOLVED] Re: (rx regexp to remove space and new lines

[Michael Heerdegen]

<tomas@tuxteam.de> writes:

> > Eh - oh, of course, depends on the syntax table, sorry.
>
> This would be unfortunate. What would correspond to "[[:space:]]", i.e.
> the syntax-independent POSIX whitespace?

rx transforms 'whitespace' to [:space:].

But (info "(elisp) Char Classes") told me that "[:space:] [...] matches
any character that has whitespace syntax (*note Syntax Class Table)", so I
assumed that the meaning is not constant... or is it?

Michael.

Re: [SOLVED] Re: (rx regexp to remove space and new lines

[tomas]

[-- Attachment #1: Type: text/plain, Size: 668 bytes --]

On Tue, Sep 13, 2022 at 02:32:58PM +0200, Michael Heerdegen wrote:
> <tomas@tuxteam.de> writes:
> 
> > > Eh - oh, of course, depends on the syntax table, sorry.
> >
> > This would be unfortunate. What would correspond to "[[:space:]]", i.e.
> > the syntax-independent POSIX whitespace?
> 
> rx transforms 'whitespace' to [:space:].
> 
> But (info "(elisp) Char Classes") told me that "[:space:] [...] matches
> any character that has whitespace syntax (*note Syntax Class Table)", so I
> assumed that the meaning is not constant... or is it?

Good question. I'll check once I'm off work (unless someone else beats me
to it, that is).

Cheers
-- 
t

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 195 bytes --]

Re: [SOLVED] Re: (rx regexp to remove space and new lines

[Michael Albinus]

<tomas@tuxteam.de> writes:

>> rx transforms 'whitespace' to [:space:].
>>
>> But (info "(elisp) Char Classes") told me that "[:space:] [...] matches
>> any character that has whitespace syntax (*note Syntax Class Table)", so I
>> assumed that the meaning is not constant... or is it?
>
> Good question. I'll check once I'm off work (unless someone else beats me
> to it, that is).

(rx blank) might be the better choice. Adding CR and LF to the puzzle,
I'd use (rx (any "\n\r" blank))

> Cheers

Best regards, Michael.

Re: [SOLVED] Re: (rx regexp to remove space and new lines

[Jean Louis]

* Michael Albinus <michael.albinus@gmx.de> [2022-09-13 17:33]:
> <tomas@tuxteam.de> writes:
> 
> >> rx transforms 'whitespace' to [:space:].
> >>
> >> But (info "(elisp) Char Classes") told me that "[:space:] [...] matches
> >> any character that has whitespace syntax (*note Syntax Class Table)", so I
> >> assumed that the meaning is not constant... or is it?
> >
> > Good question. I'll check once I'm off work (unless someone else beats me
> > to it, that is).
> 
> (rx blank) might be the better choice. Adding CR and LF to the puzzle,
> I'd use (rx (any "\n\r" blank))

Thanks, I have tried it here:

(defun rcd-string-clean-whitespace (s)
  "Return trimmed string S after cleaning whitespaces."
  (replace-regexp-in-string 
   (rx (one-or-more blank))
   ;; (rx (one-or-more (or "\n" (any whitespace))))
   ;; (rx (one-or-more (+ whitespace)))
   " "
   (string-trim s)))

But it seems it does not work well:

(rcd-string-clean-whitespace "H   elllo  
there") ⇒ "H elllo 
there"

This version works well:

(defun rcd-string-clean-whitespace (s)
  "Return trimmed string S after cleaning whitespaces."
  (replace-regexp-in-string 
   (rx (one-or-more (or "\n" (any whitespace))))
   " "
   (string-trim s)))

(rcd-string-clean-whitespace "H   elllo  
there") ⇒ "H elllo there"

and I can replace whitespace with blank to get same effect

-- 
Jean

Take action in Free Software Foundation campaigns:
https://www.fsf.org/campaigns

In support of Richard M. Stallman
https://stallmansupport.org/

Re: [SOLVED] Re: (rx regexp to remove space and new lines

[Michael Heerdegen]

Jean Louis <bugs@gnu.support> writes:

> > (rx blank) might be the better choice. Adding CR and LF to the
> > puzzle, I'd use (rx (any "\n\r" blank))
>
> Thanks, I have tried it here:
>
> (defun rcd-string-clean-whitespace (s)
>   "Return trimmed string S after cleaning whitespaces."
>   (replace-regexp-in-string 
>    (rx (one-or-more blank))

The newline is missing.

Michael.

Re: [SOLVED] Re: (rx regexp to remove space and new lines

[Jean Louis]

* Michael Heerdegen <michael_heerdegen@web.de> [2022-09-15 05:29]:
> Jean Louis <bugs@gnu.support> writes:
> 
> > > (rx blank) might be the better choice. Adding CR and LF to the
> > > puzzle, I'd use (rx (any "\n\r" blank))
> >
> > Thanks, I have tried it here:
> >
> > (defun rcd-string-clean-whitespace (s)
> >   "Return trimmed string S after cleaning whitespaces."
> >   (replace-regexp-in-string 
> >    (rx (one-or-more blank))
> 
> The newline is missing.

This is version that works. I can interchange (any whitespace) with
(any blank), but none of them recognizes "\n" as whitespace so far.

(defun rcd-string-clean-whitespace (s)
  "Return trimmed string S after cleaning whitespaces."
  (replace-regexp-in-string 
   (rx (one-or-more (or "\n" (any whitespace))))
   " "
   (string-trim s)))

-- 
Jean

Take action in Free Software Foundation campaigns:
https://www.fsf.org/campaigns

In support of Richard M. Stallman
https://stallmansupport.org/

Re: (rx regexp to remove space and new lines

[Michael Heerdegen]

<tomas@tuxteam.de> writes:


> > (string-replace (rx (one-or-more (any "\n" "[[:space:]]"))) " " sql)))))
>
> This looks about correct, so I don't understand your question. In which way
> this does fail? Don't make us solve riddles ;-)

When you eval that `rx' expression you see that you get ... something.

> I'm not very fluent on Rx, but I'd double check whether it takes
> "[[:space:]]" as syntax.

No, strings match literally.

Michael.