sgml-validate

sgml-validate

[Allan Gottlieb]

(I use gentoo)

When I tried M-x sgml-validate, it offers to run
nsgmls -s myfile.html

I don't have nsgmls so looked around and found
opensp providing onsgmls and a gentoo bug report claimed
a symlink nsgmls --> onsgmls.

Emerged opensp and now have onsgmls.

But onsgmls -s myfile.html
just hangs and uses no CPU time.

onsgmls claims it will validate "the SGML document whose document entity is
specified by the system identifiers SYSID..." so perhaps my error is in
supplying just a file name.  What is needed for a valid SYSID?

thanks.
allan

Re: sgml-validate

[Andreas Röhler]

Am 05.02.2011 04:48, schrieb Allan Gottlieb:
> (I use gentoo)
>
> When I tried M-x sgml-validate, it offers to run
> nsgmls -s myfile.html
>
> I don't have nsgmls so looked around and found
> opensp providing onsgmls and a gentoo bug report claimed
> a symlink nsgmls -->  onsgmls.
>
> Emerged opensp and now have onsgmls.
>
> But onsgmls -s myfile.html
> just hangs and uses no CPU time.
>
> onsgmls claims it will validate "the SGML document whose document entity is
> specified by the system identifiers SYSID..." so perhaps my error is in
> supplying just a file name.  What is needed for a valid SYSID?
>
> thanks.
> allan
>
>

Hi Allan,

AFAIU that's rather an sgml-issue.

Seems the command onsgmls fails, which should happen too for the very 
reasons also from the command line outside Emacs.

BTW I use `xmllint' for validation, may be it's ok for your purposes too.

HTH

Andreas

Re: sgml-validate

[William F Hammond]

>> When I tried M-x sgml-validate, it offers to run
>> nsgmls -s myfile.html
>>
>> I don't have nsgmls so looked around and found
>> opensp providing onsgmls and a gentoo bug report claimed
>> a symlink nsgmls -->  onsgmls.
>>
>> Emerged opensp and now have onsgmls.
>>
>> But onsgmls -s myfile.html
>> just hangs and uses no CPU time.
>>
>> onsgmls claims it will validate "the SGML document whose document entity is
>> specified by the system identifiers SYSID..." so perhaps my error is in
>> supplying just a file name.  What is needed for a valid SYSID?

> AFAIU that's rather an sgml-issue.
>
> Seems the command onsgmls fails, which should happen too for the very
> reasons also from the command line outside Emacs.
>
> BTW I use `xmllint' for validation, may be it's ok for your purposes too.

onsgmls is a very reliable tool.  In general, however, it requires
complicated command lines.

AIUI "xmllint" works only on xml files, and, therefore, probably won't
work with most extant html files, even those self-identified as
the xml form of html, which commonly are not "well-formed xml".
(Xml well-formedness is easily and quickly checked using James Clark's
"xmlwf" that is included with "expat" distributions.)

If your html is dependably well-formed xml, then take your questions
to comp.text.xml.  Otherwise maybe take them to
comp.infosystems.www.authoring.html unless you really, really want a
full understanding of the sgml background for html in which case ask
in the rather quiet group comp.text.sgml.

Furthermore, be aware that the proposal for future html5 served as
"text/html" falls outside of all classical sgml/xml validation
paradigms.

                                    -- Bill

Re: sgml-validate

[Allan Gottlieb]

On Sat, Feb 12 2011, William F. Hammond wrote:

>>> When I tried M-x sgml-validate, it offers to run
>>> nsgmls -s myfile.html
>>>
>>> I don't have nsgmls so looked around and found
>>> opensp providing onsgmls and a gentoo bug report claimed
>>> a symlink nsgmls -->  onsgmls.
>>>
>>> Emerged opensp and now have onsgmls.
>>>
>>> But onsgmls -s myfile.html
>>> just hangs and uses no CPU time.
>>>
>>> onsgmls claims it will validate "the SGML document whose document entity is
>>> specified by the system identifiers SYSID..." so perhaps my error is in
>>> supplying just a file name.  What is needed for a valid SYSID?
>
>> AFAIU that's rather an sgml-issue.
>>
>> Seems the command onsgmls fails, which should happen too for the very
>> reasons also from the command line outside Emacs.
>>
>> BTW I use `xmllint' for validation, may be it's ok for your purposes too.
>
> onsgmls is a very reliable tool.  In general, however, it requires
> complicated command lines.

Agreed.  I have given up since I was not able to figure out how to have
it "not validate" and xmllint has that ability.  The validation adds
minutes to the test so needs to be used sparingly.

> AIUI "xmllint" works only on xml files, and, therefore, probably won't
> work with most extant html files, even those self-identified as
> the xml form of html, which commonly are not "well-formed xml".
> (Xml well-formedness is easily and quickly checked using James Clark's
> "xmlwf" that is included with "expat" distributions.)

Thank you very much for this tip.  I ran xmlwf and my html passed!  This
was made possible in large part by sgml-xml-mode.  I believe xmllint
also validates, but xmlwf has the plus of speed and not commenting about
entities (see below).

> If your html is dependably well-formed xml, then take your questions
> to comp.text.xml.  Otherwise maybe take them to
> comp.infosystems.www.authoring.html unless you really, really want a
> full understanding of the sgml background for html in which case ask
> in the rather quiet group comp.text.sgml.

Actually I am now doing OK thanks to the help I received here.
The only annoyance is that xmllint keeps telling me that
≥ et al are not valid entities.

> Furthermore, be aware that the proposal for future html5 served as
> "text/html" falls outside of all classical sgml/xml validation
> paradigms.

Thanks for the warning.

allan

Re: sgml-validate

[William F Hammond]

>> onsgmls is a very reliable tool.  In general, however, it requires
>> complicated command lines.
>
> Agreed.  I have given up since I was not able to figure out how to have
> it "not validate" and xmllint has that ability.  The validation adds
> minutes to the test so needs to be used sparingly.

If it's adding minutes, then it's probably because external entities
are being loaded from across the network.  With most tools there are
ways to avoid this, and one should avoid it.

For a non-validating parse with onsgmls use something like this shell
script:

------
#!/bin/sh
# interface to "onsgmls" for non-validating XML parse
pname=`basename "$0"`
SP_CHARSET_FIXED=YES
export SP_CHARSET_FIXED
SP_ENCODING=XML
export SP_ENCODING
SGML_CATALOG_FILES=/usr/local/xml/pubtext/myFavoriteCatalog
export SGML_CATALOG_FILES
if [ -f "$1" -a -r "$1" ] ; then
  fname="$1"
else
  fname="${1}.xml"
fi
if [ -f "$fname" ] ; then
  onsgmls -wxml -wno-valid -c "$SGML_CATALOG_FILES" "$fname"
else
  echo "${pname}: Cannot find $fname"
fi
------

For a non-validating parse the specified catalog should contain
the line

SGMLDECL "xml.dcl"

where "xml.dcl" is James Clark's sgml declaration for xml, usually
distributed with opensp, which should be located parallel to the
catalog or else referenced in the catalog with a pathname relative to
the location of the catalog.

> The only annoyance is that xmllint keeps telling me that
> ≥ et al are not valid entities.

Correct.  The only such entities that are available by default are
'&amp;' for '&', '&lt;' for '<', annd '&gt;' for '>'.

Something like '&ge;' (which I imagine to be U-2265, "greater than or
equal to") can be defined for in-house use but will not work well
across the network.  For publication on the network use the character
itself if the XML instance is given a suitable content-encoding, e.g.,
utf-8, or use '&#x2265;'.

                                    -- Bill

Re: sgml-validate

[Allan Gottlieb]

On Wed, Feb 16 2011, William F. Hammond wrote:

> For a non-validating parse with onsgmls use something like this shell
> script:

[ snipped]

> For a non-validating parse the specified catalog should contain
> the line
>
> SGMLDECL "xml.dcl"
>
> where "xml.dcl" is James Clark's sgml declaration for xml, usually
> distributed with opensp,

Thank you for all the information

>> The only annoyance is that xmllint keeps telling me that
>> ≥ et al are not valid entities.
>
> Correct.  The only such entities that are available by default are
> '&amp;' for '&', '&lt;' for '<', annd '&gt;' for '>'.
>
> Something like '&ge;' (which I imagine to be U-2265, "greater than or
> equal to") can be defined for in-house use but will not work well
> across the network.  For publication on the network use the character
> itself if the XML instance is given a suitable content-encoding, e.g.,
> utf-8, or use '&#x2265;'.

I had hoped I would be able to put somewhere in my .html file
some version of
<entity-defs>
  ge #x2265
  ...
</entity-defs>
But I see from your reply that this will not be possible.

Thanks again for your expert commentary.
allan

Re: sgml-validate

[Yuri Khan]

On Thu, Feb 17, 2011 at 10:21, Allan Gottlieb <gottlieb@nyu.edu> wrote:

> I had hoped I would be able to put somewhere in my .html file
> some version of
> <entity-defs>
>  ge #x2265
>  ...
> </entity-defs>
> But I see from your reply that this will not be possible.

In fact, in an XML document you should be able to specify an internal
subset in your document type declaration:

<!DOCTYPE html
     PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN"
     "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd" [
<!ENTITY ge "&#x2265;">
]>

Any conforming XML parser should then understand &ge; in the rest of
the document, along with the built-in &lt;, &gt;, &amp;, &quot;, and
&apos;. Whether the web browsers use conforming XML parsers is an
entirely different matter.

Re: sgml-validate

[Allan Gottlieb]

On Sun, Feb 20 2011, Yuri Khan wrote:

> On Thu, Feb 17, 2011 at 10:21, Allan Gottlieb <gottlieb@nyu.edu> wrote:
>
>> I had hoped I would be able to put somewhere in my .html file
>> some version of
>> <entity-defs>
>>  ge #x2265
>>  ...
>> </entity-defs>
>> But I see from your reply that this will not be possible.
>
> In fact, in an XML document you should be able to specify an internal
> subset in your document type declaration:
>
> <!DOCTYPE html
>      PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN"
>      "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd" [
> <!ENTITY ge "&#x2265;">
> ]>

Thank you.  I put a bunch in my file and it now validates
(I had previously wrote a sed script to convert before validating)

> Any conforming XML parser should then understand &ge; in the rest of
> the document, along with the built-in &lt;, &gt;, &amp;, &quot;, and
> &apos;. Whether the web browsers use conforming XML parsers is an
> entirely different matter.

What I can say is that firefox doesn't complain and does show the
characters correctly, but it also recognized the native &ge;, etc
so perhaps it is just ignoring the <!ENTITY ge "&#x2265;">.

Thanks again.
allan

Re: sgml-validate

[Yuri Khan]

On Tue, Feb 22, 2011 at 20:44, Allan Gottlieb <gottlieb@nyu.edu> wrote:
>> <!DOCTYPE html
>>      PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN"
>>      "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd" [
>> <!ENTITY ge "&#x2265;">
>> ]>

> What I can say is that firefox doesn't complain and does show the
> characters correctly, but it also recognized the native &ge;, etc
> so perhaps it is just ignoring the <!ENTITY ge "&#x2265;">.

This may happen if the browser is led to believe that your document is
an HTML one. It will therefore parse it using HTML rules, which
include the whole lot of HTML entities. Many servers serve XHTML
documents as text/html because of one widely used browser that did not
support application/xhtml+xml until its most recent version 9.

Re: sgml-validate

[Allan Gottlieb]

On Tue, Feb 22 2011, Yuri Khan wrote:

> On Tue, Feb 22, 2011 at 20:44, Allan Gottlieb <gottlieb@nyu.edu> wrote:
>>> <!DOCTYPE html
>>>      PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN"
>>>      "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd" [
>>> <!ENTITY ge "&#x2265;">
>>> ]>
>
>> What I can say is that firefox doesn't complain and does show the
>> characters correctly, but it also recognized the native &ge;, etc
>> so perhaps it is just ignoring the <!ENTITY ge "&#x2265;">.
>
> This may happen if the browser is led to believe that your document is
> an HTML one. It will therefore parse it using HTML rules, which
> include the whole lot of HTML entities. Many servers serve XHTML
> documents as text/html because of one widely used browser that did not
> support application/xhtml+xml until its most recent version 9.

I see.  Thanks.
allan

Re: sgml-validate

[William F Hammond]

Allan Gottlieb <gottlieb@nyu.edu> writes:

> I had hoped I would be able to put somewhere in my .html file
> some version of
> <entity-defs>
>   ge #x2265
>   ...
> </entity-defs>

That is essentially a macro definition.

You can put something like that in your source file that is then
auto-translated to public HTML.

                                    -- Bill

Re: sgml-validate

[Allan Gottlieb]

On Fri, Feb 18 2011, William F. Hammond wrote:

> Allan Gottlieb <gottlieb@nyu.edu> writes:
>
>> I had hoped I would be able to put somewhere in my .html file
>> some version of
>> <entity-defs>
>>   ge #x2265
>>   ...
>> </entity-defs>
>
> That is essentially a macro definition.

Agreed; I was hoping that html would support such.

> You can put something like that in your source file that is then
> auto-translated to public HTML.

Right.  I will write a script.

thanks.
allan