bug#25108: 26.0.50; info node shows octal characters instead of curvy quotes

bug#25108: 26.0.50; info node shows octal characters instead of curvy quotes

[Eric Hanchrow]

[-- Attachment #1: Type: text/plain, Size: 3839 bytes --]

I built emacs from git (commit a486fabb41cdbaa5813c2687fd4008945297d71d) via

  git clean -dxf
  ./autogen.sh
  ./configure
  make all install

I then invoked it like this

  open --new
~/git-repositories/3rd-party/emacs-master/nextstep/Emacs-master.app/ --args
-Q

I then invoked info on the file elisp.info, something like this (I'm not
sure exactly what I typed, but it wound up leaving this in command-history)

  (info "~/git-repositories/3rd-party/emacs-master/info/elisp.info" nil)

I then typed g Keys SPC in SPC Documentation RET

I then noticed that the description of text-quoting-style looked like
this:

     -- Variable: text-quoting-style
         The value of this variable is a symbol that specifies the style
         Emacs should use for single quotes in the wording of help and
         messages.  If the variable's value is `curve', the style is
         \342\200\230like this\342\200\231 with curved single quotes.  If
the value is
         `straight', the style is 'like this' with straight apostrophes.

It's supposed to have actual curly quotes instead of octal escape sequences.


In GNU Emacs 26.0.50.1 (x86_64-apple-darwin16.1.0, NS appkit-1504.60
Version 10.12.1 (Build 16B2555))
 of 2016-12-03 built on Eric-Hanchrows-MacBook-Pro.local
Repository revision: a486fabb41cdbaa5813c2687fd4008945297d71d
Windowing system distributor 'Apple', version 10.3.1504
Recent messages:
For information about GNU Emacs and the GNU system, type C-h C-a.
Composing main Info directory...done
Quit
Making completion list...
Type C-x 1 to delete the help window.
C-x | is undefined

Configured features:
NOTIFY ACL GNUTLS LIBXML2 ZLIB TOOLKIT_SCROLL_BARS NS

Important settings:
  value of $LANG: en_US.UTF-8
  locale-coding-system: utf-8-unix

Major mode: Info

Minor modes in effect:
  tooltip-mode: t
  global-eldoc-mode: t
  electric-indent-mode: t
  mouse-wheel-mode: t
  tool-bar-mode: t
  menu-bar-mode: t
  file-name-shadow-mode: t
  global-font-lock-mode: t
  font-lock-mode: t
  blink-cursor-mode: t
  auto-composition-mode: t
  auto-encryption-mode: t
  auto-compression-mode: t
  buffer-read-only: t
  line-number-mode: t
  transient-mark-mode: t

Load-path shadows:
None found.

Features:
(shadow sort mail-extr emacsbug message subr-x puny format-spec rfc822
mml mml-sec password-cache epa derived epg epg-config gnus-util rmail
rmail-loaddefs mm-decode mm-bodies mm-encode mail-parse rfc2231
mailabbrev gmm-utils mailheader sendmail rfc2047 rfc2045 ietf-drums
mm-util mail-prsvr mail-utils help-fns radix-tree map seq byte-opt gv
bytecomp byte-compile cl-extra help-mode cconv cl-loaddefs pcase cl-lib
dired dired-loaddefs info easymenu time-date mule-util tooltip eldoc
electric uniquify ediff-hook vc-hooks lisp-float-type mwheel term/ns-win
ns-win ucs-normalize term/common-win tool-bar dnd fontset image
regexp-opt fringe tabulated-list replace newcomment text-mode elisp-mode
lisp-mode prog-mode register page menu-bar rfn-eshadow isearch timer
select scroll-bar mouse jit-lock font-lock syntax facemenu font-core
term/tty-colors frame cl-generic cham georgian utf-8-lang misc-lang
vietnamese tibetan thai tai-viet lao korean japanese eucjp-ms cp51932
hebrew greek romanian slovak czech european ethiopic indian cyrillic
chinese composite charscript case-table epa-hook jka-cmpr-hook help
simple abbrev obarray minibuffer cl-preloaded nadvice loaddefs button
faces cus-face macroexp files text-properties overlay sha1 md5 base64
format env code-pages mule custom widget hashtable-print-readable
backquote kqueue cocoa ns multi-tty make-network-process emacs)

Memory information:
((conses 16 273252 11695)
 (symbols 48 29287 0)
 (miscs 40 60 246)
 (strings 32 42280 7568)
 (string-bytes 1 883829)
 (vectors 16 35721)
 (vector-slots 8 689453 7268)
 (floats 8 180 148)
 (intervals 56 4829 0)
 (buffers 976 15))

[-- Attachment #2: Type: text/html, Size: 5183 bytes --]

bug#25108: 26.0.50; info node shows octal characters instead of curvy quotes

[Eli Zaretskii]

> From: Eric Hanchrow <eric.hanchrow@gmail.com>
> Date: Sun, 04 Dec 2016 17:40:28 +0000
> 
> I built emacs from git (commit a486fabb41cdbaa5813c2687fd4008945297d71d) via
> 
> git clean -dxf
> ./autogen.sh
> ./configure
> make all install
> 
> I then invoked it like this
> 
> open --new ~/git-repositories/3rd-party/emacs-master/nextstep/Emacs-master.app/ --args -Q
> 
> I then invoked info on the file elisp.info, something like this (I'm not
> sure exactly what I typed, but it wound up leaving this in command-history)
> 
> (info "~/git-repositories/3rd-party/emacs-master/info/elisp.info" nil)
> 
> I then typed g Keys SPC in SPC Documentation RET
> 
> I then noticed that the description of text-quoting-style looked like
> this:
> 
> -- Variable: text-quoting-style
> The value of this variable is a symbol that specifies the style
> Emacs should use for single quotes in the wording of help and
> messages. If the variable's value is `curve', the style is
> \342\200\230like this\342\200\231 with curved single quotes. If the value is
> `straight', the style is 'like this' with straight apostrophes.

According to the mode line, what is buffer-file-coding-system of the
buffer showing this?  It should be UTF-8.

bug#25108: 26.0.50; info node shows octal characters instead of curvy quotes

[Eric Hanchrow]

[-- Attachment #1: Type: text/plain, Size: 1423 bytes --]

It read t:%%-; clicking the mouse says it's "t -- raw-text-unix".

On Sun, Dec 4, 2016 at 7:39 PM Eli Zaretskii <eliz@gnu.org> wrote:

> > From: Eric Hanchrow <eric.hanchrow@gmail.com>
> > Date: Sun, 04 Dec 2016 17:40:28 +0000
> >
> > I built emacs from git (commit a486fabb41cdbaa5813c2687fd4008945297d71d)
> via
> >
> > git clean -dxf
> > ./autogen.sh
> > ./configure
> > make all install
> >
> > I then invoked it like this
> >
> > open --new
> ~/git-repositories/3rd-party/emacs-master/nextstep/Emacs-master.app/ --args
> -Q
> >
> > I then invoked info on the file elisp.info, something like this (I'm not
> > sure exactly what I typed, but it wound up leaving this in
> command-history)
> >
> > (info "~/git-repositories/3rd-party/emacs-master/info/elisp.info" nil)
> >
> > I then typed g Keys SPC in SPC Documentation RET
> >
> > I then noticed that the description of text-quoting-style looked like
> > this:
> >
> > -- Variable: text-quoting-style
> > The value of this variable is a symbol that specifies the style
> > Emacs should use for single quotes in the wording of help and
> > messages. If the variable's value is `curve', the style is
> > \342\200\230like this\342\200\231 with curved single quotes. If the
> value is
> > `straight', the style is 'like this' with straight apostrophes.
>
> According to the mode line, what is buffer-file-coding-system of the
> buffer showing this?  It should be UTF-8.
>

[-- Attachment #2: Type: text/html, Size: 2729 bytes --]

bug#25108: 26.0.50; info node shows octal characters instead of curvy quotes

[Eli Zaretskii]

> From: Eric Hanchrow <eric.hanchrow@gmail.com>
> Date: Mon, 05 Dec 2016 05:20:20 +0000
> Cc: 25108@debbugs.gnu.org
> 
> It read t:%%-; clicking the mouse says it's "t -- raw-text-unix".

That's a clear sign of a problem.

Does the elisp.info file has a Local Variables section at its end
which sets the file's encoding to be UTF-8?

bug#25108: 26.0.50; info node shows octal characters instead of curvy quotes

[Eric Hanchrow]

[-- Attachment #1: Type: text/plain, Size: 435 bytes --]

Yes, it does.

On Mon, Dec 5, 2016 at 7:51 AM Eli Zaretskii <eliz@gnu.org> wrote:

> > From: Eric Hanchrow <eric.hanchrow@gmail.com>
> > Date: Mon, 05 Dec 2016 05:20:20 +0000
> > Cc: 25108@debbugs.gnu.org
> >
> > It read t:%%-; clicking the mouse says it's "t -- raw-text-unix".
>
> That's a clear sign of a problem.
>
> Does the elisp.info file has a Local Variables section at its end
> which sets the file's encoding to be UTF-8?
>

[-- Attachment #2: Type: text/html, Size: 1163 bytes --]

bug#25108: 26.0.50; info node shows octal characters instead of curvy quotes

[Eli Zaretskii]

> From: Eric Hanchrow <eric.hanchrow@gmail.com>
> Date: Tue, 06 Dec 2016 01:57:16 +0000
> Cc: 25108@debbugs.gnu.org
> 
> Yes, it does. 

Can you show the file-local variables section in that file?

bug#25108: 26.0.50; info node shows octal characters instead of curvy quotes

[Eric Hanchrow]

[-- Attachment #1: Type: text/plain, Size: 316 bytes --]

Local Variables:
coding: UTF-8
End:


On Tue, Dec 6, 2016 at 7:27 AM Eli Zaretskii <eliz@gnu.org> wrote:

> > From: Eric Hanchrow <eric.hanchrow@gmail.com>
> > Date: Tue, 06 Dec 2016 01:57:16 +0000
> > Cc: 25108@debbugs.gnu.org
> >
> > Yes, it does.
>
> Can you show the file-local variables section in that file?
>

[-- Attachment #2: Type: text/html, Size: 918 bytes --]

bug#25108: 26.0.50; info node shows octal characters instead of curvy quotes

[Eli Zaretskii]

> From: Eric Hanchrow <eric.hanchrow@gmail.com>
> Date: Wed, 07 Dec 2016 03:31:55 +0000
> Cc: 25108@debbugs.gnu.org
> 
> coding: UTF-8
> End:

Does it help to lower-case "UTF-8"?

If it does, please tell what version of makeinfo was used to produced
this file (you should find that information at the beginning of the
file).

bug#25108: 26.0.50; info node shows octal characters instead of curvy quotes

[Eli Zaretskii]

[Please keep the bug address on the CC list.]

> From: Eric Hanchrow <eric.hanchrow@gmail.com>
> Date: Thu, 08 Dec 2016 03:07:57 +0000
> 
>  > coding: UTF-8
>  > End:
> 
>  Does it help to lower-case "UTF-8"?
> 
> Nope. To my surprise, however, it _does_ work if I delete the large "Tag table" paragraph, or if I move the
> "Local Variables" section -after- the "Tag Table" section.

It should have been after the Tag Table in the first place.  It should
be at the very end of the file (within 3KB from its end, to be exact).

>  If it does, please tell what version of makeinfo was used to produced
>  this file (you should find that information at the beginning of the
>  file).
> 
> makeinfo version 4.8 

This is really old; the current version is 6.3.  Texinfo 4.8 was the
first one that supported @documentencoding, so I guess it had some
bugs in that area.  I suggest to upgrade.

Any reason not to close this bug report, now that we know it wasn't an
Emacs problem?

Thanks.

bug#25108: 26.0.50; info node shows octal characters instead of curvy quotes

[Glenn Morris]

Eli Zaretskii wrote:

>> makeinfo version 4.8 
>
> This is really old; the current version is 6.3.  Texinfo 4.8 was the
> first one that supported @documentencoding, so I guess it had some
> bugs in that area.

Emacs's configure currently accepts makeinfo >= 4.7.
It sounds like this should be increased.
Certainly it's not clear how 4.7 could work, based on what you say about
documentencoding.

bug#25108: 26.0.50; info node shows octal characters instead of curvy quotes

[Eli Zaretskii]

> From: Glenn Morris <rgm@gnu.org>
> Cc: Eric Hanchrow <eric.hanchrow@gmail.com>,  25108@debbugs.gnu.org
> Date: Thu, 08 Dec 2016 12:44:52 -0500
> 
> Emacs's configure currently accepts makeinfo >= 4.7.
> It sounds like this should be increased.

Yes, I think so.  I'm not sure where to bump it, though.  4.13,
perhaps, to accommodate those who don't want to switch to the slower
Perl-based releases?

> Certainly it's not clear how 4.7 could work, based on what you say about
> documentencoding.

Indeed, since we switched to UTF-8 in many manuals, 4.7 is probably no
longer appropriate.

Thanks.

bug#25108: 26.0.50; info node shows octal characters instead of curvy quotes

[Glenn Morris]

Eli Zaretskii wrote:

> 4.13, perhaps, to accommodate those who don't want to switch to the
> slower Perl-based releases?

That would be my preference.

bug#25108: 26.0.50; info node shows octal characters instead of curvy quotes

[Eric Hanchrow]

[-- Attachment #1: Type: text/plain, Size: 400 bytes --]

For what it's worth, I tried a current version of makeinfo (version 6.3)
and it was so slow that I killed it before it finished; I thought something
was wrong with it.

On Thu, Dec 8, 2016 at 10:49 AM Glenn Morris <rgm@gnu.org> wrote:

> Eli Zaretskii wrote:
>
> > 4.13, perhaps, to accommodate those who don't want to switch to the
> > slower Perl-based releases?
>
> That would be my preference.
>

[-- Attachment #2: Type: text/html, Size: 773 bytes --]

bug#25108: 26.0.50; info node shows octal characters instead of curvy quotes

[Eli Zaretskii]

> From: Eric Hanchrow <eric.hanchrow@gmail.com>
> Date: Fri, 09 Dec 2016 03:16:14 +0000
> Cc: 25108@debbugs.gnu.org
> 
> For what it's worth, I tried a current version of makeinfo (version 6.3) and it was so slow that I killed it before it
> finished; I thought something was wrong with it.

It's slow (18 times slower, to be precise) because makeinfo was
reimplemented in Perl.  You can install Texinfo 4.13, which was the
last version with a C implementation, if you are annoyed by the
slowness.

bug#25108: 26.0.50; info node shows octal characters instead of curvy quotes

[Glenn Morris]

Version: 25.2

In 5f7d906 I bumped the makeinfo requirement to 4.13.