html image rendering not working Win Emacs 24.4 (eww and gnus)

html image rendering not working Win Emacs 24.4 (eww and gnus)

[Sivaram Neelakantan]

I upgraded to the stock install of GNU Emacs 24.4.1 (i686-pc-mingw32)
of 2014-10-24 and now the image rendering has stopped in gnus(shr) and
eww.  This used to work in Emacs 24.3. And here is some of the
settings that I picked up from my .Emacs and vars.  I believe the
dynamic-library-alist is picked up from ezwinports bin directory.

--8<---------------cut here---------------start------------->8---
dynamic-library-alist is

Value: ((xpm "libxpm.dll" "xpm4.dll" "libXpm-nox4.dll")
 (png "libpng16.dll" "libpng16-16.dll")
 (tiff "libtiff-5.dll" "libtiff3.dll" "libtiff.dll")
 (jpeg "libjpeg-9.dll")
 (gif "libgif-7.dll")
 (svg "librsvg-2-2.dll")
 (gdk-pixbuf "libgdk_pixbuf-2.0-0.dll")
 (glib "libglib-2.0-0.dll")
 (gobject "libgobject-2.0-0.dll")
 (gnutls "libgnutls-28.dll" "libgnutls-26.dll")
 (libxml2 "libxml2-2.dll" "libxml2.dll")
 (zlib "zlib1.dll" "libz-1.dll"))

(setq exec-path
      (cons "C:/MiKTeX2.9/miktex/bin/x64"
      (cons "C:/gnu/ezwinports/bin"
      (cons "C:/gnu/bin/"
      (cons "C:/cygwin/usr/bin"
      (cons "C:/cygwin/bin" exec-path))))))

(setenv "PATH" (concat "C:\\Users\\ADMIN\\AppData\\Roaming\\.emacs.d;C:\\gnu\\ezwinports\\bin;C:\\MiKTeX2.9\\miktex\\bin\\x64;C:\\cygwin\\bin;C:\\cygwin\\usr\\bin;C:\\gnu\\bin\\;" (getenv "PATH")))
--8<---------------cut here---------------end--------------->8---

 sivaram
 -- 

Re: html image rendering not working Win Emacs 24.4 (eww and gnus)

[Eli Zaretskii]

> From: Sivaram Neelakantan <nsivaram.net@gmail.com>
> Date: Mon, 19 Jan 2015 08:17:32 +0530
> User-Mail-Address: nsivaram.net@gmail.com
> 
> I upgraded to the stock install of GNU Emacs 24.4.1 (i686-pc-mingw32)
> of 2014-10-24 and now the image rendering has stopped in gnus(shr) and
> eww.  This used to work in Emacs 24.3.

Check the versions of your image DLLs and the corresponding versions
expected by Emacs, and upgrade the image libraries accordingly.

> dynamic-library-alist is
> 
> Value: ((xpm "libxpm.dll" "xpm4.dll" "libXpm-nox4.dll")
>  (png "libpng16.dll" "libpng16-16.dll")
>  (tiff "libtiff-5.dll" "libtiff3.dll" "libtiff.dll")
>  (jpeg "libjpeg-9.dll")
>  (gif "libgif-7.dll")
>  (svg "librsvg-2-2.dll")
>  (gdk-pixbuf "libgdk_pixbuf-2.0-0.dll")
>  (glib "libglib-2.0-0.dll")
>  (gobject "libgobject-2.0-0.dll")
>  (gnutls "libgnutls-28.dll" "libgnutls-26.dll")
>  (libxml2 "libxml2-2.dll" "libxml2.dll")
>  (zlib "zlib1.dll" "libz-1.dll"))

Do you have all of these DLL?

Re: html image rendering not working Win Emacs 24.4 (eww and gnus)

[Sivaram Neelakantan]

On Mon, Jan 19 2015,Eli Zaretskii wrote:


[snipped 8 lines]

> Check the versions of your image DLLs and the corresponding versions
> expected by Emacs, and upgrade the image libraries accordingly.

Presumably you're talking about the dynamic-library-alist values and
what I have in my c:\gnu\ezwinports\bin directory?  Everything is the
same other than the gif one, I have libgif-6.dll while the alist has
libgif-7. 

>
>> dynamic-library-alist is
>> 
>> Value: ((xpm "libxpm.dll" "xpm4.dll" "libXpm-nox4.dll")
>>  (png "libpng16.dll" "libpng16-16.dll")
>>  (tiff "libtiff-5.dll" "libtiff3.dll" "libtiff.dll")
>>  (jpeg "libjpeg-9.dll")
>>  (gif "libgif-7.dll")
>>  (svg "librsvg-2-2.dll")
>>  (gdk-pixbuf "libgdk_pixbuf-2.0-0.dll")
>>  (glib "libglib-2.0-0.dll")
>>  (gobject "libgobject-2.0-0.dll")
>>  (gnutls "libgnutls-28.dll" "libgnutls-26.dll")
>>  (libxml2 "libxml2-2.dll" "libxml2.dll")
>>  (zlib "zlib1.dll" "libz-1.dll"))
>
> Do you have all of these DLL?

Yes, apart from the gif one, the rest are the same versions as
mentioned in the alist in the ezwinports\bin directory.

Still no jpeg or png have rendered for any html posts; I typically
connect to the rbloggers rss gwene feed and it's fairly heavy on
graphics and nothing renders so far.

 sivaram
 -- 

Re: html image rendering not working Win Emacs 24.4 (eww and gnus)

[Eli Zaretskii]

> From: Sivaram Neelakantan <nsivaram.net@gmail.com>
> Date: Mon, 19 Jan 2015 22:41:13 +0530
> 
> On Mon, Jan 19 2015,Eli Zaretskii wrote:
> 
> > Check the versions of your image DLLs and the corresponding versions
> > expected by Emacs, and upgrade the image libraries accordingly.
> 
> Presumably you're talking about the dynamic-library-alist values and
> what I have in my c:\gnu\ezwinports\bin directory?

No, I'm talking about the variables that report the versions of the
image libraries expected by your Emacs binary: libpng-version,
libjpeg-version, and libgif-version.  See lisp/term/w32-win.el for
more about that.

> Everything is the same other than the gif one, I have libgif-6.dll
> while the alist has libgif-7.

Then you need to install libgif-7.dll, if you want GIF support.

> >> dynamic-library-alist is
> >> 
> >> Value: ((xpm "libxpm.dll" "xpm4.dll" "libXpm-nox4.dll")
> >>  (png "libpng16.dll" "libpng16-16.dll")
> >>  (tiff "libtiff-5.dll" "libtiff3.dll" "libtiff.dll")
> >>  (jpeg "libjpeg-9.dll")
> >>  (gif "libgif-7.dll")
> >>  (svg "librsvg-2-2.dll")
> >>  (gdk-pixbuf "libgdk_pixbuf-2.0-0.dll")
> >>  (glib "libglib-2.0-0.dll")
> >>  (gobject "libgobject-2.0-0.dll")
> >>  (gnutls "libgnutls-28.dll" "libgnutls-26.dll")
> >>  (libxml2 "libxml2-2.dll" "libxml2.dll")
> >>  (zlib "zlib1.dll" "libz-1.dll"))
> >
> > Do you have all of these DLL?
> 
> Yes, apart from the gif one, the rest are the same versions as
> mentioned in the alist in the ezwinports\bin directory.

Then my guess is that you don't have that directory on PATH outside
Emacs.  (It is not enough to set PATH and exec-path inside Emacs,
because DLL search is done by system components that don't know about
Emacs-specific directory lists.)

Or maybe there's another directory (Cygwin? 64-bit?) on your PATH
before ezwinports\bin, where you have incompatible (Cygwin? 64-bit)
DLLs by the same names.  I see a Cygwin directory in the list you
posted and at least one 64-bit directory, whereas the DLLs from
ezwinports are all 32-bit DLLs, and your Emacs is a 32-bit executable.

Or some other similar snafu.  The point is, somehow Emacs does not
find these DLLs, or finds incompatible DLLs by the same name.  You
need to find out why.

Re: html image rendering not working Win Emacs 24.4 (eww and gnus)

[Sivaram Neelakantan]

On Mon, Jan 19 2015,Eli Zaretskii wrote:

>> From: Sivaram Neelakantan <nsivaram.net@gmail.com>

[snipped 40 lines]

> Then my guess is that you don't have that directory on PATH outside
> Emacs.  (It is not enough to set PATH and exec-path inside Emacs,
> because DLL search is done by system components that don't know about
> Emacs-specific directory lists.)

You are right, I think.  After a couple of hours of confused and
increasingly frustrated debugging with .Emacs and system PATH, I think
I sort of fixed the issue.

I went into control panel and added the ezwinports\bin path to it. I
added it as the first path name.  Hopefully, there aren't any windows
level component that has similar names to what is there in the bin
directory, both for exes and DLLs.

Second, the ezwinport gnutls DLLs don't seem to work when I launched
 Gnus(it complained of 256 bits and certificate errors of some sort).
 I simply renamed them and I think cygwin gnutls is handling it now as
 gnus downloads rss and mails without any issues again.


[snipped 7 lines]

> Or some other similar snafu.  The point is, somehow Emacs does not
> find these DLLs, or finds incompatible DLLs by the same name.  You
> need to find out why.

To summarise, your premise was right; adding ezwinports\bin to system
PATH fixed the issue.  I think.

I probably have to remove the exec-path and getenv PATH cruft from my
.Emacs to reduce future errors but for now, all images are rendering.
 
 sivaram
 -- 

Re: html image rendering not working Win Emacs 24.4 (eww and gnus)

[Eli Zaretskii]

> From: Sivaram Neelakantan <nsivaram.net@gmail.com>
> Date: Tue, 20 Jan 2015 22:21:36 +0530
> 
> Second, the ezwinport gnutls DLLs don't seem to work when I launched
>  Gnus(it complained of 256 bits and certificate errors of some sort).

That doesn't really mean "don't seem to work".  It could be some real
problem (assuming your gnutls DLL is the latest one).  This works for
everyone else, including in Gnus.

>  I simply renamed them and I think cygwin gnutls is handling it now as
>  gnus downloads rss and mails without any issues again.

That's hardly a good solution, because you now use gnutls via its
external gnutls-cli program, which relies on signals for its
communications with Emacs.  This only works when your Emacs is a
Cygwin build, otherwise you might see Emacs hang in TLS connections.

> I probably have to remove the exec-path and getenv PATH cruft from my
> .Emacs to reduce future errors

Indeed, that's a good idea.

Re: html image rendering not working Win Emacs 24.4 (eww and gnus)

[Sivaram Neelakantan]

On Tue, Jan 20 2015,Eli Zaretskii wrote:


[snipped 6 lines]

> That doesn't really mean "don't seem to work".  It could be some real
> problem (assuming your gnutls DLL is the latest one).  This works for
> everyone else, including in Gnus.
>

Right, got it working after reading up a bit.  Apparently, it was
simple as setting the following

(setq gnutls-log-level 1) ;; just in case it borks for some sites
(setq gnutls-trustfiles '("c:/cygwin/usr/ssl/certs/ca-bundle.trust.crt" "c:/cygwin/usr/ssl/certs/ca-bundle.crt"))

BTW, what is the recommended approach to 1) get the latest trustfiles
2) keep it updated?

[snipped 3 lines]

> That's hardly a good solution, because you now use gnutls via its
> external gnutls-cli program, which relies on signals for its
> communications with Emacs.  This only works when your Emacs is a
> Cygwin build, otherwise you might see Emacs hang in TLS connections.

Now it works with the version in ezwinports\bin directory and I was
able to use eww and gnus without any issues.

>
>> I probably have to remove the exec-path and getenv PATH cruft from my
>> .Emacs to reduce future errors
>
> Indeed, that's a good idea.

After adding ezwinports\bin to the system PATH, the only additional
change I had to add was

;; need this for using cygwin.
(setq cygwin-mount-cygwin-bin-directory "C:/cygwin/bin/")

With that, I could remove all the exec-path and getenv PATH
modifications in .Emacs that you warned against.

Thanks for the help.  Appreciated.

 sivaram
 -- 

Re: html image rendering not working Win Emacs 24.4 (eww and gnus)

[Eli Zaretskii]

> From: Sivaram Neelakantan <nsivaram.net@gmail.com>
> Date: Wed, 21 Jan 2015 14:09:26 +0530
> 
> > That doesn't really mean "don't seem to work".  It could be some real
> > problem (assuming your gnutls DLL is the latest one).  This works for
> > everyone else, including in Gnus.
> >
> 
> Right, got it working after reading up a bit.  Apparently, it was
> simple as setting the following
> 
> (setq gnutls-log-level 1) ;; just in case it borks for some sites
> (setq gnutls-trustfiles '("c:/cygwin/usr/ssl/certs/ca-bundle.trust.crt" "c:/cygwin/usr/ssl/certs/ca-bundle.crt"))
> 
> BTW, what is the recommended approach to 1) get the latest trustfiles
> 2) keep it updated?

The recommended approach is not to do that at all ;-) Your system
already has the certificates stored (ever asked yourself how come IE
can access those https URLs?), and gnutls already knows how to read
them using a Windows specific API.  The only problem is that Emacs
24.4 doesn't use that capability (the development sources of Emacs
already do).  So for now you will have to live with using an external
bundle, or install a snapshot of the Emacs development repository.

As to how to get and update the certificate bundle, I use the recipe
here:

  http://www.linuxfromscratch.org/blfs/view/svn/postlfs/cacerts.html

It includes a bunch of Unix shell scripts that need to be run to
massage the bundle, but since you evidently have Cygwin installed, it
shouldn't be a problem for you.  (People who have MSYS could use MSYS
Bash instead, which is what I did.)

Re: html image rendering not working Win Emacs 24.4 (eww and gnus)

[Sivaram Neelakantan]

On Wed, Jan 21 2015,Eli Zaretskii wrote:

>> From: Sivaram Neelakantan <nsivaram.net@gmail.com>
>> Date: Wed, 21 Jan 2015 14:09:26 +0530

[snipped 6 lines]

>> Right, got it working after reading up a bit.  Apparently, it was
>> simple as setting the following
>> 
>> (setq gnutls-log-level 1) ;; just in case it borks for some sites
>> (setq gnutls-trustfiles
>> '("c:/cygwin/usr/ssl/certs/ca-bundle.trust.crt"
>> "c:/cygwin/usr/ssl/certs/ca-bundle.crt"))
>> 

With the gnutls stuff working, am I to understand that I no longer
need msmtp as MTA to connect to gmail and send emails and can use
smtpmail?

(setq smtpmail-stream-type 'ssl)
(setq smtpmail-smtp-server "smtp.gmail.com")
(setq smtpmail-smtp-service 465)

along with a .authinfo file, should be enough?


[snipped 22 lines]



 sivaram
 -- 

Re: html image rendering not working Win Emacs 24.4 (eww and gnus)

[Eli Zaretskii]

> From: Sivaram Neelakantan <nsivaram.net@gmail.com>
> Date: Fri, 23 Jan 2015 17:28:17 +0530
> 
> With the gnutls stuff working, am I to understand that I no longer
> need msmtp as MTA to connect to gmail and send emails and can use
> smtpmail?
> 
> (setq smtpmail-stream-type 'ssl)
> (setq smtpmail-smtp-server "smtp.gmail.com")
> (setq smtpmail-smtp-service 465)
> 
> along with a .authinfo file, should be enough?

If you were asking me, then I don't know, as I don't use Gnus.

Perhaps someone else could help you.