Latest 21.3 CVS and MS Windows

Latest 21.3 CVS and MS Windows

[Frank Schmitt]

Hello

I just wanted to try Emacs 21.3 under MS Windows, therefor checked out
latest CVS but run into several problems:

First I tried to build using MS Visual C++ 6.0. I said "configure.bat
--with-ms-vc" and then said nmake but got an error message telling that
essential Lisp files would be missing and that I should either create
abbrev.elc somehow or run nmake bootstrap.

I then said "nmake bootstrap", this took ages but worked. I then said
"nmake install" however something seems to be broken about creation of
Info files because when i fire up info, I get the usual top node, but no
matter on which menu item I go, I get the error message "Info file foo
does not exist.". (There's no difference if I install Emacs where it's
build or if I give configure the --prefix foo option).

Then I wanted to try out the new external image library support, therefor
I got 

jpeg-6b-1-bin.zip   libpng-1.0.13-bin.zip   libpng-1.2.4-src.zip      tiff-3.5.7-bin.zip
jpeg-6b-1-lib.zip   libpng-1.0.13-lib.zip   libungif-4.1.0b1-bin.zip  tiff-3.5.7-lib.zip
libjpeg-6b-bin.zip  libpng-1.2.4-1-bin.zip  libungif-4.1.0b1-lib.zip  xpm-3.4k-1-bin.zip
libjpeg-6b-lib.zip  libpng-1.2.4-1-lib.zip  libungif-4.1.0b1-src.zip  xpm-3.4k-1-lib.zip
zlib-1.1.4-bin.zip  zlib-1.1.4-lib.zip

from gnuwin32.sourceforge.net, unziped the files, added the include
directory to $INCLUDE and the bin directory to $PATH and repeated the
cycle from above. Configure found all external libraries except the gif
libraries and nmake gave me an Emacs which was able of displaying
XPM's. However (image-type-available-p 'tif) (or 'tiff) evaluates to
nil, as well as configure said it found the necessary libraries, trying
to display a jpeg results in an empty square of the size of a character
and trying to display a png makes Emacs crash, no matter if I use
libpng-1.2.4 or libpng-1.0.13.


So I thought "MS-VC build seems to be somehow broken, let's try it with
Cygwin's gcc" 

I said
./configure.bat --with-gcc --no-cygwin --cflags -I/win/g/Programme/gnuwin32/include/
which worked

but saying make (or make bootstrap) results in

[Please ignore a syntax error on the next line - it is intentional]
Syntax error: Unterminated quoted string
Using /bin/sh.exe as shell.
gcc -o oo-spd/i386/addpm.exe \
           -g -mno-cygwin  oo-spd/i386/addpm.o   -ladvapi32 -luser32
/usr/lib/gcc-lib/i686-pc-mingw32/3.2/../../../../i686-pc-mingw32/bin/ld: cannot open crt2.o: No such file or directory
make: *** [oo-spd/i386/addpm.exe] Error 1

Reducing the configure options to --with-gcc doesn't help, I get the
same error.

My environment: Full install of up-to-date Cygwin, Cygwin bin dirs in
global $PATH,Latest Emacs CVS head, MS Visual C++ (all patches), Cygwin
make 3.79.1, Cygwin gcc 3.2, Windows XP SP1.

However after so much trouble, there's also joy: Damned, Emacs is FAST!
I'm using XEmacs 21.5 at the moment and even if I disable all debugging
when building XEmacs it is unbelievable much slower. I'm not talking
about Emacs being 10 or 20% faster, when I run Gnus in both and stop the
time for e.g. entering a large group I'm talking about Emacs being 3-4
times (sic!) faster. This is incredible, and it's a major pain for me
now to return to this sluggish XEmacs, so I would be really grateful, if
you could help me to get Emacs 21.3 up and running. (I need (want) the
external image library support of 21.3, because I want to display XFaces
and Faces headers and use preview-latex).

MFG Frank

-- 
One Ring to rule them all, One Ring to find them,
One Ring to bring them all and in the darkness bind them
In the Land of Mordor where the Shadows lie.

Re: Latest 21.3 CVS and MS Windows

[Juanma Barranquero]

On Thu, 06 Feb 2003 09:25:59 +0100, Frank Schmitt <ich@Frank-Schmitt.net> wrote:

> First I tried to build using MS Visual C++ 6.0. I said "configure.bat
> --with-ms-vc"

 --with-msvc, I suppose.

> and then said nmake but got an error message telling that
> essential Lisp files would be missing and that I should either create
> abbrev.elc somehow or run nmake bootstrap.
> 
> I then said "nmake bootstrap", this took ages but worked.

That's the right procedure. First time you *must* do a bootstrap.

> I then said
> "nmake install" however something seems to be broken about creation of
> Info files because when i fire up info, I get the usual top node, but no
> matter on which menu item I go, I get the error message "Info file foo
> does not exist.".

Is not broken, it's simply not supported, because most Windows users
don't have the tools to build info files. You can get a working makeinfo
from http://www.simtel.net/pub/djgpp/v2gnu/ (get txi42b.zip) and
manually build the info files (that's what I do). If you get make errors
try taking Cygwin bin directory from the PATH.

(Lack of support for building info files hasn't been a problem till now
because prebuilt binaries come with prebuilt info files too.)

> Configure found all external libraries except the gif
> libraries and nmake gave me an Emacs which was able of displaying
> XPM's. However (image-type-available-p 'tif) (or 'tiff) evaluates to
> nil

There are some interactions between the libraries (libtiff.dll needs
libjpeg.dll, etc.), and not all releases work well togheter. I'm using:

 libjpeg-6b (includes librle.dll)
 libpng-1.2.4-1
 libungif-4.1.0b1
 tiff-3.5.7
 xpm-3.4k-1
 zlib-1.1.4

(from GnuWin32) which seem to be nice with each other.

> trying to display a jpeg results in an empty square of the size of a character

When that happened to me, it was the result of a mismatch between the
libraries (a libjpeg.dll that couldn't find the corresponding librle.dll).

> and trying to display a png makes Emacs crash, no matter if I use
> libpng-1.2.4 or libpng-1.0.13.

That's probably a bug. Were you compiling Emacs with optimizations?
Currently, images work well for me with MSVC 6.0 and --no-opt, but I get
crashes with TIFF and PNG files when optimization is enabled.

Don't forget that image support on Windows is still experimental. Any
information you can gather about the crashes could be useful.


                                                           /L/e/k/t/u

Re: Latest 21.3 CVS and MS Windows

[lawrence mitchell]

Frank Schmitt wrote:

[...]

 trying to display a png makes Emacs crash, no matter if I use
> libpng-1.2.4 or libpng-1.0.13.


I had the same problem for a while, and tracked it down to
conflicting dll files.  Some other windows programs[1] also install
(a different) libpng for their own use.  To get it to work, I
moved the gnuwin32 directory to the front of $PATH, so that
those dlls were picked up first.

[...]


[1]  Ones on my system include fpTeX and GraphViz.

-- 
lawrence mitchell <wence@gmx.li>

Re: Latest 21.3 CVS and MS Windows

[Juanma Barranquero]

On Thu, 06 Feb 2003 11:01:49 +0100, Juanma Barranquero <lektu@terra.es> wrote:

> > and trying to display a png makes Emacs crash, no matter if I use
> > libpng-1.2.4 or libpng-1.0.13.
> 
> That's probably a bug.

On second thought, I'd say that crashing emacs *is* a bug for certain :)


                                                           /L/e/k/t/u

Re: Latest 21.3 CVS and MS Windows

[Frank Schmitt]

Juanma Barranquero <lektu@terra.es> writes:

> On Thu, 06 Feb 2003 09:25:59 +0100, Frank Schmitt <ich@Frank-Schmitt.net> wrote:
>
>> First I tried to build using MS Visual C++ 6.0. I said "configure.bat
>> --with-ms-vc"
>
>  --with-msvc, I suppose.

Yes, of course.

>> and then said nmake but got an error message telling that
>> essential Lisp files would be missing and that I should either create
>> abbrev.elc somehow or run nmake bootstrap.
>> 
>> I then said "nmake bootstrap", this took ages but worked.
>
> That's the right procedure. First time you *must* do a bootstrap.

Shouldn't this be mentioned in section Building of nt/INSTALL?

>> I then said
>> "nmake install" however something seems to be broken about creation of
>> Info files because when i fire up info, I get the usual top node, but no
>> matter on which menu item I go, I get the error message "Info file foo
>> does not exist.".
>
> Is not broken, it's simply not supported, because most Windows users
> don't have the tools to build info files. You can get a working makeinfo
> from http://www.simtel.net/pub/djgpp/v2gnu/ (get txi42b.zip) and
> manually build the info files (that's what I do). If you get make errors
> try taking Cygwin bin directory from the PATH.

OK, I'll do so. However, wouldn't it be nice if configure.bat checked if
Makeinfo is available and if it is change the Makefile accordingly?

> There are some interactions between the libraries (libtiff.dll needs
> libjpeg.dll, etc.), and not all releases work well togheter. I'm using:
>
>  libjpeg-6b (includes librle.dll)
>  libpng-1.2.4-1
>  libungif-4.1.0b1
>  tiff-3.5.7
>  xpm-3.4k-1
>  zlib-1.1.4
>
> (from GnuWin32) which seem to be nice with each other.

I had libjpeg-6b-1 and missed librle.dll (it's not included there). With
the above configuration everything is fine, except that
libungif-4.1.0b1-lib.zip doesn't include gif_lib.h, after I copied it
from the src package to gnuwin32/include all libraries were found and
Emacs build OK.

>> trying to display a jpeg results in an empty square of the size of a character
>
> When that happened to me, it was the result of a mismatch between the
> libraries (a libjpeg.dll that couldn't find the corresponding librle.dll).

Works now, I had missed librle.dll.

>> and trying to display a png makes Emacs crash, no matter if I use
>> libpng-1.2.4 or libpng-1.0.13.
>
> That's probably a bug. Were you compiling Emacs with optimizations?
> Currently, images work well for me with MSVC 6.0 and --no-opt, but I get
> crashes with TIFF and PNG files when optimization is enabled.

Yes, I had optimization enabled which resulted in a crash whenever I
tried to display a png or tiff file. If I build without optimization, the
crashes are gone.

> Don't forget that image support on Windows is still experimental. Any
> information you can gather about the crashes could be useful.

I'll build one more Emacs in a different directory with optimization and
try to debug where the crash occurs.

Thanks for now for your help, I now seem to have everything running. Now
I /only/ have to transfer my configuration from XEmacs to Emacs :-).

-- 
One Ring to rule them all, One Ring to find them,
One Ring to bring them all and in the darkness bind them
In the Land of Mordor where the Shadows lie.

Re: Latest 21.3 CVS and MS Windows

[Reiner Steib]

On Thu, Feb 06 2003, Frank Schmitt wrote:

> Juanma Barranquero <lektu@terra.es> writes:
>> That's the right procedure. First time you *must* do a bootstrap.
>
> Shouldn't this be mentioned in section Building of nt/INSTALL?

It's described in INSTALL-CVS.  It's not related to Windows.

Bye, Reiner.
-- 
       ,,,
      (o o)
---ooO-(_)-Ooo--- PGP key available via WWW   http://rsteib.home.pages.de/

Re: Latest 21.3 CVS and MS Windows

[Eli Zaretskii]

> From: lawrence mitchell <wence@gmx.li>
> Date: Thu, 06 Feb 2003 10:37:59 +0000
> 
>  trying to display a png makes Emacs crash, no matter if I use
> > libpng-1.2.4 or libpng-1.0.13.
> 
> I had the same problem for a while, and tracked it down to
> conflicting dll files.  Some other windows programs[1] also install
> (a different) libpng for their own use.

Perhaps this should be mentioned in PROBLEMS.

Re: Latest 21.3 CVS and MS Windows

[Luc Teirlinck]

Reiner Steib wrote:

   It's described in INSTALL-CVS.  It's not related to Windows.

Yes, but would it not be good to add a small line to each of the
operating system dependent INSTALL files referring to INSTALL-CVS.

It is not the first time I have seen somebody confused by this and I
guess that, unless such short references get added, it will not be the
last.

Sincerely,

Luc.

Re: Latest 21.3 CVS and MS Windows

[Eli Zaretskii]

> From: Frank Schmitt <ich@Frank-Schmitt.net>
> Date: Thu, 06 Feb 2003 19:18:50 +0100
> 
> wouldn't it be nice if configure.bat checked if Makeinfo is
> available and if it is change the Makefile accordingly?

IIRC, this is not easy to do with stock Windows shells.  They don't
have built-in commands and features to find out whether a program
exists.

But if this is possible, I agree it would be nice.

Re: Latest 21.3 CVS and MS Windows

[Jason Rumney]

Frank Schmitt <ich@Frank-Schmitt.net> writes:

> I then said "nmake bootstrap", this took ages but worked. I then said
> "nmake install" however something seems to be broken about creation of
> Info files

That is a known bug with the W32 build scripts.

> I said
> ./configure.bat --with-gcc --no-cygwin --cflags -I/win/g/Programme/gnuwin32/include/
> which worked
> 
> but saying make (or make bootstrap) results in
> 
> [Please ignore a syntax error on the next line - it is intentional]
> Syntax error: Unterminated quoted string
> Using /bin/sh.exe as shell.
> gcc -o oo-spd/i386/addpm.exe \
>            -g -mno-cygwin  oo-spd/i386/addpm.o   -ladvapi32 -luser32
> /usr/lib/gcc-lib/i686-pc-mingw32/3.2/../../../../i686-pc-mingw32/bin/ld: cannot open crt2.o: No such file or directory


Your version of make seems to be generating cygwin paths, which is
known to cause problems.  Try the mingw32 port of GNU make instead of
the Cygwin port.  Since gcc is (I assume) a Cygwin program, it is
probably not the cause of this specific failure, but it will cause
problems later in the build process once you get beyond this.
I think the problem here may be that you do not have the mingw32
runtime libraries installed, which are necessary for --no-cygwin builds.

Re: Latest 21.3 CVS and MS Windows

[Jason Rumney]

Frank Schmitt <ich@Frank-Schmitt.net> writes:

> Shouldn't this be mentioned in section Building of nt/INSTALL?

nt/INSTALL is intended for the released version of Emacs, where this
step is unnecessary.  CVS users are expected to either read
INSTALL-CVS or cope with it when they get that error the first time
they build from CVS. Subsequent builds will not require a make
bootstrap (but you'll need to "make recompile" in the lisp subdir to
generate any new .elc files).


> > Is not broken, it's simply not supported, because most Windows users
> > don't have the tools to build info files. You can get a working makeinfo
> > from http://www.simtel.net/pub/djgpp/v2gnu/ (get txi42b.zip) and
> > manually build the info files (that's what I do). If you get make errors
> > try taking Cygwin bin directory from the PATH.
> 
> OK, I'll do so. However, wouldn't it be nice if configure.bat checked if
> Makeinfo is available and if it is change the Makefile accordingly?

The intent is to assume that it is available and try to build the
info files.  It is only an issue for CVS users, so it is not too much
to expect them to be able to install it.  Configure tests are
difficult to get right on Windows, because of the variety of shells
that need to be catered for.

> Yes, I had optimization enabled which resulted in a crash whenever I
> tried to display a png or tiff file. If I build without optimization, the
> crashes are gone.

Can one of you try to investigate, perhaps by disabling optimization
options one by one (I think we use -O2, but it is possible to have
finer control).  Once we narrow down the type of optimization that is
causing this, it may become apparent what sort of problem to look for.
The MS compiler I have does not do optimization, so I cannot debug this
directly myself.

Re: Latest 21.3 CVS and MS Windows

[Jason Rumney]

lawrence mitchell <wence@gmx.li> writes:

> Frank Schmitt wrote:
> 
> [...]
> 
>  trying to display a png makes Emacs crash, no matter if I use
> > libpng-1.2.4 or libpng-1.0.13.
> 
> 
> I had the same problem for a while, and tracked it down to
> conflicting dll files.

If Emacs tries to use the DLL, then the API is the same as what Emacs
expects, so there is still a bug there that needs fixing, even if the
library being used is not the one you expected.

Re: Latest 21.3 CVS and MS Windows

[Jason Rumney]

"Eli Zaretskii" <eliz@is.elta.co.il> writes:

> > I had the same problem for a while, and tracked it down to
> > conflicting dll files.  Some other windows programs[1] also install
> > (a different) libpng for their own use.
> 
> Perhaps this should be mentioned in PROBLEMS.

Perhaps, but first we need to figure out what the problems are. The
code has only been in CVS about 10 days, and it may be possible to fix
it once we find out what is happening.

Re: Latest 21.3 CVS and MS Windows

[Frank Schmitt]

"Eli Zaretskii" <eliz@is.elta.co.il> writes:

> IIRC, this is not easy to do with stock Windows shells.  They don't
> have built-in commands and features to find out whether a program
> exists.

Well, you could say something like

makeinfo small-example.texi
IF EXIST small-example.info (
  del small-example.info
  set HAVE_MAKEINFO=1
) ELSE (
  echo Couldn't find Makeinfo, skipping creation of info files
)

According to "help if" in Windows XP's cmd.exe this should work. However
I don't know about the Win9x command.com.

-- 
One Ring to rule them all, One Ring to find them,
One Ring to bring them all and in the darkness bind them
In the Land of Mordor where the Shadows lie.

Re: Latest 21.3 CVS and MS Windows

[Jason Rumney]

Frank Schmitt <ich@Frank-Schmitt.net> writes:

> makeinfo small-example.texi
> IF EXIST small-example.info (
>   del small-example.info
>   set HAVE_MAKEINFO=1
> ) ELSE (
>   echo Couldn't find Makeinfo, skipping creation of info files
> )
> 
> According to "help if" in Windows XP's cmd.exe this should work. However
> I don't know about the Win9x command.com.

Multiline if's do not work in command.com.  We also need to cater for
bash (although that is done elsewhere in the code by using separate
make rules).

Re: Latest 21.3 CVS and MS Windows

[Frank Schmitt]

Jason Rumney <jasonr@gnu.org> writes:

> Frank Schmitt <ich@Frank-Schmitt.net> writes:
>
>> makeinfo small-example.texi
>> IF EXIST small-example.info (
>>   del small-example.info
>>   set HAVE_MAKEINFO=1
>> ) ELSE (
>>   echo Couldn't find Makeinfo, skipping creation of info files
>> )
>> 
>> According to "help if" in Windows XP's cmd.exe this should work. However
>> I don't know about the Win9x command.com.
>
> Multiline if's do not work in command.com.

Multiline if's can be simulated by GOTOs:

:testMakeinfo
makeinfo small-example.texi
IF NOT EXIST small-example.info GOTO noMakeinfo
del small-example.info
set HAVE_MAKEINFO=1
GOTO testMakeInfoEnd

:noMakeinfo
echo Couldn't find Makeinfo, skipping creation of info files

:testMakeinfoEnd

> We also need to cater for bash (although that is done elsewhere in the
> code by using separate make rules).

Sorry, what do you mean?

-- 
One Ring to rule them all, One Ring to find them,
One Ring to bring them all and in the darkness bind them
In the Land of Mordor where the Shadows lie.

Re: Latest 21.3 CVS and MS Windows

[Jason Rumney]

Frank Schmitt <ich@Frank-Schmitt.net> writes:

> > Multiline if's do not work in command.com.
> 
> Multiline if's can be simulated by GOTOs:

I'm not sure goto can be used in makefiles.

> > We also need to cater for bash (although that is done elsewhere in the
> > code by using separate make rules).
> 
> Sorry, what do you mean?

I mean that the Windows configure scripts and makefiles need to work
with bash as well as cmd.exe and command.com.

Re: Latest 21.3 CVS and MS Windows

[Juanma Barranquero]

On 06 Feb 2003 20:02:56 +0000, Jason Rumney <jasonr@gnu.org> wrote:

> Can one of you try to investigate, perhaps by disabling optimization
> options one by one (I think we use -O2, but it is possible to have
> finer control).  Once we narrow down the type of optimization that is
> causing this, it may become apparent what sort of problem to look for.

I'm giving some time to debugging that. I'll let you know my findings 
(if any :)


                                                           /L/e/k/t/u

Re: Latest 21.3 CVS and MS Windows

[Juanma Barranquero]

On Thu, 06 Feb 2003 19:18:50 +0100, Frank Schmitt <ich@Frank-Schmitt.net> wrote:

> Shouldn't this be mentioned in section Building of nt/INSTALL?

As it's already been said, people building from the CVS instead of using
release tarballs should read INSTALL-CVS :)

> I had libjpeg-6b-1 and missed librle.dll (it's not included there).

Yes, I know. Also, the libjpeg from 6b-1 isn't in friendly terms with
libtiff.

> except that libungif-4.1.0b1-lib.zip doesn't include gif_lib.h

I agree, it's a bit absurd not to have a bundle of the .DLLs, the libs 
(.lib's and .a's) and the includes... So in order to use the libraries
you must download at least three of the packages :)

> Yes, I had optimization enabled which resulted in a crash whenever I
> tried to display a png or tiff file. If I build without optimization, the
> crashes are gone.

Glad to hear the bug is repeatable on other people's machines :)

> I'll build one more Emacs in a different directory with optimization and
> try to debug where the crash occurs.

Ok.


                                                           /L/e/k/t/u

Re: Latest 21.3 CVS and MS Windows

[Frank Schmitt]

Jason Rumney <jasonr@gnu.org> writes:

> Frank Schmitt <ich@Frank-Schmitt.net> writes:
>
>> > Multiline if's do not work in command.com.
>> 
>> Multiline if's can be simulated by GOTOs:
>
> I'm not sure goto can be used in makefiles.

But we are talking about configure.bat, not the Makefile, aren't we? In
configure.bat we can easily check if Makeinfo is available (see
previous posting), if it is we activate Info creation in the Makefile,
just like we check for the image libraries in configure.bat and
activate them if found in the Makefile.

-- 
One Ring to rule them all, One Ring to find them,
One Ring to bring them all and in the darkness bind them
In the Land of Mordor where the Shadows lie.

Re: Latest 21.3 CVS and MS Windows

[Eli Zaretskii]

> From: Jason Rumney <jasonr@gnu.org>
> Date: 06 Feb 2003 20:02:56 +0000
> 
> > Shouldn't this be mentioned in section Building of nt/INSTALL?
> 
> nt/INSTALL is intended for the released version of Emacs, where this
> step is unnecessary.  CVS users are expected to either read
> INSTALL-CVS or cope with it when they get that error the first time
> they build from CVS.

Maybe nt/INSTALL should tell that if the CVS version is being built,
users should refer to INSTALL-CVS instead.

Re: Latest 21.3 CVS and MS Windows

[Jason Rumney]

Frank Schmitt <ich@Frank-Schmitt.net> writes:

> But we are talking about configure.bat, not the Makefile, aren't we?

Judging by the syntax and commands used in the examples, it was the
Makefile.  It would probably be easier to do it from the
configure.bat script, but disabling makeinfo completely is not the
same as anything else we do from the script, so it is not a simple
case of copying some existing code.  Previously when this was
discussed, the conclusion was this:

  In the actual Emacs release, we should include all the Info files
  pre-made.  People who want to build from CVS will have to learn
  to install Makeinfo.

    I'd say the opposite: assume that if the Texinfo files are newer than
    the Info files, makeinfo is _always_ present.  All you risk is an
    error message.

  I agree.  When people install the standard release, the Info files
  will always be newer than the Texinfo files.

  This is not just a good idea, it is also how all past releases have
  been handled.