bug#64167: 29.0.92; Ahead-of-time native compilation failed Emacs 29.0.92

bug#64167: 29.0.92; Ahead-of-time native compilation failed Emacs 29.0.92

[Eason Huang]

Hi Emacs dev Team,

Thanks for making Emacs 29.

I try to build Emacs 29.0.92 on Windows 11, the `aot` option have no
affect. After I start Emacs, still need to compile the built-in
packages, such org,cc-mode and so on.


The source code used to build:
https://alpha.gnu.org/gnu/emacs/pretest/emacs-29.0.92.tar.xz

You can find the detailed build command and build logs from the link below:
https://gist.github.com/Eason0210/6710700a77d632e7fffba44c584a7692



In GNU Emacs 29.0.92 (build 2, x86_64-w64-mingw32) of 2023-06-19 built
 on AREA-51
Windowing system distributor 'Microsoft Corp.', version 10.0.22000
System Description: Microsoft Windows 10 Pro (v10.0.2009.22000.2057)

Configured using:
 'configure --prefix=/c/opt/emacs --with-native-compilation=aot
 --without-dbus'

Configured features:
ACL GIF GMP GNUTLS HARFBUZZ JPEG JSON LCMS2 LIBXML2 MODULES NATIVE_COMP
NOTIFY W32NOTIFY PDUMPER PNG RSVG SOUND SQLITE3 THREADS TIFF
TOOLKIT_SCROLL_BARS TREE_SITTER WEBP XPM ZLIB

Important settings:
  value of $LANG: zh_CN.UTF-8
  locale-coding-system: cp936

Major mode: Lisp Interaction

Minor modes in effect:
  tooltip-mode: t
  global-eldoc-mode: t
  eldoc-mode: t
  show-paren-mode: t
  electric-indent-mode: t
  mouse-wheel-mode: t
  tool-bar-mode: t
  menu-bar-mode: t
  file-name-shadow-mode: t
  global-font-lock-mode: t
  font-lock-mode: t
  blink-cursor-mode: t
  line-number-mode: t
  indent-tabs-mode: t
  transient-mark-mode: t
  auto-composition-mode: t
  auto-encryption-mode: t
  auto-compression-mode: t

Load-path shadows:
None found.

Features:
(shadow sort mail-extr emacsbug message mailcap yank-media puny dired
dired-loaddefs rfc822 mml mml-sec password-cache epa derived epg rfc6068
epg-config gnus-util text-property-search time-date mm-decode mm-bodies
mm-encode mail-parse rfc2231 mailabbrev gmm-utils mailheader cl-loaddefs
comp comp-cstr warnings icons subr-x rx cl-seq cl-macs gv cl-extra
help-mode bytecomp byte-compile cl-lib sendmail rfc2047 rfc2045
ietf-drums mm-util mail-prsvr mail-utils china-util rmc iso-transl
tooltip cconv eldoc paren electric uniquify ediff-hook vc-hooks
lisp-float-type elisp-mode mwheel dos-w32 ls-lisp disp-table
term/w32-win w32-win w32-vars term/common-win tool-bar dnd fontset image
regexp-opt fringe tabulated-list replace newcomment text-mode lisp-mode
prog-mode register page tab-bar menu-bar rfn-eshadow isearch easymenu
timer select scroll-bar mouse jit-lock font-lock syntax font-core
term/tty-colors frame minibuffer nadvice seq simple cl-generic
indonesian philippine cham georgian utf-8-lang misc-lang vietnamese
tibetan thai tai-viet lao korean japanese eucjp-ms cp51932 hebrew greek
romanian slovak czech european ethiopic indian cyrillic chinese
composite emoji-zwj charscript charprop case-table epa-hook
jka-cmpr-hook help abbrev obarray oclosure cl-preloaded button loaddefs
theme-loaddefs faces cus-face macroexp files window text-properties
overlay sha1 md5 base64 format env code-pages mule custom widget keymap
hashtable-print-readable backquote threads w32notify w32 lcms2 multi-tty
make-network-process native-compile emacs)

Memory information:
((conses 16 78660 6903)
 (symbols 48 7183 0)
 (strings 32 20726 1997)
 (string-bytes 1 601305)
 (vectors 16 15695)
 (vector-slots 8 379860 13498)
 (floats 8 41 46)
 (intervals 56 251 0)
 (buffers 984 12))

--
Eason Huang

bug#64167: 29.0.92; Ahead-of-time native compilation failed Emacs 29.0.92

[Corwin Brust]

On Mon, Jun 19, 2023 at 8:24 AM Eason Huang <aqua0210@foxmail.com> wrote:
>
> I try to build Emacs 29.0.92 on Windows 11, the `aot` option have no
> affect. After I start Emacs, still need to compile the built-in
> packages, such org,cc-mode and so on.

I can reproduce this.   Additionally, expressly passing
--WITH_FULL_AOT=1 to make also has no effect.

Both appear to work fine for non-release builds (i.e., "snapshot"
builds made in-tree, vs building from a release tarball as we are
doing in this case).

Thanks for reporting.

bug#64167: 29.0.92; Ahead-of-time native compilation failed Emacs 29.0.92

[Eli Zaretskii]

> Cc: 64167@debbugs.gnu.org
> From: Corwin Brust <corwin@bru.st>
> Date: Mon, 19 Jun 2023 09:33:03 -0500
> 
> On Mon, Jun 19, 2023 at 8:24 AM Eason Huang <aqua0210@foxmail.com> wrote:
> >
> > I try to build Emacs 29.0.92 on Windows 11, the `aot` option have no
> > affect. After I start Emacs, still need to compile the built-in
> > packages, such org,cc-mode and so on.
> 
> I can reproduce this.   Additionally, expressly passing
> --WITH_FULL_AOT=1 to make also has no effect.
> 
> Both appear to work fine for non-release builds (i.e., "snapshot"
> builds made in-tree, vs building from a release tarball as we are
> doing in this case).

The difference is that in the release tarball you have all the *.elc
files up-to-date, so the native-compilation rule doesn't kick in.
Remove all the *.elc file, and I'm guessing that the aot build will
work.

I will need to think how to fix this for a release tarball build.

bug#64167: 29.0.92; Ahead-of-time native compilation failed Emacs 29.0.92

[Eason Huang]

Eli Zaretskii <eliz@gnu.org> writes:

>> Cc: 64167@debbugs.gnu.org
>> From: Corwin Brust <corwin@bru.st>
>> Date: Mon, 19 Jun 2023 09:33:03 -0500
>>
>> On Mon, Jun 19, 2023 at 8:24 AM Eason Huang <aqua0210@foxmail.com> wrote:
>> >
>> > I try to build Emacs 29.0.92 on Windows 11, the `aot` option have no
>> > affect. After I start Emacs, still need to compile the built-in
>> > packages, such org,cc-mode and so on.
>>
>> I can reproduce this.   Additionally, expressly passing
>> --WITH_FULL_AOT=1 to make also has no effect.
>>
>> Both appear to work fine for non-release builds (i.e., "snapshot"
>> builds made in-tree, vs building from a release tarball as we are
>> doing in this case).
>
> The difference is that in the release tarball you have all the *.elc
> files up-to-date, so the native-compilation rule doesn't kick in.
> Remove all the *.elc file, and I'm guessing that the aot build will
> work.
Yes, you are right. I tried to download source code from
https://git.savannah.gnu.org/cgit/emacs.git/snapshot/emacs-2bad5829ff76538774676f7274f40ce7baf04c73.tar.gz

And it can be build --with-native-compilation=aot

But it will failed with some errors on Windows 10 and Windows 11:
```
  ELC+ELN  erc/erc-menu.elc
  ELC+ELN  erc/erc-netsplit.elc
  ELC+ELN  erc/erc-networks.elc

Backtrace:
00007ff6a78ca72e
00007ff6a7798b21
00007ff6a77b9611
00007ff6a792ee8a
00007ffa37c47ff0
00007ffa38712477
00007ffa386c14ec
```
you can see the details on line 2521 in the build log with the link below:

https://gist.github.com/Eason0210/f97220ec5fac3565036975e97ba16098

If you need more infomation, please let me known.


-- 
Eason Huang

bug#64167: 29.0.92; Ahead-of-time native compilation failed Emacs 29.0.92

[Eli Zaretskii]

> From: Eason Huang <aqua0210@foxmail.com>
> Cc: Corwin Brust <corwin@bru.st>,  64167@debbugs.gnu.org
> Date: Wed, 21 Jun 2023 14:05:13 +0800
> 
> Yes, you are right. I tried to download source code from
> https://git.savannah.gnu.org/cgit/emacs.git/snapshot/emacs-2bad5829ff76538774676f7274f40ce7baf04c73.tar.gz
> 
> And it can be build --with-native-compilation=aot
> 
> But it will failed with some errors on Windows 10 and Windows 11:
> ```
>   ELC+ELN  erc/erc-menu.elc
>   ELC+ELN  erc/erc-netsplit.elc
>   ELC+ELN  erc/erc-networks.elc
> 
> Backtrace:
> 00007ff6a78ca72e
> 00007ff6a7798b21
> 00007ff6a77b9611
> 00007ff6a792ee8a
> 00007ffa37c47ff0
> 00007ffa38712477
> 00007ffa386c14ec
> ```

And the build without aot succeeds and can successfully natively
compile those same files (erc-networks.el) without problems?

If the build without aot also fails, then this is a separate problem
and should be discussed in a separate bug report.  It might be the
same problem reported and discussed in bug#63365 (are you also using
GCC 13.1?).

bug#64167: 29.0.92; Ahead-of-time native compilation failed Emacs 29.0.92

[Corwin Brust]

On Wed, Jun 21, 2023 at 6:06 AM Eli Zaretskii <eliz@gnu.org> wrote:
>
> > https://git.savannah.gnu.org/cgit/emacs.git/snapshot/emacs-2bad5829ff76538774676f7274f40ce7baf04c73.tar.gz
> >
> > But it will failed with some errors on Windows 10 and Windows 11:
> > ```

> If the build without aot also fails, then this is a separate problem
> and should be discussed in a separate bug report.  It might be the
> same problem reported and discussed in bug#63365 (are you also using
> GCC 13.1?).
>

I cannot reproduce   Both AOT and non-AOT builds appear fine (AOT only
once I remove eln files from the tree, of course).  I have: Win10 +
gcc version 11.3.0 (Rev1, Built by MSYS2 project)

bug#64167: 29.0.92; Ahead-of-time native compilation failed Emacs 29.0.92

[Eason Huang]

Eli Zaretskii <eliz@gnu.org> writes:

> If the build without aot also fails, then this is a separate problem
> and should be discussed in a separate bug report.  It might be the
> same problem reported and discussed in bug#63365 (are you also using
> GCC 13.1?).
Yes, build without aot also fails, and I'am also using GCC 13.1.
So the issue is same as bug#63365

-- 
Eason Huang

bug#64167: 29.0.92; Ahead-of-time native compilation failed Emacs 29.0.92

[Eli Zaretskii]

> From: Eason Huang <aqua0210@foxmail.com>
> Cc: Corwin Brust <corwin@bru.st>,  64167@debbugs.gnu.org
> Date: Wed, 21 Jun 2023 14:05:13 +0800
> 
> Eli Zaretskii <eliz@gnu.org> writes:
> 
> > The difference is that in the release tarball you have all the *.elc
> > files up-to-date, so the native-compilation rule doesn't kick in.
> > Remove all the *.elc file, and I'm guessing that the aot build will
> > work.
> Yes, you are right. I tried to download source code from
> https://git.savannah.gnu.org/cgit/emacs.git/snapshot/emacs-2bad5829ff76538774676f7274f40ce7baf04c73.tar.gz
> 
> And it can be build --with-native-compilation=aot

OK, I think I fixed this now on the emacs-29 branch.  I tested the fix
with several configurations, but not all of them.  In particular, I
didn't test out-of-tree builds, so if someone could test that, I'd
appreciate.

bug#64167: 29.0.92; Ahead-of-time native compilation failed Emacs 29.0.92

[Eli Zaretskii]

> Cc: corwin@bru.st, 64167@debbugs.gnu.org
> Date: Thu, 22 Jun 2023 14:48:47 +0300
> From: Eli Zaretskii <eliz@gnu.org>
> 
> > From: Eason Huang <aqua0210@foxmail.com>
> > Cc: Corwin Brust <corwin@bru.st>,  64167@debbugs.gnu.org
> > Date: Wed, 21 Jun 2023 14:05:13 +0800
> > 
> > Eli Zaretskii <eliz@gnu.org> writes:
> > 
> > > The difference is that in the release tarball you have all the *.elc
> > > files up-to-date, so the native-compilation rule doesn't kick in.
> > > Remove all the *.elc file, and I'm guessing that the aot build will
> > > work.
> > Yes, you are right. I tried to download source code from
> > https://git.savannah.gnu.org/cgit/emacs.git/snapshot/emacs-2bad5829ff76538774676f7274f40ce7baf04c73.tar.gz
> > 
> > And it can be build --with-native-compilation=aot
> 
> OK, I think I fixed this now on the emacs-29 branch.  I tested the fix
> with several configurations, but not all of them.  In particular, I
> didn't test out-of-tree builds, so if someone could test that, I'd
> appreciate.

No further comments, so I presume the bug was indeed fixed, and I'm
closing it.  Feel free to reopen if something still doesn't work.