bug#46790: 28.0.50; make install with native-comp branch

bug#46790: 28.0.50; make install with native-comp branch

[Thierry Volpiatto]

Hello,

giving a try to native-comp branch.

I install Emacs generaly with:

make install bindir=/usr/local/sbin/emacs-28.0.50 infodir=/usr/local/share/info-28.0.50

This always worked fine.  However with native-comp branch, I have to
manually add a symlink of "/usr/local/lib/emacs/28.0.50/native-lisp/" to
"/usr/local/sbin" otherwise I endup with an error:

thierry@IPadS340:/usr/local/sbin/emacs-28.0.50$ ls
ctags  ebrowse  emacs  emacs-28.0.50  emacsclient  etags
thierry@IPadS340:/usr/local/sbin/emacs-28.0.50$ ./emacs-28.0.50
emacs: /usr/local/sbin/emacs-28.0.50/../native-lisp/28.0.50-40158ec0/window-0d1b8b93-738411b0.eln: cannot open shared object file: No such file or directory
thierry@IPadS340:/usr/local/sbin/emacs-28.0.50$ ./emacs
emacs: /usr/local/sbin/emacs-28.0.50/../native-lisp/28.0.50-40158ec0/window-0d1b8b93-738411b0.eln: cannot open shared object file: No such file or directory

Thanks.


In GNU Emacs 28.0.50 (build 1, x86_64-pc-linux-gnu, GTK+ Version 3.22.30, cairo version 1.15.10)
 of 2021-02-24 built on IPadS340
Repository revision: 0ee1a16769bfc8d3e6205e8d8dabc3be34df48b4
Repository branch: feature/native-comp
Windowing system distributor 'The X.Org Foundation', version 11.0.12008000
System Description: Linux Mint 19.3

Configured using:
 'configure 'CFLAGS=-O3 -march=native' --with-nativecomp=yes
 --with-json=yes --with-mailutils --without-gconf --without-gsettings
 --without-dbus'

Configured features:
ACL CAIRO FREETYPE GIF GLIB GMP GNUTLS GPM HARFBUZZ JPEG JSON LCMS2
LIBOTF LIBSELINUX LIBSYSTEMD LIBXML2 M17N_FLT MODULES NATIVE_COMP NOTIFY
INOTIFY PDUMPER PNG RSVG SOUND THREADS TIFF TOOLKIT_SCROLL_BARS X11 XDBE
XIM XPM GTK3 ZLIB

Important settings:
  value of $LANG: fr_FR.UTF-8
  locale-coding-system: utf-8-unix

Major mode: Ilisp

Minor modes in effect:
  global-git-commit-mode: t
  magit-auto-revert-mode: t
  global-undo-tree-mode: t
  undo-tree-mode: t
  global-ligature-mode: t
  ligature-mode: t
  psession-mode: t
  psession-savehist-mode: t
  global-git-gutter-mode: t
  eldoc-in-minibuffer-mode: t
  display-time-mode: t
  winner-mode: t
  show-paren-mode: t
  helm-epa-mode: t
  helm-descbinds-mode: t
  override-global-mode: t
  helm-adaptive-mode: t
  helm-mode: t
  shell-dirtrack-mode: t
  helm-popup-tip-mode: t
  async-bytecomp-package-mode: t
  dired-async-mode: t
  minibuffer-depth-indicate-mode: t
  straight-use-package-mode: t
  straight-package-neutering-mode: t
  tooltip-mode: t
  global-eldoc-mode: t
  eldoc-mode: t
  mouse-wheel-mode: t
  file-name-shadow-mode: t
  global-font-lock-mode: t
  font-lock-mode: t
  auto-composition-mode: t
  auto-encryption-mode: t
  auto-compression-mode: t
  column-number-mode: t
  line-number-mode: t
  transient-mark-mode: t

Load-path shadows:
None found.

Features:
(epa-mail gnutls epa-file network-stream nsm mailalias autocrypt-mu4e
addressbook-bookmark mu4e-config org-mu4e gnus-art mm-uu mml2015 mm-view
mml-smime smime dig gnus-sum gnus-group gnus-undo gnus-start gnus-dbus
dbus gnus-cloud nnimap nnmail mail-source utf7 netrc nnoo gnus-spec
gnus-int gnus-range gnus-win gnus nnheader mu4e-patch mu4e-contrib mu4e
mu4e-org mu4e-main mu4e-view mu4e-headers mu4e-compose mu4e-context
mu4e-draft mu4e-actions ido rfc2368 smtpmail mu4e-mark mu4e-proc
mu4e-utils doc-view image-mode exif mu4e-lists mu4e-message shr kinsoku
svg dom flow-fill hl-line mu4e-vars mu4e-meta emamux helm-x-files
helm-for-files sh-script smie executable shadow sort autocrypt-message
autocrypt mail-extr face-remap magit-bookmark magit-submodule
magit-obsolete magit-blame magit-stash magit-reflog magit-bisect
magit-push magit-pull magit-fetch magit-clone magit-remote magit-commit
magit-sequence magit-notes magit-worktree magit-tag magit-merge
magit-branch magit-reset magit-files magit-refs magit-status magit
magit-repos magit-apply magit-wip magit-log which-func magit-diff
smerge-mode git-commit log-edit add-log magit-core magit-autorevert
autorevert magit-margin magit-transient magit-process with-editor
magit-mode transient magit-git magit-section magit-utils crm image-file
image-converter tramp-cache helm-bookmark bookmark emacsbug message rmc
puny rfc822 mml mml-sec gnus-util rmail rmail-loaddefs mm-decode
mm-bodies mm-encode mail-parse rfc2231 mailabbrev gmm-utils mailheader
sendmail rfc2047 rfc2045 ietf-drums mm-util mail-prsvr mail-utils
helm-command jka-compr vc-filewise vc-rcs conf-mode ledger-config
ledger-mode ledger-check ledger-texi ledger-test ledger-sort
ledger-report ledger-reconcile ledger-occur ledger-fonts ledger-fontify
ledger-state ledger-complete ledger-schedule ledger-init ledger-xact
ledger-post ledger-exec ledger-navigate eshell esh-cmd esh-ext esh-opt
esh-proc esh-io esh-arg esh-module esh-groups esh-util ledger-context
ledger-commodities ledger-regex bug-reference naquadah-theme view solar
cal-dst holidays hol-loaddefs tv-utils sly-autoloads undo-tree diff
undo-tree-autoloads ligature ligature-autoloads boxquote rect
rainbow-mode-autoloads psession frameset wgrep-helm wgrep grep compile
text-property-search wgrep-autoloads log-view pcvs-util pcmpl-git
pcmpl-git-autoloads powerline powerline-separators color
powerline-themes powerline-autoloads toc-org-autoloads cl-indent ffap
markdown-toc-autoloads markdown-mode-autoloads autocrypt-autoloads
config-w3m w3m-autoloads git-gutter git-gutter-autoloads mule-util appt
diary-lib diary-loaddefs anaconda-mode xref project pythonic f dash s
anaconda-mode-autoloads pythonic-autoloads f-autoloads s-autoloads
eldoc-eval emamux-autoloads magit-autoloads git-commit-autoloads
with-editor-autoloads transient-autoloads dash-autoloads
pcomplete-extension pcmpl-unix pcmpl-gnu iterator iedit-autoloads
ledger-mode-autoloads wdired dired-extension org-config ob-gnuplot
org-crypt net-utils time winner w3m-wget wget thingatpt wget-sysdep
autotest-mode autoconf-mode paren woman man ediff ediff-merg ediff-mult
ediff-wind ediff-diff ediff-help ediff-init ediff-util init-helm helm-fd
epa derived epg epg-config helm-epa helm-misc helm-imenu imenu
helm-elisp-package package url-handlers helm-find helm-org org ob
ob-tangle ob-ref ob-lob ob-table ob-exp org-macro org-footnote org-src
ob-comint org-pcomplete org-list org-faces org-entities noutline outline
org-version ob-emacs-lisp ob-core ob-eval org-table ol org-keys
org-compat org-macs org-loaddefs cal-menu calendar cal-loaddefs
helm-external helm-net browse-url xml url url-proxy url-privacy
url-expand url-methods url-history url-cookie url-domsuf url-util
url-parse url-vars mailcap isearch-light helm-descbinds cus-edit pp
wid-edit helm-ls-git vc-git diff-mode vc vc-dispatcher helm-ipython
helm-elisp helm-eval edebug backtrace find-func helm-info python
tramp-sh use-package-bind-key bind-key popup helm-adaptive diminish
helm-mode helm-files filenotify tramp tramp-loaddefs trampver
tramp-integration files-x tramp-compat shell pcomplete comint ansi-color
ring parse-time iso8601 time-date ls-lisp auth-source password-cache
json map helm-buffers helm-occur helm-tags helm-locate helm-grep
helm-regexp format-spec helm-utils helm-help helm-types
use-package-diminish helm-extensions-autoloads helm-config
helm-autoloads helm easy-mmode async-bytecomp helm-global-bindings
helm-easymenu helm-source eieio-compat eieio eieio-core eieio-loaddefs
helm-multi-match helm-lib dired-async advice dired-aux dired
dired-loaddefs async emms-autoloads use-package-core popup-autoloads
finder-inf diminish-autoloads mb-depth server comp comp-cstr warnings rx
cl-seq edmacro kmacro avoid cus-start cus-load use-package-autoloads
bind-key-autoloads straight-autoloads info cl-extra help-mode easymenu
seq byte-opt straight subr-x cl-macs gv bytecomp byte-compile cconv
cl-loaddefs cl-lib iso-transl tooltip eldoc electric uniquify ediff-hook
vc-hooks lisp-float-type mwheel term/x-win x-win term/common-win x-dnd
tool-bar dnd fontset image regexp-opt fringe tabulated-list replace
newcomment text-mode elisp-mode lisp-mode prog-mode register page
tab-bar menu-bar rfn-eshadow isearch timer select scroll-bar mouse
jit-lock font-lock syntax facemenu font-core term/tty-colors frame
minibuffer cl-generic cham georgian utf-8-lang misc-lang vietnamese
tibetan thai tai-viet lao korean japanese eucjp-ms cp51932 hebrew greek
romanian slovak czech european ethiopic indian cyrillic chinese
composite charscript charprop case-table epa-hook jka-cmpr-hook help
simple abbrev obarray cl-preloaded nadvice button loaddefs faces
cus-face pcase macroexp files window text-properties overlay sha1 md5
base64 format env code-pages mule custom widget hashtable-print-readable
backquote threads inotify lcms2 dynamic-setting font-render-setting
cairo move-toolbar gtk x-toolkit x multi-tty make-network-process
nativecomp emacs)

Memory information:
((conses 16 661731 286737)
 (symbols 48 41455 4)
 (strings 32 156019 31841)
 (string-bytes 1 5776862)
 (vectors 16 78802)
 (vector-slots 8 1345750 234886)
 (floats 8 2140 1053)
 (intervals 56 5946 962)
 (buffers 992 107))
<#secure method=pgpmime mode=sign>

-- 
Thierry

bug#46790: 28.0.50; make install with native-comp branch

[Eli Zaretskii]

> From: Thierry Volpiatto <thievol@posteo.net>
> Date: Fri, 26 Feb 2021 08:35:30 +0100
> 
> giving a try to native-comp branch.
> 
> I install Emacs generaly with:
> 
> make install bindir=/usr/local/sbin/emacs-28.0.50 infodir=/usr/local/share/info-28.0.50
> 
> This always worked fine.  However with native-comp branch, I have to
> manually add a symlink of "/usr/local/lib/emacs/28.0.50/native-lisp/" to
> "/usr/local/sbin" otherwise I endup with an error:
> 
> thierry@IPadS340:/usr/local/sbin/emacs-28.0.50$ ls
> ctags  ebrowse  emacs  emacs-28.0.50  emacsclient  etags
> thierry@IPadS340:/usr/local/sbin/emacs-28.0.50$ ./emacs-28.0.50
> emacs: /usr/local/sbin/emacs-28.0.50/../native-lisp/28.0.50-40158ec0/window-0d1b8b93-738411b0.eln: cannot open shared object file: No such file or directory
> thierry@IPadS340:/usr/local/sbin/emacs-28.0.50$ ./emacs
> emacs: /usr/local/sbin/emacs-28.0.50/../native-lisp/28.0.50-40158ec0/window-0d1b8b93-738411b0.eln: cannot open shared object file: No such file or directory

Hmm... I'm not sure we can resolve this in any other way, although we
should try.  What worked for you with previous versions was just a
side effect of the implementation detail: how Emacs finds the files it
needs when it starts.  The *.eln files bring more restrictions to the
table, and it could very well be that the symlink trick will be the
only practical solution to such a non-standard installation.

A possible solution is to set EMACSNATIVELOADPATH in the environment.

Alternatively, you could modify your Emacs to look in the correct
directory by default.

bug#46790: 28.0.50; make install with native-comp branch

[Thierry Volpiatto]

[-- Attachment #1: Type: text/plain, Size: 2249 bytes --]


Eli Zaretskii <eliz@gnu.org> writes:

>> From: Thierry Volpiatto <thievol@posteo.net>
>> Date: Fri, 26 Feb 2021 08:35:30 +0100
>> 
>> giving a try to native-comp branch.
>> 
>> I install Emacs generaly with:
>> 
>> make install bindir=/usr/local/sbin/emacs-28.0.50 infodir=/usr/local/share/info-28.0.50
>> 
>> This always worked fine.  However with native-comp branch, I have to
>> manually add a symlink of "/usr/local/lib/emacs/28.0.50/native-lisp/" to
>> "/usr/local/sbin" otherwise I endup with an error:
>> 
>> thierry@IPadS340:/usr/local/sbin/emacs-28.0.50$ ls
>> ctags  ebrowse  emacs  emacs-28.0.50  emacsclient  etags
>> thierry@IPadS340:/usr/local/sbin/emacs-28.0.50$ ./emacs-28.0.50
>> emacs: /usr/local/sbin/emacs-28.0.50/../native-lisp/28.0.50-40158ec0/window-0d1b8b93-738411b0.eln: cannot open shared object file: No such file or directory
>> thierry@IPadS340:/usr/local/sbin/emacs-28.0.50$ ./emacs
>> emacs: /usr/local/sbin/emacs-28.0.50/../native-lisp/28.0.50-40158ec0/window-0d1b8b93-738411b0.eln: cannot open shared object file: No such file or directory
>
> Hmm... I'm not sure we can resolve this in any other way, although we
> should try.

I am sure you will find some makefile magic for this.

> What worked for you with previous versions was just a side effect of
> the implementation detail: how Emacs finds the files it needs when it
> starts.  The *.eln files bring more restrictions to the table, and it
> could very well be that the symlink trick will be the only practical
> solution to such a non-standard installation.

This not really a non standard installation, it is documented in INSTALL
since always, I use this installation to manage different Emacs
versions (the executables in sbin/emacs-xxx are symlinked in bin).

I am not sure also if everything is working properly with a "standard"
installation, i.e. in /usr/local/bin, is in this case the native-lisp
dir found?

> A possible solution is to set EMACSNATIVELOADPATH in the environment.

Didn't know this env var.

> Alternatively, you could modify your Emacs to look in the correct
> directory by default.

Don't know how to do this, anyway all methods should be documented.

Thanks.

-- 
Thierry

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 686 bytes --]

bug#46790: 28.0.50; make install with native-comp branch

[Andrea Corallo via Bug reports for GNU Emacs, the Swiss army knife of text editors]

Eli Zaretskii <eliz@gnu.org> writes:

>> From: Thierry Volpiatto <thievol@posteo.net>
>> Date: Fri, 26 Feb 2021 08:35:30 +0100
>>
>> giving a try to native-comp branch.
>>
>> I install Emacs generaly with:
>>
>> make install bindir=/usr/local/sbin/emacs-28.0.50 infodir=/usr/local/share/info-28.0.50
>>
>> This always worked fine.  However with native-comp branch, I have to
>> manually add a symlink of "/usr/local/lib/emacs/28.0.50/native-lisp/" to
>> "/usr/local/sbin" otherwise I endup with an error:
>>
>> thierry@IPadS340:/usr/local/sbin/emacs-28.0.50$ ls
>> ctags  ebrowse  emacs  emacs-28.0.50  emacsclient  etags
>> thierry@IPadS340:/usr/local/sbin/emacs-28.0.50$ ./emacs-28.0.50
>> emacs: /usr/local/sbin/emacs-28.0.50/../native-lisp/28.0.50-40158ec0/window-0d1b8b93-738411b0.eln: cannot open shared object file: No such file or directory
>> thierry@IPadS340:/usr/local/sbin/emacs-28.0.50$ ./emacs
>> emacs: /usr/local/sbin/emacs-28.0.50/../native-lisp/28.0.50-40158ec0/window-0d1b8b93-738411b0.eln: cannot open shared object file: No such file or directory
>
> Hmm... I'm not sure we can resolve this in any other way, although we
> should try.  What worked for you with previous versions was just a
> side effect of the implementation detail: how Emacs finds the files it
> needs when it starts.  The *.eln files bring more restrictions to the
> table, and it could very well be that the symlink trick will be the
> only practical solution to such a non-standard installation.
>
> A possible solution is to set EMACSNATIVELOADPATH in the environment.

As the error is while resurrecting from dump I think acting on the load
path will not help as in this phase we relocate elns simply by filename.

Thierry, are you specifying your custom bindir only when installing or
also while building?  If the case is the first could you please try
again setting bindir also while building?

Sorry for not responding earlier, I've been in round robin on the issues
I had the feeling were higher priority but was still in my todo list :)

Regards

  Andrea

bug#46790: 28.0.50; make install with native-comp branch

[Eli Zaretskii]

> From: Thierry Volpiatto <thievol@posteo.net>
> Cc: Andrea Corallo <akrl@sdf.org>, 46790@debbugs.gnu.org
> Date: Sat, 10 Apr 2021 07:17:09 +0200
> 
> > What worked for you with previous versions was just a side effect of
> > the implementation detail: how Emacs finds the files it needs when it
> > starts.  The *.eln files bring more restrictions to the table, and it
> > could very well be that the symlink trick will be the only practical
> > solution to such a non-standard installation.
> 
> This not really a non standard installation, it is documented in INSTALL
> since always

Documented where?  INSTALL explains the meaning of each Makefile
variable, but it never says that any arbitrary combination of their
values will work.

> I am not sure also if everything is working properly with a "standard"
> installation, i.e. in /usr/local/bin, is in this case the native-lisp
> dir found?

When you configure Emacs, the place is recorded in epaths.h, exactly
like the directory for Lisp files is.

> > A possible solution is to set EMACSNATIVELOADPATH in the environment.
> 
> Didn't know this env var.
> 
> > Alternatively, you could modify your Emacs to look in the correct
> > directory by default.
> 
> Don't know how to do this, anyway all methods should be documented.

The documentation is not yet complete.

In any case, I don't think this issue should block the merge of the
branch.

bug#46790: 28.0.50; make install with native-comp branch

[Eli Zaretskii]

> From: Andrea Corallo <akrl@sdf.org>
> Cc: Thierry Volpiatto <thievol@posteo.net>, 46790@debbugs.gnu.org
> Date: Sat, 10 Apr 2021 06:57:26 +0000
> 
> Thierry, are you specifying your custom bindir only when installing or
> also while building?  If the case is the first could you please try
> again setting bindir also while building?

I don't think this can fly.  "make FOOdir=FOO" is a paradigm for
installing parts of Emacs in specified directories without rebuilding.

I think if we want to support this, the PATH_REL_LOADSEARCH trick is
incorrect: we need to look for native-lisp directory relative to
PATH_LOADSEARCH, i.e. relative to where the Lisp files are installed.
Is this possible?  The part that worries me is that we need to find
these *.eln files very early during the process of restoring from the
pdumper file, where we don't yet have all the directories handy.

bug#46790: 28.0.50; make install with native-comp branch

[Thierry Volpiatto]

[-- Attachment #1: Type: text/plain, Size: 2298 bytes --]


Andrea Corallo <akrl@sdf.org> writes:

> Eli Zaretskii <eliz@gnu.org> writes:
>
>>> From: Thierry Volpiatto <thievol@posteo.net>
>>> Date: Fri, 26 Feb 2021 08:35:30 +0100
>>>
>>> giving a try to native-comp branch.
>>>
>>> I install Emacs generaly with:
>>>
>>> make install bindir=/usr/local/sbin/emacs-28.0.50 infodir=/usr/local/share/info-28.0.50
>>>
>>> This always worked fine.  However with native-comp branch, I have to
>>> manually add a symlink of "/usr/local/lib/emacs/28.0.50/native-lisp/" to
>>> "/usr/local/sbin" otherwise I endup with an error:
>>>
>>> thierry@IPadS340:/usr/local/sbin/emacs-28.0.50$ ls
>>> ctags  ebrowse  emacs  emacs-28.0.50  emacsclient  etags
>>> thierry@IPadS340:/usr/local/sbin/emacs-28.0.50$ ./emacs-28.0.50
>>> emacs: /usr/local/sbin/emacs-28.0.50/../native-lisp/28.0.50-40158ec0/window-0d1b8b93-738411b0.eln: cannot open shared object file: No such file or directory
>>> thierry@IPadS340:/usr/local/sbin/emacs-28.0.50$ ./emacs
>>> emacs: /usr/local/sbin/emacs-28.0.50/../native-lisp/28.0.50-40158ec0/window-0d1b8b93-738411b0.eln: cannot open shared object file: No such file or directory
>>
>> Hmm... I'm not sure we can resolve this in any other way, although we
>> should try.  What worked for you with previous versions was just a
>> side effect of the implementation detail: how Emacs finds the files it
>> needs when it starts.  The *.eln files bring more restrictions to the
>> table, and it could very well be that the symlink trick will be the
>> only practical solution to such a non-standard installation.
>>
>> A possible solution is to set EMACSNATIVELOADPATH in the environment.
>
> As the error is while resurrecting from dump I think acting on the load
> path will not help as in this phase we relocate elns simply by filename.
>
> Thierry, are you specifying your custom bindir only when installing or
> also while building?

Only when installing.

> If the case is the first could you please try again setting bindir
> also while building?

How, is this allowed or even possible?

> Sorry for not responding earlier, I've been in round robin on the issues
> I had the feeling were higher priority but was still in my todo list :)

No problems, congrats for the huge work.

-- 
Thierry

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 686 bytes --]

bug#46790: 28.0.50; make install with native-comp branch

[Andrea Corallo via Bug reports for GNU Emacs, the Swiss army knife of text editors]

Thierry Volpiatto <thievol@posteo.net> writes:

> Andrea Corallo <akrl@sdf.org> writes:
>
>> Eli Zaretskii <eliz@gnu.org> writes:
>>
>>>> From: Thierry Volpiatto <thievol@posteo.net>
>>>> Date: Fri, 26 Feb 2021 08:35:30 +0100
>>>>
>>>> giving a try to native-comp branch.
>>>>
>>>> I install Emacs generaly with:
>>>>
>>>> make install bindir=/usr/local/sbin/emacs-28.0.50 infodir=/usr/local/share/info-28.0.50
>>>>
>>>> This always worked fine.  However with native-comp branch, I have to
>>>> manually add a symlink of "/usr/local/lib/emacs/28.0.50/native-lisp/" to
>>>> "/usr/local/sbin" otherwise I endup with an error:
>>>>
>>>> thierry@IPadS340:/usr/local/sbin/emacs-28.0.50$ ls
>>>> ctags  ebrowse  emacs  emacs-28.0.50  emacsclient  etags
>>>> thierry@IPadS340:/usr/local/sbin/emacs-28.0.50$ ./emacs-28.0.50
>>>> emacs: /usr/local/sbin/emacs-28.0.50/../native-lisp/28.0.50-40158ec0/window-0d1b8b93-738411b0.eln: cannot open shared object file: No such file or directory
>>>> thierry@IPadS340:/usr/local/sbin/emacs-28.0.50$ ./emacs
>>>> emacs: /usr/local/sbin/emacs-28.0.50/../native-lisp/28.0.50-40158ec0/window-0d1b8b93-738411b0.eln: cannot open shared object file: No such file or directory
>>>
>>> Hmm... I'm not sure we can resolve this in any other way, although we
>>> should try.  What worked for you with previous versions was just a
>>> side effect of the implementation detail: how Emacs finds the files it
>>> needs when it starts.  The *.eln files bring more restrictions to the
>>> table, and it could very well be that the symlink trick will be the
>>> only practical solution to such a non-standard installation.
>>>
>>> A possible solution is to set EMACSNATIVELOADPATH in the environment.
>>
>> As the error is while resurrecting from dump I think acting on the load
>> path will not help as in this phase we relocate elns simply by filename.
>>
>> Thierry, are you specifying your custom bindir only when installing or
>> also while building?
>
> Only when installing.
>
>> If the case is the first could you please try again setting bindir
>> also while building?
>
> How, is this allowed or even possible?

make bootstrap bindir=/xxx

I think ATM this should work (would be nice if you could check this),
reading Eli's opinion we may change it tho.

>> Sorry for not responding earlier, I've been in round robin on the issues
>> I had the feeling were higher priority but was still in my todo list :)
>
> No problems, congrats for the huge work.

Thanks

  Andrea

bug#46790: 28.0.50; make install with native-comp branch

[Andrea Corallo via Bug reports for GNU Emacs, the Swiss army knife of text editors]

Eli Zaretskii <eliz@gnu.org> writes:

>> From: Andrea Corallo <akrl@sdf.org>
>> Cc: Thierry Volpiatto <thievol@posteo.net>, 46790@debbugs.gnu.org
>> Date: Sat, 10 Apr 2021 06:57:26 +0000
>> 
>> Thierry, are you specifying your custom bindir only when installing or
>> also while building?  If the case is the first could you please try
>> again setting bindir also while building?
>
> I don't think this can fly.  "make FOOdir=FOO" is a paradigm for
> installing parts of Emacs in specified directories without rebuilding.
>
> I think if we want to support this, the PATH_REL_LOADSEARCH trick is
> incorrect: we need to look for native-lisp directory relative to
> PATH_LOADSEARCH, i.e. relative to where the Lisp files are installed.
> Is this possible?
> The part that worries me is that we need to find
> these *.eln files very early during the process of restoring from the
> pdumper file, where we don't yet have all the directories handy.

I share your same worries (almost certainties here).

  Andrea

bug#46790: 28.0.50; make install with native-comp branch

[Thierry Volpiatto]

[-- Attachment #1: Type: text/plain, Size: 5138 bytes --]


Andrea Corallo <akrl@sdf.org> writes:

> Thierry Volpiatto <thievol@posteo.net> writes:
>
>> Andrea Corallo <akrl@sdf.org> writes:
>>
>>> Eli Zaretskii <eliz@gnu.org> writes:
>>>
>>>>> From: Thierry Volpiatto <thievol@posteo.net>
>>>>> Date: Fri, 26 Feb 2021 08:35:30 +0100
>>>>>
>>>>> giving a try to native-comp branch.
>>>>>
>>>>> I install Emacs generaly with:
>>>>>
>>>>> make install bindir=/usr/local/sbin/emacs-28.0.50 infodir=/usr/local/share/info-28.0.50
>>>>>
>>>>> This always worked fine.  However with native-comp branch, I have to
>>>>> manually add a symlink of "/usr/local/lib/emacs/28.0.50/native-lisp/" to
>>>>> "/usr/local/sbin" otherwise I endup with an error:
>>>>>
>>>>> thierry@IPadS340:/usr/local/sbin/emacs-28.0.50$ ls
>>>>> ctags  ebrowse  emacs  emacs-28.0.50  emacsclient  etags
>>>>> thierry@IPadS340:/usr/local/sbin/emacs-28.0.50$ ./emacs-28.0.50
>>>>> emacs: /usr/local/sbin/emacs-28.0.50/../native-lisp/28.0.50-40158ec0/window-0d1b8b93-738411b0.eln: cannot open shared object file: No such file or directory
>>>>> thierry@IPadS340:/usr/local/sbin/emacs-28.0.50$ ./emacs
>>>>> emacs: /usr/local/sbin/emacs-28.0.50/../native-lisp/28.0.50-40158ec0/window-0d1b8b93-738411b0.eln: cannot open shared object file: No such file or directory
>>>>
>>>> Hmm... I'm not sure we can resolve this in any other way, although we
>>>> should try.  What worked for you with previous versions was just a
>>>> side effect of the implementation detail: how Emacs finds the files it
>>>> needs when it starts.  The *.eln files bring more restrictions to the
>>>> table, and it could very well be that the symlink trick will be the
>>>> only practical solution to such a non-standard installation.
>>>>
>>>> A possible solution is to set EMACSNATIVELOADPATH in the environment.
>>>
>>> As the error is while resurrecting from dump I think acting on the load
>>> path will not help as in this phase we relocate elns simply by filename.
>>>
>>> Thierry, are you specifying your custom bindir only when installing or
>>> also while building?
>>
>> Only when installing.
>>
>>> If the case is the first could you please try again setting bindir
>>> also while building?
>>
>> How, is this allowed or even possible?
>
> make bootstrap bindir=/xxx
>
> I think ATM this should work (would be nice if you could check this),

I tried and it is working partially.

Calling emacs from /usr/local/sbin works, however when I symlink
/usr/local/sbin/emacs-28.0.50/emacs-28.0.50 to /usr/local/bin I have the
same error:

make[1] : on quitte le répertoire « /home/thierry/tmp/emacs/lib-src »
find native-lisp -type d -exec /bin/mkdir -p "/usr/local/lib/emacs/28.0.50/{}" \; ; \
find native-lisp -type f -exec /usr/bin/install -c -m 644 "{}" "/usr/local/lib/emacs/28.0.50/{}" \;
thierry@IPadS340:~/tmp/emacs$ cd
thierry@IPadS340:~$ cd /usr/local/sbin/emacs-28.0.50/
thierry@IPadS340:/usr/local/sbin/emacs-28.0.50$ ls
ctags  ebrowse  emacs  emacs-28.0.50  emacsclient  etags
thierry@IPadS340:/usr/local/sbin/emacs-28.0.50$ ./emacs
thierry@IPadS340:/usr/local/sbin/emacs-28.0.50$ sudo eselect-emacs
Versions availables:
1) emacs-27.1
2) emacs-26.3
3) emacs-28.0.50

Current version is emacs-27.2
Choose a new version: 3
Deleting Symlink /usr/local/bin/emacsclient
Deleting Symlink /usr/local/bin/ctags
Deleting Symlink /usr/local/bin/etags
Deleting Symlink /usr/local/bin/ebrowse
Deleting Symlink /usr/local/bin/emacs
Symlinking /usr/local/sbin/emacs-28.0.50/emacsclient to /usr/local/bin/emacsclient
Symlinking /usr/local/sbin/emacs-28.0.50/ctags to /usr/local/bin/ctags
Symlinking /usr/local/sbin/emacs-28.0.50/etags to /usr/local/bin/etags
Symlinking /usr/local/sbin/emacs-28.0.50/ebrowse to /usr/local/bin/ebrowse
Symlinking /usr/local/sbin/emacs-28.0.50/emacs-28.0.50 to /usr/local/bin/emacs
Deleting symlink/usr/local/share/info
Symlinking /usr/local/share/info-28.0.50 to /usr/local/share/info

emacs-28.0.50 installed
thierry@IPadS340:/usr/local/sbin/emacs-28.0.50$ cdl
thierry@IPadS340:/usr/local/sbin$ cdl
thierry@IPadS340:/usr/local$ cd bin
thierry@IPadS340:/usr/local/bin$ ls
apt  ctags  ebrowse  emacs  emacsclient  emacseditor  eselect-emacs  etags  gnome-help  helm  highlight-mint  mint-sha256sum  mu  piactl  search  xournal  yelp
thierry@IPadS340:/usr/local/bin$ ./emacs
emacs: /usr/local/bin/../native-lisp/28.0.50-2f134e58/preloaded/window-0d1b8b93-513ac8ca.eln: cannot open shared object file: No such file or directory
thierry@IPadS340:/usr/local/bin$ emacs
emacs: /usr/local/bin/../native-lisp/28.0.50-2f134e58/preloaded/window-0d1b8b93-513ac8ca.eln: cannot open shared object file: No such file or directory
 

So for now what is working best for me is symlinking native-lisp
directory to /usr/local/sbin.

> 
> reading Eli's opinion we may change it tho.
>
>>> Sorry for not responding earlier, I've been in round robin on the issues
>>> I had the feeling were higher priority but was still in my todo list :)
>>
>> No problems, congrats for the huge work.
>
> Thanks
>
>   Andrea


-- 
Thierry

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 686 bytes --]

bug#46790: 28.0.50; [native-comp] Emacs doesn't start when run from a symlink

[Phil Sainty]

I've compiled the feature/native-comp branch and it starts if I run
the real path to the executable; but if I run it from a symlink it
fails:

$ ls -l /home/phil/bin/emacs-native-comp
lrwxrwxrwx 1 phil phil 48 Apr 14 00:01 /home/phil/bin/emacs-native-comp -> /home/phil/emacs/native-comp/usr/local/bin/emacs

$ emacs-native-comp -Q
emacs: /home/phil/bin/../native-lisp/28.0.50-abd7aa58/preloaded/window-0d1b8b93-513ac8ca.eln: cannot open shared object file: No such file or directory


Looking relative to the symlink itself is clearly wrong.  Something
like `file-truename' should surely be utilised here.  (GNU readlink
with the -m option does much the same thing, if that's at all helpful.)

I'm sending to what looks like a duplicate bug, although my case seems
like a more standard configuration -- I'm not passing a custom 'bindir'
to 'make install'; I'm simply using the normal 'configure --prefix=...'
(see below).


-Phil



In GNU Emacs 28.0.50 (build 1, x86_64-pc-linux-gnu, X toolkit, cairo version 1.15.10, Xaw3d scroll bars)
 of 2021-04-13 built on shodan
Repository revision: 8ed46b7646de7166aa8bbd3b5d29a4947316c900
Repository branch: feature/native-comp
Windowing system distributor 'The X.Org Foundation', version 11.0.12008000
System Description: Ubuntu 18.04.5 LTS

Configured using:
 'configure --prefix=/home/phil/emacs/native-comp/usr/local
 --with-x-toolkit=lucid --without-sound --with-native-compilation'

Configured features:
CAIRO DBUS FREETYPE GIF GLIB GMP GNUTLS GSETTINGS HARFBUZZ JPEG JSON
LCMS2 LIBXML2 MODULES NATIVE_COMP NOTIFY INOTIFY PDUMPER PNG RSVG
THREADS TIFF TOOLKIT_SCROLL_BARS X11 XAW3D XDBE XIM XPM LUCID ZLIB

Important settings:
  value of $LANG: en_NZ.UTF-8
  locale-coding-system: utf-8-unix

Major mode: Lisp Interaction

Minor modes in effect:
  tooltip-mode: t
  global-eldoc-mode: t
  eldoc-mode: t
  electric-indent-mode: t
  mouse-wheel-mode: t
  tool-bar-mode: t
  menu-bar-mode: t
  file-name-shadow-mode: t
  global-font-lock-mode: t
  font-lock-mode: t
  blink-cursor-mode: t
  auto-composition-mode: t
  auto-encryption-mode: t
  auto-compression-mode: t
  line-number-mode: t
  transient-mark-mode: t

Load-path shadows:
None found.

Features:
(shadow sort mail-extr emacsbug message rmc puny dired dired-loaddefs
rfc822 mml mml-sec epa derived epg epg-config gnus-util rmail
rmail-loaddefs auth-source eieio eieio-core eieio-loaddefs
password-cache json map text-property-search time-date mm-decode
mm-bodies mm-encode mail-parse rfc2231 mailabbrev gmm-utils mailheader
sendmail rfc2047 rfc2045 ietf-drums mm-util mail-prsvr mail-utils comp
comp-cstr warnings subr-x rx cl-seq cl-macs cl-extra help-mode seq
byte-opt gv cl-loaddefs cl-lib bytecomp byte-compile cconv iso-transl
tooltip eldoc electric uniquify ediff-hook vc-hooks lisp-float-type
mwheel term/x-win x-win term/common-win x-dnd tool-bar dnd fontset image
regexp-opt fringe tabulated-list replace newcomment text-mode elisp-mode
lisp-mode prog-mode register page tab-bar menu-bar rfn-eshadow isearch
easymenu timer select scroll-bar mouse jit-lock font-lock syntax
font-core term/tty-colors frame minibuffer cl-generic cham georgian
utf-8-lang misc-lang vietnamese tibetan thai tai-viet lao korean
japanese eucjp-ms cp51932 hebrew greek romanian slovak czech european
ethiopic indian cyrillic chinese composite charscript charprop
case-table epa-hook jka-cmpr-hook help simple abbrev obarray
cl-preloaded nadvice button loaddefs faces cus-face macroexp files
window text-properties overlay sha1 md5 base64 format env code-pages
mule custom widget hashtable-print-readable backquote threads dbusbind
inotify lcms2 dynamic-setting system-font-setting font-render-setting
cairo x-toolkit x multi-tty make-network-process nativecomp emacs)

Memory information:
((conses 16 92899 8806)
 (symbols 48 7808 1)
 (strings 32 24363 4126)
 (string-bytes 1 830720)
 (vectors 16 17056)
 (vector-slots 8 316265 21888)
 (floats 8 37 35)
 (intervals 56 225 0)
 (buffers 992 12))

bug#46790: 28.0.50; [native-comp] Emacs doesn't start when run from a symlink

[Eli Zaretskii]

> Cc: Andrea Corallo <akrl@sdf.org>, Eli Zaretskii <eliz@gnu.org>,
>  Thierry Volpiatto <thievol@posteo.net>
> From: Phil Sainty <psainty@orcon.net.nz>
> Date: Wed, 14 Apr 2021 00:37:38 +1200
> 
> I've compiled the feature/native-comp branch and it starts if I run
> the real path to the executable; but if I run it from a symlink it
> fails:
> 
> $ ls -l /home/phil/bin/emacs-native-comp
> lrwxrwxrwx 1 phil phil 48 Apr 14 00:01 /home/phil/bin/emacs-native-comp -> /home/phil/emacs/native-comp/usr/local/bin/emacs
> 
> $ emacs-native-comp -Q
> emacs: /home/phil/bin/../native-lisp/28.0.50-abd7aa58/preloaded/window-0d1b8b93-513ac8ca.eln: cannot open shared object file: No such file or directory

Andrea, I think the code which resolves symlinks in load_pdump should
also affect how Vinvocation_directory etc. are computed in
set_invocation_vars.

bug#46790: 28.0.50; [native-comp] Emacs doesn't start when run from a symlink

[Andrea Corallo via Bug reports for GNU Emacs, the Swiss army knife of text editors]

Phil Sainty <psainty@orcon.net.nz> writes:

> I've compiled the feature/native-comp branch and it starts if I run
> the real path to the executable; but if I run it from a symlink it
> fails:
>
> $ ls -l /home/phil/bin/emacs-native-comp
> lrwxrwxrwx 1 phil phil 48 Apr 14 00:01 /home/phil/bin/emacs-native-comp -> /home/phil/emacs/native-comp/usr/local/bin/emacs
>
> $ emacs-native-comp -Q
> emacs: /home/phil/bin/../native-lisp/28.0.50-abd7aa58/preloaded/window-0d1b8b93-513ac8ca.eln: cannot open shared object file: No such file or directory
>
>
> Looking relative to the symlink itself is clearly wrong.  Something
> like `file-truename' should surely be utilised here.  (GNU readlink
> with the -m option does much the same thing, if that's at all helpful.)
>
> I'm sending to what looks like a duplicate bug, although my case seems
> like a more standard configuration -- I'm not passing a custom 'bindir'
> to 'make install'; I'm simply using the normal 'configure --prefix=...'
> (see below).

Hi Phil,

thanks for reporting, yeah this was reported already in #44128, I'll try
to see how we can solve it.

Thanks

  Andrea

bug#46790: 28.0.50; make install with native-comp branch

[Phil Sainty]

Hi Thierry,

I suspect your bug has now been fixed in #44128.
https://debbugs.gnu.org/cgi/bugreport.cgi?bug=44128

Could you re-test with the latest feature/native-comp revision?

bug#46790: 28.0.50; make install with native-comp branch

[Eli Zaretskii]

> From: Phil Sainty <psainty@orcon.net.nz>
> Date: Tue, 20 Apr 2021 21:33:45 +1200
> Cc: 46790@debbugs.gnu.org
> 
> Hi Thierry,
> 
> I suspect your bug has now been fixed in #44128.
> https://debbugs.gnu.org/cgi/bugreport.cgi?bug=44128

I think only as long as $(libdir) and $(libexecdir) keep their
relative locations.

We don't really support separate unsynchronized locations for the
various *dir variables used to install Emacs.  The official way of
moving the entire installation is by either specifying prefix= or by
DESTDIR=.

bug#46790: 28.0.50; make install with native-comp branch

[Thierry Volpiatto]

[-- Attachment #1: Type: text/plain, Size: 596 bytes --]


Phil Sainty <psainty@orcon.net.nz> writes:

> Hi Thierry,
>
> I suspect your bug has now been fixed in #44128.
> https://debbugs.gnu.org/cgi/bugreport.cgi?bug=44128
>
> Could you re-test with the latest feature/native-comp revision?

Just tried now with 062e5994802 and no it is not working, worst the workaround
I found i.e. symlinking native-lisp/ to /usr/local/sbin is no more
working as well. Emacs IS starting though but is not finding needed
libraries.

It is reproducible by using dired-async and trying to copy a file, no
child emacs process is created.

-- 
Thierry

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 686 bytes --]

bug#46790: 28.0.50; make install with native-comp branch

[Thierry Volpiatto]

[-- Attachment #1: Type: text/plain, Size: 802 bytes --]


Eli Zaretskii <eliz@gnu.org> writes:

>> From: Phil Sainty <psainty@orcon.net.nz>
>> Date: Tue, 20 Apr 2021 21:33:45 +1200
>> Cc: 46790@debbugs.gnu.org
>> 
>> Hi Thierry,
>> 
>> I suspect your bug has now been fixed in #44128.
>> https://debbugs.gnu.org/cgi/bugreport.cgi?bug=44128
>
> I think only as long as $(libdir) and $(libexecdir) keep their
> relative locations.
>
> We don't really support separate unsynchronized locations for the
> various *dir variables used to install Emacs.

Don't know what you are speaking about, the problem is with

make install bindir=foo

which IS documented in INSTALL.

> The official way of moving the entire installation is by either
> specifying prefix= or by DESTDIR=.

This is unrelated, I don't want to do this.

-- 
Thierry

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 686 bytes --]

bug#46790: 28.0.50; make install with native-comp branch

[Eli Zaretskii]

> From: Thierry Volpiatto <thievol@posteo.net>
> Cc: Phil Sainty <psainty@orcon.net.nz>, 46790@debbugs.gnu.org
> Date: Sat, 24 Apr 2021 06:48:24 +0000
> 
> > I think only as long as $(libdir) and $(libexecdir) keep their
> > relative locations.
> >
> > We don't really support separate unsynchronized locations for the
> > various *dir variables used to install Emacs.
> 
> Don't know what you are speaking about, the problem is with
> 
> make install bindir=foo
> 
> which IS documented in INSTALL.

So please describe the details of the deployment in your case:

  . where is the _real_ Emacs executable?
  . where is the symlink to it?
  . are you invoking the symlink explicitly or via PATH?
  . where is the .pdmp file?
  . where is the installed native-lisp/ directory?

(When I say "where" above, I mean what is the exact absolute file name
of that file or directory.  Also whether it's a symlink or not, and in
the former case where does the symlink point.)

Thanks.

bug#46790: 28.0.50; make install with native-comp branch

[Eli Zaretskii]

> Date: Sat, 24 Apr 2021 10:49:07 +0300
> From: Eli Zaretskii <eliz@gnu.org>
> Cc: psainty@orcon.net.nz, 46790@debbugs.gnu.org
> 
>   . where is the _real_ Emacs executable?
>   . where is the symlink to it?
>   . are you invoking the symlink explicitly or via PATH?
>   . where is the .pdmp file?
>   . where is the installed native-lisp/ directory?

Also I've now tried to improve the diagnostics when Emacs fails to
find the *.eln files, so please report what it says when it fails.

In addition: you said earlier:

> Emacs IS starting though but is not finding needed libraries.

Maybe I misunderstand the problem.  Your original report quoted error
messages like these:

> thierry <at> IPadS340:/usr/local/sbin/emacs-28.0.50$ ./emacs-28.0.50
> emacs: /usr/local/sbin/emacs-28.0.50/../native-lisp/28.0.50-40158ec0/window-0d1b8b93-738411b0.eln: cannot open shared object file: No such file or directory
> thierry <at> IPadS340:/usr/local/sbin/emacs-28.0.50$ ./emacs
> emacs: /usr/local/sbin/emacs-28.0.50/../native-lisp/28.0.50-40158ec0/window-0d1b8b93-738411b0.eln: cannot open shared object file: No such file or directory

AFAIK these are fatal errors: Emacs doesn't start up when it reports
these.  But you seem to be saying Emacs does start in your case?  Then
what do you mean by "is not finding needed libraries"?

bug#46790: 28.0.50; make install with native-comp branch

[Thierry Volpiatto]

[-- Attachment #1: Type: text/plain, Size: 1831 bytes --]


Eli Zaretskii <eliz@gnu.org> writes:

>> From: Thierry Volpiatto <thievol@posteo.net>
>> Cc: Phil Sainty <psainty@orcon.net.nz>, 46790@debbugs.gnu.org
>> Date: Sat, 24 Apr 2021 06:48:24 +0000
>> 
>> > I think only as long as $(libdir) and $(libexecdir) keep their
>> > relative locations.
>> >
>> > We don't really support separate unsynchronized locations for the
>> > various *dir variables used to install Emacs.
>> 
>> Don't know what you are speaking about, the problem is with
>> 
>> make install bindir=foo
>> 
>> which IS documented in INSTALL.
>
> So please describe the details of the deployment in your case:
>
>   . where is the _real_ Emacs executable?

/usr/local/sbin/emacs-28.0.50/

This directory is not a symlink, it contains emacs-28.0.50 executable
and its symlink emacs.

/usr/local/sbin/emacs-28.0.50/ctags
/usr/local/sbin/emacs-28.0.50/ebrowse
/usr/local/sbin/emacs-28.0.50/emacs -> emacs-28.0.50
/usr/local/sbin/emacs-28.0.50/emacs-28.0.50
/usr/local/sbin/emacs-28.0.50/emacsclient
/usr/local/sbin/emacs-28.0.50/etags

>   
>   . where is the symlink to it?

/usr/local/bin/

The symlink is from /usr/local/sbin/emacs-28.0.50/emacs-28.0.50, not
from /usr/local/sbin/emacs-28.0.50/emacs which is itself a symlink of
/usr/local/sbin/emacs-28.0.50/emacs-28.0.50 (see above).

>   . are you invoking the symlink explicitly or via PATH?

Via PATH, i.e. with emacs.

>   . where is the .pdmp file?

Didn't find such file.

>   . where is the installed native-lisp/ directory?

/usr/local/lib/emacs/28.0.50/

Not a symlink.

> (When I say "where" above, I mean what is the exact absolute file name
> of that file or directory.  Also whether it's a symlink or not, and in
> the former case where does the symlink point.)
>
> Thanks.


-- 
Thierry

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 686 bytes --]

bug#46790: 28.0.50; make install with native-comp branch

[Eli Zaretskii]

> From: Thierry Volpiatto <thievol@posteo.net>
> Cc: psainty@orcon.net.nz, 46790@debbugs.gnu.org
> Date: Sat, 24 Apr 2021 11:11:05 +0000
> 
> >   . where is the .pdmp file?
> 
> Didn't find such file.

It should be under /usr/local/libexec, please try finding it.  Its
name should be emacs.pdmp.  Its location is important for
understanding why things don't work for you.

bug#46790: 28.0.50; make install with native-comp branch

[Phil Sainty]

In case it helps, I've just tried to do a similar test on my system.

I didn't reconfigure from my previous tests, so I'm still using this:

./configure --prefix=/home/phil/emacs/native-comp/usr/local \
  --with-x-toolkit=lucid --without-sound --with-native-compilation

I then used the 'bindir' and 'infodir' options to install those
somewhere else:

make install \
  bindir=/home/phil/emacs/native-comp/elsewhere/usr/local/sbin/emacs-28.0.50 \
  infodir=/home/phil/emacs/native-comp/elsewhere/usr/local/share/info-28.0.50

Next I created a symlink to the new executable:

/home/phil/bin/etest -> /home/phil/emacs/native-comp/elsewhere/usr/local/sbin/emacs-28.0.50/emacs-28.0.50

And this seems to work.  Running it gives me:

$ etest --batch --eval "(print comp-eln-load-path)" --eval "(print (pdumper-stats))"

("/home/phil/.emacs.d/eln-cache/" "/home/phil/emacs/native-comp/usr/local/lib/emacs/28.0.50/native-lisp/")

((dumped-with-pdumper . t) (load-time . 0.021803813) (dump-file-name . "/home/phil/emacs/native-comp/usr/local/libexec/emacs/28.0.50/x86_64-pc-linux-gnu/emacs.pdmp"))

bug#46790: 28.0.50; make install with native-comp branch

[Thierry Volpiatto]

[-- Attachment #1: Type: text/plain, Size: 419 bytes --]


Eli Zaretskii <eliz@gnu.org> writes:

>> From: Thierry Volpiatto <thievol@posteo.net>
>> Cc: psainty@orcon.net.nz, 46790@debbugs.gnu.org
>> Date: Sat, 24 Apr 2021 11:11:05 +0000
>> 
>> >   . where is the .pdmp file?
>> 
>> Didn't find such file.
>
> It should be under /usr/local/libexec, please try finding it.

Got it.

/usr/local/libexec/emacs/28.0.50/x86_64-pc-linux-gnu/emacs.pdmp

-- 
Thierry

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 686 bytes --]

bug#46790: 28.0.50; make install with native-comp branch

[Thierry Volpiatto]

[-- Attachment #1: Type: text/plain, Size: 1837 bytes --]


Eli Zaretskii <eliz@gnu.org> writes:

>> Date: Sat, 24 Apr 2021 10:49:07 +0300
>> From: Eli Zaretskii <eliz@gnu.org>
>> Cc: psainty@orcon.net.nz, 46790@debbugs.gnu.org
>> 
>>   . where is the _real_ Emacs executable?
>>   . where is the symlink to it?
>>   . are you invoking the symlink explicitly or via PATH?
>>   . where is the .pdmp file?
>>   . where is the installed native-lisp/ directory?
>
> Also I've now tried to improve the diagnostics when Emacs fails to
> find the *.eln files, so please report what it says when it fails.

As I said before I found this bug when using dired-async-mode from
emacs-async package. When trying to copy a file nothing happened, no
child emacs process was made. As soon I symlinked the native-lisp/
directory in /usr/local/sbin dired-async started working, now it is no
more working symlink or not, I guess emacs --batch is not finding the
necessary libraries to start, but now unsure.


> In addition: you said earlier:
>
>> Emacs IS starting though but is not finding needed libraries.
>
> Maybe I misunderstand the problem.  Your original report quoted error
> messages like these:
>
>> thierry <at> IPadS340:/usr/local/sbin/emacs-28.0.50$ ./emacs-28.0.50
>> emacs: /usr/local/sbin/emacs-28.0.50/../native-lisp/28.0.50-40158ec0/window-0d1b8b93-738411b0.eln: cannot open shared object file: No such file or directory
>> thierry <at> IPadS340:/usr/local/sbin/emacs-28.0.50$ ./emacs
>> emacs: /usr/local/sbin/emacs-28.0.50/../native-lisp/28.0.50-40158ec0/window-0d1b8b93-738411b0.eln: cannot open shared object file: No such file or directory

Yes I sent this because I thought it was a straight forward way to show
the problem, however the strange thing was emacs was starting with no
apparent errors from its symlink in /usr/local/bin/

-- 
Thierry

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 686 bytes --]

bug#46790: 28.0.50; make install with native-comp branch

[Eli Zaretskii]

> From: Thierry Volpiatto <thievol@posteo.net>
> Cc: psainty@orcon.net.nz, 46790@debbugs.gnu.org
> Date: Sat, 24 Apr 2021 12:04:20 +0000
> 
> /usr/local/libexec/emacs/28.0.50/x86_64-pc-linux-gnu/emacs.pdmp

Then it ought to have worked.  There's some factor at work here that
I'm missing...

Could you please update to the latest branch, build and install it,
then try invoking Emacs via PATH.  The error message, if it happens,
should provide more information, which perhaps will explain what I am
missing.

P.S. Just to be sure we are on the same page: you are building with
just "make" and then installing with "make install bindir=.. infodir=..",
right?

bug#46790: 28.0.50; make install with native-comp branch

[Eli Zaretskii]

> From: Thierry Volpiatto <thievol@posteo.net>
> Cc: Andrea Corallo <akrl@sdf.org>, psainty@orcon.net.nz, 46790@debbugs.gnu.org
> Date: Sat, 24 Apr 2021 12:21:56 +0000
> 
> As I said before I found this bug when using dired-async-mode from
> emacs-async package. When trying to copy a file nothing happened, no
> child emacs process was made. As soon I symlinked the native-lisp/
> directory in /usr/local/sbin dired-async started working, now it is no
> more working symlink or not, I guess emacs --batch is not finding the
> necessary libraries to start, but now unsure.

Wait a minute: you are saying that starting "emacs" with your
installation works well, and the problem happens only when you use the
dired-async-mode?  If so, it's a different problem from what I
thought, sorry for not realizing this earlier.

I think we need to see how "emacs --batch" is invoked in your
scenario, in order for us to understand the problem you have.  can you
show the complete Emacs batch command that fails like that?

> >> thierry <at> IPadS340:/usr/local/sbin/emacs-28.0.50$ ./emacs-28.0.50
> >> emacs: /usr/local/sbin/emacs-28.0.50/../native-lisp/28.0.50-40158ec0/window-0d1b8b93-738411b0.eln: cannot open shared object file: No such file or directory
> >> thierry <at> IPadS340:/usr/local/sbin/emacs-28.0.50$ ./emacs
> >> emacs: /usr/local/sbin/emacs-28.0.50/../native-lisp/28.0.50-40158ec0/window-0d1b8b93-738411b0.eln: cannot open shared object file: No such file or directory
> 
> Yes I sent this because I thought it was a straight forward way to show
> the problem, however the strange thing was emacs was starting with no
> apparent errors from its symlink in /usr/local/bin/

Are these messages emitted by the "emacs --batch" invocation done by
dired-async-mode, or are they shown when you start your interactive
Emacs session?

bug#46790: 28.0.50; make install with native-comp branch

[Thierry Volpiatto]

[-- Attachment #1: Type: text/plain, Size: 5994 bytes --]


Eli Zaretskii <eliz@gnu.org> writes:

>> From: Thierry Volpiatto <thievol@posteo.net>
>> Cc: Andrea Corallo <akrl@sdf.org>, psainty@orcon.net.nz, 46790@debbugs.gnu.org
>> Date: Sat, 24 Apr 2021 12:21:56 +0000
>> 
>> As I said before I found this bug when using dired-async-mode from
>> emacs-async package. When trying to copy a file nothing happened, no
>> child emacs process was made. As soon I symlinked the native-lisp/
>> directory in /usr/local/sbin dired-async started working, now it is no
>> more working symlink or not, I guess emacs --batch is not finding the
>> necessary libraries to start, but now unsure.
>
> Wait a minute: you are saying that starting "emacs" with your
> installation works well, and the problem happens only when you use the
> dired-async-mode?

Yes.

> If so, it's a different problem from what I thought, sorry for not
> realizing this earlier.
>
> I think we need to see how "emacs --batch" is invoked in your
> scenario, in order for us to understand the problem you have.  can you
> show the complete Emacs batch command that fails like that?

You will find the code in async-start function in async.el
https://github.com/jwiegley/emacs-async/blob/master/async.el#L296


>> >> thierry <at> IPadS340:/usr/local/sbin/emacs-28.0.50$ ./emacs-28.0.50
>> >> emacs: /usr/local/sbin/emacs-28.0.50/../native-lisp/28.0.50-40158ec0/window-0d1b8b93-738411b0.eln: cannot open shared object file: No such file or directory
>> >> thierry <at> IPadS340:/usr/local/sbin/emacs-28.0.50$ ./emacs
>> >> emacs: /usr/local/sbin/emacs-28.0.50/../native-lisp/28.0.50-40158ec0/window-0d1b8b93-738411b0.eln: cannot open shared object file: No such file or directory
>> 
>> Yes I sent this because I thought it was a straight forward way to show
>> the problem, however the strange thing was emacs was starting with no
>> apparent errors from its symlink in /usr/local/bin/
>
> Are these messages emitted by the "emacs --batch" invocation done by
> dired-async-mode,

No, unfortunately it is really hard to get error messages from async.el.
These message came from calling ./emacs or ./emacs-28.0.50 from
/usr/local/sbin/emacs-28.0.50/.
However if it may help, it seems the process buffer is created, and then
the process (emacs) never start, here the contents of the "*emacs*"
buffer (emacs started with "./emacs" from /usr/local/sbin/emacs-28.0.50 directory):

Lisp expression: Backtrace:
/usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x17a324)[0x55e34b4cc324]
/usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x46299)[0x55e34b398299]
/usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x469fa)[0x55e34b3989fa]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x12980)[0x7ff2a34b1980]
/usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x1f66f8)[0x55e34b5486f8]
/usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x1f4caf)[0x55e34b546caf]
/usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x1f592d)[0x55e34b54792d]
/usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x1f4caf)[0x55e34b546caf]
/usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x1f62ad)[0x55e34b5482ad]
/usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x1f4caf)[0x55e34b546caf]
/usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x1f4f2d)[0x55e34b546f2d]
/usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x1f2a93)[0x55e34b544a93]
/usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x1f4caf)[0x55e34b546caf]
/usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x1f4b6e)[0x55e34b546b6e]
/usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x1f4a98)[0x55e34b546a98]
/usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x1f4a98)[0x55e34b546a98]
/usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x1f605d)[0x55e34b54805d]
/usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x1f4caf)[0x55e34b546caf]
/usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x1f50ed)[0x55e34b5470ed]
/usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x1f0cc1)[0x55e34b542cc1]
/usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x1f4dab)[0x55e34b546dab]
/usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x1f4b6e)[0x55e34b546b6e]
/usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x1f6769)[0x55e34b548769]
/usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x1f4caf)[0x55e34b546caf]
/usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x1f543d)[0x55e34b54743d]
/usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x1f4caf)[0x55e34b546caf]
/usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x1f605d)[0x55e34b54805d]
/usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x1f4caf)[0x55e34b546caf]
/usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x1f50ed)[0x55e34b5470ed]
/usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x1f0cc1)[0x55e34b542cc1]
/usr/local/libexec/emacs/28.0.50/x86_64-pc-linux-gnu/../../../../bin/../lib/emacs/28.0.50/native-lisp/28.0.50-f294808a/preloaded/startup-bbc6ea72-3a1d4504.eln(F636f6d6d616e642d6c696e652d31_command_line_1_0+0xad3)[0x7ff2918cf923]
/usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x1f0e73)[0x55e34b542e73]
/usr/local/libexec/emacs/28.0.50/x86_64-pc-linux-gnu/../../../../bin/../lib/emacs/28.0.50/native-lisp/28.0.50-f294808a/preloaded/startup-bbc6ea72-3a1d4504.eln(F636f6d6d616e642d6c696e65_command_line_0+0x17a2)[0x7ff2918c8512]
/usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x1f0e73)[0x55e34b542e73]
/usr/local/libexec/emacs/28.0.50/x86_64-pc-linux-gnu/../../../../bin/../lib/emacs/28.0.50/native-lisp/28.0.50-f294808a/preloaded/startup-bbc6ea72-3a1d4504.eln(F6e6f726d616c2d746f702d6c6576656c_normal_top_level_0+0xfca)[0x7ff2918c4fca]
/usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x1f4ce8)[0x55e34b546ce8]
/usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x1f6969)[0x55e34b548969]
/usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x1efd57)[0x55e34b541d57]
/usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x15a846)[0x55e34b4ac846]
/usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x1f2a93)[0x55e34b544a93]
/usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x159d08)[0x55e34b4abd08]
...


> or are they shown when you start your interactive Emacs session?

The interactive session.

-- 
Thierry

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 686 bytes --]

bug#46790: 28.0.50; make install with native-comp branch

[Eli Zaretskii]

> Date: Sat, 24 Apr 2021 15:40:07 +0300
> From: Eli Zaretskii <eliz@gnu.org>
> Cc: psainty@orcon.net.nz, 46790@debbugs.gnu.org, akrl@sdf.org
> 
> I think we need to see how "emacs --batch" is invoked in your
> scenario, in order for us to understand the problem you have.  can you
> show the complete Emacs batch command that fails like that?

On a hunch I installed some potential fix on the branch.  Could you
please see if it solves your problem?

bug#46790: 28.0.50; make install with native-comp branch

[Eli Zaretskii]

> From: Thierry Volpiatto <thievol@posteo.net>
> Cc: akrl@sdf.org, psainty@orcon.net.nz, 46790@debbugs.gnu.org
> Date: Sat, 24 Apr 2021 12:47:17 +0000
> 
> > Wait a minute: you are saying that starting "emacs" with your
> > installation works well, and the problem happens only when you use the
> > dired-async-mode?
> 
> Yes.

But below you say:

> > or are they shown when you start your interactive Emacs session?
> 
> The interactive session.

So now I'm completely confused.  I don't think I understand whether
Emacs fails to start interactively, or it starts and then
dired-async-mode fails because invoking an inferior Emacs in batch
mode fails (or crashes, see below).

> However if it may help, it seems the process buffer is created, and then
> the process (emacs) never start, here the contents of the "*emacs*"
> buffer (emacs started with "./emacs" from /usr/local/sbin/emacs-28.0.50 directory):
> 
> Lisp expression: Backtrace:
> /usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x17a324)[0x55e34b4cc324]
> /usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x46299)[0x55e34b398299]
> /usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x469fa)[0x55e34b3989fa]
> /lib/x86_64-linux-gnu/libpthread.so.0(+0x12980)[0x7ff2a34b1980]

This is a backtrace from an abort or crash.  Even more weird.

I installed some change that might fix the problem.  If not, I'm
afraid someone else who is smarter than I am will have to investigate
this.  Thank you for your time and help.

bug#46790: 28.0.50; make install with native-comp branch

[Eli Zaretskii]

> Date: Sat, 24 Apr 2021 16:33:17 +0300
> From: Eli Zaretskii <eliz@gnu.org>
> Cc: psainty@orcon.net.nz, 46790@debbugs.gnu.org, akrl@sdf.org
> 
> > Lisp expression: Backtrace:
> > /usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x17a324)[0x55e34b4cc324]
> > /usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x46299)[0x55e34b398299]
> > /usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x469fa)[0x55e34b3989fa]
> > /lib/x86_64-linux-gnu/libpthread.so.0(+0x12980)[0x7ff2a34b1980]
> 
> This is a backtrace from an abort or crash.  Even more weird.
> 
> I installed some change that might fix the problem.  If not, I'm
> afraid someone else who is smarter than I am will have to investigate
> this.  Thank you for your time and help.

Btw, this part of the backtrace:

> /usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x1f0cc1)[0x55e34b542cc1]
> /usr/local/libexec/emacs/28.0.50/x86_64-pc-linux-gnu/../../../../bin/../lib/emacs/28.0.50/native-lisp/28.0.50-f294808a/preloaded/startup-bbc6ea72-3a1d4504.eln(F636f6d6d616e642d6c696e652d31_command_line_1_0+0xad3)[0x7ff2918cf923]
> /usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x1f0e73)[0x55e34b542e73]
> /usr/local/libexec/emacs/28.0.50/x86_64-pc-linux-gnu/../../../../bin/../lib/emacs/28.0.50/native-lisp/28.0.50-f294808a/preloaded/startup-bbc6ea72-3a1d4504.eln(F636f6d6d616e642d6c696e65_command_line_0+0x17a2)[0x7ff2918c8512]
> /usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x1f0e73)[0x55e34b542e73]
> /usr/local/libexec/emacs/28.0.50/x86_64-pc-linux-gnu/../../../../bin/../lib/emacs/28.0.50/native-lisp/28.0.50-f294808a/preloaded/startup-bbc6ea72-3a1d4504.eln(F6e6f726d616c2d746f702d6c6576656c_normal_top_level_0+0xfca)[0x7ff2918c4fca]
> /usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x1f4ce8)[0x55e34b546ce8]

clearly indicates that Emacs did find the preloaded *.eln files, and
the place where it found them was the correct one.  So it really could
be that the crash and/or the failures of dired-async-mode have nothing
to do with the code which looks for the *.eln files, but with
something entirely different.

bug#46790: 28.0.50; make install with native-comp branch

[Thierry Volpiatto]

[-- Attachment #1: Type: text/plain, Size: 1783 bytes --]


Eli Zaretskii <eliz@gnu.org> writes:

>> From: Thierry Volpiatto <thievol@posteo.net>
>> Cc: akrl@sdf.org, psainty@orcon.net.nz, 46790@debbugs.gnu.org
>> Date: Sat, 24 Apr 2021 12:47:17 +0000
>> 
>> > Wait a minute: you are saying that starting "emacs" with your
>> > installation works well, and the problem happens only when you use the
>> > dired-async-mode?
>> 
>> Yes.
>
> But below you say:
>
>> > or are they shown when you start your interactive Emacs session?
>> 
>> The interactive session.
>
> So now I'm completely confused.  I don't think I understand whether
> Emacs fails to start interactively, or it starts and then
> dired-async-mode fails because invoking an inferior Emacs in batch
> mode fails (or crashes, see below).
>
>> However if it may help, it seems the process buffer is created, and then
>> the process (emacs) never start, here the contents of the "*emacs*"
>> buffer (emacs started with "./emacs" from /usr/local/sbin/emacs-28.0.50 directory):
>> 
>> Lisp expression: Backtrace:
>> /usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x17a324)[0x55e34b4cc324]
>> /usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x46299)[0x55e34b398299]
>> /usr/local/sbin/emacs-28.0.50/emacs-28.0.50(+0x469fa)[0x55e34b3989fa]
>> /lib/x86_64-linux-gnu/libpthread.so.0(+0x12980)[0x7ff2a34b1980]
>
> This is a backtrace from an abort or crash.  Even more weird.
>
> I installed some change that might fix the problem.  If not, I'm
> afraid someone else who is smarter than I am will have to investigate
> this.  Thank you for your time and help.

Just tried and it still the same.
Probably we should start back from where it was working for me with my
symlink workaround and see why it was working like this and not now?

-- 
Thierry

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 686 bytes --]

bug#46790: 28.0.50; make install with native-comp branch

[Eli Zaretskii]

> From: Thierry Volpiatto <thievol@posteo.net>
> Cc: akrl@sdf.org, psainty@orcon.net.nz, 46790@debbugs.gnu.org
> Date: Sat, 24 Apr 2021 13:58:06 +0000
> 
> > I installed some change that might fix the problem.  If not, I'm
> > afraid someone else who is smarter than I am will have to investigate
> > this.  Thank you for your time and help.
> 
> Just tried and it still the same.

Thanks for trying.

> Probably we should start back from where it was working for me with my
> symlink workaround and see why it was working like this and not now?

Can you show the full "ln -s" command which created that symlink?

bug#46790: 28.0.50; make install with native-comp branch

[Thierry Volpiatto]

[-- Attachment #1: Type: text/plain, Size: 1730 bytes --]


Eli Zaretskii <eliz@gnu.org> writes:

>> From: Thierry Volpiatto <thievol@posteo.net>
>> Cc: akrl@sdf.org, psainty@orcon.net.nz, 46790@debbugs.gnu.org
>> Date: Sat, 24 Apr 2021 13:58:06 +0000
>> 
>> > I installed some change that might fix the problem.  If not, I'm
>> > afraid someone else who is smarter than I am will have to investigate
>> > this.  Thank you for your time and help.
>> 
>> Just tried and it still the same.
>
> Thanks for trying.
>
>> Probably we should start back from where it was working for me with my
>> symlink workaround and see why it was working like this and not now?
>
> Can you show the full "ln -s" command which created that symlink?

So lets restart from beginning:

I rebuilded emacs starting at b064ddd3f60 and trying to copy a file
with dired-async, it fails with error in process buffer "*emacs*" with:

emacs:
/usr/local/sbin/emacs-28.0.50/../native-lisp/28.0.50-2f134e58/preloaded/window-0d1b8b93-581f9fcd.eln:
cannot open shared object file: No such file or directory

Then I do the symlink (here from /usr/local/sbin/ directory):

sudo ln -s /usr/local/lib/emacs/28.0.50/native-lisp/ .

And now I can copy a file from dired-async with no error even without
restarting emacs. If you want to reproduce you can bypass dired-async
and use something like this much simpler which avoid possible errors
from something else and need no configuration:

    (async-start
     (lambda ()
       (copy-file "~/.emacs.d/init.el" "~/tmp/")))

you should have now a buffer "*emacs*" with same contents as above.

then make the symlink as described above and run the same snippet, you
should see your init file copied.

Hope that helps.

-- 
Thierry

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 686 bytes --]

bug#46790: 28.0.50; make install with native-comp branch

[Eli Zaretskii]

> From: Thierry Volpiatto <thievol@posteo.net>
> Cc: akrl@sdf.org, psainty@orcon.net.nz, 46790@debbugs.gnu.org
> Date: Sat, 24 Apr 2021 15:22:38 +0000
> 
> I rebuilded emacs starting at b064ddd3f60 and trying to copy a file
> with dired-async, it fails with error in process buffer "*emacs*" with:
> 
> emacs:
> /usr/local/sbin/emacs-28.0.50/../native-lisp/28.0.50-2f134e58/preloaded/window-0d1b8b93-581f9fcd.eln:
> cannot open shared object file: No such file or directory

That's too fast.  Let's make one step back.  Before you copy the file
with dired-async, you start the interactive Emacs session, right?  Or
do you start dired-async in batch mode directly from the shell prompt?

> Then I do the symlink (here from /usr/local/sbin/ directory):
> 
> sudo ln -s /usr/local/lib/emacs/28.0.50/native-lisp/ .
> 
> And now I can copy a file from dired-async with no error even without
> restarting emacs.

That's understandable with the code that was on the branch back then.
But the code have changed a lot (to support Emacs invocation via
symlinks), and it changed in a way that should have worked for you
even without the symlink to native-lisp/.  So what happens with the
branch HEAD if you start Emacs as "emacs -Q" when there's no symlink
in /usr/local/sbin/ to native-lisp/? does it start or does it crash or
does it display some error message and fails to start?

> If you want to reproduce you can bypass dired-async
> and use something like this much simpler which avoid possible errors
> from something else and need no configuration:
> 
>     (async-start
>      (lambda ()
>        (copy-file "~/.emacs.d/init.el" "~/tmp/")))
> 
> you should have now a buffer "*emacs*" with same contents as above.

This is a sexp you evaluate in a running Emacs session, right?  So how
did that running Emacs session start successfully if you say that you
needed the symlink to native-lisp/ ?

I'm sorry to ask so many questions, but I'm still in the dark wrt what
exactly do you do to reproduce the problem and what happens when you
do that.

bug#46790: 28.0.50; make install with native-comp branch

[Thierry Volpiatto]

[-- Attachment #1: Type: text/plain, Size: 3116 bytes --]


Eli Zaretskii <eliz@gnu.org> writes:

>> From: Thierry Volpiatto <thievol@posteo.net>
>> Cc: akrl@sdf.org, psainty@orcon.net.nz, 46790@debbugs.gnu.org
>> Date: Sat, 24 Apr 2021 15:22:38 +0000
>> 
>> I rebuilded emacs starting at b064ddd3f60 and trying to copy a file
>> with dired-async, it fails with error in process buffer "*emacs*" with:
>> 
>> emacs:
>> /usr/local/sbin/emacs-28.0.50/../native-lisp/28.0.50-2f134e58/preloaded/window-0d1b8b93-581f9fcd.eln:
>> cannot open shared object file: No such file or directory
>
> That's too fast.  Let's make one step back.  Before you copy the file
> with dired-async, you start the interactive Emacs session, right?

Yes from PATH with emacs which is a symlink in /usr/local/bin pointing
to /usr/local/sbin/emacs-28.0.50/emacs-28.0.50.

And yes emacs starts fine like this. And if I start it from 
/usr/local/sbin/emacs-28.0.50/emacs-28.0.50 with ./emacs it fails to
start with always the same error:

emacs: /usr/local/sbin/emacs-28.0.50/../native-lisp/28.0.50-2f134e58/preloaded/window-0d1b8b93-581f9fcd.eln: cannot open shared object file: No such file or directory

I also don't understand why emacs start from /usr/local/bin/emacs (the
symlink) but not directly from the true directory
/usr/local/sbin/emacs-28.0.50/emacs-28.0.50 with ./emacs.

> Or do you start dired-async in batch mode directly from the shell
> prompt?

No.

>> Then I do the symlink (here from /usr/local/sbin/ directory):
>> 
>> sudo ln -s /usr/local/lib/emacs/28.0.50/native-lisp/ .
>> 
>> And now I can copy a file from dired-async with no error even without
>> restarting emacs.
>
> That's understandable with the code that was on the branch back then.
> But the code have changed a lot (to support Emacs invocation via
> symlinks), and it changed in a way that should have worked for you
> even without the symlink to native-lisp/.  So what happens with the
> branch HEAD if you start Emacs as "emacs -Q" when there's no symlink
> in /usr/local/sbin/ to native-lisp/? does it start or does it crash or
> does it display some error message and fails to start?

Yes it starts.
But then fails with dired-async with and without the native-lisp/ symlink.

>> If you want to reproduce you can bypass dired-async
>> and use something like this much simpler which avoid possible errors
>> from something else and need no configuration:
>> 
>>     (async-start
>>      (lambda ()
>>        (copy-file "~/.emacs.d/init.el" "~/tmp/")))
>> 
>> you should have now a buffer "*emacs*" with same contents as above.
>
> This is a sexp you evaluate in a running Emacs session, right?

Yes.

> So how did that running Emacs session start successfully if you say
> that you needed the symlink to native-lisp/ ?

As said above it starts fine from /usr/local/bin but fails from
/usr/local/sbin/emacs-28.0.50/emacs-28.0.50 and running ./emacs.

> I'm sorry to ask so many questions, but I'm still in the dark wrt what
> exactly do you do to reproduce the problem and what happens when you
> do that.

No problems.

-- 
Thierry

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 686 bytes --]

bug#46790: 28.0.50; make install with native-comp branch

[Eli Zaretskii]

> From: Thierry Volpiatto <thievol@posteo.net>
> Cc: akrl@sdf.org, psainty@orcon.net.nz, 46790@debbugs.gnu.org
> Date: Sat, 24 Apr 2021 16:20:41 +0000
> 
> > So how did that running Emacs session start successfully if you say
> > that you needed the symlink to native-lisp/ ?
> 
> As said above it starts fine from /usr/local/bin but fails from
> /usr/local/sbin/emacs-28.0.50/emacs-28.0.50 and running ./emacs.

Is this the latest branch HEAD?  If so, it should display 2 lines
instead of one when it fails to find the *.eln files.  I need to see
both of those two lines.

If the above is not with the branch HEAD, please do build and install
the latest branch.  The code changes since b064ddd3f60 are needed for
other use cases, so we won't revert them.  We need to understand why
the latest code doesn't work for you.

Thanks.

bug#46790: 28.0.50; make install with native-comp branch

[Eli Zaretskii]

Earlier you said:

> >> >   . where is the .pdmp file?
> >> 
> >> Didn't find such file.
> >
> > It should be under /usr/local/libexec, please try finding it.
> 
> Got it.
> 
> /usr/local/libexec/emacs/28.0.50/x86_64-pc-linux-gnu/emacs.pdmp

Is that the only place where you have the emacs.pdmp file that
corresponds to that Emacs binary?  Or do you have another copy
somewhere else?

bug#46790: 28.0.50; make install with native-comp branch

[Thierry Volpiatto]

[-- Attachment #1: Type: text/plain, Size: 980 bytes --]


Eli Zaretskii <eliz@gnu.org> writes:

>> From: Thierry Volpiatto <thievol@posteo.net>
>> Cc: akrl@sdf.org, psainty@orcon.net.nz, 46790@debbugs.gnu.org
>> Date: Sat, 24 Apr 2021 16:20:41 +0000
>> 
>> > So how did that running Emacs session start successfully if you say
>> > that you needed the symlink to native-lisp/ ?
>> 
>> As said above it starts fine from /usr/local/bin but fails from
>> /usr/local/sbin/emacs-28.0.50/emacs-28.0.50 and running ./emacs.
>
> Is this the latest branch HEAD?

No b064ddd3f60.

> If so, it should display 2 lines instead of one when it fails to find
> the *.eln files.  I need to see both of those two lines.
>
> If the above is not with the branch HEAD, please do build and install
> the latest branch.  The code changes since b064ddd3f60 are needed for
> other use cases, so we won't revert them.  We need to understand why
> the latest code doesn't work for you.

Ok, will do tomorrow.

Thanks.


-- 
Thierry

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 686 bytes --]

bug#46790: 28.0.50; make install with native-comp branch

[Thierry Volpiatto]

[-- Attachment #1: Type: text/plain, Size: 737 bytes --]


Eli Zaretskii <eliz@gnu.org> writes:

> Earlier you said:
>
>> >> >   . where is the .pdmp file?
>> >> 
>> >> Didn't find such file.
>> >
>> > It should be under /usr/local/libexec, please try finding it.
>> 
>> Got it.
>> 
>> /usr/local/libexec/emacs/28.0.50/x86_64-pc-linux-gnu/emacs.pdmp
>
> Is that the only place where you have the emacs.pdmp file that
> corresponds to that Emacs binary?  Or do you have another copy
> somewhere else?

Only one for each emacs except 26* ones but they are not using this
mechanism (pdumper) isn't it? 

libexec/emacs/27.1/x86_64-pc-linux-gnu/emacs.pdmp
libexec/emacs/27.2/x86_64-pc-linux-gnu/emacs.pdmp
libexec/emacs/28.0.50/x86_64-pc-linux-gnu/emacs.pdmp

-- 
Thierry

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 686 bytes --]

bug#46790: 28.0.50; make install with native-comp branch

[Eli Zaretskii]

> From: Thierry Volpiatto <thievol@posteo.net>
> Cc: akrl@sdf.org, psainty@orcon.net.nz, 46790@debbugs.gnu.org
> Date: Sat, 24 Apr 2021 17:39:01 +0000
> 
> >> /usr/local/libexec/emacs/28.0.50/x86_64-pc-linux-gnu/emacs.pdmp
> >
> > Is that the only place where you have the emacs.pdmp file that
> > corresponds to that Emacs binary?  Or do you have another copy
> > somewhere else?
> 
> Only one for each emacs except 26* ones but they are not using this
> mechanism (pdumper) isn't it? 
> 
> libexec/emacs/27.1/x86_64-pc-linux-gnu/emacs.pdmp
> libexec/emacs/27.2/x86_64-pc-linux-gnu/emacs.pdmp
> libexec/emacs/28.0.50/x86_64-pc-linux-gnu/emacs.pdmp

Surely, you have at least one more in the directory where you built
Emacs?  Or did you remove that directory after building?

bug#46790: 28.0.50; make install with native-comp branch

[Thierry Volpiatto]

[-- Attachment #1: Type: text/plain, Size: 969 bytes --]


Eli Zaretskii <eliz@gnu.org> writes:

>> From: Thierry Volpiatto <thievol@posteo.net>
>> Cc: akrl@sdf.org, psainty@orcon.net.nz, 46790@debbugs.gnu.org
>> Date: Sat, 24 Apr 2021 17:39:01 +0000
>> 
>> >> /usr/local/libexec/emacs/28.0.50/x86_64-pc-linux-gnu/emacs.pdmp
>> >
>> > Is that the only place where you have the emacs.pdmp file that
>> > corresponds to that Emacs binary?  Or do you have another copy
>> > somewhere else?
>> 
>> Only one for each emacs except 26* ones but they are not using this
>> mechanism (pdumper) isn't it? 
>> 
>> libexec/emacs/27.1/x86_64-pc-linux-gnu/emacs.pdmp
>> libexec/emacs/27.2/x86_64-pc-linux-gnu/emacs.pdmp
>> libexec/emacs/28.0.50/x86_64-pc-linux-gnu/emacs.pdmp
>
> Surely, you have at least one more in the directory where you built
> Emacs?

No, there is no such file there, where should it be located normally?

> Or did you remove that directory after building?

No I kept it.


-- 
Thierry

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 686 bytes --]

bug#46790: 28.0.50; make install with native-comp branch

[Eli Zaretskii]

> From: Thierry Volpiatto <thievol@posteo.net>
> Cc: akrl@sdf.org, psainty@orcon.net.nz, 46790@debbugs.gnu.org
> Date: Sat, 24 Apr 2021 18:06:29 +0000
> 
> >> libexec/emacs/27.1/x86_64-pc-linux-gnu/emacs.pdmp
> >> libexec/emacs/27.2/x86_64-pc-linux-gnu/emacs.pdmp
> >> libexec/emacs/28.0.50/x86_64-pc-linux-gnu/emacs.pdmp
> >
> > Surely, you have at least one more in the directory where you built
> > Emacs?
> 
> No, there is no such file there, where should it be located normally?

In the src directory, where you have the Emacs executable.

bug#46790: 28.0.50; make install with native-comp branch

[Thierry Volpiatto]

[-- Attachment #1: Type: text/plain, Size: 827 bytes --]


Eli Zaretskii <eliz@gnu.org> writes:

>> From: Thierry Volpiatto <thievol@posteo.net>
>> Cc: akrl@sdf.org, psainty@orcon.net.nz, 46790@debbugs.gnu.org
>> Date: Sat, 24 Apr 2021 18:06:29 +0000
>> 
>> >> libexec/emacs/27.1/x86_64-pc-linux-gnu/emacs.pdmp
>> >> libexec/emacs/27.2/x86_64-pc-linux-gnu/emacs.pdmp
>> >> libexec/emacs/28.0.50/x86_64-pc-linux-gnu/emacs.pdmp
>> >
>> > Surely, you have at least one more in the directory where you built
>> > Emacs?
>> 
>> No, there is no such file there, where should it be located normally?
>
> In the src directory, where you have the Emacs executable.

Yes, there is 3 such files in src/, couldn't find them because my search
tool was ignoring files which are in .gitignore.

src/bootstrap-emacs.pdmp
src/emacs-28.0.50.1.pdmp
src/emacs.pdmp

-- 
Thierry

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 686 bytes --]

bug#46790: 28.0.50; make install with native-comp branch

[Eli Zaretskii]

> From: Thierry Volpiatto <thievol@posteo.net>
> Cc: akrl@sdf.org, psainty@orcon.net.nz, 46790@debbugs.gnu.org
> Date: Sun, 25 Apr 2021 04:29:14 +0000
> 
> >> >> libexec/emacs/27.1/x86_64-pc-linux-gnu/emacs.pdmp
> >> >> libexec/emacs/27.2/x86_64-pc-linux-gnu/emacs.pdmp
> >> >> libexec/emacs/28.0.50/x86_64-pc-linux-gnu/emacs.pdmp
> >> >
> >> > Surely, you have at least one more in the directory where you built
> >> > Emacs?
> >> 
> >> No, there is no such file there, where should it be located normally?
> >
> > In the src directory, where you have the Emacs executable.
> 
> Yes, there is 3 such files in src/, couldn't find them because my search
> tool was ignoring files which are in .gitignore.
> 
> src/bootstrap-emacs.pdmp
> src/emacs-28.0.50.1.pdmp
> src/emacs.pdmp

And these or their directories are not symlinked from somewhere else?

I'm asking because the current code on the branch looks for the
native-lisp directory relatively to the directory of the .pdmp file,
so if Emacs picks up the .pdmp file from some unexpected directory,
perhaps via a symlink, it could decide to look for native-lisp in the
wrong place.

bug#46790: 28.0.50; make install with native-comp branch

[Thierry Volpiatto]

[-- Attachment #1: Type: text/plain, Size: 1006 bytes --]


Eli Zaretskii <eliz@gnu.org> writes:

>> From: Thierry Volpiatto <thievol@posteo.net>
>> Cc: akrl@sdf.org, psainty@orcon.net.nz, 46790@debbugs.gnu.org
>> Date: Sun, 25 Apr 2021 04:29:14 +0000
>> 
>> >> >> libexec/emacs/27.1/x86_64-pc-linux-gnu/emacs.pdmp
>> >> >> libexec/emacs/27.2/x86_64-pc-linux-gnu/emacs.pdmp
>> >> >> libexec/emacs/28.0.50/x86_64-pc-linux-gnu/emacs.pdmp
>> >> >
>> >> > Surely, you have at least one more in the directory where you built
>> >> > Emacs?
>> >> 
>> >> No, there is no such file there, where should it be located normally?
>> >
>> > In the src directory, where you have the Emacs executable.
>> 
>> Yes, there is 3 such files in src/, couldn't find them because my search
>> tool was ignoring files which are in .gitignore.
>> 
>> src/bootstrap-emacs.pdmp
>> src/emacs-28.0.50.1.pdmp
>> src/emacs.pdmp
>
> And these or their directories are not symlinked from somewhere else?

No these and their directories are not symlinks.

-- 
Thierry

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 686 bytes --]

bug#46790: 28.0.50; make install with native-comp branch

[Eli Zaretskii]

> From: Thierry Volpiatto <thievol@posteo.net>
> Cc: akrl@sdf.org, psainty@orcon.net.nz, 46790@debbugs.gnu.org
> Date: Sun, 25 Apr 2021 12:07:29 +0000
> 
> >> src/bootstrap-emacs.pdmp
> >> src/emacs-28.0.50.1.pdmp
> >> src/emacs.pdmp
> >
> > And these or their directories are not symlinked from somewhere else?
> 
> No these and their directories are not symlinks.

I'm afraid I'm out of ideas, then.

Would it be possible for you to give me an ssh login on your machine
and set up a guest account where I could run Emacs produced from that
branch's HEAD under GDB?  I'd need an unstripped binary of Emacs
installed as you do and access to the source tree identical to one you
used to build the branch.  I assume the same problem happens with
"emacs -nw", so I will not need any X forwarding support.

If this is possible, I think debugging of this tricky issue will be
much easier and more efficient, and will yield a solution faster.

TIA

bug#46790: 28.0.50; make install with native-comp branch

[Thierry Volpiatto]

[-- Attachment #1: Type: text/plain, Size: 1111 bytes --]


Eli Zaretskii <eliz@gnu.org> writes:

>> From: Thierry Volpiatto <thievol@posteo.net>
>> Cc: akrl@sdf.org, psainty@orcon.net.nz, 46790@debbugs.gnu.org
>> Date: Sat, 24 Apr 2021 16:20:41 +0000
>> 
>> > So how did that running Emacs session start successfully if you say
>> > that you needed the symlink to native-lisp/ ?
>> 
>> As said above it starts fine from /usr/local/bin but fails from
>> /usr/local/sbin/emacs-28.0.50/emacs-28.0.50 and running ./emacs.
>
> Is this the latest branch HEAD?  If so, it should display 2 lines
> instead of one when it fails to find the *.eln files.  I need to see
> both of those two lines.
>
> If the above is not with the branch HEAD, please do build and install
> the latest branch.  The code changes since b064ddd3f60 are needed for
> other use cases, so we won't revert them.  We need to understand why
> the latest code doesn't work for you.

I am back with the branch at HEAD, as I said before, I can't have the
error lines you ask because there is no more error at startup, only when
using async-start or dired-async, sorry.

-- 
Thierry

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 686 bytes --]

bug#46790: 28.0.50; make install with native-comp branch

[Eli Zaretskii]

> From: Thierry Volpiatto <thievol@posteo.net>
> Cc: akrl@sdf.org, psainty@orcon.net.nz, 46790@debbugs.gnu.org
> Date: Sun, 25 Apr 2021 13:14:23 +0000
> 
> > If the above is not with the branch HEAD, please do build and install
> > the latest branch.  The code changes since b064ddd3f60 are needed for
> > other use cases, so we won't revert them.  We need to understand why
> > the latest code doesn't work for you.
> 
> I am back with the branch at HEAD, as I said before, I can't have the
> error lines you ask because there is no more error at startup, only when
> using async-start or dired-async, sorry.

OK.  So the interactive session starts as expected, whether you invoke
Emacs by "emacs" via PAYH or by its explicit absolute file name
/usr/local/sbin/emacs-28.0.50/emacs-28.0.50 or by going into
/usr/local/sbin/emacs-28.0.50 and typing "./emacs", right?  So I think
there's progress.

I will see what can be done to understand why async-start fails.

In any case, what error messages do you see with async-start now? can
you show those messages in their entirety?

Thanks.

bug#46790: 28.0.50; make install with native-comp branch

[Thierry Volpiatto]

[-- Attachment #1: Type: text/plain, Size: 1287 bytes --]


Eli Zaretskii <eliz@gnu.org> writes:

>> From: Thierry Volpiatto <thievol@posteo.net>
>> Cc: akrl@sdf.org, psainty@orcon.net.nz, 46790@debbugs.gnu.org
>> Date: Sun, 25 Apr 2021 13:14:23 +0000
>> 
>> > If the above is not with the branch HEAD, please do build and install
>> > the latest branch.  The code changes since b064ddd3f60 are needed for
>> > other use cases, so we won't revert them.  We need to understand why
>> > the latest code doesn't work for you.
>> 
>> I am back with the branch at HEAD, as I said before, I can't have the
>> error lines you ask because there is no more error at startup, only when
>> using async-start or dired-async, sorry.
>
> OK.  So the interactive session starts as expected, whether you invoke
> Emacs by "emacs" via PAYH or by its explicit absolute file name
> /usr/local/sbin/emacs-28.0.50/emacs-28.0.50 or by going into
> /usr/local/sbin/emacs-28.0.50 and typing "./emacs", right?  So I think
> there's progress.
>
> I will see what can be done to understand why async-start fails.
>
> In any case, what error messages do you see with async-start now? can
> you show those messages in their entirety?

Nothing more helpful than the output in *emacs* buffer process I sent
previously.

Thanks.


-- 
Thierry

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 686 bytes --]

bug#46790: 28.0.50; make install with native-comp branch

[Phil Sainty]

On 26/04/21 1:28 am, Eli Zaretskii wrote:
> In any case, what error messages do you see with async-start now?
> can you show those messages in their entirety?

Perhaps something like this will help?

emacs --batch -f package-initialize -l async \
  --eval "(message \"%s\" (executable-find \"emacs\"))" \
  --eval "(pp (async-get (async-start (lambda ()
          (list comp-eln-load-path (pdumper-stats))))))"

bug#46790: 28.0.50; make install with native-comp branch

[Eli Zaretskii]

> From: Thierry Volpiatto <thievol@posteo.net>
> Cc: akrl@sdf.org, psainty@orcon.net.nz, 46790@debbugs.gnu.org
> Date: Sun, 25 Apr 2021 14:02:07 +0000
> 
> > In any case, what error messages do you see with async-start now? can
> > you show those messages in their entirety?
> 
> Nothing more helpful than the output in *emacs* buffer process I sent
> previously.

So the async-start invocation crashes with a backtrace?  And the file
names of the *.eln files shown in the backtrace are the correct file
names?

bug#46790: 28.0.50; make install with native-comp branch

[Thierry Volpiatto]

[-- Attachment #1: Type: text/plain, Size: 721 bytes --]


Eli Zaretskii <eliz@gnu.org> writes:

>> From: Thierry Volpiatto <thievol@posteo.net>
>> Cc: akrl@sdf.org, psainty@orcon.net.nz, 46790@debbugs.gnu.org
>> Date: Sun, 25 Apr 2021 12:07:29 +0000
>> 
>> >> src/bootstrap-emacs.pdmp
>> >> src/emacs-28.0.50.1.pdmp
>> >> src/emacs.pdmp
>> >
>> > And these or their directories are not symlinked from somewhere else?
>> 
>> No these and their directories are not symlinks.
>
> I'm afraid I'm out of ideas, then.
>
> Would it be possible for you to give me an ssh login on your machine
> and set up a guest account where I could run Emacs produced from that
> branch's HEAD under GDB?

I will try to setup an account next week.

Thanks.


-- 
Thierry

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 686 bytes --]

bug#46790: 28.0.50; make install with native-comp branch

[Eli Zaretskii]

> Cc: 46790@debbugs.gnu.org, akrl@sdf.org
> From: Phil Sainty <psainty@orcon.net.nz>
> Date: Mon, 26 Apr 2021 02:28:08 +1200
> 
> On 26/04/21 1:28 am, Eli Zaretskii wrote:
> > In any case, what error messages do you see with async-start now?
> > can you show those messages in their entirety?
> 
> Perhaps something like this will help?
> 
> emacs --batch -f package-initialize -l async \
>   --eval "(message \"%s\" (executable-find \"emacs\"))" \
>   --eval "(pp (async-get (async-start (lambda ()
>           (list comp-eln-load-path (pdumper-stats))))))"

If my reading of async.el is correct, it invoces the inferior Emacs
like this:

    (setq async--procvar
          (async-start-process
           "emacs" (file-truename
                    (expand-file-name invocation-name
                                      invocation-directory))
           finish-func
           async-quiet-switch "-l"
           ;; Using `locate-library' ensure we use the right file
           ;; when the .elc have been deleted.
           (locate-library "async")
           "-batch" "-f" "async-batch-invoke"
           (if async-send-over-pipe
               "<none>"
             (with-temp-buffer
               (async--insert-sexp (list 'quote sexp)) (buffer-string)))))

Thierry, what does the below yield in the interactive session from
which you invoke async-start?

  M-: (file-truename (expand-file-name invocation-name invocation-directory)) RET

bug#46790: 28.0.50; make install with native-comp branch

[Thierry Volpiatto]

[-- Attachment #1: Type: text/plain, Size: 1941 bytes --]


Eli Zaretskii <eliz@gnu.org> writes:

>> Cc: 46790@debbugs.gnu.org, akrl@sdf.org
>> From: Phil Sainty <psainty@orcon.net.nz>
>> Date: Mon, 26 Apr 2021 02:28:08 +1200
>> 
>> On 26/04/21 1:28 am, Eli Zaretskii wrote:
>> > In any case, what error messages do you see with async-start now?
>> > can you show those messages in their entirety?
>> 
>> Perhaps something like this will help?
>> 
>> emacs --batch -f package-initialize -l async \
>>   --eval "(message \"%s\" (executable-find \"emacs\"))" \
>>   --eval "(pp (async-get (async-start (lambda ()
>>           (list comp-eln-load-path (pdumper-stats))))))"
>
> If my reading of async.el is correct, it invoces the inferior Emacs
> like this:
>
>     (setq async--procvar
>           (async-start-process
>            "emacs" (file-truename
>                     (expand-file-name invocation-name
>                                       invocation-directory))
>            finish-func
>            async-quiet-switch "-l"
>            ;; Using `locate-library' ensure we use the right file
>            ;; when the .elc have been deleted.
>            (locate-library "async")
>            "-batch" "-f" "async-batch-invoke"
>            (if async-send-over-pipe
>                "<none>"
>              (with-temp-buffer
>                (async--insert-sexp (list 'quote sexp)) (buffer-string)))))
>
> Thierry, what does the below yield in the interactive session from
> which you invoke async-start?
>
>   M-: (file-truename (expand-file-name invocation-name invocation-directory)) RET

With my emacs started from PATH with "emacs" where emacs is a symlink:

    /usr/local/sbin/emacs-28.0.50/emacs-28.0.50

which is the correct path:

    (expand-file-name invocation-name invocation-directory)

==>/usr/local/bin/emacs

    (file-truename "/usr/local/bin/emacs")

==> /usr/local/sbin/emacs-28.0.50/emacs-28.0.50

-- 
Thierry

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 686 bytes --]

bug#46790: 28.0.50; make install with native-comp branch

[Eli Zaretskii]

> From: Thierry Volpiatto <thievol@posteo.net>
> Cc: Phil Sainty <psainty@orcon.net.nz>, 46790@debbugs.gnu.org, akrl@sdf.org
> Date: Sun, 25 Apr 2021 18:21:41 +0000
> 
> >   M-: (file-truename (expand-file-name invocation-name invocation-directory)) RET
> 
> With my emacs started from PATH with "emacs" where emacs is a symlink:
> 
>     /usr/local/sbin/emacs-28.0.50/emacs-28.0.50
> 
> which is the correct path:
> 
>     (expand-file-name invocation-name invocation-directory)
> 
> ==>/usr/local/bin/emacs
> 
>     (file-truename "/usr/local/bin/emacs")
> 
> ==> /usr/local/sbin/emacs-28.0.50/emacs-28.0.50

This is the same executable file name using which to start the
interactive session does work, as far as I remember.  So I don't
understand why async-start crashes, sounds like an unrelated issue
with the native-comp feature.

bug#46790: 28.0.50; make install with native-comp branch

[Thierry Volpiatto]

[-- Attachment #1: Type: text/plain, Size: 1053 bytes --]


Eli Zaretskii <eliz@gnu.org> writes:

>> From: Thierry Volpiatto <thievol@posteo.net>
>> Cc: Phil Sainty <psainty@orcon.net.nz>, 46790@debbugs.gnu.org, akrl@sdf.org
>> Date: Sun, 25 Apr 2021 18:21:41 +0000
>> 
>> >   M-: (file-truename (expand-file-name invocation-name invocation-directory)) RET
>> 
>> With my emacs started from PATH with "emacs" where emacs is a symlink:
>> 
>>     /usr/local/sbin/emacs-28.0.50/emacs-28.0.50
>> 
>> which is the correct path:
>> 
>>     (expand-file-name invocation-name invocation-directory)
>> 
>> ==>/usr/local/bin/emacs
>> 
>>     (file-truename "/usr/local/bin/emacs")
>> 
>> ==> /usr/local/sbin/emacs-28.0.50/emacs-28.0.50
>
> This is the same executable file name using which to start the
> interactive session does work, as far as I remember.  So I don't
> understand why async-start crashes, sounds like an unrelated issue
> with the native-comp feature.

Don't know, I will try to build another emacs without native comp to see
if I can reproduce the bug.


-- 
Thierry

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 686 bytes --]

bug#46790: 28.0.50; make install with native-comp branch

[Thierry Volpiatto]

[-- Attachment #1: Type: text/plain, Size: 1700 bytes --]


Eli Zaretskii <eliz@gnu.org> writes:

>> From: Thierry Volpiatto <thievol@posteo.net>
>> Cc: Phil Sainty <psainty@orcon.net.nz>, 46790@debbugs.gnu.org, akrl@sdf.org
>> Date: Sun, 25 Apr 2021 18:21:41 +0000
>> 
>> >   M-: (file-truename (expand-file-name invocation-name invocation-directory)) RET
>> 
>> With my emacs started from PATH with "emacs" where emacs is a symlink:
>> 
>>     /usr/local/sbin/emacs-28.0.50/emacs-28.0.50
>> 
>> which is the correct path:
>> 
>>     (expand-file-name invocation-name invocation-directory)
>> 
>> ==>/usr/local/bin/emacs
>> 
>>     (file-truename "/usr/local/bin/emacs")
>> 
>> ==> /usr/local/sbin/emacs-28.0.50/emacs-28.0.50
>
> This is the same executable file name using which to start the
> interactive session does work, as far as I remember.  So I don't
> understand why async-start crashes, sounds like an unrelated issue
> with the native-comp feature.

I found what was wrong in dired-async :-), it was a simple paren error
in a condition-case which is here since years and emacs up to recent
changes in master never detect.
What confused me is that initialy dired-async failed in the same way due
to the symlink bug I reported, then you made some change to fix this
symlink problem but in the same time, a change occur that doesn't
support condition-case with such paren error!

Before:

    (condition-case err
       (some-code)
     (file-error (handle-error-code))
     nil)

Now:

    (condition-case err
       (some-code)
     (file-error (handle-error-code) nil))

I didn't try with native-compilation yet, but it should work.

Thanks and sorry to take your time on this.

-- 
Thierry

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 686 bytes --]

bug#46790: 28.0.50; make install with native-comp branch

[Lars Ingebrigtsen]

Thierry Volpiatto <thievol@posteo.net> writes:

> I found what was wrong in dired-async :-), it was a simple paren error
> in a condition-case which is here since years and emacs up to recent
> changes in master never detect.

[...]

> I didn't try with native-compilation yet, but it should work.
>
> Thanks and sorry to take your time on this.

(I'm going through old bug reports that unfortunately weren't resolved
at the time.)

This was a long thread, and I only lightly skimmed it, but does this
mean that things work fine for you now, and this bug report can be
closed?

-- 
(domestic pets only, the antidote for overdose, milk.)
   bloggy blog: http://lars.ingebrigtsen.no

bug#46790: 28.0.50; make install with native-comp branch

[Thierry Volpiatto]

[-- Attachment #1: Type: text/plain, Size: 747 bytes --]


Lars Ingebrigtsen <larsi@gnus.org> writes:

> Thierry Volpiatto <thievol@posteo.net> writes:
>
>> I found what was wrong in dired-async :-), it was a simple paren error
>> in a condition-case which is here since years and emacs up to recent
>> changes in master never detect.
>
> [...]
>
>> I didn't try with native-compilation yet, but it should work.
>>
>> Thanks and sorry to take your time on this.
>
> (I'm going through old bug reports that unfortunately weren't resolved
> at the time.)
>
> This was a long thread, and I only lightly skimmed it, but does this
> mean that things work fine for you now, and this bug report can be
> closed?

Don't remember the details, but yes it seems fixed, thanks.

-- 
Thierry

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 686 bytes --]

bug#46790: 28.0.50; make install with native-comp branch

[Lars Ingebrigtsen]

Thierry Volpiatto <thievol@posteo.net> writes:

> Don't remember the details, but yes it seems fixed, thanks.

Thanks; I'm closing this bug report, then.

-- 
(domestic pets only, the antidote for overdose, milk.)
   bloggy blog: http://lars.ingebrigtsen.no

bug#46790: 28.1; Bug#46790 reintroduced; Was make install with native-comp

[Thierry Volpiatto]

It seems bug#46790 has been reintroduced as I have this error when
running emacs after installing:

Error using execdir /usr/local/sbin/emacs-29.0.50/:
emacs: /usr/local/sbin/emacs-29.0.50/../native-lisp/29.0.50-ca991e8a/preloaded/window-0d1b8b93-0c17e2d3.eln: cannot open shared object file: No such file or directory

I fixed it by setting in my ~/.profile EMACSNATIVELOADPATH.

Thanks.


In GNU Emacs 28.1 (build 2, x86_64-pc-linux-gnu, Motif Version 2.3.8, cairo version 1.16.0)
 of 2022-04-20 built on IPad-S340
Windowing system distributor 'The X.Org Foundation', version 11.0.12013000
System Description: Linux Mint 20.3

Configured using:
 'configure CFLAGS=-O8 --with-mailutils --with-cairo --without-dbus
 --without-gconf --without-gsettings --with-x-toolkit=motif'

Configured features:
ACL CAIRO FREETYPE GIF GLIB GMP GNUTLS GPM HARFBUZZ JPEG JSON LCMS2
LIBOTF LIBSELINUX LIBSYSTEMD LIBXML2 M17N_FLT MODULES NOTIFY INOTIFY
PDUMPER PNG RSVG SECCOMP SOUND THREADS TIFF TOOLKIT_SCROLL_BARS X11 XDBE
XIM XPM MOTIF ZLIB

Important settings:
  value of $LANG: fr_FR.UTF-8
  locale-coding-system: utf-8-unix

Major mode: İĽ

Minor modes in effect:
  global-undo-tree-mode: t
  undo-tree-mode: t
  psession-mode: t
  psession-savehist-mode: t
  global-git-gutter-mode: t
  display-time-mode: t
  winner-mode: t
  helm-epa-mode: t
  helm-descbinds-mode: t
  helm-adaptive-mode: t
  helm-mode: t
  helm-minibuffer-history-mode: t
  helm-ff-icon-mode: t
  shell-dirtrack-mode: t
  helm-popup-tip-mode: t
  async-bytecomp-package-mode: t
  dired-async-mode: t
  minibuffer-depth-indicate-mode: t
  gcmh-mode: t
  override-global-mode: t
  tooltip-mode: t
  global-eldoc-mode: t
  eldoc-mode: t
  show-paren-mode: t
  mouse-wheel-mode: t
  file-name-shadow-mode: t
  global-font-lock-mode: t
  font-lock-mode: t
  auto-composition-mode: t
  auto-encryption-mode: t
  auto-compression-mode: t
  column-number-mode: t
  line-number-mode: t
  transient-mark-mode: t

Load-path shadows:
None found.

Features:
(shadow epa-mail face-remap tramp-cache qp sort gnus-cite mm-archive
smiley mail-extr view emacsbug helm-command emamux addressbook-bookmark
tv-mu4e-config org-mu4e mu4e-contrib mu4e-patch mu4e mu4e-org mu4e-view
gnus-art mm-uu mml2015 mm-view mml-smime smime dig gnus-sum gnus-group
gnus-undo gnus-start gnus-dbus gnus-cloud nnimap nnmail mail-source utf7
netrc nnoo gnus-spec gnus-int gnus-range gnus-win mu4e-main mu4e-headers
mu4e-compose mu4e-draft mu4e-actions smtpmail sendmail mu4e-search
mu4e-lists mu4e-bookmarks mu4e-mark mu4e-message shr kinsoku svg
flow-fill hl-line mu4e-contacts mu4e-update mu4e-folders mu4e-server
mu4e-context mu4e-vars mu4e-helpers mu4e-config ido char-fold esh-toggle
epa-file em-unix em-term term disp-table ehelp em-script em-prompt em-ls
em-hist em-pred em-glob em-cmpl em-dirs esh-var em-basic em-banner
em-alias esh-mode image-file image-converter tramp-archive tramp-gvfs
dbus helm-x-files helm-for-files vc-filewise vc-rcs conf-mode
ledger-config ledger-mode ledger-check ledger-texi ledger-test
ledger-sort ledger-report ledger-reconcile ledger-occur ledger-fonts
ledger-fontify ledger-state ledger-complete ledger-schedule ledger-init
ledger-xact ledger-post ledger-exec ledger-navigate eshell esh-cmd
esh-ext esh-opt esh-proc esh-io esh-arg esh-module esh-groups esh-util
ledger-context ledger-commodities ledger-regex cc-mode cc-fonts cc-guess
cc-menus cc-cmds cc-styles cc-align cc-engine cc-vars cc-defs make-mode
flymake-proc flymake project warnings jka-compr markdown-mode sh-script
smie executable bug-reference naquadah-theme solar cal-dst holidays
hol-loaddefs tv-utils osm dom yaml-mode undo-tree diff queue
rainbow-mode color psession frameset log-view pcvs-util pcmpl-git
cl-indent ffap thingatpt autocrypt-message message rmc puny rfc822 mml
mml-sec mm-decode mm-bodies mm-encode mail-parse rfc2231 mailabbrev
gmm-utils mailheader autocrypt-gnus gnus nnheader gnus-util rmail
rmail-loaddefs rfc2047 rfc2045 mail-utils mm-util mail-prsvr
autocrypt-mu4e autocrypt ietf-drums config-w3m git-gutter mule-util appt
diary-lib diary-loaddefs gud pcomplete-extension pcmpl-unix pcmpl-gnu
iterator pcase wdired dired-extension org-config ob-gnuplot org-crypt
net-utils time winner autotest-mode autoconf-mode woman man ediff
ediff-merg ediff-mult ediff-wind ediff-diff ediff-help ediff-init
ediff-util init-helm helm-ls-git vc-git diff-mode vc vc-dispatcher
helm-fd epa derived epg rfc6068 epg-config helm-epa helm-imenu imenu
helm-elisp-package helm-find helm-org org ob ob-tangle ob-ref ob-lob
ob-table ob-exp org-macro org-footnote org-src ob-comint org-pcomplete
org-list org-faces org-entities noutline outline org-version
ob-emacs-lisp ob-core ob-eval org-table oc-basic bibtex ol rx org-keys
oc org-compat advice org-macs org-loaddefs cal-menu calendar
cal-loaddefs helm-external isearch-light helm-descbinds helm-wikipedia
all-the-icons all-the-icons-faces data-material data-weathericons
data-octicons data-fileicons data-faicons data-alltheicons cus-edit
wid-edit helm-ipython helm-elisp helm-eval edebug backtrace find-func
python tramp-sh helm-bookmark helm-net xml helm-info bookmark pp
helm-adaptive helm-mode helm-misc helm-files image-dired image-mode exif
filenotify tramp tramp-loaddefs trampver tramp-integration files-x
tramp-compat shell pcomplete parse-time iso8601 time-date ls-lisp
helm-buffers helm-occur helm-tags helm-locate helm-grep wgrep-helm wgrep
grep compile text-property-search comint ring helm-regexp format-spec
ansi-color helm-utils helm-help helm-types helm-extensions-autoloads
helm-config helm-autoloads helm helm-global-bindings helm-easymenu
helm-core async-bytecomp helm-source helm-multi-match helm-lib
dired-async dired-aux dired dired-loaddefs async popup diminish mb-depth
server edmacro kmacro avoid cus-load gcmh cl-extra help-mode use-package
use-package-ensure use-package-delight use-package-diminish
use-package-bind-key bind-key easy-mmode use-package-core finder-inf
package browse-url url url-proxy url-privacy url-expand url-methods
url-history url-cookie url-domsuf url-util mailcap url-handlers
url-parse auth-source cl-seq eieio eieio-core cl-macs eieio-loaddefs
password-cache json subr-x map url-vars seq byte-opt gv bytecomp
byte-compile cconv cl-loaddefs cl-lib info w3m-load iso-transl tooltip
eldoc paren electric uniquify ediff-hook vc-hooks lisp-float-type
elisp-mode mwheel term/x-win x-win term/common-win x-dnd tool-bar dnd
fontset image regexp-opt fringe tabulated-list replace newcomment
text-mode lisp-mode prog-mode register page tab-bar menu-bar rfn-eshadow
isearch easymenu timer select scroll-bar mouse jit-lock font-lock syntax
font-core term/tty-colors frame minibuffer cl-generic cham georgian
utf-8-lang misc-lang vietnamese tibetan thai tai-viet lao korean
japanese eucjp-ms cp51932 hebrew greek romanian slovak czech european
ethiopic indian cyrillic chinese composite emoji-zwj charscript charprop
case-table epa-hook jka-cmpr-hook help simple abbrev obarray
cl-preloaded nadvice button loaddefs faces cus-face macroexp files
window text-properties overlay sha1 md5 base64 format env code-pages
mule custom widget hashtable-print-readable backquote threads inotify
lcms2 dynamic-setting font-render-setting cairo motif x-toolkit x
multi-tty make-network-process emacs)

Memory information:
((conses 16 887561 317113)
 (symbols 48 46354 6)
 (strings 32 261239 32455)
 (string-bytes 1 7342643)
 (vectors 16 92844)
 (vector-slots 8 2023229 350006)
 (floats 8 2595 1811)
 (intervals 56 49924 33094)
 (buffers 992 179))
<#secure method=pgpmime mode=sign>

-- 
Thierry

bug#46790: 28.1; Bug#46790 reintroduced; Was make install with native-comp

[Eli Zaretskii]

> From: Thierry Volpiatto <thievol@posteo.net>
> Date: Sun, 26 Jun 2022 05:39:45 +0000
> 
> 
> It seems bug#46790 has been reintroduced as I have this error when
> running emacs after installing:
> 
> Error using execdir /usr/local/sbin/emacs-29.0.50/:
> emacs: /usr/local/sbin/emacs-29.0.50/../native-lisp/29.0.50-ca991e8a/preloaded/window-0d1b8b93-0c17e2d3.eln: cannot open shared object file: No such file or directory

Please tell:

 . what is the directory where you installed the Emacs binary, the one
   invoked when you start Emacs "normally"
 . if that binary is a symlink, how is the symlink defined (is the
   file itself a symlink or is the directory a symlink?), and where
   does that symlink point
 . what is the directory where you have the pdumper file, and what is
   its name
 . if the pdumper file is itself a symlink, please provide the same
   details as for the Emacs binary
 . where is the native-lisp/ directory with the *.eln files produced
   during the build

In each case, please show the full absolute name of the files I'm
asking about.

Thanks.

bug#46790: 28.1; Bug#46790 reintroduced; Was make install with native-comp

[Eli Zaretskii]

> Cc: 46790@debbugs.gnu.org
> Date: Sun, 26 Jun 2022 08:52:31 +0300
> From: Eli Zaretskii <eliz@gnu.org>
> 
> > From: Thierry Volpiatto <thievol@posteo.net>
> > Date: Sun, 26 Jun 2022 05:39:45 +0000
> > 
> > 
> > It seems bug#46790 has been reintroduced as I have this error when
> > running emacs after installing:
> > 
> > Error using execdir /usr/local/sbin/emacs-29.0.50/:
> > emacs: /usr/local/sbin/emacs-29.0.50/../native-lisp/29.0.50-ca991e8a/preloaded/window-0d1b8b93-0c17e2d3.eln: cannot open shared object file: No such file or directory
> 
> Please tell:
> 
>  . what is the directory where you installed the Emacs binary, the one
>    invoked when you start Emacs "normally"
>  . if that binary is a symlink, how is the symlink defined (is the
>    file itself a symlink or is the directory a symlink?), and where
>    does that symlink point
>  . what is the directory where you have the pdumper file, and what is
>    its name
>  . if the pdumper file is itself a symlink, please provide the same
>    details as for the Emacs binary
>  . where is the native-lisp/ directory with the *.eln files produced
>    during the build
> 
> In each case, please show the full absolute name of the files I'm
> asking about.

In addition, please tell how you configured Emacs, i.e. please show
the full command line with which you invoked the configure script.

bug#46790: 28.1; Bug#46790 reintroduced; Was make install with native-comp

[Thierry Volpiatto]

[-- Attachment #1: Type: text/plain, Size: 1491 bytes --]


Eli Zaretskii <eliz@gnu.org> writes:

>> From: Thierry Volpiatto <thievol@posteo.net>
>> Date: Sun, 26 Jun 2022 05:39:45 +0000
>> 
>> 
>> It seems bug#46790 has been reintroduced as I have this error when
>> running emacs after installing:
>> 
>> Error using execdir /usr/local/sbin/emacs-29.0.50/:
>> emacs: /usr/local/sbin/emacs-29.0.50/../native-lisp/29.0.50-ca991e8a/preloaded/window-0d1b8b93-0c17e2d3.eln: cannot open shared object file: No such file or directory
>
> Please tell:

Nothing as changed since bug#46790 my installation is the same.

make install bindir=/usr/local/sbin/emacs-29.0.50 infodir=/usr/local/share/info-29.0.50

>  . what is the directory where you installed the Emacs binary, the one
>    invoked when you start Emacs "normally"

/usr/local/bin/emacs

>  . if that binary is a symlink, how is the symlink defined (is the
>    file itself a symlink or is the directory a symlink?), and where
>    does that symlink point

/usr/local/bin/emacs => /usr/local/sbin/emacs-29.0.50/emacs

>  . what is the directory where you have the pdumper file, and what is
>    its name

/usr/local/libexec/emacs/29.0.50/x86_64-pc-linux-gnu

>  . if the pdumper file is itself a symlink, please provide the same
>    details as for the Emacs binary

Not a symlink

>  . where is the native-lisp/ directory with the *.eln files produced
>    during the build

/usr/local/lib/emacs/29.0.50/native-lisp/29.0.50-ca991e8a


-- 
Thierry

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 686 bytes --]

bug#46790: 28.1; Bug#46790 reintroduced; Was make install with native-comp

[Thierry Volpiatto]

[-- Attachment #1: Type: text/plain, Size: 1574 bytes --]


Eli Zaretskii <eliz@gnu.org> writes:

>> Cc: 46790@debbugs.gnu.org
>> Date: Sun, 26 Jun 2022 08:52:31 +0300
>> From: Eli Zaretskii <eliz@gnu.org>
>> 
>> > From: Thierry Volpiatto <thievol@posteo.net>
>> > Date: Sun, 26 Jun 2022 05:39:45 +0000
>> > 
>> > 
>> > It seems bug#46790 has been reintroduced as I have this error when
>> > running emacs after installing:
>> > 
>> > Error using execdir /usr/local/sbin/emacs-29.0.50/:
>> > emacs: /usr/local/sbin/emacs-29.0.50/../native-lisp/29.0.50-ca991e8a/preloaded/window-0d1b8b93-0c17e2d3.eln: cannot open shared object file: No such file or directory
>> 
>> Please tell:
>> 
>>  . what is the directory where you installed the Emacs binary, the one
>>    invoked when you start Emacs "normally"
>>  . if that binary is a symlink, how is the symlink defined (is the
>>    file itself a symlink or is the directory a symlink?), and where
>>    does that symlink point
>>  . what is the directory where you have the pdumper file, and what is
>>    its name
>>  . if the pdumper file is itself a symlink, please provide the same
>>    details as for the Emacs binary
>>  . where is the native-lisp/ directory with the *.eln files produced
>>    during the build
>> 
>> In each case, please show the full absolute name of the files I'm
>> asking about.
>
> In addition, please tell how you configured Emacs, i.e. please show
> the full command line with which you invoked the configure script.

./configure CFLAGS='-O8' --with-mailutils --with-cairo --with-native-compilation

-- 
Thierry

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 686 bytes --]

bug#46790: 28.1; Bug#46790 reintroduced; Was make install with native-comp

[Eli Zaretskii]

> From: Thierry Volpiatto <thievol@posteo.net>
> Cc: 46790@debbugs.gnu.org
> Date: Sun, 26 Jun 2022 14:19:32 +0000
> 
> >> > Error using execdir /usr/local/sbin/emacs-29.0.50/:
> >> > emacs: /usr/local/sbin/emacs-29.0.50/../native-lisp/29.0.50-ca991e8a/preloaded/window-0d1b8b93-0c17e2d3.eln: cannot open shared object file: No such file or directory
> >> 
> >> Please tell:
> >> 
> >>  . what is the directory where you installed the Emacs binary, the one
> >>    invoked when you start Emacs "normally"
> >>  . if that binary is a symlink, how is the symlink defined (is the
> >>    file itself a symlink or is the directory a symlink?), and where
> >>    does that symlink point
> >>  . what is the directory where you have the pdumper file, and what is
> >>    its name
> >>  . if the pdumper file is itself a symlink, please provide the same
> >>    details as for the Emacs binary
> >>  . where is the native-lisp/ directory with the *.eln files produced
> >>    during the build
> >> 
> >> In each case, please show the full absolute name of the files I'm
> >> asking about.
> >
> > In addition, please tell how you configured Emacs, i.e. please show
> > the full command line with which you invoked the configure script.
> 
> ./configure CFLAGS='-O8' --with-mailutils --with-cairo --with-native-compilation

I think that's the problem: installing the binary in a directory other
than $execdir/bin needs to configure with --bindir accordingly set.
Emacs built with native compilation records at build time the way to
get to native-lisp/ directory starting from the directory where the
Emacs binary is installed, so you must use --bindir at configure time
to let the build process know where the binary will be installed.  It
is no longer enough to set bindir only at "make install" time.

Emacs 28.1, as released, could work without --bindir, but that was at
a price of effectively dropping the support for --bindir
configure-time switch, something I don't want to do, since it's a
regression.

So please try re-configuring with

  ./configure CFLAGS='-O8' --bindir=/usr/local/sbin/emacs-29.0.50 --with-mailutils --with-cairo --with-native-compilation

and tell if the problem is solved by that after you install the
resulting binary.

Thanks.

bug#46790: 28.1; Bug#46790 reintroduced; Was make install with native-comp

[Thierry Volpiatto]

[-- Attachment #1: Type: text/plain, Size: 2453 bytes --]


Eli Zaretskii <eliz@gnu.org> writes:

>> From: Thierry Volpiatto <thievol@posteo.net>
>> Cc: 46790@debbugs.gnu.org
>> Date: Sun, 26 Jun 2022 14:19:32 +0000
>> 
>> >> > Error using execdir /usr/local/sbin/emacs-29.0.50/:
>> >> > emacs: /usr/local/sbin/emacs-29.0.50/../native-lisp/29.0.50-ca991e8a/preloaded/window-0d1b8b93-0c17e2d3.eln: cannot open shared object file: No such file or directory
>> >> 
>> >> Please tell:
>> >> 
>> >>  . what is the directory where you installed the Emacs binary, the one
>> >>    invoked when you start Emacs "normally"
>> >>  . if that binary is a symlink, how is the symlink defined (is the
>> >>    file itself a symlink or is the directory a symlink?), and where
>> >>    does that symlink point
>> >>  . what is the directory where you have the pdumper file, and what is
>> >>    its name
>> >>  . if the pdumper file is itself a symlink, please provide the same
>> >>    details as for the Emacs binary
>> >>  . where is the native-lisp/ directory with the *.eln files produced
>> >>    during the build
>> >> 
>> >> In each case, please show the full absolute name of the files I'm
>> >> asking about.
>> >
>> > In addition, please tell how you configured Emacs, i.e. please show
>> > the full command line with which you invoked the configure script.
>> 
>> ./configure CFLAGS='-O8' --with-mailutils --with-cairo --with-native-compilation
>
> I think that's the problem: installing the binary in a directory other
> than $execdir/bin needs to configure with --bindir accordingly set.
> Emacs built with native compilation records at build time the way to
> get to native-lisp/ directory starting from the directory where the
> Emacs binary is installed, so you must use --bindir at configure time
> to let the build process know where the binary will be installed.  It
> is no longer enough to set bindir only at "make install" time.
>
> Emacs 28.1, as released, could work without --bindir, but that was at
> a price of effectively dropping the support for --bindir
> configure-time switch, something I don't want to do, since it's a
> regression.
>
> So please try re-configuring with
>
>   ./configure CFLAGS='-O8' --bindir=/usr/local/sbin/emacs-29.0.50 --with-mailutils --with-cairo --with-native-compilation
>
> and tell if the problem is solved by that after you install the
> resulting binary.

Yes this fixed the problem.

Thanks.

-- 
Thierry

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 686 bytes --]

bug#46790: 28.1; Bug#46790 reintroduced; Was make install with native-comp

[Eli Zaretskii]

> From: Thierry Volpiatto <thievol@posteo.net>
> Cc: 46790@debbugs.gnu.org
> Date: Mon, 27 Jun 2022 10:14:50 +0000
> 
> >> ./configure CFLAGS='-O8' --with-mailutils --with-cairo --with-native-compilation
> >
> > I think that's the problem: installing the binary in a directory other
> > than $execdir/bin needs to configure with --bindir accordingly set.
> > Emacs built with native compilation records at build time the way to
> > get to native-lisp/ directory starting from the directory where the
> > Emacs binary is installed, so you must use --bindir at configure time
> > to let the build process know where the binary will be installed.  It
> > is no longer enough to set bindir only at "make install" time.
> >
> > Emacs 28.1, as released, could work without --bindir, but that was at
> > a price of effectively dropping the support for --bindir
> > configure-time switch, something I don't want to do, since it's a
> > regression.
> >
> > So please try re-configuring with
> >
> >   ./configure CFLAGS='-O8' --bindir=/usr/local/sbin/emacs-29.0.50 --with-mailutils --with-cairo --with-native-compilation
> >
> > and tell if the problem is solved by that after you install the
> > resulting binary.
> 
> Yes this fixed the problem.

Great, thanks for testing.

I guess we should mention this new requirement in NEWS or something.
I will take care of that.

bug#46790: 28.1; Bug#46790 reintroduced; Was make install with native-comp

[Eli Zaretskii]

> Cc: 46790@debbugs.gnu.org
> Date: Mon, 27 Jun 2022 14:19:17 +0300
> From: Eli Zaretskii <eliz@gnu.org>
> 
> > >   ./configure CFLAGS='-O8' --bindir=/usr/local/sbin/emacs-29.0.50 --with-mailutils --with-cairo --with-native-compilation
> > >
> > > and tell if the problem is solved by that after you install the
> > > resulting binary.
> > 
> > Yes this fixed the problem.
> 
> Great, thanks for testing.
> 
> I guess we should mention this new requirement in NEWS or something.
> I will take care of that.

Now done.

bug#46790: 28.1; Bug#46790 reintroduced; Was make install with native-comp

[Thierry Volpiatto]

[-- Attachment #1: Type: text/plain, Size: 630 bytes --]


Eli Zaretskii <eliz@gnu.org> writes:

>> Cc: 46790@debbugs.gnu.org
>> Date: Mon, 27 Jun 2022 14:19:17 +0300
>> From: Eli Zaretskii <eliz@gnu.org>
>> 
>> > >   ./configure CFLAGS='-O8' --bindir=/usr/local/sbin/emacs-29.0.50 --with-mailutils --with-cairo --with-native-compilation
>> > >
>> > > and tell if the problem is solved by that after you install the
>> > > resulting binary.
>> > 
>> > Yes this fixed the problem.
>> 
>> Great, thanks for testing.
>> 
>> I guess we should mention this new requirement in NEWS or something.
>> I will take care of that.
>
> Now done.


Great thanks.

-- 
Thierry

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 686 bytes --]