bug#55211: 29.0.50; bad package/native comp interaction

bug#55211: 29.0.50; bad package/native comp interaction

[Mark Kennedy]

this is one of those "too complicated for a -Q recipe" stories.

running "package-list-packages" with a native-comp emacs binary
fails with a "too many open files" message.  if lsof is used to examine
the emacs process, there are hundreds of read-only file descriptors bound to
"tramp-archive.elc".  if the same .emacs.d tree is run against an emacs
binary built *without* native compilation, it works correctly.

In GNU Emacs 29.0.50 (build 1, x86_64-pc-linux-gnu, GTK+ Version 3.24.31, cairo version 1.17.4)
 of 2022-05-01 built on new.mofjwutu.com
Repository revision: 4f395efa06d88832c376c2b1d4607677436228c0
Repository branch: master
Windowing system distributor 'The X.Org Foundation', version 11.0.12014000
System Description: Fedora Linux 35 (Workstation Edition)

Configured using:
 'configure --with-native-compilation'

Configured features:
CAIRO DBUS FREETYPE GIF GLIB GMP GNUTLS GSETTINGS HARFBUZZ JPEG JSON
LIBSELINUX LIBSYSTEMD LIBXML2 MODULES NATIVE_COMP NOTIFY INOTIFY PDUMPER
PNG SECCOMP SOUND SQLITE3 THREADS TIFF TOOLKIT_SCROLL_BARS X11 XDBE XIM
XPM GTK3 ZLIB

Important settings:
  value of $LANG: en_US.UTF-8
  value of $XMODIFIERS: @im=none
  locale-coding-system: utf-8-unix

Major mode: Package Menu

Minor modes in effect:
  shell-dirtrack-mode: t
  save-place-mode: t
  desktop-save-mode: t
  global-display-line-numbers-mode: t
  display-line-numbers-mode: t
  beacon-mode: t
  pcre-mode: t
  dynamic-completion-mode: t
  msb-mode: t
  savehist-mode: t
  which-function-mode: t
  global-page-break-lines-mode: t
  global-hi-lock-mode: t
  hi-lock-mode: t
  icomplete-mode: t
  dap-tooltip-mode: t
  dap-ui-many-windows-mode: t
  dap-ui-controls-mode: t
  dap-ui-mode: t
  treemacs-filewatch-mode: t
  treemacs-git-mode: t
  treemacs-fringe-indicator-mode: t
  dap-auto-configure-mode: t
  dap-mode: t
  which-key-mode: t
  override-global-mode: t
  tooltip-mode: t
  global-eldoc-mode: t
  show-paren-mode: t
  electric-indent-mode: t
  mouse-wheel-mode: t
  tool-bar-mode: t
  global-prettify-symbols-mode: t
  tab-bar-mode: t
  menu-bar-mode: t
  file-name-shadow-mode: t
  global-font-lock-mode: t
  font-lock-mode: t
  blink-cursor-mode: t
  buffer-read-only: t
  size-indication-mode: t
  column-number-mode: t
  line-number-mode: t
  indent-tabs-mode: t
  transient-mark-mode: t
  auto-composition-mode: t
  auto-encryption-mode: t
  auto-compression-mode: t

Load-path shadows:
/home/mtk/.emacs.d/elpa/transient-20220425.1314/transient hides /usr/local/share/emacs/29.0.50/lisp/transient

Features:
(shadow sort mail-extr emacsbug bs add-log tramp-cache zeroconf
tramp-archive tramp-gvfs dbus xml tramp tramp-loaddefs trampver
tramp-integration cus-start files-x tramp-compat shell pcomplete
parse-time iso8601 ls-lisp format-spec mm-archive message sendmail
yank-media dired dired-loaddefs rfc822 mml mml-sec epa derived gnus-util
mailabbrev gmm-utils mm-decode mm-bodies mm-encode lsp-modeline
lsp-headerline lsp-icons lsp-diagnostics vc-git diff-mode vc-dispatcher
lsp-zig lsp-steep lsp-svelte lsp-sqls lsp-yaml lsp-xml lsp-vimscript
lsp-vhdl lsp-volar lsp-vetur lsp-html lsp-verilog lsp-vala lsp-v
lsp-typeprof lsp-ttcn3 lsp-toml lsp-terraform lsp-tex lsp-sorbet
lsp-solargraph lsp-rust lsp-rf lsp-remark lsp-r lsp-purescript lsp-pylsp
lsp-pyls lsp-pwsh lsp-php lsp-perlnavigator lsp-perl lsp-openscad
lsp-ocaml lsp-magik lsp-nix lsp-nim lsp-nginx lsp-markdown lsp-lua
lsp-kotlin lsp-json lsp-javascript lsp-idris lsp-haxe lsp-groovy
lsp-hack lsp-graphql lsp-go lsp-completion lsp-gdscript lsp-fsharp
lsp-fortran lsp-eslint lsp-erlang lsp-emmet lsp-elixir lsp-elm
lsp-dockerfile lsp-dhall lsp-d lsp-css lsp-csharp lsp-crystal lsp-cmake
lsp-clojure lsp-semantic-tokens lsp-clangd dom lsp-beancount lsp-bash
lsp-ansible lsp-angular lsp-ada lsp-actionscript ccls
ccls-member-hierarchy ccls-inheritance-hierarchy ccls-call-hierarchy
ccls-tree ccls-code-lens ccls-semantic-highlight ccls-common
company-oddmuse company-keywords company-etags etags fileloop generator
company-gtags company-dabbrev-code company-dabbrev company-files
company-clang company-capf company-cmake company-semantic
company-template company-bbdb scala-mode scala-mode-prettify-symbols
scala-mode-imenu scala-mode-map scala-mode-fontlock scala-mode-indent
scala-mode-paragraph scala-mode-syntax scala-mode-lib time-date gnutls
url-http mail-parse rfc2231 rfc2047 rfc2045 mm-util ietf-drums
mail-prsvr url-gw url-cache url-auth mule-util disp-table
highlight-indent-guides hlinum linum cap-words superword subword
saveplace desktop frameset display-line-numbers beacon pcre2el rxt
re-builder completion msb savehist which-func page-break-lines hi-lock
avoid icomplete server lsp-pyright dap-mouse dap-ui gdb-mi bindat gud
bui bui-list bui-info bui-entry bui-core bui-history bui-button
bui-utils cus-edit pp cus-load dap-java lsp-java request mailheader
autorevert mail-utils cc-mode cc-fonts cc-guess cc-menus cc-cmds
cc-styles cc-align cc-engine cc-vars cc-defs company-lsp company lsp-ui
lsp-ui-flycheck lsp-ui-doc goto-addr lsp-ui-imenu lsp-ui-peek
lsp-ui-sideline lsp-ui-util face-remap lsp-metals view
lsp-metals-treeview lsp-treemacs lsp-treemacs-themes treemacs
treemacs-header-line treemacs-compatibility treemacs-mode
treemacs-interface treemacs-extensions treemacs-mouse-interface
treemacs-tags treemacs-persistence treemacs-filewatch-mode
treemacs-follow-mode treemacs-rendering treemacs-async
treemacs-workspaces treemacs-dom treemacs-visuals
treemacs-fringe-indicator treemacs-scope pulse treemacs-faces
treemacs-icons treemacs-themes treemacs-core-utils pfuture hl-line
treemacs-logging treemacs-customization treemacs-macros
lsp-metals-protocol lsp-lens dap-mode dap-launch posframe dap-overlays
lsp-mode comp comp-cstr warnings lsp-protocol aws-snippets go-snippets
yasnippet-snippets yasnippet xref project tree-widget wid-edit spinner
pcase network-stream puny nsm rmc markdown-mode color noutline outline
inline ht filenotify ewoc epg rfc6068 epg-config use-package-delight
which-key hydra lv projectile grep compile text-property-search comint
ring ibuf-ext ibuffer ibuffer-loaddefs thingatpt flycheck-package
package-lint let-alist imenu finder finder-inf lisp-mnt flycheck-eldev
flycheck ansi-color find-func use-package-bind-key bind-key easy-mmode
importmagic f dash s epc ctable edmacro kmacro concurrent deferred
hl-todo compat use-package-ensure ialign align cl-extra help-mode
use-package-core tab-line trim page-menu cperl-mode facemenu rx cl
advice info package browse-url url url-proxy url-privacy url-expand
url-methods url-history url-cookie url-domsuf url-util mailcap
url-handlers url-parse auth-source cl-seq eieio eieio-core cl-macs
eieio-loaddefs password-cache json map url-vars seq gv subr-x byte-opt
bytecomp byte-compile cconv cl-loaddefs cl-lib iso-transl tooltip eldoc
paren electric uniquify ediff-hook vc-hooks lisp-float-type elisp-mode
mwheel term/x-win x-win term/common-win x-dnd tool-bar dnd fontset image
regexp-opt fringe tabulated-list replace newcomment text-mode lisp-mode
prog-mode register page tab-bar menu-bar rfn-eshadow isearch easymenu
timer select scroll-bar mouse jit-lock font-lock syntax font-core
term/tty-colors frame minibuffer nadvice simple cl-generic cham georgian
utf-8-lang misc-lang vietnamese tibetan thai tai-viet lao korean
japanese eucjp-ms cp51932 hebrew greek romanian slovak czech european
ethiopic indian cyrillic chinese composite emoji-zwj charscript charprop
case-table epa-hook jka-cmpr-hook help abbrev obarray oclosure
cl-preloaded button loaddefs faces cus-face macroexp files window
text-properties overlay sha1 md5 base64 format env code-pages mule
custom widget keymap hashtable-print-readable backquote threads dbusbind
inotify dynamic-setting system-font-setting font-render-setting cairo
move-toolbar gtk x-toolkit x multi-tty make-network-process
native-compile emacs)

Memory information:
((conses 16 1956216 822154)
 (symbols 48 73182 348)
 (strings 32 361812 147332)
 (string-bytes 1 14224869)
 (vectors 16 142368)
 (vector-slots 8 2633757 815803)
 (floats 8 793 2442)
 (intervals 56 182958 7433)
 (buffers 992 35))

bug#55211: 29.0.50; bad package/native comp interaction

[Lars Ingebrigtsen]

Mark Kennedy <mark.t.kennedy@gmail.com> writes:

> this is one of those "too complicated for a -Q recipe" stories.
>
> running "package-list-packages" with a native-comp emacs binary
> fails with a "too many open files" message.  if lsof is used to examine
> the emacs process, there are hundreds of read-only file descriptors bound to
> "tramp-archive.elc".  if the same .emacs.d tree is run against an emacs
> binary built *without* native compilation, it works correctly.

[...]

> System Description: Fedora Linux 35 (Workstation Edition)

I tried that just now (nativecomp on Debian/bookworm), and I didn't get
any errors.

Are you saying you don't get the error if you say `M-x
package-list-packages' in an "emacs -Q", but you get it with a non-Q
Emacs?

-- 
(domestic pets only, the antidote for overdose, milk.)
   bloggy blog: http://lars.ingebrigtsen.no

bug#55211: 29.0.50; bad package/native comp interaction

[Mark Kennedy]

[-- Attachment #1: Type: text/plain, Size: 1139 bytes --]

and now the error has gone away for me as well.  something cached in
~/.emacs.d must have been the source of the problem.  sorry for the fire
drill.
/mark

On Sun, May 1, 2022 at 4:52 PM Lars Ingebrigtsen <larsi@gnus.org> wrote:

> Mark Kennedy <mark.t.kennedy@gmail.com> writes:
>
> > this is one of those "too complicated for a -Q recipe" stories.
> >
> > running "package-list-packages" with a native-comp emacs binary
> > fails with a "too many open files" message.  if lsof is used to examine
> > the emacs process, there are hundreds of read-only file descriptors
> bound to
> > "tramp-archive.elc".  if the same .emacs.d tree is run against an emacs
> > binary built *without* native compilation, it works correctly.
>
> [...]
>
> > System Description: Fedora Linux 35 (Workstation Edition)
>
> I tried that just now (nativecomp on Debian/bookworm), and I didn't get
> any errors.
>
> Are you saying you don't get the error if you say `M-x
> package-list-packages' in an "emacs -Q", but you get it with a non-Q
> Emacs?
>
> --
> (domestic pets only, the antidote for overdose, milk.)
>    bloggy blog: http://lars.ingebrigtsen.no
>

[-- Attachment #2: Type: text/html, Size: 1733 bytes --]

bug#55211: 29.0.50; bad package/native comp interaction

[Lars Ingebrigtsen]

Mark Kennedy <mark.t.kennedy@gmail.com> writes:

> and now the error has gone away for me as well.  something cached in ~/.emacs.d
> must have been the source of the problem.  sorry for the fire drill.

No problem; I'm closing this bug report, then.

-- 
(domestic pets only, the antidote for overdose, milk.)
   bloggy blog: http://lars.ingebrigtsen.no