bug#66885: 29.1; gnus search with mu always returns empty

bug#66885: 29.1; gnus search with mu always returns empty

[Britt Anderson]

Using gnus and the mu search engine always returns an empty search. This
is despite the fact that mu on the command line works, and that search
in mu4e works.

I noted that there was a bug report for something similar in #54162 for
notmuch search, but that was apparently due to an empty server name,
which is not the case for me.

I will note that if I run from the command line a command like:

mu find --clearlinks --format=links --linksdir=/home/britt/.local/share/mail/search/ 55214

It will populate a "search" group in Gnus that I manually added, and all the
links work to take me to the emails. I can live with that for now, but
it would be nice to get this working.

I did look at how mu search is handled in gnus-search.el.gz (that is why
I tried adding a config-directory), but was not able to detect what is
broken.

Thank you for your help and support -- Britt


My current version of the ~gnus.el~ file is:

(setq user-mail-address "britt@uwaterloo.ca")
(setq user-full-name "Britt Anderson")
(setq gnus-agent-synchronize-flags t)
(setq gnus-search-use-parsed-queries t)
(setq gnus-select-method '(nnnil ""))
(setq message-sendmail-f-is-evil 't)
(setq message-sendmail-extra-arguments '("--read-envelope-from"))
(setq message-send-mail-function 'message-send-mail-with-sendmail)
(setq sendmail-program "msmtp")
(setq gnus-gcc-mark-as-read t)
(setq gnus-agent nil)
(setq gnus-summary-line-format "%U%R%z %(%&user-date;  %-15,15f  %B%s%)\n"
      gnus-user-date-format-alist '((t . "%Y-%m-%d %H:%M")))


(setq gnus-secondary-select-methods
      '((nnmaildir "mail"
		   (directory "/home/britt/.local/share/mail")
		   (gnus-search-engine gnus-search-mu)
		   (config-directory "/home/britt/.cache/mu"))))




In GNU Emacs 29.1 (build 1, x86_64-pc-linux-gnu, GTK+ Version 3.24.38,
cairo version 1.17.8)
Windowing system distributor 'The X.Org Foundation', version 11.0.12101009
System Description: Arch Linux

Configured using:
 'configure --sysconfdir=/etc --prefix=/usr --libexecdir=/usr/lib
 --with-tree-sitter --localstatedir=/var --with-cairo
 --disable-build-details --with-harfbuzz --with-libsystemd
 --with-modules --with-x-toolkit=gtk3 'CFLAGS=-march=x86-64
 -mtune=generic -O2 -pipe -fno-plt -fexceptions -Wp,-D_FORTIFY_SOURCE=2
 -Wformat -Werror=format-security -fstack-clash-protection
 -fcf-protection -g
 -ffile-prefix-map=/build/emacs/src=/usr/src/debug/emacs -flto=auto'
 'LDFLAGS=-Wl,-O1,--sort-common,--as-needed,-z,relro,-z,now -flto=auto''

Configured features:
ACL CAIRO DBUS FREETYPE GIF GLIB GMP GNUTLS GPM GSETTINGS HARFBUZZ JPEG
JSON LCMS2 LIBOTF LIBSYSTEMD LIBXML2 M17N_FLT MODULES NOTIFY INOTIFY
PDUMPER PNG RSVG SECCOMP SOUND SQLITE3 THREADS TIFF TOOLKIT_SCROLL_BARS
TREE_SITTER WEBP X11 XDBE XIM XINPUT2 XPM GTK3 ZLIB

Important settings:
  value of $LANG: en_US.UTF-8
  locale-coding-system: utf-8-unix

Major mode: Lisp Interaction

Minor modes in effect:
  mu4e-modeline-mode: t
  global-evil-surround-mode: t
  evil-surround-mode: t
  org-roam-bibtex-mode: t
  helm-mode: t
  helm-minibuffer-history-mode: t
  shell-dirtrack-mode: t
  helm--remap-mouse-mode: t
  async-bytecomp-package-mode: t
  org-roam-db-autosync-mode: t
  server-mode: t
  pdf-occur-global-minor-mode: t
  override-global-mode: t
  straight-use-package-mode: t
  straight-package-neutering-mode: t
  tooltip-mode: t
  global-eldoc-mode: t
  eldoc-mode: t
  show-paren-mode: t
  electric-indent-mode: t
  mouse-wheel-mode: t
  file-name-shadow-mode: t
  global-font-lock-mode: t
  font-lock-mode: t
  blink-cursor-mode: t
  line-number-mode: t
  global-visual-line-mode: t
  visual-line-mode: t
  indent-tabs-mode: t
  transient-mark-mode: t
  auto-composition-mode: t
  auto-encryption-mode: t
  auto-compression-mode: t

Load-path shadows:
/home/britt/.emacs.d/straight/build/emacsql-sqlite/emacsql-sqlite hides /home/britt/.emacs.d/straight/build/emacsql/emacsql-sqlite
/home/britt/.emacs.d/straight/build/transient/transient hides /usr/share/emacs/29.1/lisp/transient
/home/britt/.emacs.d/straight/build/use-package/use-package-bind-key hides /usr/share/emacs/29.1/lisp/use-package/use-package-bind-key
/home/britt/.emacs.d/straight/build/use-package/use-package-core hides /usr/share/emacs/29.1/lisp/use-package/use-package-core
/home/britt/.emacs.d/straight/build/use-package/use-package-delight hides /usr/share/emacs/29.1/lisp/use-package/use-package-delight
/home/britt/.emacs.d/straight/build/use-package/use-package-lint hides /usr/share/emacs/29.1/lisp/use-package/use-package-lint
/home/britt/.emacs.d/straight/build/use-package/use-package-jump hides /usr/share/emacs/29.1/lisp/use-package/use-package-jump
/home/britt/.emacs.d/straight/build/use-package/use-package-ensure hides /usr/share/emacs/29.1/lisp/use-package/use-package-ensure
/home/britt/.emacs.d/straight/build/use-package/use-package hides /usr/share/emacs/29.1/lisp/use-package/use-package
/home/britt/.emacs.d/straight/build/use-package/use-package-diminish hides /usr/share/emacs/29.1/lisp/use-package/use-package-diminish
/home/britt/.emacs.d/straight/build/bind-key/bind-key hides /usr/share/emacs/29.1/lisp/use-package/bind-key
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-octave hides /usr/share/emacs/29.1/lisp/org/ob-octave
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-julia hides /usr/share/emacs/29.1/lisp/org/ob-julia
/home/britt/.emacs.d/straight/build/org-plus-contrib/org-footnote hides /usr/share/emacs/29.1/lisp/org/org-footnote
/home/britt/.emacs.d/straight/build/org-plus-contrib/ox-koma-letter hides /usr/share/emacs/29.1/lisp/org/ox-koma-letter
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-makefile hides /usr/share/emacs/29.1/lisp/org/ob-makefile
/home/britt/.emacs.d/straight/build/org-plus-contrib/org-attach hides /usr/share/emacs/29.1/lisp/org/org-attach
/home/britt/.emacs.d/straight/build/org-plus-contrib/org-crypt hides /usr/share/emacs/29.1/lisp/org/org-crypt
/home/britt/.emacs.d/straight/build/org-plus-contrib/org-capture hides /usr/share/emacs/29.1/lisp/org/org-capture
/home/britt/.emacs.d/straight/build/org-plus-contrib/oc-csl hides /usr/share/emacs/29.1/lisp/org/oc-csl
/home/britt/.emacs.d/straight/build/org-plus-contrib/org-compat hides /usr/share/emacs/29.1/lisp/org/org-compat
/home/britt/.emacs.d/straight/build/org-plus-contrib/ox-man hides /usr/share/emacs/29.1/lisp/org/ox-man
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-ref hides /usr/share/emacs/29.1/lisp/org/ob-ref
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-groovy hides /usr/share/emacs/29.1/lisp/org/ob-groovy
/home/britt/.emacs.d/straight/build/org-plus-contrib/ol-rmail hides /usr/share/emacs/29.1/lisp/org/ol-rmail
/home/britt/.emacs.d/straight/build/org-plus-contrib/org-num hides /usr/share/emacs/29.1/lisp/org/org-num
/home/britt/.emacs.d/straight/build/org-plus-contrib/ol-bibtex hides /usr/share/emacs/29.1/lisp/org/ol-bibtex
/home/britt/.emacs.d/straight/build/org-plus-contrib/ox-icalendar hides /usr/share/emacs/29.1/lisp/org/ox-icalendar
/home/britt/.emacs.d/straight/build/org-plus-contrib/org-id hides /usr/share/emacs/29.1/lisp/org/org-id
/home/britt/.emacs.d/straight/build/org-plus-contrib/ox-beamer hides /usr/share/emacs/29.1/lisp/org/ox-beamer
/home/britt/.emacs.d/straight/build/org-plus-contrib/org-macro hides /usr/share/emacs/29.1/lisp/org/org-macro
/home/britt/.emacs.d/straight/build/org-plus-contrib/org-fold hides /usr/share/emacs/29.1/lisp/org/org-fold
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-tangle hides /usr/share/emacs/29.1/lisp/org/ob-tangle
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-awk hides /usr/share/emacs/29.1/lisp/org/ob-awk
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-org hides /usr/share/emacs/29.1/lisp/org/ob-org
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-calc hides /usr/share/emacs/29.1/lisp/org/ob-calc
/home/britt/.emacs.d/straight/build/org-plus-contrib/org-feed hides /usr/share/emacs/29.1/lisp/org/org-feed
/home/britt/.emacs.d/straight/build/org-plus-contrib/oc-biblatex hides /usr/share/emacs/29.1/lisp/org/oc-biblatex
/home/britt/.emacs.d/straight/build/org-plus-contrib/oc-bibtex hides /usr/share/emacs/29.1/lisp/org/oc-bibtex
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-python hides /usr/share/emacs/29.1/lisp/org/ob-python
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-gnuplot hides /usr/share/emacs/29.1/lisp/org/ob-gnuplot
/home/britt/.emacs.d/straight/build/org-plus-contrib/org-duration hides /usr/share/emacs/29.1/lisp/org/org-duration
/home/britt/.emacs.d/straight/build/org-plus-contrib/ox hides /usr/share/emacs/29.1/lisp/org/ox
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-maxima hides /usr/share/emacs/29.1/lisp/org/ob-maxima
/home/britt/.emacs.d/straight/build/org-plus-contrib/ol-bbdb hides /usr/share/emacs/29.1/lisp/org/ol-bbdb
/home/britt/.emacs.d/straight/build/org-plus-contrib/ol-w3m hides /usr/share/emacs/29.1/lisp/org/ol-w3m
/home/britt/.emacs.d/straight/build/org-plus-contrib/org-loaddefs hides /usr/share/emacs/29.1/lisp/org/org-loaddefs
/home/britt/.emacs.d/straight/build/org-plus-contrib/org-habit hides /usr/share/emacs/29.1/lisp/org/org-habit
/home/britt/.emacs.d/straight/build/org-plus-contrib/ol-info hides /usr/share/emacs/29.1/lisp/org/ol-info
/home/britt/.emacs.d/straight/build/org-plus-contrib/ox-md hides /usr/share/emacs/29.1/lisp/org/ox-md
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-fortran hides /usr/share/emacs/29.1/lisp/org/ob-fortran
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-ruby hides /usr/share/emacs/29.1/lisp/org/ob-ruby
/home/britt/.emacs.d/straight/build/org-plus-contrib/ol-gnus hides /usr/share/emacs/29.1/lisp/org/ol-gnus
/home/britt/.emacs.d/straight/build/org-plus-contrib/org-cycle hides /usr/share/emacs/29.1/lisp/org/org-cycle
/home/britt/.emacs.d/straight/build/org-plus-contrib/ol-docview hides /usr/share/emacs/29.1/lisp/org/ol-docview
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-sql hides /usr/share/emacs/29.1/lisp/org/ob-sql
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-lob hides /usr/share/emacs/29.1/lisp/org/ob-lob
/home/britt/.emacs.d/straight/build/org-plus-contrib/org-timer hides /usr/share/emacs/29.1/lisp/org/org-timer
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-processing hides /usr/share/emacs/29.1/lisp/org/ob-processing
/home/britt/.emacs.d/straight/build/org-plus-contrib/ox-odt hides /usr/share/emacs/29.1/lisp/org/ox-odt
/home/britt/.emacs.d/straight/build/org-plus-contrib/org-faces hides /usr/share/emacs/29.1/lisp/org/org-faces
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-exp hides /usr/share/emacs/29.1/lisp/org/ob-exp
/home/britt/.emacs.d/straight/build/org-plus-contrib/org-inlinetask hides /usr/share/emacs/29.1/lisp/org/org-inlinetask
/home/britt/.emacs.d/straight/build/org-plus-contrib/oc-basic hides /usr/share/emacs/29.1/lisp/org/oc-basic
/home/britt/.emacs.d/straight/build/org-plus-contrib/org-element hides /usr/share/emacs/29.1/lisp/org/org-element
/home/britt/.emacs.d/straight/build/org-plus-contrib/ox-org hides /usr/share/emacs/29.1/lisp/org/ox-org
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-screen hides /usr/share/emacs/29.1/lisp/org/ob-screen
/home/britt/.emacs.d/straight/build/org-plus-contrib/ol-eww hides /usr/share/emacs/29.1/lisp/org/ol-eww
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-js hides /usr/share/emacs/29.1/lisp/org/ob-js
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-clojure hides /usr/share/emacs/29.1/lisp/org/ob-clojure
/home/britt/.emacs.d/straight/build/org-plus-contrib/org-pcomplete hides /usr/share/emacs/29.1/lisp/org/org-pcomplete
/home/britt/.emacs.d/straight/build/org-plus-contrib/ox-latex hides /usr/share/emacs/29.1/lisp/org/ox-latex
/home/britt/.emacs.d/straight/build/org-plus-contrib/org-entities hides /usr/share/emacs/29.1/lisp/org/org-entities
/home/britt/.emacs.d/straight/build/org-plus-contrib/org-archive hides /usr/share/emacs/29.1/lisp/org/org-archive
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-scheme hides /usr/share/emacs/29.1/lisp/org/ob-scheme
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob hides /usr/share/emacs/29.1/lisp/org/ob
/home/britt/.emacs.d/straight/build/org-plus-contrib/ol hides /usr/share/emacs/29.1/lisp/org/ol
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-ocaml hides /usr/share/emacs/29.1/lisp/org/ob-ocaml
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-emacs-lisp hides /usr/share/emacs/29.1/lisp/org/ob-emacs-lisp
/home/britt/.emacs.d/straight/build/org-plus-contrib/org-ctags hides /usr/share/emacs/29.1/lisp/org/org-ctags
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-sqlite hides /usr/share/emacs/29.1/lisp/org/ob-sqlite
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-latex hides /usr/share/emacs/29.1/lisp/org/ob-latex
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-eval hides /usr/share/emacs/29.1/lisp/org/ob-eval
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-eshell hides /usr/share/emacs/29.1/lisp/org/ob-eshell
/home/britt/.emacs.d/straight/build/org-plus-contrib/oc hides /usr/share/emacs/29.1/lisp/org/oc
/home/britt/.emacs.d/straight/build/org-plus-contrib/org-refile hides /usr/share/emacs/29.1/lisp/org/org-refile
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-lua hides /usr/share/emacs/29.1/lisp/org/ob-lua
/home/britt/.emacs.d/straight/build/org-plus-contrib/org-mouse hides /usr/share/emacs/29.1/lisp/org/org-mouse
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-sed hides /usr/share/emacs/29.1/lisp/org/ob-sed
/home/britt/.emacs.d/straight/build/org-plus-contrib/org-list hides /usr/share/emacs/29.1/lisp/org/org-list
/home/britt/.emacs.d/straight/build/org-plus-contrib/ox-publish hides /usr/share/emacs/29.1/lisp/org/ox-publish
/home/britt/.emacs.d/straight/build/org-plus-contrib/org-macs hides /usr/share/emacs/29.1/lisp/org/org-macs
/home/britt/.emacs.d/straight/build/org-plus-contrib/org-datetree hides /usr/share/emacs/29.1/lisp/org/org-datetree
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-perl hides /usr/share/emacs/29.1/lisp/org/ob-perl
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-shell hides /usr/share/emacs/29.1/lisp/org/ob-shell
/home/britt/.emacs.d/straight/build/org-plus-contrib/org hides /usr/share/emacs/29.1/lisp/org/org
/home/britt/.emacs.d/straight/build/org-plus-contrib/org-persist hides /usr/share/emacs/29.1/lisp/org/org-persist
/home/britt/.emacs.d/straight/build/org-plus-contrib/org-table hides /usr/share/emacs/29.1/lisp/org/org-table
/home/britt/.emacs.d/straight/build/org-plus-contrib/ol-doi hides /usr/share/emacs/29.1/lisp/org/ol-doi
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-plantuml hides /usr/share/emacs/29.1/lisp/org/ob-plantuml
/home/britt/.emacs.d/straight/build/org-plus-contrib/ox-html hides /usr/share/emacs/29.1/lisp/org/ox-html
/home/britt/.emacs.d/straight/build/org-plus-contrib/org-plot hides /usr/share/emacs/29.1/lisp/org/org-plot
/home/britt/.emacs.d/straight/build/org-plus-contrib/org-fold-core hides /usr/share/emacs/29.1/lisp/org/org-fold-core
/home/britt/.emacs.d/straight/build/org-plus-contrib/ol-irc hides /usr/share/emacs/29.1/lisp/org/ol-irc
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-forth hides /usr/share/emacs/29.1/lisp/org/ob-forth
/home/britt/.emacs.d/straight/build/org-plus-contrib/org-colview hides /usr/share/emacs/29.1/lisp/org/org-colview
/home/britt/.emacs.d/straight/build/org-plus-contrib/org-indent hides /usr/share/emacs/29.1/lisp/org/org-indent
/home/britt/.emacs.d/straight/build/org-plus-contrib/ox-texinfo hides /usr/share/emacs/29.1/lisp/org/ox-texinfo
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-ditaa hides /usr/share/emacs/29.1/lisp/org/ob-ditaa
/home/britt/.emacs.d/straight/build/org-plus-contrib/org-protocol hides /usr/share/emacs/29.1/lisp/org/org-protocol
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-java hides /usr/share/emacs/29.1/lisp/org/ob-java
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-sass hides /usr/share/emacs/29.1/lisp/org/ob-sass
/home/britt/.emacs.d/straight/build/org-plus-contrib/ol-mhe hides /usr/share/emacs/29.1/lisp/org/ol-mhe
/home/britt/.emacs.d/straight/build/org-plus-contrib/ol-man hides /usr/share/emacs/29.1/lisp/org/ol-man
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-core hides /usr/share/emacs/29.1/lisp/org/ob-core
/home/britt/.emacs.d/straight/build/org-plus-contrib/org-clock hides /usr/share/emacs/29.1/lisp/org/org-clock
/home/britt/.emacs.d/straight/build/org-plus-contrib/org-attach-git hides /usr/share/emacs/29.1/lisp/org/org-attach-git
/home/britt/.emacs.d/straight/build/org-plus-contrib/org-lint hides /usr/share/emacs/29.1/lisp/org/org-lint
/home/britt/.emacs.d/straight/build/org-plus-contrib/org-keys hides /usr/share/emacs/29.1/lisp/org/org-keys
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-comint hides /usr/share/emacs/29.1/lisp/org/ob-comint
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-table hides /usr/share/emacs/29.1/lisp/org/ob-table
/home/britt/.emacs.d/straight/build/org-plus-contrib/oc-natbib hides /usr/share/emacs/29.1/lisp/org/oc-natbib
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-lisp hides /usr/share/emacs/29.1/lisp/org/ob-lisp
/home/britt/.emacs.d/straight/build/org-plus-contrib/org-goto hides /usr/share/emacs/29.1/lisp/org/org-goto
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-matlab hides /usr/share/emacs/29.1/lisp/org/ob-matlab
/home/britt/.emacs.d/straight/build/org-plus-contrib/org-src hides /usr/share/emacs/29.1/lisp/org/org-src
/home/britt/.emacs.d/straight/build/org-plus-contrib/org-mobile hides /usr/share/emacs/29.1/lisp/org/org-mobile
/home/britt/.emacs.d/straight/build/org-plus-contrib/org-agenda hides /usr/share/emacs/29.1/lisp/org/org-agenda
/home/britt/.emacs.d/straight/build/org-plus-contrib/org-tempo hides /usr/share/emacs/29.1/lisp/org/org-tempo
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-lilypond hides /usr/share/emacs/29.1/lisp/org/ob-lilypond
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-haskell hides /usr/share/emacs/29.1/lisp/org/ob-haskell
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-R hides /usr/share/emacs/29.1/lisp/org/ob-R
/home/britt/.emacs.d/straight/build/org-plus-contrib/ol-eshell hides /usr/share/emacs/29.1/lisp/org/ol-eshell
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-dot hides /usr/share/emacs/29.1/lisp/org/ob-dot
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-C hides /usr/share/emacs/29.1/lisp/org/ob-C
/home/britt/.emacs.d/straight/build/org-plus-contrib/ox-ascii hides /usr/share/emacs/29.1/lisp/org/ox-ascii
/home/britt/.emacs.d/straight/build/org-plus-contrib/org-version hides /usr/share/emacs/29.1/lisp/org/org-version
/home/britt/.emacs.d/straight/build/org-plus-contrib/ob-css hides /usr/share/emacs/29.1/lisp/org/ob-css
/home/britt/.emacs.d/straight/build/let-alist/let-alist hides /usr/share/emacs/29.1/lisp/emacs-lisp/let-alist

Features:
(shadow emacsbug mm-archive smiley gnus-cite mail-extr textsec
uni-scripts idna-mapping ucs-normalize uni-confusable textsec-check qp
gnus-async gnus-bcklg sort help-fns radix-tree misearch multi-isearch
image-file image-converter helm-external gnus-ml disp-table gnus-search
eieio-opt speedbar ezimage dframe nndraft nnmh gnus-agent gnus-srvr
gnus-score score-mode nnvirtual gnus-msg nnmaildir nnfolder gnus-cache
nnnil nntp light-blue-theme winner tramp-archive tramp-gvfs tramp-cache
time-stamp zeroconf helm-command helm-elisp helm-eval edebug debug
backtrace helm-info simple-httpd simple-httpd-autoloads paredit
paredit-autoloads org-mime org-mime-autoloads mu4e mu4e-org
mu4e-notification notifications mu4e-main mu4e-view mu4e-headers
mu4e-compose mu4e-draft mu4e-actions smtpmail mu4e-search mu4e-lists
mu4e-bookmarks mu4e-mark mu4e-message flow-fill mule-util mu4e-contacts
mu4e-update mu4e-folders mu4e-context mu4e-query-items mu4e-server
mu4e-modeline mu4e-vars mu4e-helpers mu4e-config mu4e-window
mu4e-obsolete evil-surround evil-surround-autoloads evil
evil-keybindings evil-integration evil-maps evil-commands reveal
evil-jumps evil-command-window evil-search evil-ex evil-types
evil-macros evil-repeat evil-states evil-core evil-common rect evil-vars
evil-autoloads goto-chg-autoloads nov recentf tree-widget esxml-query
nov-autoloads esxml-autoloads kv-autoloads magit-autoloads
git-commit-autoloads with-editor-autoloads transient-autoloads poly-R
poly-markdown poly-noweb ess-r-mode ess-r-flymake flymake-proc flymake
ess-r-xref ess-trns ess-r-package ess-r-completion ess-roxy ess-r-syntax
ess-rd hideshow ess-s-lang ess-help ess-mode ess-inf ess-tracebug ess
lisp-mnt ess-utils ess-custom poly-R-autoloads poly-noweb-autoloads
poly-markdown-autoloads polymode poly-lock polymode-base polymode-weave
polymode-export polymode-compat polymode-methods polymode-core
polymode-classes eieio-custom eieio-base polymode-autoloads org-caldav
icalendar diary-lib diary-loaddefs url-dav url-http url-auth url-gw nsm
org-caldav-autoloads flycheck flycheck-autoloads pkg-info-autoloads
epl-autoloads slime apropos etags fileloop xref arc-mode archive-mode
hyperspec slime-autoloads macrostep-autoloads htmlize htmlize-autoloads
ob-haskell ob-shell ob-latex ob-python python project ob-R ob-maxima
ob-lisp ox-rss ox-org ox-md ox-beamer ox-odt rng-loc rng-uri rng-parse
rng-match rng-dt rng-util rng-pttrn nxml-parse nxml-ns nxml-enc xmltok
nxml-util ox-latex ox-icalendar ox-html table ox-ascii ox-publish ox
org-roam-bibtex orb-core orb-compat orb-utils org-roam-bibtex-autoloads
org-noter org-noter-djvu org-noter-nov org-noter-pdf org-noter-core
org-noter-autoloads citeproc citeproc-itemgetters citeproc-biblatex
citeproc-bibtex citeproc-cite citeproc-subbibs citeproc-sort
citeproc-name citeproc-formatters citeproc-number rst citeproc-proc
citeproc-disamb citeproc-itemdata citeproc-generic-elements
citeproc-macro citeproc-choose citeproc-date citeproc-context
citeproc-prange citeproc-style citeproc-locale citeproc-term citeproc-rt
citeproc-lib citeproc-s queue citeproc-autoloads
string-inflection-autoloads queue-autoloads helm-bibtex
bibtex-completion biblio biblio-download biblio-dissemin biblio-ieee
biblio-hal biblio-dblp biblio-crossref biblio-arxiv biblio-doi
biblio-core ido hl-line f f-shortdoc s parsebib helm-net
helm-bibtex-autoloads bibtex-completion-autoloads biblio-autoloads
biblio-core-autoloads f-autoloads s-autoloads parsebib-autoloads
helm-mode helm-misc helm-files image-dired image-dired-tags
image-dired-external image-dired-util tramp tramp-loaddefs trampver
tramp-integration files-x tramp-compat shell helm-buffers helm-occur
helm-tags helm-locate helm-grep helm-regexp helm-utils helm-help
helm-types helm helm-global-bindings helm-easymenu helm-core
async-bytecomp helm-source helm-multi-match helm-lib async
helm-autoloads popup-autoloads wfnames-autoloads helm-core-autoloads
async-autoloads preview-latex tex-site auctex-autoloads pcase
use-package-ensure warnings oc-basic ol-eww eww ol-rmail ol-mhe ol-irc
ol-info ol-gnus nnselect ol-docview ol-bibtex bibtex ol-bbdb ol-w3m
ol-doi org-link-doi org-roam-migrate org-roam-mode org-roam-capture
org-roam-id org-roam-node org-roam-db org-roam-utils org-roam-compat
org-roam emacsql-sqlite emacsql-sqlite-common emacsql emacsql-compiler
magit-section cursor-sensor compat dash org-roam-autoloads
magit-section-autoloads compat-autoloads emacsql-sqlite-autoloads
emacsql-autoloads dash-autoloads org-journal org-crypt cal-iso
org-journal-autoloads org-tree-slide face-remap org-timer
org-tree-slide-autoloads visual-fill-column visual-fill-column-autoloads
elfeed-goodies-logging elfeed-goodies-new-entry-hooks mm-url
elfeed-goodies-split-pane popwin elfeed-goodies-show-mode link-hint ffap
goto-addr elfeed-goodies-search-mode powerline powerline-separators
powerline-themes elfeed-goodies elfeed-goodies-autoloads
link-hint-autoloads powerline-autoloads popwin-autoloads elfeed-show
elfeed-search elfeed-csv elfeed elfeed-curl elfeed-log elfeed-db
elfeed-lib url-queue xml-query elfeed-autoloads go-translate-autoloads
w3m doc-view filenotify timezone w3m-hist bookmark-w3m w3m-ems
w3m-favicon w3m-image w3m-fb tab-line w3m-proc w3m-util w3m-autoloads
server pdf-occur ibuf-ext ibuffer ibuffer-loaddefs tablist advice
tablist-filter semantic/wisent/comp semantic/wisent
semantic/wisent/wisent semantic/util-modes semantic/util semantic
semantic/tag semantic/lex semantic/fw mode-local cedet pdf-isearch
let-alist pdf-misc imenu pdf-tools package url-handlers compile cus-edit
cus-load pdf-view bookmark pp jka-compr pdf-cache pdf-info tq pdf-util
pdf-macs image-mode exif pdf-tools-autoloads let-alist-autoloads
tablist-autoloads deft-autoloads ace-window avy edmacro kmacro
ace-window-autoloads avy-autoloads finder-inf use-package-bind-key
bind-key easy-mmode markdown-mode color thingatpt
markdown-mode-autoloads showkey showkey-autoloads org-contacts
org-capture org-agenda org-element org-element-ast inline org-persist
xdg org-id avl-tree generator org-refile gnus-art mm-uu mml2015 mm-view
mml-smime smime gnutls dig gnus-sum shr pixel-fill kinsoku url-file svg
dom browse-url url url-proxy url-privacy url-expand url-methods
url-history url-cookie generate-lisp-file url-domsuf url-util url-parse
auth-source eieio eieio-core json map byte-opt url-vars gnus-group
gnus-undo gnus-start gnus-dbus gnus-cloud nnimap nnmail mail-source utf7
nnoo parse-time iso8601 gnus-spec gnus-int gnus-range message sendmail
mailcap yank-media puny dired dired-loaddefs rfc822 mml mml-sec
password-cache epa derived epg rfc6068 epg-config mm-decode mm-bodies
mm-encode mail-parse rfc2231 rfc2047 rfc2045 ietf-drums mailabbrev
gmm-utils mailheader gnus-win gnus nnheader mail-utils range mm-util
mail-prsvr wid-edit gnus-util text-property-search
org-contacts-autoloads use-package-core org-clock dbus xml org ob
ob-tangle ob-ref ob-lob ob-table ob-exp org-macro org-src sh-script smie
treesit executable ob-comint org-pcomplete pcomplete comint ansi-osc
ansi-color ring org-list org-footnote org-faces org-entities time-date
noutline outline icons ob-emacs-lisp ob-core ob-eval org-cycle org-table
ol rx org-fold org-fold-core org-keys oc org-loaddefs find-func cal-menu
calendar cal-loaddefs org-version org-compat org-macs format-spec
tsdh-dark-theme use-package-autoloads info bind-key-autoloads
straight-autoloads cl-seq cl-extra help-mode straight subr-x cl-macs gv
cl-loaddefs cl-lib bytecomp byte-compile rmc iso-transl tooltip cconv
eldoc paren electric uniquify ediff-hook vc-hooks lisp-float-type
elisp-mode mwheel term/x-win x-win term/common-win x-dnd tool-bar dnd
fontset image regexp-opt fringe tabulated-list replace newcomment
text-mode lisp-mode prog-mode register page tab-bar menu-bar rfn-eshadow
isearch easymenu timer select scroll-bar mouse jit-lock font-lock syntax
font-core term/tty-colors frame minibuffer nadvice seq simple cl-generic
indonesian philippine cham georgian utf-8-lang misc-lang vietnamese
tibetan thai tai-viet lao korean japanese eucjp-ms cp51932 hebrew greek
romanian slovak czech european ethiopic indian cyrillic chinese
composite emoji-zwj charscript charprop case-table epa-hook
jka-cmpr-hook help abbrev obarray oclosure cl-preloaded button loaddefs
theme-loaddefs faces cus-face macroexp files window text-properties
overlay sha1 md5 base64 format env code-pages mule custom widget keymap
hashtable-print-readable backquote threads dbusbind inotify lcms2
dynamic-setting system-font-setting font-render-setting cairo
move-toolbar gtk x-toolkit xinput2 x multi-tty make-network-process
emacs)

Memory information:
((conses 16 784633 52325)
 (symbols 48 60688 5)
 (strings 32 273880 19318)
 (string-bytes 1 10302730)
 (vectors 16 159428)
 (vector-slots 8 2690699 83295)
 (floats 8 798 505)
 (intervals 56 5392 1285)
 (buffers 984 56))

bug#66885: 29.1; gnus search with mu always returns empty

[Eric Abrahamsen]

Britt Anderson <britt@b3l.xyz> writes:

> Using gnus and the mu search engine always returns an empty search. This
> is despite the fact that mu on the command line works, and that search
> in mu4e works.

Thanks for the report.

> I noted that there was a bug report for something similar in #54162 for
> notmuch search, but that was apparently due to an empty server name,
> which is not the case for me.
>
> I will note that if I run from the command line a command like:
>
> mu find --clearlinks --format=links --linksdir=/home/britt/.local/share/mail/search/ 55214

Gnus' code will construct a command line like this:

mu find --nocolor --muhome=~/.cache/mu <QUERY HERE> --format=plain --fields=l

Would you try running this with a sample query, and sending a sample
output (I hope it's just a list of file names). That should help narrow
down whether it's a problem sending the query in, or a problem parsing
the output.

Thanks,
Eric

bug#66885: 29.1; gnus search with mu always returns empty

[Britt Anderson]

Copy and pasted the terminal output. mu is not expanding the 'tilde' in
"--muhome", but if I use the full path, then I do get a list of files
returned. However the error in the first form is not an empty search but
a database detection error. 

Here are the two versions:

britt@joy ~]$ mu find --nocolor --muhome=~/.cache/mu from:"eric abrahamsen" --format=plain --fields=l
Couldn't detect type of database
[britt@joy ~]$ mu find --nocolor --muhome=/home/britt/.cache/mu from:"eric abrahamsen" --format=plain --fields=l
/home/britt/.local/share/mail/uwaterloo.ca/britt/archives/y2022/cur/1686484828.9058_11546.joy:2,S
/home/britt/.local/share/mail/uwaterloo.ca/britt/archives/y2022/cur/1686484831.9058_11566.joy:2,S
/home/britt/.local/share/mail/uwaterloo.ca/britt/archives/y2022/cur/1686484834.9058_11591.joy:2,S
/home/britt/.local/share/mail/uwaterloo.ca/britt/archives/y2022/cur/1686484839.9058_11615.joy:2,S
/home/britt/.local/share/mail/uwaterloo.ca/britt/archives/y2022/cur/1686484842.9058_11638.joy:2,S
/home/britt/.local/share/mail/uwaterloo.ca/britt/archives/y2022/cur/1686484843.9058_11640.joy:2,S
/home/britt/.local/share/mail/uwaterloo.ca/britt/archives/y2022/cur/1686484858.9058_11707.joy:2,S


Regards, Britt

Eric Abrahamsen <eric@ericabrahamsen.net> writes:

> Britt Anderson <britt@b3l.xyz> writes:
>
>> Using gnus and the mu search engine always returns an empty search. This
>> is despite the fact that mu on the command line works, and that search
>> in mu4e works.
>
> Thanks for the report.
>
>> I noted that there was a bug report for something similar in #54162 for
>> notmuch search, but that was apparently due to an empty server name,
>> which is not the case for me.
>>
>> I will note that if I run from the command line a command like:
>>
>> mu find --clearlinks --format=links --linksdir=/home/britt/.local/share/mail/search/ 55214
>
> Gnus' code will construct a command line like this:
>
> mu find --nocolor --muhome=~/.cache/mu <QUERY HERE> --format=plain --fields=l
>
> Would you try running this with a sample query, and sending a sample
> output (I hope it's just a list of file names). That should help narrow
> down whether it's a problem sending the query in, or a problem parsing
> the output.
>
> Thanks,
> Eric


-- 
Britt Anderson
Kitchener, ON CA; Paris France

bug#66885: 29.1; gnus search with mu always returns empty

[Eric Abrahamsen]

Britt Anderson <britt@b3l.xyz> writes:

> Copy and pasted the terminal output. mu is not expanding the 'tilde' in
> "--muhome", but if I use the full path, then I do get a list of files
> returned. However the error in the first form is not an empty search but
> a database detection error. 

That's fine, the value of config-directory is expand-file-name'd, so the
tilde doesn't make it through to mu.

Your problem is likely that your configuration doesn't include the
correct `remove-prefix', a string prefix that is removed from the
filenames returned by mu. The default is "~/Mail", which is wrong in
your case, it looks like it should be
"/home/britt/.local/share/mail/uwaterloo.ca/britt/archives".

That will have to go in your config. Note that search-engine
configuration options need to go inside the `gnus-search-engine' sexp --
your previous `config-directory' config was outside, at the `nnmaildir'
level. But that was the default value anyway, so you can leave it out.
This should be sufficient:

(setq gnus-secondary-select-methods
      '((nnmaildir "mail"
		   (directory "/home/britt/.local/share/mail")
		   (gnus-search-engine gnus-search-mu
                     (remove-prefix "/home/britt/.local/share/mail/uwaterloo.ca/britt/archives")))))

The "(gnus) Search Engines" info manual has more detail.

bug#66885: 29.1; gnus search with mu always returns empty

[Britt Anderson]

Thank you for your efforts so far, but I still cannot get it working.

Your recommendation for the remove-prefix didn't work for me. I
essentially tried incrementally going through the directory hierarchy
and never found a level that I could specify and it would work.

But even if I had, it would not be a very complete solution, because I
have numerous accounts with numerous user names that live under
~/home/britt/.local/share/mail~

there is a microsoft exchange email account, a protonmail account, a
gandi account ( and I have a few more that I haven't even set up yet).

I would really like to be able to search across those, and I can do this
with mu where it will show up all the emails it finds that meet the
search criteria.

It seems like that even if I could find a "remove-prefix" that would
have worked for that one particular search we tested that would not have
been the necessary prefix for searches in other folders/groups.

For right now I have gone back to using a local dovecot server to use
imap, and imap search is now good enough most of the time (with your
excellent work on standardizing the search command to use a common
structure).

I am happy to try again if you have some suggestions, but otherwise it
is probably reasonable to just close this and I will search with mu on
the command line on those few occassions where I cannot find what I need
with the built-in imap search functions.

Thank you. Britt

Eric Abrahamsen <eric@ericabrahamsen.net> writes:

> Britt Anderson <britt@b3l.xyz> writes:
>
>> Copy and pasted the terminal output. mu is not expanding the 'tilde' in
>> "--muhome", but if I use the full path, then I do get a list of files
>> returned. However the error in the first form is not an empty search but
>> a database detection error. 
>
> That's fine, the value of config-directory is expand-file-name'd, so the
> tilde doesn't make it through to mu.
>
> Your problem is likely that your configuration doesn't include the
> correct `remove-prefix', a string prefix that is removed from the
> filenames returned by mu. The default is "~/Mail", which is wrong in
> your case, it looks like it should be
> "/home/britt/.local/share/mail/uwaterloo.ca/britt/archives".
>
> That will have to go in your config. Note that search-engine
> configuration options need to go inside the `gnus-search-engine' sexp --
> your previous `config-directory' config was outside, at the `nnmaildir'
> level. But that was the default value anyway, so you can leave it out.
> This should be sufficient:
>
> (setq gnus-secondary-select-methods
>       '((nnmaildir "mail"
> 		   (directory "/home/britt/.local/share/mail")
> 		   (gnus-search-engine gnus-search-mu
>                      (remove-prefix "/home/britt/.local/share/mail/uwaterloo.ca/britt/archives")))))
>
> The "(gnus) Search Engines" info manual has more detail.

bug#66885: 29.1; gnus search with mu always returns empty

[Eric Abrahamsen]

Britt Anderson <britt@b3l.xyz> writes:

> Thank you for your efforts so far, but I still cannot get it working.
>
> Your recommendation for the remove-prefix didn't work for me. I
> essentially tried incrementally going through the directory hierarchy
> and never found a level that I could specify and it would work.

Bummer, in theory that should have done it.

> But even if I had, it would not be a very complete solution, because I
> have numerous accounts with numerous user names that live under
> ~/home/britt/.local/share/mail~
>
> there is a microsoft exchange email account, a protonmail account, a
> gandi account ( and I have a few more that I haven't even set up yet).

And each of these is a separate Gnus backend, right?

> I would really like to be able to search across those, and I can do this
> with mu where it will show up all the emails it finds that meet the
> search criteria.
>
> It seems like that even if I could find a "remove-prefix" that would
> have worked for that one particular search we tested that would not have
> been the necessary prefix for searches in other folders/groups.

The remove-prefix should delete the file path up to the level of the
server, meaning that the group/folder name will be read as the first
filepath segment _after_ the removal.

In theory, if you have multiple mail installations all indexed by mu,
and those installations are represented by multiple Gnus backends, it
could still work. If each backend was configured with a separate
remove-prefix, then it could only extract the results that were relevant
to that backend. I don't think that would currently work correctly,
though.

> For right now I have gone back to using a local dovecot server to use
> imap, and imap search is now good enough most of the time (with your
> excellent work on standardizing the search command to use a common
> structure).
>
> I am happy to try again if you have some suggestions, but otherwise it
> is probably reasonable to just close this and I will search with mu on
> the command line on those few occassions where I cannot find what I need
> with the built-in imap search functions.

I've got another outstanding bug report on indexed search engine
behavior, so I'll need to find some time to install a few dummy
maildir/notmuch/mu servers and experiment. I may come back to you with
more questions after that. Please leave the bug report open!

Thanks,
Eric

bug#66885: 29.1; gnus search with mu always returns empty

[Britt Anderson]

Eric Abrahamsen <eric@ericabrahamsen.net> writes:

>
> The remove-prefix should delete the file path up to the level of the
> server, meaning that the group/folder name will be read as the first
> filepath segment _after_ the removal.
>
> In theory, if you have multiple mail installations all indexed by mu,
> and those installations are represented by multiple Gnus backends, it
> could still work. If each backend was configured with a separate
> remove-prefix, then it could only extract the results that were relevant
> to that backend. I don't think that would currently work correctly,
> though.
>

Eric, I don't if this helps, but I have kept fiddling around with this.
I decided to watch the ~gnus-search-mu-remove-prefix~ variable with this
in my .gnus.el file:

	(nnmaildir "b3l-archives"
		   (directory "/home/britt/.local/share/mail/b3l.xyz/britt/archives")
		   (gnus-search-engine gnus-search-mu
				       (remove-prefix "/home/britt/.local/share/mail/b3l.xyz/britt/archives")))


There is a maildir "y2023" that lives in archives. Using gnus I can read
the mail in there.

Before I start gnus none of the gnus-* variables are available from C-h
v.

After I start gnus I can see many of them, but not the gnus-search-*
variables.

After I go into gnus and try to perform a search on that directory then
the gnus-search variables become visible. When I do C-h v
gnus-search-mu-remove-prefix it still shows "/home/britt/Mail" even
though the remove prefix was set above. Is my syntax bad somehow?

I have tried manually to setq that variable to remove the prefix you
advised in an earlier email. But search still doesn't work even though
C-h v shows that my new value is the variable's current value. 

Just hoping this may give you an idea where the trouble lies. Still
working hard to get back to gnus again.

Thanks, Britt

bug#66885: 29.1; gnus search with mu always returns empty

[Eric Abrahamsen]

Britt Anderson <britt@b3l.xyz> writes:

> Eric Abrahamsen <eric@ericabrahamsen.net> writes:
>
>>
>> The remove-prefix should delete the file path up to the level of the
>> server, meaning that the group/folder name will be read as the first
>> filepath segment _after_ the removal.
>>
>> In theory, if you have multiple mail installations all indexed by mu,
>> and those installations are represented by multiple Gnus backends, it
>> could still work. If each backend was configured with a separate
>> remove-prefix, then it could only extract the results that were relevant
>> to that backend. I don't think that would currently work correctly,
>> though.
>>
>
> Eric, I don't if this helps, but I have kept fiddling around with this.
> I decided to watch the ~gnus-search-mu-remove-prefix~ variable with this
> in my .gnus.el file:
>
> 	(nnmaildir "b3l-archives"
> 		   (directory "/home/britt/.local/share/mail/b3l.xyz/britt/archives")
> 		   (gnus-search-engine gnus-search-mu
> 				       (remove-prefix "/home/britt/.local/share/mail/b3l.xyz/britt/archives")))
>
>
> There is a maildir "y2023" that lives in archives. Using gnus I can read
> the mail in there.
>
> Before I start gnus none of the gnus-* variables are available from C-h
> v.
>
> After I start gnus I can see many of them, but not the gnus-search-*
> variables.
>
> After I go into gnus and try to perform a search on that directory then
> the gnus-search variables become visible. When I do C-h v
> gnus-search-mu-remove-prefix it still shows "/home/britt/Mail" even
> though the remove prefix was set above. Is my syntax bad somehow?

Your syntax is fine! `gnus-search-mu-remove-prefix' is used as a default
value for `gnus-search-mu` engines, if they don't set their own
`remove-prefix' value. Your config above sets that option, so the global
variable will be ignored in this case. Sorry if that was a bit of a
wild goose chase.

Your configuration looks correct (your configuration also reveals an
annoying redundancy in gnus-search, which is that most nnmail
backends have a "directory" value that can and should be used as the
value of remove-prefix).

Basically, if you're seeing "a maildir "y2023" that lives in archives"
as a Gnus group, then this is just a bug in gnus-search's mu handling,
plain and simple.

> Just hoping this may give you an idea where the trouble lies. Still
> working hard to get back to gnus again.

Thanks for keeping at it! Don't lose hope, and I'll try to figure out
what's going on with gnus-search.

bug#66885: 29.1; gnus search with mu always returns empty

[Britt Anderson]

Eric Abrahamsen <eric@ericabrahamsen.net> writes:

> Your configuration looks correct (your configuration also reveals an
> annoying redundancy in gnus-search, which is that most nnmail
> backends have a "directory" value that can and should be used as the
> value of remove-prefix).
>
> Basically, if you're seeing "a maildir "y2023" that lives in archives"
> as a Gnus group, then this is just a bug in gnus-search's mu handling,
> plain and simple.

I think the bug starts on line 1952 of gnus-search.el.gz (when opened in
emacs). It is in the definition of the method for

~ cl-defmethod gnus-search-indexed-search-command ((engine
gnus-search-mu) ... ~

And the lines are:

	,@(if groups
	      `("and" "("
		,@(nbutlast (mapcan (lambda (x)
				      (list (concat "maildir:/" x) "or"))
				    groups))
		")")
	    "")


This splices the groups to be searched into the mu find query, but they
seem to mess up the search when put in there (at least the way I have mu
configured). When I comment out the offending lines above and recompile,
I can now search from withing gnus using G G. I noticed that this same
code for groups appears in the "grep" search that follows the mu method,
but did not appear in the method definitions above (including notmuch,
which also relies on xapian under the hood I believe) so I decided to
try the change.

Hope this information proves useful.

/Britt

bug#66885: 29.1; gnus search with mu always returns empty

[Eric Abrahamsen]

Britt Anderson <britt@uwaterloo.ca> writes:

> Eric Abrahamsen <eric@ericabrahamsen.net> writes:
>
>> Your configuration looks correct (your configuration also reveals an
>> annoying redundancy in gnus-search, which is that most nnmail
>> backends have a "directory" value that can and should be used as the
>> value of remove-prefix).
>>
>> Basically, if you're seeing "a maildir "y2023" that lives in archives"
>> as a Gnus group, then this is just a bug in gnus-search's mu handling,
>> plain and simple.
>
> I think the bug starts on line 1952 of gnus-search.el.gz (when opened in
> emacs). It is in the definition of the method for

(Thank you for continuing to bug-hunt, this looks promising, I've just
gotten back from traveling and will set this up to test soon...)

bug#66885: 29.1; gnus search with mu always returns empty

[Eric Abrahamsen]

Eric Abrahamsen <eric@ericabrahamsen.net> writes:

> Britt Anderson <britt@uwaterloo.ca> writes:
>
>> Eric Abrahamsen <eric@ericabrahamsen.net> writes:
>>
>>> Your configuration looks correct (your configuration also reveals an
>>> annoying redundancy in gnus-search, which is that most nnmail
>>> backends have a "directory" value that can and should be used as the
>>> value of remove-prefix).
>>>
>>> Basically, if you're seeing "a maildir "y2023" that lives in archives"
>>> as a Gnus group, then this is just a bug in gnus-search's mu handling,
>>> plain and simple.
>>
>> I think the bug starts on line 1952 of gnus-search.el.gz (when opened in
>> emacs). It is in the definition of the method for
>
> (Thank you for continuing to bug-hunt, this looks promising, I've just
> gotten back from traveling and will set this up to test soon...)

Hi Britt, I'm finally getting around to testing this. I set up mu with a
local maildir, and so far I'm not able to reproduce the problem. I mark
two maildir groups and search for unread messages with "mark:unread".

The search arguments constructed by gnus-search look like:

("find" "--nocolor" "--muhome=/home/eric/.cache/mu" "" "" "flag:unread"
"and" "(" "maildir:/mails" "or" "maildir:/Welcome" ")" "--format=plain"
"--fields=l")

Putting that on the command line and running it gives 17 results, and I
see the same 17 results within the Gnus search buffer. With the search
engine's `remove-prefix` set to the full system file path up to the main
directory of the nnmaildir backend (under which the groups appear as
top-level directories) the results are shown correctly within Gnus.

The group handling code you noticed is necessary, the
`(concat "maildir:/" x)` code is mu-specific.

I'm not sure what else to try! Even if mu is returning results from
other Gnus backends, that shouldn't cause a failure. Though mu has the
"path:" key we can use with remove-prefix...

The last things to try would be: setting `gnus-verbose' to 10, trying
the search, and telling me what you find in *Message*, and...

eval'ing this version of the mu command method, that includes the
"path:" key. Does this fix the problem?

(cl-defmethod gnus-search-indexed-search-command ((engine gnus-search-mu)
						  (qstring string)
						  query &optional groups)
  (let ((limit (alist-get 'limit query))
	(thread (alist-get 'thread query)))
    (with-slots (switches config-directory remove-prefix) engine
      `("find" 			; command must come first
	"--nocolor"		; mu will always give colored output otherwise
	,(format "--muhome=%s" config-directory)
	,@switches
	,(if thread "-r" "")
	,(if limit (format "--maxnum=%d" limit) "")
	,qstring
	,@(if groups
	      `("and" "("
		,@(nbutlast (mapcan (lambda (x)
				      (list (concat "maildir:/" x) "or"))
				    groups))
		")")
	    "")
	,(format "path:%s" (file-name-as-directory
                    (expand-file-name remove-prefix "/")))
	"--format=plain"
	"--fields=l"))))

bug#66885: 29.1; gnus search with mu always returns empty

[Eric Abrahamsen]

On 01/05/24 11:24 AM, Britt Anderson wrote:
>>Hi Britt, I'm finally getting around to testing this. I set up mu with a
>>local maildir, and so far I'm not able to reproduce the problem. I mark
>>two maildir groups and search for unread messages with "mark:unread".
>>
>>The search arguments constructed by gnus-search look like:
>>
>>("find" "--nocolor" "--muhome=/home/eric/.cache/mu" "" "" "flag:unread"
>>"and" "(" "maildir:/mails" "or" "maildir:/Welcome" ")" "--format=plain"
>>"--fields=l")
>
> Thanks for getting back to me. I can get results with a similar
> command on the command line, but the same search in gnus still
> returns empty. My mail (for three different addresses) lives in
> /home/britt/.local/mail with the unique part of the directory
> hierarchy following the above. I edited my gnus.el to remove that
> common part as the "remove prefix", but still returned empty.
>
>
>>I'm not sure what else to try! Even if mu is returning results from
>>other Gnus backends, that shouldn't cause a failure. Though mu has the
>>"path:" key we can use with remove-prefix...
>>
>>The last things to try would be: setting `gnus-verbose' to 10, trying
>>the search, and telling me what you find in *Message*, and...
>
> I tried this and only got:
>
> #+begin_verbatim
> Doing mu query on (nnmaildir+b3l-archives:y2023)...
> Group nnselect:nnselect-87zfxjahkq.fsf contains no messages

This is really weird, after the "Doing mu query on" message, you should
have either gotten a "Search engine returned N results" message, or an
error buffer pop-up. With `gnus-verbose' at 10 I don't know how you'd
get this particular message situation.

> Quit
> No other window to select
> Quit
> C-M-x is undefined
> 10 (#o12, #xa, ?\C-j)
> You can run the command ‘eval-expression’ with M-:
> 10 (#o12, #xa, ?\C-j)
> Mark set [2 times]
> #+end_verbatim
>
> That "10" at the end is me evaluating gnus-verbose to verify it was set
> to 10.  The details of the mu command are not displayed. 
>
>>
>>eval'ing this version of the mu command method, that includes the
>>"path:" key. Does this fix the problem?
>>
>>(cl-defmethod gnus-search-indexed-search-command ((engine gnus-search-mu)
>>						  (qstring string)
>>						  query &optional groups)
>>  (let ((limit (alist-get 'limit query))
>>	(thread (alist-get 'thread query)))
>>    (with-slots (switches config-directory remove-prefix) engine
>>      `("find" 			; command must come first
>>	"--nocolor"		; mu will always give colored output otherwise
>>	,(format "--muhome=%s" config-directory)
>>	,@switches
>>	,(if thread "-r" "")
>>	,(if limit (format "--maxnum=%d" limit) "")
>>	,qstring
>>	,@(if groups
>>	      `("and" "("
>>		,@(nbutlast (mapcan (lambda (x)
>>				      (list (concat "maildir:/" x) "or"))
>>				    groups))
>>		")")
>>	    "")
>>	,(format "path:%s" (file-name-as-directory
>>                    (expand-file-name remove-prefix "/")))
>>	"--format=plain"
>>	"--fields=l"))))
>
> I did try this with no change. 
>
> I think you have given it the hero's try. Since it works for you and
> not for me I assume it is a problem on my side, and given the limited
> number of users it is probably not worth more of your time at this
> point. Thanks for all your efforts. Gnus is great and I don't want you
> to have to spend too much time on this. 

Okay, I'm closing the bug report for now, but I really would like
gnus-search to be as robust as possible. If anything more jumps out at
you, or there are any other further developments, please let me know!

Yours,
Eric