bug#43896: 28.0.50; End of file during parsing ~/.pop3-uidl

bug#43896: 28.0.50; End of file during parsing ~/.pop3-uidl

[Mats Lidell]

Trying to use gnus with pop3 but getting "end of file during parsing ~/.pop3-uidl" when fetching mail. The file that is created when fetching mails look strange:

(("fencepost.gnu.org"
  ("matsl"
   "Mm6!!WRW!!3k~"!*&@!!" (24448 57982)
   "bL^"!i1n!!W#N"!Q$I!!" (24448 57982)
   "Dc7!!~J-!!X1T!!A%$#!" (24448 57982)
   "\L9!!GWa"!n+p"!Q1^"!" (24448 57982))))

Any ideas what could be causing this?


In GNU Emacs 28.0.50 (build 7, x86_64-pc-linux-gnu, GTK+ Version 3.24.22, cairo version 1.16.0)
 of 2020-10-10 built on barnacle
Repository revision: 5824c209ba17b97978519ea62478c57010311e88
Repository branch: master
Windowing system distributor 'The X.Org Foundation', version 11.0.12008000
System Description: Gentoo/Linux

Configured using:
 'configure --prefix=/home/matsl --with-mailutils --with-dumping=pdumper'

Configured features:
XPM JPEG TIFF GIF PNG RSVG CAIRO SOUND GPM DBUS GSETTINGS GLIB NOTIFY INOTIFY ACL GNUTLS LIBXML2 FREETYPE HARFBUZZ ZLIB TOOLKIT_SCROLL_BARS GTK3 X11 XDBE XIM MODULES THREADS LIBSYSTEMD PDUMPER LCMS2

Important settings:
  value of $LC_MONETARY: sv_SE.UTF-8
  value of $LC_NUMERIC: sv_SE.UTF-8
  value of $LC_TIME: sv_SE.UTF-8
  value of $LANG: sv_SE.UTF-8
  value of $XMODIFIERS: @im=ibus
  locale-coding-system: utf-8-unix

Major mode: ELisp/d

Minor modes in effect:
  global-company-mode: t
  company-mode: t
  ace-window-display-mode: t
  editorconfig-mode: t
  override-global-mode: t
  counsel-mode: t
  ivy-mode: t
  desktop-save-mode: t
  global-magit-file-mode: t
  magit-auto-revert-mode: t
  global-git-commit-mode: t
  savehist-mode: t
  global-undo-tree-mode: t
  undo-tree-mode: t
  recentf-mode: t
  delete-selection-mode: t
  show-paren-mode: t
  save-place-mode: t
  display-time-mode: t
  async-bytecomp-package-mode: t
  shell-dirtrack-mode: t
  cl-old-struct-compat-mode: t
  tooltip-mode: t
  global-eldoc-mode: t
  eldoc-mode: t
  electric-indent-mode: t
  mouse-wheel-mode: t
  tool-bar-mode: t
  menu-bar-mode: t
  file-name-shadow-mode: t
  global-font-lock-mode: t
  font-lock-mode: t
  auto-composition-mode: t
  auto-encryption-mode: t
  auto-compression-mode: t
  size-indication-mode: t
  column-number-mode: t
  line-number-mode: t
  transient-mark-mode: t

Load-path shadows:
None found.

Features:
(magit-bookmark bookmark help-fns radix-tree cl-print debug backtrace pp shadow warnings emacsbug smiley gnus-async gnus-bcklg gnus-salt gnus-ml rfc2104 sort gnus-cite bbdb-message mailalias mail-extr hsmail flyspell ispell pop3 gnus-topic cursor-sensor nndraft nnmh nnml utf-7 nnfolder epa-file gnutls gnus-agent gnus-srvr gnus-score score-mode nnvirtual gnus-cache gnus-demon nntp spam spam-stat gnus-uu yenc gnus-msg bbdb-gnus hywconfig disp-table enriched kotl-mode kcell knode kvspec kfile kview kfill klabel kmenu kproperty sh-script executable vc-cvs mhtml-mode css-mode smie eww url-queue mm-url js cc-mode cc-fonts cc-guess cc-menus cc-cmds cc-styles cc-align cc-engine cc-vars cc-defs sgml-mode vc bug-reference vc-git conf-mode dired-aux vc-dispatcher editorconfig-core editorconfig-core-handle editorconfig-fnmatch company-oddmuse company-keywords company-etags etags fileloop company-gtags company-dabbrev-code company-dabbrev company-files company-clang company-capf company-cmake company-semantic company-template company-bbdb company .emacs ace-window avy rc-hyperbole kotl-note hib-ashell ashell hyperbole hinit hibtypes hib-doc-id hsys-org hsys-www klink hib-kbd hib-social hib-debbugs hactypes hui-mini hui hui-mouse hmouse-key hargs hui-menu hyrolo-menu hui-jmenu hmouse-sh hmouse-drv hypb locate hui-window pulse hycontrol hsettings hui-em-but hyrolo hmail hbut hact hpath hhist hbdata htz cal-julian hbmap hmoccur hui-select hvar set hversion hload-path hyperbole-autoloads kotl-autoloads ob-plantuml rc-editorconfig editorconfig rc-dired-sidebar dired-sidebar dired-subtree dired-hacks-utils use-package-bind-key bind-key use-package-ensure use-package-core autoinsert org-element avl-tree generator ol-eww ol-rmail ol-mhe ol-irc ol-info ol-gnus nnselect nnir gnus-art mm-uu mml2015 mm-view mml-smime smime dig gnus-sum url url-proxy url-privacy url-expand url-methods url-history mailcap shr kinsoku url-cookie url-domsuf svg dom gnus-group gnus-undo gnus-start gnus-dbus dbus xml gnus-cloud nnimap nnmail mail-source utf7 netrc nnoo gnus-spec gnus-int gnus-range gnus-win gnus nnheader ol-docview doc-view jka-compr image-mode exif ol-bibtex bibtex ol-bbdb ol-w3m org-agenda rc-org-journal org-journal org-crypt cal-iso org ob ob-tangle ob-ref ob-lob ob-table ob-exp org-macro org-footnote org-src ob-comint org-pcomplete org-list org-faces org-entities org-version ob-emacs-lisp ob-core ob-eval org-table ol org-keys org-compat org-macs org-loaddefs org-install lsp-python-ms projectile grep ibuf-ext ibuffer ibuffer-loaddefs lsp-ui lsp-ui-flycheck lsp-ui-doc goto-addr lsp-ui-imenu lsp-ui-peek lsp-ui-sideline face-remap flycheck lsp-mode yasnippet url-util spinner pcase network-stream nsm markdown-mode rx thingatpt lv inline f ewoc dash-functional bindat find-func lsp-protocol s ht rc-ivy counsel xdg xref project compile swiper two-column ivy ivy-faces ivy-overlay colir color site-gentoo ecb-autoloads desktop frameset dmacro bbdb-mua bbdb-com bbdb bbdb-site timezone smtpmail sendmail dired-x view mule-util solar cal-dst holidays hol-loaddefs vc-hg noutline outline appt diary-lib diary-loaddefs sv-kalender-namnsdagar cal-menu calendar cal-loaddefs magit-submodule magit-obsolete magit-blame magit-stash magit-reflog magit-bisect magit-push magit-pull magit-fetch magit-clone magit-remote magit-commit magit-sequence magit-notes magit-worktree magit-tag magit-merge magit-branch magit-reset magit-files magit-refs magit-status magit magit-repos magit-apply magit-wip magit-log which-func imenu magit-diff smerge-mode diff-mode magit-core magit-autorevert autorevert filenotify magit-margin magit-transient magit-process magit-mode git-commit transient magit-git magit-section magit-utils crm log-edit easy-mmode message rmc puny dired dired-loaddefs rfc822 mml mml-sec epa derived epg epg-config gnus-util rmail rmail-loaddefs text-property-search mm-decode mm-bodies mm-encode mail-parse rfc2231 rfc2047 rfc2045 mm-util ietf-drums mail-prsvr mailabbrev mail-utils gmm-utils mailheader pcvs-util add-log with-editor cl-extra help-mode server dash savehist undo-tree diff edmacro kmacro iso-transl recentf tree-widget wid-edit delsel matsl-theme paren saveplace time async-bytecomp advice async cus-start cus-load tramp tramp-loaddefs trampver tramp-integration files-x tramp-compat shell pcomplete comint ansi-color ring parse-time iso8601 time-date ls-lisp format-spec info package easymenu browse-url url-handlers url-parse auth-source cl-seq eieio eieio-core cl-macs eieio-loaddefs password-cache json subr-x map url-vars seq byte-opt gv bytecomp byte-compile cconv cl-loaddefs cl-lib tooltip eldoc electric uniquify ediff-hook vc-hooks lisp-float-type mwheel term/x-win x-win term/common-win x-dnd tool-bar dnd fontset image regexp-opt fringe tabulated-list replace newcomment text-mode elisp-mode lisp-mode prog-mode register page tab-bar menu-bar rfn-eshadow isearch timer select scroll-bar mouse jit-lock font-lock syntax facemenu font-core term/tty-colors frame minibuffer cl-generic cham georgian utf-8-lang misc-lang vietnamese tibetan thai tai-viet lao korean japanese eucjp-ms cp51932 hebrew greek romanian slovak czech european ethiopic indian cyrillic chinese composite charscript charprop case-table epa-hook jka-cmpr-hook help simple abbrev obarray cl-preloaded nadvice button loaddefs faces cus-face macroexp files window text-properties overlay sha1 md5 base64 format env code-pages mule custom widget hashtable-print-readable backquote threads dbusbind inotify lcms2 dynamic-setting system-font-setting font-render-setting cairo move-toolbar gtk x-toolkit x multi-tty make-network-process emacs)

Memory information:
((conses 16 648866 537311)
 (symbols 48 55471 2)
 (strings 32 198266 71217)
 (string-bytes 1 6439531)
 (vectors 16 91515)
 (vector-slots 8 1095123 544593)
 (floats 8 919 2335)
 (intervals 56 16007 2835)
 (buffers 992 72))

bug#43896: 28.0.50; End of file during parsing ~/.pop3-uidl

[Lars Ingebrigtsen]

Mats Lidell <matsl@gnu.org> writes:

> Trying to use gnus with pop3 but getting "end of file during parsing ~/.pop3-uidl" when fetching mail. The file that is created when fetching mails look strange:
>
> (("fencepost.gnu.org"
>   ("matsl"
>    "Mm6!!WRW!!3k~"!*&@!!" (24448 57982)
>    "bL^"!i1n!!W#N"!Q$I!!" (24448 57982)
>    "Dc7!!~J-!!X1T!!A%$#!" (24448 57982)
>    "\L9!!GWa"!n+p"!Q1^"!" (24448 57982))))
>
> Any ideas what could be causing this?

I'm not sure whether that file looks strange or not?  It looks
well-formed, at least.

But a backtrace would be helpful.  (setq debug-on-error t), repeat the
bug and post the resulting backtrace.

-- 
(domestic pets only, the antidote for overdose, milk.)
   bloggy blog: http://lars.ingebrigtsen.no

bug#43896: 28.0.50; End of file during parsing ~/.pop3-uidl

[Lars Ingebrigtsen]

(Please keep the debbugs address in the Cc header.)

Mats Lidell <matsl@gnu.org> writes:

>> Lars Ingebrigtsen writes:
>> I'm not sure whether that file looks strange or not?  It looks
>> well-formed, at least.
>
> Yes, you are right. Today I can't recreate that particular error.
>
>> But a backtrace would be helpful.  (setq debug-on-error t), repeat the
>> bug and post the resulting backtrace.
>
> Today I get the following error in *Messages*
>
> Mail source (pop :server fencepost.gnu.org :port 995 :user matsl
> :authentication apop :stream ssl :leave 14) failed:
> (wrong-type-argument listp !!)

I'm not sure whether that looks related or not...

> My mail-sources looks like this which seems OK.
>
> (setq mail-sources
>       '((pop :server "fencepost.gnu.org" :port 995 :user "matsl"
> :authentication apop :stream ssl :leave 14)))
>
> Setting debug on error or debug on quit does not produce any
> backtrace.  Is it because this happens in a gnus-byte-compile section?

Is gnus-byte-compile involved here?  I'm not sure I follow.

Anyway, I forgot about all the error-catching stuff here.

(setq debug-on-signal t)

should give you a backtrace.  But it may give you many backtraces,
because it basically makes most ignored errors give you a backtrace, so
it should only be set just before you run this stuff and then switched
off again.

bug#43896: 28.0.50; End of file during parsing ~/.pop3-uidl

[Mats Lidell]

> Lars Ingebrigtsen writes:
> (Please keep the debbugs address in the Cc header.)

OOPS! Sorry. Trying to learn using debbugs.

[...]
> Is gnus-byte-compile involved here?  I'm not sure I follow.
>
> Anyway, I forgot about all the error-catching stuff here.
>
> (setq debug-on-signal t)
>
> should give you a backtrace.

I was just guessing about gnus-byte-compile causing problems. Reading the help
for debug-on-error I now think it is that the code is executed in a
condition-case that stops the backtrace from being created. Using
debug-on-signal does not seem to help in this respect either. (But I don't
know elisp good enough to tell.) Anyway the patch provided by Andreas seems to
do the trick.

bug#43896: 28.0.50; End of file during parsing ~/.pop3-uidl

[Andreas Schwab]

On Okt 10 2020, Lars Ingebrigtsen wrote:

> Mats Lidell <matsl@gnu.org> writes:
>
>> Trying to use gnus with pop3 but getting "end of file during parsing ~/.pop3-uidl" when fetching mail. The file that is created when fetching mails look strange:
>>
>> (("fencepost.gnu.org"
>>   ("matsl"
>>    "Mm6!!WRW!!3k~"!*&@!!" (24448 57982)
>>    "bL^"!i1n!!W#N"!Q$I!!" (24448 57982)
>>    "Dc7!!~J-!!X1T!!A%$#!" (24448 57982)
>>    "\L9!!GWa"!n+p"!Q1^"!" (24448 57982))))
>>
>> Any ideas what could be causing this?
>
> I'm not sure whether that file looks strange or not?  It looks
> well-formed, at least.

It's not, the embedded double quotes need to be quoted.

diff --git a/lisp/net/pop3.el b/lisp/net/pop3.el
index 6f5898437c..d7d563fbc2 100644
--- a/lisp/net/pop3.el
+++ b/lisp/net/pop3.el
@@ -463,7 +463,7 @@ Return non-nil if it is necessary to update the local UIDL file."
 		(when (cdr elt)
 		  (insert "(\"" (pop elt) "\"\n   ")
 		  (while elt
-		    (insert (format "\"%s\" %s\n   " (pop elt) (pop elt))))
+		    (insert (format "%S %s\n   " (pop elt) (pop elt))))
 		  (delete-char -4)
 		  (insert ")\n  ")))
 	      (delete-char -3)

-- 
Andreas Schwab, schwab@linux-m68k.org
GPG Key fingerprint = 7578 EB47 D4E5 4D69 2510  2552 DF73 E780 A9DA AEC1
"And now for something completely different."

bug#43896: 28.0.50; End of file during parsing ~/.pop3-uidl

[Mats Lidell]

> Andreas Schwab writes:
> It's not, the embedded double quotes need to be quoted.

Thanks! I applied the patch and things start to work as expected.

bug#43896: (no subject)

[Mats Lidell]

> Mats Lidell writes:
> > Andreas Schwab writes:
> > It's not, the embedded double quotes need to be quoted.
>
> Thanks! I applied the patch and things start to work as expected.

Hi, just a friendly ping that the patch has served me well for nearly three months now. What is the proper action to bring this forward? Shall I raise a PR or is the bug report enough?

Yours
-- 
%% Mats

bug#43896: (no subject)

[Lars Ingebrigtsen]

Mats Lidell <matsl@gnu.org> writes:

> Hi, just a friendly ping that the patch has served me well for nearly
> three months now. What is the proper action to bring this forward?
> Shall I raise a PR or is the bug report enough?

Oh, I assumed Andreas had pushed the fix.  I've now done so.

-- 
(domestic pets only, the antidote for overdose, milk.)
   bloggy blog: http://lars.ingebrigtsen.no