From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: Eli Zaretskii Newsgroups: gmane.emacs.bugs Subject: bug#71893: 27.1; Gnus pop3 download progress goes over 100% Date: Sat, 28 Sep 2024 12:19:01 +0300 Message-ID: <86cyko6sqi.fsf@gnu.org> References: <87o77geojf.fsf@DESKTOP-1FS65SF.i-did-not-set--mail-host-address--so-tickle-me> <87zfqz9zo2.fsf@jeremybryant.net> <86y15wcr6d.fsf@gnu.org> <86zfpssoyv.fsf@gnu.org> <86zfotcemg.fsf@gnu.org> Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="32852"; mail-complaints-to="usenet@ciao.gmane.io" Cc: jb@jeremybryant.net, 71893@debbugs.gnu.org To: Daniel Bastos Original-X-From: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org Sat Sep 28 11:19:58 2024 Return-path: Envelope-to: geb-bug-gnu-emacs@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1suTcL-0008Mj-73 for geb-bug-gnu-emacs@m.gmane-mx.org; Sat, 28 Sep 2024 11:19:57 +0200 Original-Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1suTby-0007Kv-DU; Sat, 28 Sep 2024 05:19:34 -0400 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1suTbx-0007Kl-18 for bug-gnu-emacs@gnu.org; Sat, 28 Sep 2024 05:19:33 -0400 Original-Received: from debbugs.gnu.org ([2001:470:142:5::43]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1suTbw-0005I0-Ou for bug-gnu-emacs@gnu.org; Sat, 28 Sep 2024 05:19:32 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=debbugs.gnu.org; s=debbugs-gnu-org; h=MIME-version:References:In-Reply-To:From:Date:To:Subject; bh=iDSuVM6lQyIfgEWHIG/D9Nf4G5vW/sJtLtWDc1eFGtg=; b=asIWsmFauFSsZs4aMw2yz5FYnD3592jTZ0dZDoPmDOK07346rZe1J+TD4qmJbsM9FcZ6IurGYlQq8ZQpnZtFOVsA0xJq/LPXE5aGSfukobUWXztTLrVRedAPlLS4k/+VNuNqmOk3p6GRwscuSPt/GD90mueQrju8/sWy/w3RO5jGFItpivtYyr1JGUZQiBlBPTu1ePWXYBSak5EUpOEytfJET7PSbwl29o884+8G+1Cy5fqSKY7W1EuHeNlsbwlQ81aSrq06y4kA7V2jDT3LKIfOQsk4yZbAA2fqy3bnUFt0H7ipF8WQV8UVOQNJtN+ScAO8eQMgT5/7/oXCyFXW5Q==; Original-Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1suTcQ-0007Lt-F0 for bug-gnu-emacs@gnu.org; Sat, 28 Sep 2024 05:20:02 -0400 X-Loop: help-debbugs@gnu.org Resent-From: Eli Zaretskii Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Sat, 28 Sep 2024 09:20:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 71893 X-GNU-PR-Package: emacs Original-Received: via spool by 71893-submit@debbugs.gnu.org id=B71893.172751518428224 (code B ref 71893); Sat, 28 Sep 2024 09:20:02 +0000 Original-Received: (at 71893) by debbugs.gnu.org; 28 Sep 2024 09:19:44 +0000 Original-Received: from localhost ([127.0.0.1]:51844 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1suTc8-0007L9-1J for submit@debbugs.gnu.org; Sat, 28 Sep 2024 05:19:44 -0400 Original-Received: from eggs.gnu.org ([209.51.188.92]:37860) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1suTc5-0007Kv-Fj for 71893@debbugs.gnu.org; Sat, 28 Sep 2024 05:19:42 -0400 Original-Received: from fencepost.gnu.org ([2001:470:142:3::e]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1suTbV-0005GM-FA; Sat, 28 Sep 2024 05:19:05 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-version:References:Subject:In-Reply-To:To:From: Date; bh=iDSuVM6lQyIfgEWHIG/D9Nf4G5vW/sJtLtWDc1eFGtg=; b=RgGWzemr0SeGx30viwXX lxiKMSRciKu2H0t5n5iM5YPc2SNmNa++rQ8hll5Jl+QlWodH/t3RtzWSZxxC2FqFeIjqjFezCZ84a DlETy0xrdcEnBQO3JOoWQJisRWZVf/u5jeBmxevHxeBdG55z9ixm9Dsk/Q0Ixr+/wn+DhVusAApqK BeklpPAjj/YGGrPU2d5dTPD3g9QkqEv+Np0nFGs8LND+RLEVxnvbiiT2zY6h2CS0chXpOj3MItdfA hVtALKd5BxYXEpFLzn1FrKVBVWyPt2iRoHMBfK84mCZri08ApITnq4CCwRv0AmsdoWQxyhdW1wbOj XudLCAUKN+Kf+g==; In-Reply-To: (message from Daniel Bastos on Thu, 19 Sep 2024 16:13:30 -0300) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-BeenThere: bug-gnu-emacs@gnu.org List-Id: "Bug reports for GNU Emacs, the Swiss army knife of text editors" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org Original-Sender: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org Xref: news.gmane.io gmane.emacs.bugs:292560 Archived-At: > From: Daniel Bastos > Date: Thu, 19 Sep 2024 16:13:30 -0300 > Cc: jb@jeremybryant.net, 71893@debbugs.gnu.org > > On Mon, Sep 9, 2024 at 8:29 PM Daniel Bastos wrote: > > > > On Sat, Aug 31, 2024 at 4:53 AM Eli Zaretskii wrote: > > > Any progress there? > > > > I've the 29.3 set up and I have not yet managed to reproduce. > > Now I did. The problem happens in > > GNU Emacs 29.3 (build 2, x86_64-w64-mingw32) of 2024-03-24 > > too. Here's what I found in the POP3 before fetching my mail. > > +OK 69 messages (2041560 bytes) > 1 1243 > 2 56203 > 3 5694 > 4 1858 > 5 8704 > 6 2264 > 7 1626 > 8 1626 > 9 1626 > 10 8704 > 11 15079 > 12 15079 > 13 15079 > 14 1858 > 15 6303 > 16 1303 > 17 1303 > 18 1858 > 19 8704 > 20 8704 > 21 8581 > 22 8704 > 23 8581 > 24 13969 > 25 13969 > 26 61517 > 27 9590 > 28 47193 > 29 61517 > 30 47193 > 31 13969 > 32 16591 > 33 1880 > 34 56203 > 35 16591 > 36 16591 > 37 61517 > 38 12830 > 39 56203 > 40 56203 > 41 13969 > 42 16591 > 43 16591 > 44 8581 > 45 1880 > 46 1880 > 47 56203 > 48 12830 > 49 8704 > 50 12830 > 51 61517 > 52 1880 > 53 6303 > 54 6303 > 55 61517 > 56 61517 > 57 61517 > 58 61517 > 59 61517 > 60 61517 > 61 9590 > 62 9590 > 63 237515 > 64 236784 > 65 56203 > 66 56203 > 67 56203 > 68 12830 > 69 17268 > . > +OK Farewell. > > If I sum the bytes of each message, I get > > %awk '{ sum += $2; } END { print(sum) }' pop3-list.txt > 2041560 > > which is exactly the advertised total at the top. The Gmail POP3 > makes minimum sense. And here's the log after having Gnus fetch all > the messages. (I couldn't keep the beginning lines because the > *messages* buffer erased them, but the log shows that Gnus is going > well beyond 100%.) > > pop3 retrieved 6945KB (340%) > [...] > pop3 retrieved 9992KB (489%) > pop3 retrieved 10386KB (508%) > Saving file ~/.pop3-uidl... > Wrote c:/Users/x/AppData/Roaming/.pop3-uidl > Wrote c:/Users/x/AppData/Roaming/Mail/mail/misc/118 > Wrote c:/Users/x/AppData/Roaming/Mail/mail/misc/119 > [...] > Wrote c:/Users/x/AppData/Roaming/Mail/mail/misc/186 > nnml: Reading incoming mail (69 new)...done > Reading active file via nnml...done > Checking new news...done > > Here's a check of how much data I get after having written each > message to the file system. > > %ls -l | awk '$8 >= 118 && $8 <= 186 { total += $5; print; } END { > print(total) }' > -rw-rw-rw- 1 x None 1472 2024-09-19 16:00 118 > -rw-rw-rw- 1 x None 876549 2024-09-19 16:00 119 > -rw-rw-rw- 1 x None 5925 2024-09-19 16:00 120 > -rw-rw-rw- 1 x None 963 2024-09-19 16:00 121 > -rw-rw-rw- 1 x None 7307 2024-09-19 16:00 122 > -rw-rw-rw- 1 x None 2494 2024-09-19 16:00 123 > -rw-rw-rw- 1 x None 1459 2024-09-19 16:00 124 > -rw-rw-rw- 1 x None 7773 2024-09-19 16:00 125 > -rw-rw-rw- 1 x None 1855 2024-09-19 16:00 126 > -rw-rw-rw- 1 x None 2380 2024-09-19 16:00 127 > -rw-rw-rw- 1 x None 573608 2024-09-19 16:00 128 > -rw-rw-rw- 1 x None 13685 2024-09-19 16:00 129 > -rw-rw-rw- 1 x None 15324 2024-09-19 16:00 130 > -rw-rw-rw- 1 x None 7416 2024-09-19 16:00 131 > -rw-rw-rw- 1 x None 6056691 2024-09-19 16:00 132 > -rw-rw-rw- 1 x None 6596 2024-09-19 16:00 133 > -rw-rw-rw- 1 x None 1532 2024-09-19 16:00 134 > -rw-rw-rw- 1 x None 2088 2024-09-19 16:00 135 > -rw-rw-rw- 1 x None 9087 2024-09-19 16:00 136 > -rw-rw-rw- 1 x None 1398 2024-09-19 16:00 137 > -rw-rw-rw- 1 x None 10892 2024-09-19 16:00 138 > -rw-rw-rw- 1 x None 7740 2024-09-19 16:00 139 > -rw-rw-rw- 1 x None 3172 2024-09-19 16:00 140 > -rw-rw-rw- 1 x None 14922 2024-09-19 16:00 141 > -rw-rw-rw- 1 x None 15983 2024-09-19 16:00 142 > -rw-rw-rw- 1 x None 9209 2024-09-19 16:00 143 > -rw-rw-rw- 1 x None 12690 2024-09-19 16:00 144 > -rw-rw-rw- 1 x None 49851 2024-09-19 16:00 145 > -rw-rw-rw- 1 x None 3123 2024-09-19 16:00 146 > -rw-rw-rw- 1 x None 47433 2024-09-19 16:00 147 > -rw-rw-rw- 1 x None 13070 2024-09-19 16:00 148 > -rw-rw-rw- 1 x None 186296 2024-09-19 16:00 149 > -rw-rw-rw- 1 x None 1108 2024-09-19 16:00 150 > -rw-rw-rw- 1 x None 202280 2024-09-19 16:00 151 > -rw-rw-rw- 1 x None 16064 2024-09-19 16:00 152 > -rw-rw-rw- 1 x None 17431 2024-09-19 16:00 153 > -rw-rw-rw- 1 x None 39122 2024-09-19 16:00 154 > -rw-rw-rw- 1 x None 10617 2024-09-19 16:00 155 > -rw-rw-rw- 1 x None 32890 2024-09-19 16:00 156 > -rw-rw-rw- 1 x None 34388 2024-09-19 16:00 157 > -rw-rw-rw- 1 x None 14204 2024-09-19 16:00 158 > -rw-rw-rw- 1 x None 15540 2024-09-19 16:00 159 > -rw-rw-rw- 1 x None 16822 2024-09-19 16:00 160 > -rw-rw-rw- 1 x None 8825 2024-09-19 16:00 161 > -rw-rw-rw- 1 x None 6727 2024-09-19 16:00 162 > -rw-rw-rw- 1 x None 6521 2024-09-19 16:00 163 > -rw-rw-rw- 1 x None 934797 2024-09-19 16:00 164 > -rw-rw-rw- 1 x None 11879 2024-09-19 16:00 165 > -rw-rw-rw- 1 x None 8935 2024-09-19 16:00 166 > -rw-rw-rw- 1 x None 3363 2024-09-19 16:00 167 > -rw-rw-rw- 1 x None 36427 2024-09-19 16:00 168 > -rw-rw-rw- 1 x None 2109 2024-09-19 16:00 169 > -rw-rw-rw- 1 x None 1886 2024-09-19 16:00 170 > -rw-rw-rw- 1 x None 6534 2024-09-19 16:00 171 > -rw-rw-rw- 1 x None 46503 2024-09-19 16:00 172 > -rw-rw-rw- 1 x None 44079 2024-09-19 16:00 173 > -rw-rw-rw- 1 x None 54344 2024-09-19 16:00 174 > -rw-rw-rw- 1 x None 52465 2024-09-19 16:00 175 > -rw-rw-rw- 1 x None 62311 2024-09-19 16:00 176 > -rw-rw-rw- 1 x None 61752 2024-09-19 16:00 177 > -rw-rw-rw- 1 x None 8929 2024-09-19 16:00 178 > -rw-rw-rw- 1 x None 9823 2024-09-19 16:00 179 > -rw-rw-rw- 1 x None 237754 2024-09-19 16:00 180 > -rw-rw-rw- 1 x None 237022 2024-09-19 16:00 181 > -rw-rw-rw- 1 x None 49595 2024-09-19 16:00 182 > -rw-rw-rw- 1 x None 53055 2024-09-19 16:00 183 > -rw-rw-rw- 1 x None 56433 2024-09-19 16:00 184 > -rw-rw-rw- 1 x None 13062 2024-09-19 16:00 185 > -rw-rw-rw- 1 x None 17499 2024-09-19 16:00 186 > 10403078 > > I get a lot more data---10,403,078 bytes. So it makes me feel that > Gnus is not at fault here; that it's the POP3 server that sometimes > advertises a total amount, but ends up providing a lot more than the > advertised value. I wouldn't assume this is an obvious bug of any > POP3 server, but it's what the evidence seems to suggest---that the > Gmail POP3 server says one thing and does another. I'm not an expert on POP3 protocol -- does it report bytes or characters? Also, do the files created by Gnus have Unix or DOS EOL format? If the latter, could the difference be explained by the added CR characters? Eventually, if the problem is with the server, what do we want to do with this bug report? what _can_ we do?