From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: Daniel Bastos Newsgroups: gmane.emacs.bugs Subject: bug#71893: 27.1; Gnus pop3 download progress goes over 100% Date: Sat, 28 Sep 2024 12:48:10 -0300 Message-ID: <87plonvkxx.fsf@ic.ufrj.br> References: <87o77geojf.fsf@DESKTOP-1FS65SF.i-did-not-set--mail-host-address--so-tickle-me> <87zfqz9zo2.fsf@jeremybryant.net> <86y15wcr6d.fsf@gnu.org> <86zfpssoyv.fsf@gnu.org> <86zfotcemg.fsf@gnu.org> <86cyko6sqi.fsf@gnu.org> Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="31661"; mail-complaints-to="usenet@ciao.gmane.io" Cc: jb@jeremybryant.net, 71893@debbugs.gnu.org, Daniel Bastos To: Eli Zaretskii Original-X-From: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org Sat Sep 28 18:18:55 2024 Return-path: Envelope-to: geb-bug-gnu-emacs@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1sua9m-00083z-LK for geb-bug-gnu-emacs@m.gmane-mx.org; Sat, 28 Sep 2024 18:18:55 +0200 Original-Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1sua9V-00058H-5k; Sat, 28 Sep 2024 12:18:37 -0400 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1sua9S-000582-5l for bug-gnu-emacs@gnu.org; Sat, 28 Sep 2024 12:18:34 -0400 Original-Received: from debbugs.gnu.org ([2001:470:142:5::43]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1sua9Q-0005Lc-SO for bug-gnu-emacs@gnu.org; Sat, 28 Sep 2024 12:18:33 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=debbugs.gnu.org; s=debbugs-gnu-org; h=MIME-Version:In-Reply-To:Date:References:From:To:Subject; bh=we3/dHiiAkn97ttO8m8lkUs1528OyTH1ekuqRpOwSek=; b=n5yT9Hg+1y7aW8xPBMFntCR4Hs7ucTLKEx+Hikiiyfu1KJ5QXmF71nX9HMVgALlN7RaXCGLOItLuGlKem6APjQfb9GZB39BsOmtXctape1+DG818uHvN5GTSXZOTK4+PRgnKPYo8TcbHUm3RH2PDAeZZ7Gc8m0HzDAiMhfd3auLVuMUuhR7xwPdEQjeD2q+pav/r9omxbt7HrEFvkLc9P8u9sC/Ib0DUC0NDvlKe/v/n5Kdf8oPGSquKAC3V6gH9kdLsclcqxtiuShk724qrHW2JbOb5+7OR+8i27bt43xE+x3I0w5lxmKYa6E37QpLUWbKxReAVUtCyI9N5luAAGg==; Original-Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1sua9u-0002aW-Qq for bug-gnu-emacs@gnu.org; Sat, 28 Sep 2024 12:19:02 -0400 X-Loop: help-debbugs@gnu.org Resent-From: Daniel Bastos Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Sat, 28 Sep 2024 16:19:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 71893 X-GNU-PR-Package: emacs Original-Received: via spool by 71893-submit@debbugs.gnu.org id=B71893.17275403209873 (code B ref 71893); Sat, 28 Sep 2024 16:19:02 +0000 Original-Received: (at 71893) by debbugs.gnu.org; 28 Sep 2024 16:18:40 +0000 Original-Received: from localhost ([127.0.0.1]:38386 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sua9X-0002Z9-Lt for submit@debbugs.gnu.org; Sat, 28 Sep 2024 12:18:40 -0400 Original-Received: from mail-qt1-f176.google.com ([209.85.160.176]:53389) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sua9U-0002Yk-Tb for 71893@debbugs.gnu.org; Sat, 28 Sep 2024 12:18:38 -0400 Original-Received: by mail-qt1-f176.google.com with SMTP id d75a77b69052e-4585721f6edso20042581cf.2 for <71893@debbugs.gnu.org>; Sat, 28 Sep 2024 09:18:06 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ic.ufrj.br; s=google; t=1727540221; x=1728145021; darn=debbugs.gnu.org; h=content-transfer-encoding:mime-version:message-id:in-reply-to:date :references:subject:cc:to:from:from:to:cc:subject:date:message-id :reply-to; bh=we3/dHiiAkn97ttO8m8lkUs1528OyTH1ekuqRpOwSek=; b=IfgBKXb6lbUA46CoYuDmrgHI2qDJf7wmFCteqXOxXgCIPNuZXdw3lrhNEpdOzI+RgC 4JJF5MlyIC4qgsPNNfvuF8Z3gOBlP8XJyouDD81ua+bPsbk9j92ofquUExDX7EvPCJ0X IFVUtnG2zj52cQVaRe0KI5HExCaKyE543VCU2E6GSdc5ozrcvKXmIvnxlqnrh3hKzSKv rgQZpRUD212GHaiSt4NADd+04PE40vqpuxqt6lDCGoIVscwH+iQ6CCaWuyBocEhOZGgQ 3GQR51FWetV2Z9LJhEKyPDvfgIo5GwffvhVHrU5YGm2Ow/wyis1yIF9XcG5MfmPuw1t1 Kaog== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1727540221; x=1728145021; h=content-transfer-encoding:mime-version:message-id:in-reply-to:date :references:subject:cc:to:from:x-gm-message-state:from:to:cc:subject :date:message-id:reply-to; bh=we3/dHiiAkn97ttO8m8lkUs1528OyTH1ekuqRpOwSek=; b=LRIhGJwwWTBBu/5DZTDpWRLQQxxF31DFAG3U8FcVXJJI7gZsriXDATwssMAgANpipm SXShaHqHxK6mqYCW2Q/BG0jLfHF5pdbsDXspJbpD10hugovDTIR+mWT5d/eRg/zLI4Vk CLR4Lj6BGNlmsJB0Qa15I0mCCU5LGGjOJ7f9jfzoTtnbg9SVSfuA/7FlsQWUmoey/KGy m277zMRnJoRIjABof7Xe3WxyaBvenkH9Khf3MQ+33aZPtOAGhtOmf9Stckqg7dJu9tG5 Uu12DWptzPswzXDGD7WzOTVq8+hdiWK317VWE/uB8SVR46/pMxLmQ0CMUXck2IgGzQ31 fKfQ== X-Forwarded-Encrypted: i=1; AJvYcCXwx1odcPFnpquygxmzoD3XQDut3ER8BsAkQsU7fhmClIzElNIi6s5GHNZpTorOrKdaJHmL0g==@debbugs.gnu.org X-Gm-Message-State: AOJu0YwsFMXKqbmNKjO3+0Apt+FvDXfEGOZmUpU4oLnzvU4fij+Ey/gd G6o3qQKPYsZVlis0O6nU/Q4GActj/KJV5YAehGURNdXNDUpNziJigQcD1DsOpU01j3qTY45RIMY = X-Google-Smtp-Source: AGHT+IFFE9qX6SBtAH/4/33iyjSBuWdUkS/MPmpfL38alDNjXi6Ux9MVSIK2nHCyUlb7pt5VmEPZyQ== X-Received: by 2002:a05:6a00:1304:b0:714:1d96:e6bd with SMTP id d2e1a72fcca58-71b25f6a9d1mr10391150b3a.13.1727538494077; Sat, 28 Sep 2024 08:48:14 -0700 (PDT) Original-Received: from DESKTOP-1FS65SF ([186.213.84.155]) by smtp.gmail.com with ESMTPSA id d2e1a72fcca58-71b264d73f3sm3354302b3a.90.2024.09.28.08.48.12 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sat, 28 Sep 2024 08:48:13 -0700 (PDT) In-Reply-To: <86cyko6sqi.fsf@gnu.org> (Eli Zaretskii's message of "Sat, 28 Sep 2024 12:19:01 +0300") X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-BeenThere: bug-gnu-emacs@gnu.org List-Id: "Bug reports for GNU Emacs, the Swiss army knife of text editors" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org Original-Sender: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org Xref: news.gmane.io gmane.emacs.bugs:292586 Archived-At: Eli Zaretskii writes: >> From: Daniel Bastos >> Date: Thu, 19 Sep 2024 16:13:30 -0300 >> Cc: jb@jeremybryant.net, 71893@debbugs.gnu.org >>=20 >> On Mon, Sep 9, 2024 at 8:29=E2=80=AFPM Daniel Bastos wrote: >> > >> > On Sat, Aug 31, 2024 at 4:53=E2=80=AFAM Eli Zaretskii w= rote: >> > > Any progress there? >> > >> > I've the 29.3 set up and I have not yet managed to reproduce. >>=20 >> Now I did. The problem happens in >>=20 >> GNU Emacs 29.3 (build 2, x86_64-w64-mingw32) of 2024-03-24 >>=20 >> too. Here's what I found in the POP3 before fetching my mail. >>=20 >> +OK 69 messages (2041560 bytes) >> 1 1243 >> 2 56203 >> 3 5694 >> 4 1858 >> 5 8704 >> 6 2264 >> 7 1626 >> 8 1626 >> 9 1626 >> 10 8704 >> 11 15079 >> 12 15079 >> 13 15079 >> 14 1858 >> 15 6303 >> 16 1303 >> 17 1303 >> 18 1858 >> 19 8704 >> 20 8704 >> 21 8581 >> 22 8704 >> 23 8581 >> 24 13969 >> 25 13969 >> 26 61517 >> 27 9590 >> 28 47193 >> 29 61517 >> 30 47193 >> 31 13969 >> 32 16591 >> 33 1880 >> 34 56203 >> 35 16591 >> 36 16591 >> 37 61517 >> 38 12830 >> 39 56203 >> 40 56203 >> 41 13969 >> 42 16591 >> 43 16591 >> 44 8581 >> 45 1880 >> 46 1880 >> 47 56203 >> 48 12830 >> 49 8704 >> 50 12830 >> 51 61517 >> 52 1880 >> 53 6303 >> 54 6303 >> 55 61517 >> 56 61517 >> 57 61517 >> 58 61517 >> 59 61517 >> 60 61517 >> 61 9590 >> 62 9590 >> 63 237515 >> 64 236784 >> 65 56203 >> 66 56203 >> 67 56203 >> 68 12830 >> 69 17268 >> . >> +OK Farewell. >>=20 >> If I sum the bytes of each message, I get >>=20 >> %awk '{ sum +=3D $2; } END { print(sum) }' pop3-list.txt >> 2041560 >>=20 >> which is exactly the advertised total at the top. The Gmail POP3 >> makes minimum sense. And here's the log after having Gnus fetch all >> the messages. (I couldn't keep the beginning lines because the >> *messages* buffer erased them, but the log shows that Gnus is going >> well beyond 100%.) >>=20 >> pop3 retrieved 6945KB (340%) >> [...] >> pop3 retrieved 9992KB (489%) >> pop3 retrieved 10386KB (508%) >> Saving file ~/.pop3-uidl... >> Wrote c:/Users/x/AppData/Roaming/.pop3-uidl >> Wrote c:/Users/x/AppData/Roaming/Mail/mail/misc/118 >> Wrote c:/Users/x/AppData/Roaming/Mail/mail/misc/119 >> [...] >> Wrote c:/Users/x/AppData/Roaming/Mail/mail/misc/186 >> nnml: Reading incoming mail (69 new)...done >> Reading active file via nnml...done >> Checking new news...done >>=20 >> Here's a check of how much data I get after having written each >> message to the file system. >>=20 >> %ls -l | awk '$8 >=3D 118 && $8 <=3D 186 { total +=3D $5; print; } END { >> print(total) }' >> -rw-rw-rw- 1 x None 1472 2024-09-19 16:00 118 >> -rw-rw-rw- 1 x None 876549 2024-09-19 16:00 119 >> -rw-rw-rw- 1 x None 5925 2024-09-19 16:00 120 >> -rw-rw-rw- 1 x None 963 2024-09-19 16:00 121 >> -rw-rw-rw- 1 x None 7307 2024-09-19 16:00 122 >> -rw-rw-rw- 1 x None 2494 2024-09-19 16:00 123 >> -rw-rw-rw- 1 x None 1459 2024-09-19 16:00 124 >> -rw-rw-rw- 1 x None 7773 2024-09-19 16:00 125 >> -rw-rw-rw- 1 x None 1855 2024-09-19 16:00 126 >> -rw-rw-rw- 1 x None 2380 2024-09-19 16:00 127 >> -rw-rw-rw- 1 x None 573608 2024-09-19 16:00 128 >> -rw-rw-rw- 1 x None 13685 2024-09-19 16:00 129 >> -rw-rw-rw- 1 x None 15324 2024-09-19 16:00 130 >> -rw-rw-rw- 1 x None 7416 2024-09-19 16:00 131 >> -rw-rw-rw- 1 x None 6056691 2024-09-19 16:00 132 >> -rw-rw-rw- 1 x None 6596 2024-09-19 16:00 133 >> -rw-rw-rw- 1 x None 1532 2024-09-19 16:00 134 >> -rw-rw-rw- 1 x None 2088 2024-09-19 16:00 135 >> -rw-rw-rw- 1 x None 9087 2024-09-19 16:00 136 >> -rw-rw-rw- 1 x None 1398 2024-09-19 16:00 137 >> -rw-rw-rw- 1 x None 10892 2024-09-19 16:00 138 >> -rw-rw-rw- 1 x None 7740 2024-09-19 16:00 139 >> -rw-rw-rw- 1 x None 3172 2024-09-19 16:00 140 >> -rw-rw-rw- 1 x None 14922 2024-09-19 16:00 141 >> -rw-rw-rw- 1 x None 15983 2024-09-19 16:00 142 >> -rw-rw-rw- 1 x None 9209 2024-09-19 16:00 143 >> -rw-rw-rw- 1 x None 12690 2024-09-19 16:00 144 >> -rw-rw-rw- 1 x None 49851 2024-09-19 16:00 145 >> -rw-rw-rw- 1 x None 3123 2024-09-19 16:00 146 >> -rw-rw-rw- 1 x None 47433 2024-09-19 16:00 147 >> -rw-rw-rw- 1 x None 13070 2024-09-19 16:00 148 >> -rw-rw-rw- 1 x None 186296 2024-09-19 16:00 149 >> -rw-rw-rw- 1 x None 1108 2024-09-19 16:00 150 >> -rw-rw-rw- 1 x None 202280 2024-09-19 16:00 151 >> -rw-rw-rw- 1 x None 16064 2024-09-19 16:00 152 >> -rw-rw-rw- 1 x None 17431 2024-09-19 16:00 153 >> -rw-rw-rw- 1 x None 39122 2024-09-19 16:00 154 >> -rw-rw-rw- 1 x None 10617 2024-09-19 16:00 155 >> -rw-rw-rw- 1 x None 32890 2024-09-19 16:00 156 >> -rw-rw-rw- 1 x None 34388 2024-09-19 16:00 157 >> -rw-rw-rw- 1 x None 14204 2024-09-19 16:00 158 >> -rw-rw-rw- 1 x None 15540 2024-09-19 16:00 159 >> -rw-rw-rw- 1 x None 16822 2024-09-19 16:00 160 >> -rw-rw-rw- 1 x None 8825 2024-09-19 16:00 161 >> -rw-rw-rw- 1 x None 6727 2024-09-19 16:00 162 >> -rw-rw-rw- 1 x None 6521 2024-09-19 16:00 163 >> -rw-rw-rw- 1 x None 934797 2024-09-19 16:00 164 >> -rw-rw-rw- 1 x None 11879 2024-09-19 16:00 165 >> -rw-rw-rw- 1 x None 8935 2024-09-19 16:00 166 >> -rw-rw-rw- 1 x None 3363 2024-09-19 16:00 167 >> -rw-rw-rw- 1 x None 36427 2024-09-19 16:00 168 >> -rw-rw-rw- 1 x None 2109 2024-09-19 16:00 169 >> -rw-rw-rw- 1 x None 1886 2024-09-19 16:00 170 >> -rw-rw-rw- 1 x None 6534 2024-09-19 16:00 171 >> -rw-rw-rw- 1 x None 46503 2024-09-19 16:00 172 >> -rw-rw-rw- 1 x None 44079 2024-09-19 16:00 173 >> -rw-rw-rw- 1 x None 54344 2024-09-19 16:00 174 >> -rw-rw-rw- 1 x None 52465 2024-09-19 16:00 175 >> -rw-rw-rw- 1 x None 62311 2024-09-19 16:00 176 >> -rw-rw-rw- 1 x None 61752 2024-09-19 16:00 177 >> -rw-rw-rw- 1 x None 8929 2024-09-19 16:00 178 >> -rw-rw-rw- 1 x None 9823 2024-09-19 16:00 179 >> -rw-rw-rw- 1 x None 237754 2024-09-19 16:00 180 >> -rw-rw-rw- 1 x None 237022 2024-09-19 16:00 181 >> -rw-rw-rw- 1 x None 49595 2024-09-19 16:00 182 >> -rw-rw-rw- 1 x None 53055 2024-09-19 16:00 183 >> -rw-rw-rw- 1 x None 56433 2024-09-19 16:00 184 >> -rw-rw-rw- 1 x None 13062 2024-09-19 16:00 185 >> -rw-rw-rw- 1 x None 17499 2024-09-19 16:00 186 >> 10403078 >>=20 >> I get a lot more data---10,403,078 bytes. So it makes me feel that >> Gnus is not at fault here; that it's the POP3 server that sometimes >> advertises a total amount, but ends up providing a lot more than the >> advertised value. I wouldn't assume this is an obvious bug of any >> POP3 server, but it's what the evidence seems to suggest---that the >> Gmail POP3 server says one thing and does another. > > I'm not an expert on POP3 protocol -- does it report bytes or > characters? It says=20 +OK 69 messages (2041560 bytes) when we issue the LIST command. For the number to the right of the message index, I would think it's bytes as well: if I add each one of those numbers, I end up with 2041560, which is the total byte amount advertised in the +OK-line. > Also, do the files created by Gnus have Unix or DOS EOL format? > If the latter, could the difference be explained by the added CR > characters? Gnus might be even adding data to these messages such as headers---I don't know. I would not expect to read the files on the file system and find the same byte amount advertised by the POP3 server. However, the report I gave previously shows a factor of 5 increase in the total byte downloaded---we go from 2 MiB to 10 MiB---, so I would not think this is a matter of added CR characters nor headers added by Gnus. (It's too much extra data that's appearing from I don't know where.) > Eventually, if the problem is with the server, what do we want to do > with this bug report? what _can_ we do? Right now I can't see what can we do. By the way, this is not a bug report: Gnus doesn't appear to be at fault. This is a request for help: I'm puzzled. While the evidence is against the POP3 server, it's hard to think that a POP3 server would be shipped with such an obvious bug. I'm going to compare the behavior using other e-mail clients. I need to find one that lets me watch the download progress like Gnus does.