eww/url: www connections left "open"

eww/url: www connections left "open"

[raman]

This is in emacs from Git@Head -- though the issue has been around for
a long time.

If you use EWW to open a Web site -- say 
http://www.cnn.com  ---  then do M-x list-processes --- you see  that
there is a "open" connection to www.cnn.com hanging around (likely
because of http keep-alive?) -- not sure. 

There is no such connection hanging around if you open www.gnu.org.

Most of the time, this is harmless and the connections go away ---
except when they dont, and if more than a few of these hang around,
then opening other URLs with EWW produces nothing. Killing those
hanging connections with delete-process immediately gets EWW working
again --- e.g. killing those connections with  the following loop:

(cl-loop 
 for p in (process-list)
 when (string-match "www" (process-name p))
 do (delete-process p))

-- 

-- 

Re: eww/url: www connections left "open"

[Eli Zaretskii]

On December 20, 2017 6:09:24 AM GMT+02:00, raman <raman@google.com> wrote:
> This is in emacs from Git@Head -- though the issue has been around for
> a long time.
> 
> If you use EWW to open a Web site -- say 
> http://www.cnn.com  ---  then do M-x list-processes --- you see  that
> there is a "open" connection to www.cnn.com hanging around (likely
> because of http keep-alive?) -- not sure. 
> 
> There is no such connection hanging around if you open www.gnu.org.
> 
> Most of the time, this is harmless and the connections go away ---
> except when they dont, and if more than a few of these hang around,
> then opening other URLs with EWW produces nothing. Killing those
> hanging connections with delete-process immediately gets EWW working
> again --- e.g. killing those connections with  the following loop:
> 
> (cl-loop 
>  for p in (process-list)
>  when (string-match "www" (process-name p))
>  do (delete-process p))

I see such connections in the process list for gnu.org as well.
Moreover, if I open cnn.com in a browser, netstat shows me connections waiting to various addresses in cnn.com domain, exactly like I see in Emacs.
On what OS do you get "nothing" after some such open connections?

Re: eww/url: www connections left "open"

[Óscar Fuentes]

Eli Zaretskii <eliz@gnu.org> writes:

> I see such connections in the process list for gnu.org as well.
> Moreover, if I open cnn.com in a browser, netstat shows me connections
> waiting to various addresses in cnn.com domain, exactly like I see in
> Emacs. On what OS do you get "nothing" after some such open
> connections?

It is expected that you get nothing after you close the browser's tab
that is visiting the page, or shortly thereafter. The processes listed
on my Emacs session correspond to pages I visited days ago. Right now I
have no eww buffer lying around. Hence those processes are the result of
a leak.

Re: eww/url: www connections left "open"

[raman]

Eli Zaretskii <eliz@gnu.org> writes:

I'm seeing the problem on Ubuntu Trusty. As I said -- the  waiting connections dont always affect EWW --- appears to bite when there are a lot of them around.> On December 20, 2017 6:09:24 AM GMT+02:00, raman <raman@google.com> wrote:
>> This is in emacs from Git@Head -- though the issue has been around for
>> a long time.
>> 
>> If you use EWW to open a Web site -- say 
>> http://www.cnn.com  ---  then do M-x list-processes --- you see  that
>> there is a "open" connection to www.cnn.com hanging around (likely
>> because of http keep-alive?) -- not sure. 
>> 
>> There is no such connection hanging around if you open www.gnu.org.
>> 
>> Most of the time, this is harmless and the connections go away ---
>> except when they dont, and if more than a few of these hang around,
>> then opening other URLs with EWW produces nothing. Killing those
>> hanging connections with delete-process immediately gets EWW working
>> again --- e.g. killing those connections with  the following loop:
>> 
>> (cl-loop 
>>  for p in (process-list)
>>  when (string-match "www" (process-name p))
>>  do (delete-process p))
>
> I see such connections in the process list for gnu.org as well.
> Moreover, if I open cnn.com in a browser, netstat shows me connections waiting to various addresses in cnn.com domain, exactly like I see in Emacs.
> On what OS do you get "nothing" after some such open connections?

-- 

Re: eww/url: www connections left "open"

[Óscar Fuentes]

raman <raman@google.com> writes:

> This is in emacs from Git@Head -- though the issue has been around for
> a long time.
>
> If you use EWW to open a Web site -- say 
> http://www.cnn.com  ---  then do M-x list-processes --- you see  that
> there is a "open" connection to www.cnn.com hanging around (likely
> because of http keep-alive?) -- not sure. 
>
> There is no such connection hanging around if you open www.gnu.org.
>
> Most of the time, this is harmless and the connections go away ---
> except when they dont, and if more than a few of these hang around,
> then opening other URLs with EWW produces nothing. Killing those
> hanging connections with delete-process immediately gets EWW working
> again --- e.g. killing those connections with  the following loop:
>
> (cl-loop 
>  for p in (process-list)
>  when (string-match "www" (process-name p))
>  do (delete-process p))

I confirm the problem. Your method for killing those processes is not
effective because it depends on the presence of "www". Right now I have
4 open processes related to web sites, none of them contains the "www"
string.

BTW, it is preferable to report this problems with M-x report-emacs-bug.

Re: eww/url: www connections left "open"

[Andreas Schwab]

On Dez 19 2017, raman <raman@google.com> wrote:

> If you use EWW to open a Web site -- say 
> http://www.cnn.com  ---  then do M-x list-processes --- you see  that
> there is a "open" connection to www.cnn.com hanging around (likely
> because of http keep-alive?) -- not sure. 

Does it change if you set url-http-attempt-keepalives to nil?

Andreas.

-- 
Andreas Schwab, schwab@linux-m68k.org
GPG Key fingerprint = 58CA 54C7 6D53 942B 1756  01D3 44D5 214B 8276 4ED5
"And now for something completely different."

Re: eww/url: www connections left "open"

[raman]

Andreas Schwab <schwab@linux-m68k.org> writes:

Will try that --- had missed that variable.> On Dez 19 2017, raman <raman@google.com> wrote:
>
>> If you use EWW to open a Web site -- say 
>> http://www.cnn.com  ---  then do M-x list-processes --- you see  that
>> there is a "open" connection to www.cnn.com hanging around (likely
>> because of http keep-alive?) -- not sure. 
>
> Does it change if you set url-http-attempt-keepalives to nil?
>
> Andreas.

-- 

Re: eww/url: www connections left "open"

[Lars Ingebrigtsen]

raman <raman@google.com> writes:

> Most of the time, this is harmless and the connections go away ---
> except when they dont, and if more than a few of these hang around,
> then opening other URLs with EWW produces nothing. Killing those
> hanging connections with delete-process immediately gets EWW working
> again --- e.g. killing those connections with  the following loop:
>
> (cl-loop 
>  for p in (process-list)
>  when (string-match "www" (process-name p))
>  do (delete-process p))

The list of connections is in the `url-http-open-connections' hash
table, so you can just loop over that to kill the connections.

And, yes, it's annoying that url-http.el doesn't deal with hanging
connections very well.

-- 
(domestic pets only, the antidote for overdose, milk.)
   bloggy blog: http://lars.ingebrigtsen.no