From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.org!.POSTED!not-for-mail From: "Basil L. Contovounesios" Newsgroups: gmane.emacs.bugs Subject: bug#33018: 26.1.50; thread starvation with async processes and accept-process-output Date: Tue, 16 Oct 2018 15:55:28 +0100 Message-ID: <87r2gqvt3z.fsf@tcd.ie> References: <87r2gwbmma.fsf@tcd.ie> <875zy7cqzd.fsf@gmx.de> <878t30h823.fsf@tcd.ie> <87sh177i36.fsf@gmx.de> <877eiipu8g.fsf@tcd.ie> <87sh16ro91.fsf@gmx.de> NNTP-Posting-Host: blaine.gmane.org Mime-Version: 1.0 Content-Type: text/plain X-Trace: blaine.gmane.org 1539701651 12916 195.159.176.226 (16 Oct 2018 14:54:11 GMT) X-Complaints-To: usenet@blaine.gmane.org NNTP-Posting-Date: Tue, 16 Oct 2018 14:54:11 +0000 (UTC) User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.0.50 (gnu/linux) Cc: 33018@debbugs.gnu.org To: Michael Albinus Original-X-From: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane.org@gnu.org Tue Oct 16 16:54:07 2018 Return-path: Envelope-to: geb-bug-gnu-emacs@m.gmane.org Original-Received: from lists.gnu.org ([208.118.235.17]) by blaine.gmane.org with esmtp (Exim 4.84_2) (envelope-from ) id 1gCQjW-0003GP-EA for geb-bug-gnu-emacs@m.gmane.org; Tue, 16 Oct 2018 16:54:06 +0200 Original-Received: from localhost ([::1]:58510 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1gCQld-0004jP-3k for geb-bug-gnu-emacs@m.gmane.org; Tue, 16 Oct 2018 10:56:17 -0400 Original-Received: from eggs.gnu.org ([2001:4830:134:3::10]:33625) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1gCQlT-0004iR-Pa for bug-gnu-emacs@gnu.org; Tue, 16 Oct 2018 10:56:08 -0400 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1gCQlN-0004KW-Si for bug-gnu-emacs@gnu.org; Tue, 16 Oct 2018 10:56:07 -0400 Original-Received: from debbugs.gnu.org ([208.118.235.43]:49550) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1gCQlN-0004Iy-MH for bug-gnu-emacs@gnu.org; Tue, 16 Oct 2018 10:56:01 -0400 Original-Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1gCQlN-0007Ep-Kx for bug-gnu-emacs@gnu.org; Tue, 16 Oct 2018 10:56:01 -0400 X-Loop: help-debbugs@gnu.org Resent-From: "Basil L. Contovounesios" Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Tue, 16 Oct 2018 14:56:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 33018 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: Original-Received: via spool by 33018-submit@debbugs.gnu.org id=B33018.153970174227800 (code B ref 33018); Tue, 16 Oct 2018 14:56:01 +0000 Original-Received: (at 33018) by debbugs.gnu.org; 16 Oct 2018 14:55:42 +0000 Original-Received: from localhost ([127.0.0.1]:53808 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1gCQl4-0007EK-Ft for submit@debbugs.gnu.org; Tue, 16 Oct 2018 10:55:42 -0400 Original-Received: from mail-ed1-f45.google.com ([209.85.208.45]:33108) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1gCQl3-0007E8-07 for 33018@debbugs.gnu.org; Tue, 16 Oct 2018 10:55:41 -0400 Original-Received: by mail-ed1-f45.google.com with SMTP id l14-v6so12653954edq.0 for <33018@debbugs.gnu.org>; Tue, 16 Oct 2018 07:55:40 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=tcd-ie.20150623.gappssmtp.com; s=20150623; h=from:to:cc:subject:references:date:in-reply-to:message-id :user-agent:mime-version; bh=di/Z/+3iqHDOVjBzasbgFTcF610xoUOm9/YVhFlCk8o=; b=rWRKD5+gTQ8e4VNUb8YMYwZ1MIsqpV2HrfDvc2kfTFvxXzTPCEEXvaiBo2YndF4jrq zA6Op7KCOQ4xnnP94zQ4UmhZloWq4J89nQXqbMUqOiJzLnNs0pX4lNi7BOuNVvg/bkVU pDpUZN/I/FthjTRV4dLxRYxYEBuBMB+HgwqdYzU4TREUgck9xP4tqUfPoibA0l6YXTcO 3FCdZBvduwvHaafD74qWxLCHGzcoqtK9gXOlIm4QZHK1R+dAb0rxw0dVE8ICiZn4vgoM 2H01Hoz264qDzeup5rQ+0D4/aTcT0W8txWuzTlQZfLiCCvOeJXsm4ur7XhfDN1W1SEWM 2+LA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:references:date:in-reply-to :message-id:user-agent:mime-version; bh=di/Z/+3iqHDOVjBzasbgFTcF610xoUOm9/YVhFlCk8o=; b=rjGuHemkkvJRlIDvxB0tpFomDM7VGVJLGpg85ounb8x+MErxSTGiUP67uhXnyGSwB0 bXmZ2m0558WSfrDCyqu24Dt6klEV1W1Aa5oItttm6hvBsPdNmXRkLG4R40NFDbO0zXAg iKp0NubD0L+Fc26XYUAtfC5VB2YgE1wn1a92FHlRrz1Ipr/hn63FvZ+uEEfAEIIU72IZ W/23JQCWyZqkgH4/1jLVBm5XWL6W4pBa20R2IMRhTSKcdf4nv8nl8VfMwWFax6eHNZnz 9RJxk1jBBVbetK82SiyDYXVtBbib9EXArrwyyeloSQQf9OIXpSusMrWLgczmZ4wW3TpJ eK3w== X-Gm-Message-State: ABuFfojdadCewkyZg40QbF5t14dtOmiuVq5a0DFBoJqp0wwIsDYN7AGJ t16ID1cFNl3+eBrxTMZf6NkQSQ== X-Google-Smtp-Source: ACcGV632D2UgZzienNHy7N8oTWChLPw4ZZIAB6RNlBvwB39k9CK8N74XomJSLb0pojg7L1rdHdWzVQ== X-Received: by 2002:a17:906:4e03:: with SMTP id z3-v6mr23263480eju.187.1539701734893; Tue, 16 Oct 2018 07:55:34 -0700 (PDT) Original-Received: from localhost ([213.233.148.5]) by smtp.gmail.com with ESMTPSA id x15-v6sm6474371edm.26.2018.10.16.07.55.34 (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Tue, 16 Oct 2018 07:55:34 -0700 (PDT) In-Reply-To: <87sh16ro91.fsf@gmx.de> (Michael Albinus's message of "Tue, 16 Oct 2018 15:54:02 +0200") X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 208.118.235.43 X-BeenThere: bug-gnu-emacs@gnu.org List-Id: "Bug reports for GNU Emacs, the Swiss army knife of text editors" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane.org@gnu.org Original-Sender: "bug-gnu-emacs" Xref: news.gmane.org gmane.emacs.bugs:151309 Archived-At: Michael Albinus writes: > "Basil L. Contovounesios" writes: > >> There's something about going through a complete create-join cycle more >> than once within a non-main-thread which is triggering this behaviour. > > I'm not sure that it is related to threads. It has to be, because there is never an issue when I run the same asynchronous wget processes without threads, and with threads the hang reliably occurs 100% of the time. > It looks, like some of your processes do not exit properly, and then > thread-join is blocked. Indeed, but there is something about the interaction of Emacs threads and subprocesses which is causing unsuccessful process termination. Note that I am not ruling out pilot error; I simply haven't debugged this issue any deeper yet. The fact that no-one has yet pointed out any obvious blunders on my part gives me more confidence that there is indeed some ghost in the wire. > I've modified your example, again. It runs perfectly. Indeed, there are many subprocess-within-a-thread examples which don't suffer from a hang, e.g. by using a different URL. I would like to get to the bottom of why network programs like wget/curl in particular eventually hang, though. Thanks, -- Basil