From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp11.migadu.com ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms5.migadu.com with LMTPS id kDBRL0tFo2KpvQAAbAwnHQ (envelope-from ) for ; Fri, 10 Jun 2022 15:21:15 +0200 Received: from aspmx1.migadu.com ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp11.migadu.com with LMTPS id APlyL0tFo2LjdAAA9RJhRA (envelope-from ) for ; Fri, 10 Jun 2022 15:21:15 +0200 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id C21DB3F51F for ; Fri, 10 Jun 2022 15:21:14 +0200 (CEST) Received: from localhost ([::1]:39604 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1nzeZZ-0005KM-Vy for larch@yhetil.org; Fri, 10 Jun 2022 09:21:10 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:32804) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nzeYh-00047U-SX for gwl-devel@gnu.org; Fri, 10 Jun 2022 09:20:16 -0400 Received: from sender4-of-o50.zoho.com ([136.143.188.50]:21024) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nzeYf-0006iv-Pg for gwl-devel@gnu.org; Fri, 10 Jun 2022 09:20:15 -0400 ARC-Seal: i=1; a=rsa-sha256; t=1654867208; cv=none; d=zohomail.com; s=zohoarc; b=A9iAkwWMQVqWSCZ+EIcF0lOsqo18DvFVm5iPb4KFZfhXdFl/cmfV2OnkMJt1ykRxBHumam7ycg+WMPbvR3zr2XQdGzomz3M8ACyczOlwBy2Lr+VPH+uU+Sy7xbstNOvyTwDMDnZ1KVQfu+MFgnzrXpDgfjqVf23hy639rb0R2lw= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zohomail.com; s=zohoarc; t=1654867208; h=Content-Type:Content-Transfer-Encoding:Cc:Date:From:In-Reply-To:MIME-Version:Message-ID:References:Subject:To; bh=kfyXEsb5o5jrmPdTTm9zo9Ou49tfW4G5k1exBlhp/eY=; b=cFgENrA0RPRNfNl84tAH+dT7dWdlPMEOnUXPqXB/J1WobPxQDgCnPHIGedVVrQK2Wrw5jcunaQ1KVFikv+Ke1bcBF1PKer/ffl/sxGTlDBbPddFJn0jgrRNxxtXX9+xm5omfCbE0wmX1/kiIKJmnQf5gsS8bXhfp1yLJjXoVbrU= ARC-Authentication-Results: i=1; mx.zohomail.com; dkim=pass header.i=elephly.net; spf=pass smtp.mailfrom=rekado@elephly.net; dmarc=pass header.from= DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; t=1654867208; s=zoho; d=elephly.net; i=rekado@elephly.net; h=References:From:From:To:To:Cc:Cc:Subject:Subject:Date:Date:In-reply-to:Message-ID:MIME-Version:Content-Type:Content-Transfer-Encoding:Message-Id:Reply-To; bh=kfyXEsb5o5jrmPdTTm9zo9Ou49tfW4G5k1exBlhp/eY=; b=S6XBdm/aARLPUT/Lb0LvD2JcHQTYuqqATi3w3xSvG/RYiICfgYLxeKL2ZYeTU4OZ ZOZSau1mBsi7RZ7Q4VYliDcJNWafq+CD5qdWwiJ7XXeefST1qV6hSyhkFWAiAshvxPh +yt4jBupfBcqyq5JZAQdQQUQECxjkxL4N5jte6R0= Received: from localhost (120-110-142-46.pool.kielnet.net [46.142.110.120]) by mx.zohomail.com with SMTPS id 1654867206403740.5068453271658; Fri, 10 Jun 2022 06:20:06 -0700 (PDT) References: <87edzxuyis.fsf@laura> User-agent: mu4e 1.6.10; emacs 28.1 From: Ricardo Wurmus To: Olivier Dion Cc: gwl-devel@gnu.org Subject: Re: auto-connect fails to parallelize independent processes Date: Fri, 10 Jun 2022 15:13:06 +0200 In-reply-to: <87edzxuyis.fsf@laura> X-URL: https://elephly.net X-PGP-Key: https://elephly.net/rekado.pubkey X-PGP-Fingerprint: BCA6 89B6 3655 3801 C3C6 2150 197A 5888 235F ACAC Message-ID: <87h74s3bb0.fsf@elephly.net> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-ZohoMailClient: External Received-SPF: pass client-ip=136.143.188.50; envelope-from=rekado@elephly.net; helo=sender4-of-o50.zoho.com X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: gwl-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: gwl-devel-bounces+larch=yhetil.org@gnu.org Sender: "gwl-devel" X-Migadu-Flow: FLOW_IN X-Migadu-To: larch@yhetil.org X-Migadu-Country: US ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1654867275; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-unsubscribe:list-subscribe:list-post:dkim-signature; bh=kfyXEsb5o5jrmPdTTm9zo9Ou49tfW4G5k1exBlhp/eY=; b=QtQvYieHTX+d10BSgXyUQZvA9ZWA8iTgmlG6ffBuljFBGzvtvQ4wpeBOTqxOQRDRmq2Aed xs90SPQWzaz1iufJKujnMsc/oNtX4U0gcM+K7tA/MAUMRssKErPLOQARdWBsLlnqrt/543 zSDE+2HLLNOADcva+UBPwyBR2C3l9qmJ0QlZmg7ZvDn5lnsqpGjnrT1y2FVl2J+JwGCM/v 0Kgk2MLk/ACQF4QEyOX8awqb+6YloXSbvJu+tGBfn1Pa7Ws+g6CUQigJ0c2FxNLzdDUFRw L/M++IPmzBQUXLGrBDvs1zdZ2LG3BtXwKpeRHH8XJ5s3nqqISyAQ7dXuWYtaIQ== ARC-Seal: i=2; s=key1; d=yhetil.org; t=1654867275; a=rsa-sha256; cv=pass; b=NKx1j8pzzP0KWPJlK0VbV3JUFroTyDSd78Nlt9kTdDw2eAgD3gdFx7uGkwYdBzHFCYLgJv Y+O7HMaffeCVQ14LUUqZ7TBQH/X8xbBqylKFdRpkfgYrFmVQRfM35++JRkXCCwoLATx5KZ ftAMMygel0WfdiXb0uhoi96LPQmC1f2PzoYs9mx4oIPJ2kEyaCCL7jYst193OzY7byRknV JncMbxd13yvxyvgRpXn/zFaGYUtuN8ooFqIVvII4cCMwY0pYfVxlra0wCGVUUe5e8985XJ U0cMnyp/bDs2qL6k9EWNQpYubX34CEqomP00upnnblP0c5jyzCVsmPM/Ug8f4g== ARC-Authentication-Results: i=2; aspmx1.migadu.com; dkim=pass header.d=elephly.net header.s=zoho header.b="S6XBdm/a"; arc=pass ("zohomail.com:s=zohoarc:i=1"); dmarc=none; spf=pass (aspmx1.migadu.com: domain of "gwl-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="gwl-devel-bounces+larch=yhetil.org@gnu.org" X-Migadu-Spam-Score: -8.08 Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=elephly.net header.s=zoho header.b="S6XBdm/a"; arc=pass ("zohomail.com:s=zohoarc:i=1"); dmarc=none; spf=pass (aspmx1.migadu.com: domain of "gwl-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="gwl-devel-bounces+larch=yhetil.org@gnu.org" X-Migadu-Queue-Id: C21DB3F51F X-Spam-Score: -8.08 X-Migadu-Scanner: scn0.migadu.com X-TUID: eGdOs7FPN318 Olivier Dion via writes: > We can see that both processes are completely independent, and yet they > are batched linearly. [=E2=80=A6] I haven=E2=80=99t been able to reproduce this yet. I wrote this test and it passes: (let* ((proc (lambda (output) (make-process (name "does-it-matter?") (outputs (file output)) (procedure '())))) (p1 (proc "A.out")) (p2 (proc "B.out")) (wf (make-workflow (name "test-workflow") (processes (auto-connect p1 p2))))) (test-equal "auto-connect parallelizes independent processes" (list (list p2 p1)) (parallel-step-execution-order (workflow-processes wf) (workflow-restrictions wf)))) The result of parallel-step-execution-order means that p2 and p1 both belong to the first set of processes that can be executed simultaneously. (There is only one set of processes, so this list of p2 and p1 is the only entry in the list of steps.) If the above is in fact an accurate transcription of your report, we need to look at the users of workflow-run-order (which uses parallel-step-execution-order) to locate the bug. --=20 Ricardo