From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from localhost (localhost [127.0.0.1]) by arlo.cworth.org (Postfix) with ESMTP id EB3306DE142D for ; Mon, 6 May 2019 14:57:12 -0700 (PDT) X-Virus-Scanned: Debian amavisd-new at cworth.org X-Spam-Flag: NO X-Spam-Score: -0.162 X-Spam-Level: X-Spam-Status: No, score=-0.162 tagged_above=-999 required=5 tests=[AWL=0.039, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001] autolearn=disabled Received: from arlo.cworth.org ([127.0.0.1]) by localhost (arlo.cworth.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id B81nEFp97XdC for ; Mon, 6 May 2019 14:57:12 -0700 (PDT) Received: from che.mayfirst.org (che.mayfirst.org [162.247.75.118]) by arlo.cworth.org (Postfix) with ESMTPS id 26DB16DE142B for ; Mon, 6 May 2019 14:57:12 -0700 (PDT) DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/simple; d=fifthhorseman.net; i=@fifthhorseman.net; q=dns/txt; s=2019; t=1557179831; h=from : to : subject : in-reply-to : references : date : message-id : mime-version : content-type : from; bh=bVwgSFvO8z5M6k9Fl0d6z0GISHZupBnkcbDQR/pzHZ4=; b=uA5wxqM9/O07035fT1ROolrPedMHAv1HBYhcYjZ/YqOWBcnMWIMKsn8M bS+5X5I1NFqOba6nZzwjyLFvBKvmCA== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=fifthhorseman.net; i=@fifthhorseman.net; q=dns/txt; s=2019rsa; t=1557179831; h=from : to : subject : in-reply-to : references : date : message-id : mime-version : content-type : from; bh=bVwgSFvO8z5M6k9Fl0d6z0GISHZupBnkcbDQR/pzHZ4=; b=dQO35efnKkcZwhvLLdqdQ59PvmRPpArXFQJGQ4dshVzeOimvdf5i02RN 5XeJU7RTQd6eTwheTP81QF5OsnijtJ/IAv4/V8Md21zt5VfkM7FroCSKag JYoX/kNtZaMYb47LGwXM8N5Fs9La5MYHlYg2FKMpjHUWos14XyIIwgJ4EE bVH+qm2b64KsQlCCnoaamrEysh/jbCNx0YVUU7AXCTbhjCzIdgrzRqtlOY BHWRUqwJa5TpyLmIGZ9B5ZzAU0J+qe2VD1VKSaKmavRnC7t9zl0b/8So+V xkSuBWjykYqGTb7px7gIWQG2L4R33T/UrsvZGHVCcLx7CoTgEM4IOA== Received: from fifthhorseman.net (unknown [38.109.115.130]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by che.mayfirst.org (Postfix) with ESMTPSA id BBDE8F99F; Mon, 6 May 2019 17:57:10 -0400 (EDT) Received: by fifthhorseman.net (Postfix, from userid 1000) id D9EE820C60; Mon, 6 May 2019 17:39:24 -0400 (EDT) From: Daniel Kahn Gillmor To: Tomi Ollila , David Bremner , "Rollins\, Jameson" , Notmuch Mail Subject: Re: parallelize test suite In-Reply-To: References: <20190504205738.21504-1-jrollins@caltech.edu> <87r29dnbl0.fsf@fifthhorseman.net> <878svlhlwc.fsf@tethera.net> <87lfzllyd1.fsf@fifthhorseman.net> Autocrypt: addr=dkg@fifthhorseman.net; prefer-encrypt=mutual; keydata= mDMEXEK/AhYJKwYBBAHaRw8BAQdAr/gSROcn+6m8ijTN0DV9AahoHGafy52RRkhCZVwxhEe0K0Rh bmllbCBLYWhuIEdpbGxtb3IgPGRrZ0BmaWZ0aGhvcnNlbWFuLm5ldD6ImQQTFggAQQIbAQUJA8Jn AAULCQgHAgYVCgkICwIEFgIDAQIeAQIXgBYhBMS8Lds4zOlkhevpwvIGkReQOOXGBQJcQsbzAhkB AAoJEPIGkReQOOXG4fkBAO1joRxqAZY57PjdzGieXLpluk9RkWa3ufkt3YUVEpH/AP9c+pgIxtyW +FwMQRjlqljuj8amdN4zuEqaCy4hhz/1DbgzBFxCv4sWCSsGAQQB2kcPAQEHQERSZxSPmgtdw6nN u7uxY7bzb9TnPrGAOp9kClBLRwGfiPUEGBYIACYWIQTEvC3bOMzpZIXr6cLyBpEXkDjlxgUCXEK/ iwIbAgUJAeEzgACBCRDyBpEXkDjlxnYgBBkWCAAdFiEEyQ5tNiAKG5IqFQnndhgZZSmuX/gFAlxC v4sACgkQdhgZZSmuX/iVWgD/fCU4ONzgy8w8UCHGmrmIZfDvdhg512NIBfx+Mz9ls5kA/Rq97vz4 z48MFuBdCuu0W/fVqVjnY7LN5n+CQJwGC0MIA7QA/RyY7Sz2gFIOcrns0RpoHr+3WI+won3xCD8+ sVXSHZvCAP98HCjDnw/b0lGuCR7coTXKLIM44/LFWgXAdZjm1wjODbg4BFxCv50SCisGAQQBl1UB BQEBB0BG4iXnHX/fs35NWKMWQTQoRI7oiAUt0wJHFFJbomxXbAMBCAeIfgQYFggAJhYhBMS8Lds4 zOlkhevpwvIGkReQOOXGBQJcQr+dAhsMBQkB4TOAAAoJEPIGkReQOOXGe/cBAPlek5d9xzcXUn/D kY6jKmxe26CTws3ZkbK6Aa5Ey/qKAP0VuPQSCRxA7RKfcB/XrEphfUFkraL06Xn/xGwJ+D0hCw== Date: Mon, 06 May 2019 17:39:24 -0400 Message-ID: <87tve7l0tv.fsf@fifthhorseman.net> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha512; protocol="application/pgp-signature" X-BeenThere: notmuch@notmuchmail.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Use and development of the notmuch mail system." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 06 May 2019 21:57:13 -0000 --=-=-= Content-Type: text/plain On Sun 2019-05-05 19:44:01 +0300, Tomi Ollila wrote: >> I actually think that CI and autobuilders *should* exercise the parallel >> tests, as annoying as that might be initially, because it seems likely >> to catch any other potential entanglements. > > ... after it has been proven a bit more to work... i tend to think the other way around -- the way to prove it is to push it into the CI pipelines on the development branch, rather than trying to prove it on individual developer systems. > One thing more, the "perverse" pre-caching done in add_email_corpus > can be retained -- just do that step *before* going to parallelism... You could do that, but i'm not sure how much you'd gain from it -- its current implementation is all mixed up with the parallelized tests, anyway. If you wanted to propose a concrete re-optimization like this, i'd be happy to review it, test it and report back on the speedup gained. thanks for thinking this through, Tomi! --dkg --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iHUEARYKAB0WIQTJDm02IAobkioVCed2GBllKa5f+AUCXNCpjAAKCRB2GBllKa5f +AFhAP9DM6cD+iTS5iWPgievVouSX3uIN504G2xr3SpWcKGaWgD/UQCAymLBSIgp a3aGkAnEKX/8dfZYjbLgprj1PxTNwAQ= =flAg -----END PGP SIGNATURE----- --=-=-=--