From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: Michael Albinus Newsgroups: gmane.emacs.devel Subject: Re: Multi-OS Emacs buildbot? Date: Thu, 31 Dec 2020 15:14:06 +0100 Message-ID: <874kk26p1t.fsf@gmx.de> References: <871rfliy8h.fsf@gnus.org> <878s9tfqma.fsf@gnus.org> <87k0tc3loz.fsf@gmx.de> <871rfkbm9h.fsf@gmx.de> <03659494-2a6e-fdca-bc5d-8f76862d4521@yandex.ru> <877dpae4uz.fsf@iotcl.com> <87r1nh691b.fsf@gmx.de> <87v9cp4xd9.fsf@iotcl.com> <875z4pfzdy.fsf@gnus.org> <87im8p1vyn.fsf@gmx.de> <87sg7teiv8.fsf@gnus.org> <87a6u11uzh.fsf@gmx.de> <87eejdehw3.fsf@gnus.org> <87wnx5ymg9.fsf@gmx.de> <87mtxz4o4d.fsf@iotcl.com> <87sg7ry3cw.fsf@gmx.de> <87wnwz2yuz.fsf@iotcl.com> Mime-Version: 1.0 Content-Type: text/plain Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="32365"; mail-complaints-to="usenet@ciao.gmane.io" User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.0.50 (gnu/linux) Cc: Lars Ingebrigtsen , Dmitry Gutov , Alan Third , emacs-devel@gnu.org To: Toon Claes Original-X-From: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Thu Dec 31 15:14:49 2020 Return-path: Envelope-to: ged-emacs-devel@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1kuyj1-0008Hi-Hn for ged-emacs-devel@m.gmane-mx.org; Thu, 31 Dec 2020 15:14:47 +0100 Original-Received: from localhost ([::1]:33194 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kuyj0-00013L-K8 for ged-emacs-devel@m.gmane-mx.org; Thu, 31 Dec 2020 09:14:46 -0500 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]:41974) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1kuyiT-0000Xi-4z for emacs-devel@gnu.org; Thu, 31 Dec 2020 09:14:13 -0500 Original-Received: from mout.gmx.net ([212.227.17.20]:50705) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1kuyiR-0000GI-3o for emacs-devel@gnu.org; Thu, 31 Dec 2020 09:14:12 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.net; s=badeba3b8450; t=1609424047; bh=6PBr4hICRAZZbNOHcqHapGQB7QRoeevQ6VyBK22FAMA=; h=X-UI-Sender-Class:From:To:Cc:Subject:References:Date:In-Reply-To; b=CcEKCnYAbzZers65WiMkIiHW6kq5jhZ7EV9Kc1+t9SHAEbJiXySql/evciaiVnKnH 2LyPtzrwm60ZOfqsf7fW6D0MDr5G823ciohwHVxLRt9KJdYONaFcRcxjQmKVk3575H S4S2Jdv3RXwVRGsiS1ZeywiU+qpAZbeqylH7vJJw= X-UI-Sender-Class: 01bb95c1-4bf8-414a-932a-4f6e2808ef9c Original-Received: from gandalf.gmx.de ([212.86.52.148]) by mail.gmx.com (mrgmx105 [212.227.17.168]) with ESMTPSA (Nemesis) id 1N4Qwg-1jueqX2bME-011VY7; Thu, 31 Dec 2020 15:14:07 +0100 In-Reply-To: <87wnwz2yuz.fsf@iotcl.com> (Toon Claes's message of "Wed, 30 Dec 2020 14:43:32 +0100") X-Provags-ID: V03:K1:KWY7WBt9qy+CtA5guQNLjF4JzyOtmfDBPGndzqtcIphBJ/S7TVl deAeXpPeQ6x4JzAWSI0I26eQHl68zqU8Sf9NzegGKtVmSizxZ8htYLvxuncuoHbEwHbpSOF ZhVNt2CYkVdRGGOFEgszxjhc6xdUWJem4zwyJFQ2Dv4uOZ/vS1KzJJT3yqq0nkkMpKCIo2O YlUrBFtSffVC4kcw2wdKg== X-UI-Out-Filterresults: notjunk:1;V03:K0:WdIIvWas1D0=:Ko4pydbDvQTIQ+cg9u9hjo xsz42xE4RXrdpeFhoh6oKXtR8XjkB0TEklnn0BTehvuQMPBPyra+NDaICGzvqa7fFndFg4iJ7 /atvs87+D3Wh5t+Gv2z4bo9gda2DJZlmeQJVycU2O6unjHrzijTyzsxmJrmujWCjktVxruKkq MrbYp3h6O9B8KUm7HRoRwLcr8GfI9Tg8pG3F+iE5YK8C6rZitW1uWe5wrnJsuosSk553pVGwl 9rlEds5UuRLNy8XsnXzSPNIkSc/uXnT+G1EEBrZfQ/J6XgdtdFhfpY+1eIdWENZ6Ck5ywh2Ys cHGkF7XDVmeteIQHXBRlhZX5wMU9I+Me3Ql/YPBKvg0X1FBsp1NzpAnfY1OjI9KX3BTAVQvsF hZiArHZbcDI/Ar4IxRqCB9vUtNn6AAvFzMVqZeSwMb1LP9TqHrTxdxsVJgRvfO434rYwopOTx tAIbUqdUOGBtR4KvVMWHD+Wr9vwj0o+w2ifkw8FL9JOc64ujaMLRNfzjhQxEL1dIuu8ldZW9F GjMkaiT++zdtSXZMVE0GcRY0MBr+kbRs9UyMWxgdqj0ETBNdVdZS4RyLBB9NiO5hVUxN+yM/J JzHU6bNIRlsgExovMWpnrVAAg05F0pwhPCNwwiJ0dXZEjGZbBrhESiLs1FznMPAeYLdHmaud+ Ym7iUg4EUEjNZOw28uKKtp8QLh4kmH4Ufh+XoQA6cj6XxYsxrn7tvBGtRmYOHV+MBDFmQTye5 qVFlMR51A17nuFp6rN5E/8RGAMjl4nZFTh3sVK008ObRXcXF+GzDmd5i9iuPZSLOQNQQ6R4F Received-SPF: pass client-ip=212.227.17.20; envelope-from=michael.albinus@gmx.de; helo=mout.gmx.net X-Spam_score_int: -25 X-Spam_score: -2.6 X-Spam_bar: -- X-Spam_report: (-2.6 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: emacs-devel@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Emacs development discussions." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Original-Sender: "Emacs-devel" Xref: news.gmane.io gmane.emacs.devel:262159 Archived-At: Toon Claes writes: >> So it is some information that stage test has failed, but it shows only >> the Makefile output, and not the more informative test summary. That >> doesn't help. > > I'm not familiar with the Emacs test suite, but where else can we get > info about the test results? Is there another log file? As Alan wrote already, there is one log file per test file. If a test run (per test file) fails, the log file is shown. See definition of Makefile variable WRITE_LOG: --8<---------------cut here---------------start------------->8--- ## Save logs, and show logs for failed tests. WRITE_LOG = > $@ 2>&1 || { STAT=$$?; cat $@; exit $$STAT; } --8<---------------cut here---------------end--------------->8--- However, since we ran into a job timeout, the job has stopped before we could see the log file. This is fixed now for process-tests.el, because every single test is wrapped now by a timeout of 60 seconds, which let the tests fail in time. The Makefile knows also special handling when running on hydra, showing the test progress unconditionally in the Makefile output. Currently, it has the value: --8<---------------cut here---------------start------------->8--- ifdef EMACS_HYDRA_CI ## On Hydra, always show logs for certain problematic tests. lisp/net/tramp-tests.log \ : WRITE_LOG = 2>&1 | tee $@ endif --8<---------------cut here---------------end--------------->8--- That is, running Tramp tests will always show the progress in the Makefile output. We could use the same feature for emba if we want. > Toon Best regards, Michael.