From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: Ted Zlatanov Newsgroups: gmane.emacs.build-automation,gmane.emacs.devel Subject: Re: broken "fast" build - hung containers Date: Sat, 18 Sep 2021 20:01:36 +0000 Organization: =?utf-8?B?0KLQtdC+0LTQvtGAINCX0LvQsNGC0LDQvdC+0LI=?= @ Cienfuegos Message-ID: References: <87fsu6p4bx.fsf@gmx.de> <87mtocmr6h.fsf@gmx.de> Mime-Version: 1.0 Content-Type: text/plain Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="6446"; mail-complaints-to="usenet@ciao.gmane.io" User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.0.50 (gnu/linux) Cc: Lars Ingebrigtsen , emacs-build-automation@gnu.org, emacs-devel@gnu.org To: Michael Albinus Original-X-From: emacs-build-automation-bounces+geb-emacs-build-automation=m.gmane-mx.org@gnu.org Sat Sep 18 22:01:59 2021 Return-path: Envelope-to: geb-emacs-build-automation@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1mRgX9-0001T3-07 for geb-emacs-build-automation@m.gmane-mx.org; Sat, 18 Sep 2021 22:01:59 +0200 Original-Received: from localhost ([::1]:42490 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1mRgX7-0003y3-TQ for geb-emacs-build-automation@m.gmane-mx.org; Sat, 18 Sep 2021 16:01:57 -0400 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]:40728) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mRgWt-0003wm-F4 for emacs-build-automation@gnu.org; Sat, 18 Sep 2021 16:01:45 -0400 Original-Received: from mail-wm1-x32e.google.com ([2a00:1450:4864:20::32e]:34647) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1mRgWr-0000bX-4I for emacs-build-automation@gnu.org; Sat, 18 Sep 2021 16:01:43 -0400 Original-Received: by mail-wm1-x32e.google.com with SMTP id y198-20020a1c7dcf000000b0030b69a49fe9so939618wmc.1 for ; Sat, 18 Sep 2021 13:01:40 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=lifelogs.com; s=google; h=from:to:cc:subject:organization:references:mail-copies-to:date :in-reply-to:message-id:user-agent:mime-version; bh=Z82KnK8Gn/CIbLiwNYwqIknPReh3im5hBmRwqiqg9CM=; b=Ev56xXwsg4rlodroq78q2K2gfliv3FBQOrVZAi5VAynccXcOdYCwf0Z5PfC/kkiz8u P4NFitbq36Z7LhDkf0dbk8X4rla519KDGJe58vUCuMc3nFssUD1/XsnrZDrMpo08CTUF bjZIqWqKPjGt3LUpi9in9OfsDoSI1mOY3NvMs= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:from:to:cc:subject:organization:references :mail-copies-to:date:in-reply-to:message-id:user-agent:mime-version; bh=Z82KnK8Gn/CIbLiwNYwqIknPReh3im5hBmRwqiqg9CM=; b=i3ZLII0/cmUr9M2yNAkW9oZnQTZ4CmWwo5yRqXG5v9FWHG7LCx2SXXhtcys8x+yvui zrQPQ4o5x6uNbPtP0vCDksth4KJWvf6iQJDaF7ycklMPUyJ+pRXjRCabgYShoW3pBXqy T1UF8dH9B3D48BMTX89GaB6PUlKO3EnHovtzybrM1knUNDiJf0Zps2z7XE2ZUmJwU4mm hqvSjnlD3mdQgdbc1GotyoYhzNHDlMRYAnLKISB80sUoBrgs16GhsaqNahEEWdfgUPuG RnzdioqZAAshDT60/5PFy4mqRi4tLYmWGjV3WWW9Gk8Bw0jcINqG0spEpGNEKvje0jH2 Uvpg== X-Gm-Message-State: AOAM530uJR2+5Wn164ewIKOi5aYgftqw0ksxo0HPGyxZD2HkBXVZKYXF YhUhM50g0wCIq75sQ4ZI002Zdg== X-Google-Smtp-Source: ABdhPJykvTxDs8nOcs1V7s9SfBcfkGabeGhqLRd6rhmFr+yp7KWN4EylTDH2oXg4bkiIeGFRvI8wfA== X-Received: by 2002:a7b:c014:: with SMTP id c20mr16678730wmb.81.1631995298705; Sat, 18 Sep 2021 13:01:38 -0700 (PDT) Original-Received: from flea (cpc150000-brnt4-2-0-cust527.4-2.cable.virginm.net. [82.24.234.16]) by smtp.gmail.com with ESMTPSA id u29sm8005135wru.34.2021.09.18.13.01.37 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sat, 18 Sep 2021 13:01:37 -0700 (PDT) X-Face: bd.DQ~'29fIs`T_%O%C\g%6jW)yi[zuz6; d4V0`@y-~$#3P_Ng{@m+e4o<4P'#(_GJQ%TT= D}[Ep*b!\e,fBZ'j_+#"Ps?s2!4H2-Y"sx" Mail-Copies-To: never In-Reply-To: <87mtocmr6h.fsf@gmx.de> (Michael Albinus's message of "Thu, 16 Sep 2021 18:16:38 +0200") Received-SPF: none client-ip=2a00:1450:4864:20::32e; envelope-from=tzz@lifelogs.com; helo=mail-wm1-x32e.google.com X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_NONE=0.001 autolearn=unavailable autolearn_force=no X-Spam_action: no action X-BeenThere: emacs-build-automation@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Discussions about automated building and testing of Emacs List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-build-automation-bounces+geb-emacs-build-automation=m.gmane-mx.org@gnu.org Original-Sender: "Emacs-build-automation" Xref: news.gmane.io gmane.emacs.build-automation:34 gmane.emacs.devel:275030 Archived-At: I was able to replicate the bug by going into one of the hung containers and running `make check`. It hangs in the module tests, and ends with a kernel fault (this is 4.4.0). It seems that the `module--help-function-arglist` test is the last one to succeed, and `module--test-assertions--load-non-live-object` is the next one that may be the failing one. ``` # docker exec -it [hung-container-ID] bash # make -C lib all make[1]: Entering directory '/checkout/lib' ... GEN src/editfns-tests.log GEN src/emacs-module-tests.log 2021 Sep 18 06:39:13 emba kernel BUG at /build/linux-Pv5wqf/linux-4.4.0/mm/memory.c:3214! 2021 Sep 18 06:39:13 emba RIP [] handle_mm_fault+0x13de/0x1b80 ^C Makefile:181: recipe for target 'src/emacs-module-tests.log' failed make[3]: *** [src/emacs-module-tests.log] Interrupt Makefile:335: recipe for target 'check-doit' failed make[2]: [check-doit] Interrupt (ignored) Makefile:305: recipe for target 'check' failed make[1]: *** [check] Interrupt Makefile:988: recipe for target 'check' failed make: *** [check] Interrupt ``` So. I removed emacs-module-tests.* and the test kept going until process-tests.* where it locked up with the same kernel bug. I removed process-tests.* as well, and all the tests completed. Could we disable the emacs-module-tests.el and process-tests.el inside EMBA Docker? For the EMBA admins: this can be replicated with docker exec -it $(docker ps -q|shuf|head -1) bash and then `make check` (which will randomly pick one of the dozens of hung containers). I can dig further if someone can give me steps to follow. Thanks Ted