From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: Pankaj Jangid Newsgroups: gmane.emacs.devel Subject: Re: Multi-OS Emacs buildbot? Date: Sun, 20 Dec 2020 00:13:26 +0530 Organization: Code Is Great Foundation Message-ID: <87k0tdr60h.fsf@codeisgreat.org> References: <871rfliy8h.fsf@gnus.org> Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="28200"; mail-complaints-to="usenet@ciao.gmane.io" User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.0.50 (gnu/linux) Cc: emacs-devel@gnu.org To: Lars Ingebrigtsen Original-X-From: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Sat Dec 19 19:45:38 2020 Return-path: Envelope-to: ged-emacs-devel@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1kqhEX-0007Es-LN for ged-emacs-devel@m.gmane-mx.org; Sat, 19 Dec 2020 19:45:37 +0100 Original-Received: from localhost ([::1]:51900 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kqhEW-0002tL-LJ for ged-emacs-devel@m.gmane-mx.org; Sat, 19 Dec 2020 13:45:36 -0500 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]:33542) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1kqhCX-0002KF-IT for emacs-devel@gnu.org; Sat, 19 Dec 2020 13:43:33 -0500 Original-Received: from mail-pf1-x431.google.com ([2607:f8b0:4864:20::431]:36686) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1kqhCV-0003VD-8d for emacs-devel@gnu.org; Sat, 19 Dec 2020 13:43:32 -0500 Original-Received: by mail-pf1-x431.google.com with SMTP id t22so3606713pfl.3 for ; Sat, 19 Dec 2020 10:43:30 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=codeisgreat-org.20150623.gappssmtp.com; s=20150623; h=from:to:cc:subject:organization:references:mail-followup-to:date :in-reply-to:message-id:user-agent:mime-version :content-transfer-encoding; bh=nlGof6gd1bGE7T3wjZxyCJGMxYUL64aCG9SbO6upKb0=; b=K+IS+Ql797fujVG0sPqV1vMTR43x675jpKEOIVJ4jjvDnvBDGyXIf0Q55fKiEUmCRu exvM6UiZ1JcBZ576/E8F6PQzzGlw+xKcrXiC+zQ/FTqdHiloE8AORJTe+o+y8u7L49aX x7oHDvIafS4hZOcWF0imYYhVNUaUGro7I1qZtvyQARImkxd9UJqJ6e8klMxrtiPDJ0Zr l+r8AIJ1KYJXcHlor/fWeibSJJyKQ/Mv0WT/NtCZW7Hwi1xaQFpfX5VYM7E1p/XTwMUK qaxOqus7TX1mklDyEQANqH60C+Fhvohygf6MnDoUe5gOyFEyNthyIM6O3IOMKWXgeXdV lWLg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:organization:references :mail-followup-to:date:in-reply-to:message-id:user-agent :mime-version:content-transfer-encoding; bh=nlGof6gd1bGE7T3wjZxyCJGMxYUL64aCG9SbO6upKb0=; b=Z5GqcWIhvofy1m+0Wtwu6gbtIgggx6YYzeTGX9qdLIaLGq1i3NtRwWc1kUTOD35V+G cyRYKpVTr5gYvb6wmSw5PhAijQaxD/c/rAMCqLzUihMuiSJK58zlHFjM3QBq1bOVURwg QL77CLv3alWhFuWzQKF81iS08ekqL+bYgTzLMc/NF9yVWsVk79vXmh3uTaAQotiRFBV/ ffRT85I7kvt0hUDSs1cJrIp8WOtWbvjgmMna9qZCv9bDRNkB5WSHsecBOPZbiXJ1PtAc smTyU0QBJgqyj5XUsUeEkURZ6Jskfj9Mmga6QLb1xQRobAw7tTXj08uIvQ2lzd3dT15q uqFA== X-Gm-Message-State: AOAM531pb6eiKfKxhRFO+94Cf9MzmZ975xaF1EavB7D9haKAk74Pkr5Q rdU5BSH5Fjf4IaChishRiVUWcpy59ihYLg== X-Google-Smtp-Source: ABdhPJwA6aI+cutWV5wQ/CFslgdyOTmfjOjPzeIDxos1T+88kdhw8vKQDlReDJ+PJJNpQBk2eL2MVw== X-Received: by 2002:a63:4102:: with SMTP id o2mr9327176pga.166.1608403409011; Sat, 19 Dec 2020 10:43:29 -0800 (PST) Original-Received: from lt ([2405:201:5c06:70bb:a64e:31ff:fe0c:338c]) by smtp.gmail.com with ESMTPSA id b129sm10029276pgc.52.2020.12.19.10.43.27 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sat, 19 Dec 2020 10:43:28 -0800 (PST) Mail-Followup-To: Lars Ingebrigtsen , emacs-devel@gnu.org In-Reply-To: <871rfliy8h.fsf@gnus.org> (Lars Ingebrigtsen's message of "Sat, 19 Dec 2020 16:58:38 +0100") Received-SPF: none client-ip=2607:f8b0:4864:20::431; envelope-from=pankaj@codeisgreat.com; helo=mail-pf1-x431.google.com X-Spam_score_int: -15 X-Spam_score: -1.6 X-Spam_bar: - X-Spam_report: (-1.6 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HEADER_FROM_DIFFERENT_DOMAINS=0.249, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_NONE=0.001 autolearn=no autolearn_force=no X-Spam_action: no action X-BeenThere: emacs-devel@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Emacs development discussions." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Original-Sender: "Emacs-devel" Xref: news.gmane.io gmane.emacs.devel:261269 Archived-At: Lars Ingebrigtsen writes: > This can either be a lot of work if done right, or it can be done very > simply. Doing it right would mean automatically building on all > commits, and notifying the committer about breakages etc... but that's, > like, real work, and I'm not volunteering to do that at all. So it goes like this: =3D> git pull on driver system once in a day =3D> make a list of commits =3D> on each vm (concurrent) =3D> pick commit =3D last =3D> make bootstrap; make check =3D> if fail =3D> for commit in [(last-1)..0] =3D> make bootstrap; make check =3D> if pass =3D> make report for commit+1 =3D> email-to author of commit+1 =3D> break =3D> else =3D> OK Or something more ambitious? > A much simpler solution would be to just write a script that ssh-es to > all the VMs once a day, "git pull; make bootstrap; make check" and then > make a summary report on all the tests that fail to some new Emacs > mailing list. I can do that; it's trivial. I guess this is sufficient for us. The realtime stuff, like build on each commit, will be useful only to the authors who are directly committing to the repository. They will get to know within 15mins if there is a problem in commit. But those who are sending patches there will be some delay. > It'd be... somewhat useful? But not really that useful? Opinions? I guess such a system will be more useful during the period when we are about to release. Otherwise we=E2=80=99ll be spending too much energy. Peop= le are anyway build on their systems. Or, we can use this system to find out the faulty commit, once someone reports an issue. > (My current VM collection is FreeBSD, NetBSD, OpenBSD, Windows 10 > w/Cygwin, Macos-es catalina, mojave and high sierra (with HomeBrew), > Macos catalina (with Macports), and Fedora. Big Sur and Windows 10 > w/MinGW soon to follow.) I heard aws is also offering macos now. Does it actually run on VM? I thought Apple hardware is must for macos. Or is it something that runs on real Mac[(book)] only?