From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.org!.POSTED!not-for-mail From: phillip.lord@russet.org.uk (Phillip Lord) Newsgroups: gmane.emacs.devel Subject: Re: Continuous integration Date: Thu, 01 Jun 2017 13:59:53 +0100 Message-ID: <87y3tb7tiu.fsf@russet.org.uk> References: <87a88emy62.fsf@luca> <8737e5uoyd.fsf@russet.org.uk> <87d1d8ul7q.fsf@russet.org.uk> <22740.454.818489.461885@retriever.mtv.corp.google.com> <87h92jswrk.fsf@russet.org.uk> <83246C10-FB82-4BE0-80F7-A56F9A12951C@gmail.com> <87bmsrc64p.fsf@russet.org.uk> <87o9wq7i23.fsf@lifelogs.com> <85b7f49ba74f899e8e366f32a7772dce.squirrel@cloud103.planethippo.com> <878tnnm6yq.fsf@russet.org.uk> <87pogp1x53.fsf@lifelogs.com> <86tw5xzs1j.fsf@molnjunk.nocrew.org> <86mvbpzchj.fsf@molnjunk.nocrew.org> <87h900q3vk.fsf@lifelogs.com> NNTP-Posting-Host: blaine.gmane.org Mime-Version: 1.0 Content-Type: text/plain X-Trace: blaine.gmane.org 1496322638 2936 195.159.176.226 (1 Jun 2017 13:10:38 GMT) X-Complaints-To: usenet@blaine.gmane.org NNTP-Posting-Date: Thu, 1 Jun 2017 13:10:38 +0000 (UTC) User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.2.50 (gnu/linux) To: emacs-devel@gnu.org Original-X-From: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Thu Jun 01 15:10:34 2017 Return-path: Envelope-to: ged-emacs-devel@m.gmane.org Original-Received: from lists.gnu.org ([208.118.235.17]) by blaine.gmane.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dGPs2-0000Xv-3p for ged-emacs-devel@m.gmane.org; Thu, 01 Jun 2017 15:10:34 +0200 Original-Received: from localhost ([::1]:44291 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1dGPs7-0002RH-AZ for ged-emacs-devel@m.gmane.org; Thu, 01 Jun 2017 09:10:39 -0400 Original-Received: from eggs.gnu.org ([2001:4830:134:3::10]:37275) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1dGPiY-0003KY-OI for emacs-devel@gnu.org; Thu, 01 Jun 2017 09:00:50 -0400 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1dGPiP-0003aZ-7Z for emacs-devel@gnu.org; Thu, 01 Jun 2017 09:00:46 -0400 Original-Received: from cloud103.planethippo.com ([78.129.138.110]:47028) by eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1dGPiO-00032P-U1 for emacs-devel@gnu.org; Thu, 01 Jun 2017 09:00:37 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=russet.org.uk; s=default; h=Content-Type:MIME-Version:Message-ID: In-Reply-To:Date:References:Subject:To:From:Sender:Reply-To:Cc: Content-Transfer-Encoding:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Id: List-Help:List-Unsubscribe:List-Subscribe:List-Post:List-Owner:List-Archive; bh=hzmOkpZqYPGCxIKIa5I/rFyqejybHDhSZex7BcRq/Go=; b=MGoBXZJyP7ga10TozifvTRbQn qbZuCyLfFS9Y50hT8QDNS5w5SxBX9rof7ZNzwlCTlKCfwmKzXCt8rEGFXM41LMv8qvjHJqhNdDCtz AYm95FCrN7WcYVIGyRJXytChSZZcYWXaf0R1DRtI70C4Q7hCM9fMiiE9CiXuJFh78yiaQRt0X252J u1MkUUpzLQ9iTLPGIso7aD5L3DXEvaSIpe9hb3irC/MNCUmWdrzTcAWgcfqk1hsKizaqjTL9WtaE4 kjDEOBVj10XhbdJNh/4ORmQLPv9FaHas+cjiX/RpWtD2CvcU38iPG2fYkdVTH0eRpV4u+tRAmShu6 jFVfzJjNg==; Original-Received: from janus-nat-128-240-225-75.ncl.ac.uk ([128.240.225.75]:35556 helo=russet.org.uk) by cloud103.planethippo.com with esmtpsa (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256) (Exim 4.89) (envelope-from ) id 1dGPhi-000742-Bq for emacs-devel@gnu.org; Thu, 01 Jun 2017 12:59:54 +0000 In-Reply-To: (John Wiegley's message of "Wed, 31 May 2017 12:25:28 -0700") X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - cloud103.planethippo.com X-AntiAbuse: Original Domain - gnu.org X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - russet.org.uk X-Get-Message-Sender-Via: cloud103.planethippo.com: authenticated_id: phillip.lord@russet.org.uk X-Authenticated-Sender: cloud103.planethippo.com: phillip.lord@russet.org.uk X-Source: X-Source-Args: X-Source-Dir: X-detected-operating-system: by eggs.gnu.org: GNU/Linux 3.x [fuzzy] X-Received-From: 78.129.138.110 X-BeenThere: emacs-devel@gnu.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: "Emacs development discussions." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Original-Sender: "Emacs-devel" Xref: news.gmane.org gmane.emacs.devel:215382 Archived-At: John Wiegley writes: >>>>>> "TZ" == Ted Zlatanov writes: > > TZ> I'd like to start collecting evaluation criteria for a CI solution for > TZ> Emacs developers. We'll evaluate BuildBot, Hydra, and GitLab and any > TZ> others people feel should be considered. Everyone will have a chance to > TZ> comment, vote, and contribute. But first we have to agree on what we're > TZ> evaluating. > > There has been some exploration done on GitLab already, I wonder if they have > some data to share with you? And buildbot. > TZ> What features of a CI solution do you consider important that we can rate > TZ> objectively? > > Letting us know when the build fails, which commit caused it to fail, and the > ability to do this on all the platforms that we care about. > > Some of the other features that have been discussed, such as code review and > pull requests, are nice, but I think not necessary just to have a helpful CI. Building all branches though, so that pull requests can be build in a clean environment is important. Multiplatform (i.e. including windows and mac) builds would be nice. Local replicability of the environment (via docker or vm) would be good as well. Nice GUI. Important, and not to be underestimated. Phil