From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from localhost (localhost [127.0.0.1]) by arlo.cworth.org (Postfix) with ESMTP id 9ADD76DE028C for ; Mon, 4 Sep 2017 14:31:52 -0700 (PDT) X-Virus-Scanned: Debian amavisd-new at cworth.org X-Spam-Flag: NO X-Spam-Score: -0.006 X-Spam-Level: X-Spam-Status: No, score=-0.006 tagged_above=-999 required=5 tests=[AWL=-0.045, FREEMAIL_FORGED_FROMDOMAIN=0.249, FREEMAIL_FROM=0.001, HEADER_FROM_DIFFERENT_DOMAINS=0.001, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.211, SPF_PASS=-0.001] autolearn=disabled Received: from arlo.cworth.org ([127.0.0.1]) by localhost (arlo.cworth.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 2om-wZv3qUDi for ; Mon, 4 Sep 2017 14:31:47 -0700 (PDT) Received: from mail-wr0-f181.google.com (mail-wr0-f181.google.com [209.85.128.181]) by arlo.cworth.org (Postfix) with ESMTPS id 7104E6DE00D3 for ; Mon, 4 Sep 2017 14:31:47 -0700 (PDT) Received: by mail-wr0-f181.google.com with SMTP id n33so4382264wrn.4 for ; Mon, 04 Sep 2017 14:31:47 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=oDDs1HXKypWbTvnabpDObpyFSwZmwckYwJ/4jaOEihs=; b=BhkDeaYxucFLGllvbuOKbEyhZCDaukZuYtmIKHsVM92ZkD9MwNIK9EAjW0PbscwMH5 JGoabIbITKhgb85kpvKWouPfPul3REYQf8SHNd8K0AyfzpBH3J38s0VLU0x9aVKGu+xv g0kIt28L6V2mGzXIDoJlZwvZCAotUC7+pZsWpNwL3YrFZ0bEJmTFkOChjT9arwYIvHLF OwhkmcgqIOxp0Q0xzXqkYMuUQtpHuc4tczVbTsUZJFh6C+2hV1XdRRvIb/lbmscITpP+ /7ScqPEbNNZ9bKFrG9XuVYIQaPqqXH/YZQZn1ax30qKoNuvmlgxLjUci0e02Nv7tExhs 8OwQ== X-Gm-Message-State: AHPjjUgRzNuipw6p/hoZE7fMVNJGYaMoj61aBvJgemad0gzuDEoPoaXC yl76ybFv7bgQKgxeFDQ= X-Google-Smtp-Source: ADKCNb4l0mG44ejiMsxsG3TJjeYER3ezCL83jdrQeHzv0R79JUnMQEkbKJi3GZ0jzVyWC6SpF03RVA== X-Received: by 10.223.167.4 with SMTP id c4mr978228wrd.88.1504560705778; Mon, 04 Sep 2017 14:31:45 -0700 (PDT) Received: from home.thecybershadow.net (CyberShadow-1-pt.tunnel.tserv1.bud1.ipv6.he.net. [2001:470:1f1a:172::2]) by smtp.gmail.com with ESMTPSA id d10sm1422385wmh.26.2017.09.04.14.31.44 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 04 Sep 2017 14:31:44 -0700 (PDT) Subject: Re: [PATCH 7/7] .travis.yml: Test against several Emacs versions To: David Bremner , notmuch@notmuchmail.org References: <20170817175145.3204-1-notmuch@thecybershadow.net> <20170817175145.3204-8-notmuch@thecybershadow.net> <87h8wmylse.fsf@tethera.net> From: Vladimir Panteleev Message-ID: <218e3046-4dd7-c7ab-777f-8fc8ed2338a0@gmail.com> Date: Mon, 4 Sep 2017 21:31:43 +0000 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.3.0 MIME-Version: 1.0 In-Reply-To: <87h8wmylse.fsf@tethera.net> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-BeenThere: notmuch@notmuchmail.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Use and development of the notmuch mail system." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 04 Sep 2017 21:31:52 -0000 On 2017-09-02 00:41, David Bremner wrote: > I take it travis doesn't object to building 4 versions of emacs from > scratch? I don't know why they would. There are many open-source projects with much higher computational demands using Travis' free service. There are also many projects doing the exact thing proposed in this patch: https://github.com/search?utf8=%E2%9C%93&q=travis+EMACS_VERSION+language%3AYAML&type=Code > How long does that take? About 2-4 minutes for the tagged releases and 6 minutes for the snapshot. You can see the times yourself in the build logs for the Travis results of my fork: https://travis-ci.org/CyberShadow/notmuch The figure you're looking for is the execution time of the "make -f emacs-travis.mk install_emacs" command, displayed on the right-hand side in the log. > I'm not very happy about downloading and running code from a third party > during our test runs. Why do you think so? Consider: - You are already relying on a third-party here (Travis). They run a lot of code specific to their testing platform on their systems. - The code (emacs-travis.mk) is specific to Travis. It is not part of the notmuch test suite, just the Travis configuration which runs it. - Using emacs-travis.mk in this manner is how many Emacs packages run their tests: https://github.com/search?p=1&q=emacs-travis.mk+language%3AYAML&type=Code&utf8=%E2%9C%93 -- Best regards, Vladimir