RE: Next pretest, and branching plans

["Drew Adams" <drew.adams@oracle.com>]

> > Perhaps more importantly, there will be fewer (far fewer, 
> > IMO) new bug reports from Windows users for the latest code.
> >
> > Instead of a pretest, you will, in effect, just wait until
> > after the release to get such bug reports. The purpose
> > of the pretest will thus be defeated, except for those 
> > Windows pretesters who are willing to build Emacs.
> 
> It's not clear what statistics you have to back this up.

To back what up? I cited _myself_ as an example. And I have reported a _lot_ of
bugs, many of which have been fixed. There will therefore be absolutely fewer
(IMO far fewer) bug reports, just counting my own. QED.

> I know for a fact that several users of the Windows port
> build Emacs themselves;

I know that for a fact also. So what?

> what percentage that is of the overall number of people who use the
> pretest on Windows should be a subject of survey, not guesswork.

So go ahead, make such a survey.

But check the overall number of Windows pretest _bug reports_ (and the number of
such bugs that get fixed, and the number of such bugs that you deem important),
not just the number of people who _use_ the Windows pretest.

If you limit your check to those who use the Windows pretest, and if no Windows
binary is posted, then you've obviously limited your check to those who build
Emacs themselves. You will not notice a diminution in _their_ bug reports,
obviously. 'Round and 'round you go...

[French govt official in the 90s: "Since we stopped listening to the New
Caledonian independentists, we no longer hear anything from them."]

But even if you do an accurate survey, and you fairly survey the bugs
_reported_, not just the number of Windows _users_ of a pretest, and you
consider both the number of bug reports and the importance of the bugs reported,
a percentage will only give you part of the story.

That will indicate a relative loss but not the absolute loss of user feedback.
Taking only myself as an example: Even if my bug reports represent a negligible
percentage of the total number of Windows bug reports (which I doubt, but which
might be the case), they nevertheless represent info that could be useful to
Emacs development (that has proven to be the case, in the past). The question
is, do you want that info or not?

The question still is, "Do you really want bug reports from Windows users?"

> FWIW, tools for such a build are readily available, and help for
> setting them up is offered here.  So I could never understand why
> people who want to contribute refuse to install the necessary
> development environment.  It's not that setting up such a development
> environment is hard or needs many hours.

There can be many reasons why someone cannot or does not wish to build Emacs.

And if building it is so simple, and you have already built the pretest, then
why not post your binary of it? Certainly it is at least as easy to post it as
to build it, no? What holds you back? "Tools for such a posting are readily
available".

The purpose of the pretest is only partly to test whether Emacs builds with no
problem. And typically you don't need a zillion build reports for the same
platform to identify bugs affecting building. You don't need every Emacs pretest
tester to build Emacs.

The greater purpose of the pretest is to test _Emacs_ itself, after it is built,
to see what problems might have been introduced by the latest development
changes, 99% of which do not affect building. (No, I don't have statistical
evidence for claiming 99%. Sue me.)

For that, there is no reason to limit the pretest to those who build Emacs
themselves. Especially if you already have a binary available that you can post
(which you apparently do have).