From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: Jean Louis Newsgroups: gmane.emacs.devel Subject: Re: Proposal for an Emacs User Survey Date: Mon, 26 Oct 2020 23:21:38 +0300 Organization: GNU.Support Message-ID: References: <30addebe-999b-c1cc-a8d8-27aba3fac566@gmx.com> <875z76p4pg.fsf@posteo.net> <20201020113613.GA3969@t400> <87mu087t3z.fsf@gmail.com> Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="25976"; mail-complaints-to="usenet@ciao.gmane.io" User-Agent: Mutt/+ (1036f0e) (2020-10-18) Cc: "Philip K." , Richard Stallman , Thibaut Verron , emacs-devel@gnu.org To: Ivan Yonchovski Original-X-From: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Tue Oct 27 18:48:04 2020 Return-path: Envelope-to: ged-emacs-devel@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1kXT4f-0006QK-AI for ged-emacs-devel@m.gmane-mx.org; Tue, 27 Oct 2020 18:47:57 +0100 Original-Received: from localhost ([::1]:47922 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kXT4e-0003xs-6G for ged-emacs-devel@m.gmane-mx.org; Tue, 27 Oct 2020 13:47:56 -0400 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]:43514) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1kXSyk-00048T-9J for emacs-devel@gnu.org; Tue, 27 Oct 2020 13:41:50 -0400 Original-Received: from static.rcdrun.com ([95.85.24.50]:54345) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1kXSyi-00044M-Bq; Tue, 27 Oct 2020 13:41:49 -0400 Original-Received: from localhost ([::ffff:197.157.0.60]) (AUTH: PLAIN admin, TLS: TLS1.2,256bits,ECDHE_RSA_AES_256_GCM_SHA384) by static.rcdrun.com with ESMTPSA id 00000000002A0B3D.000000005F985BB7.00002F79; Tue, 27 Oct 2020 17:41:08 +0000 Content-Disposition: inline In-Reply-To: <87mu087t3z.fsf@gmail.com> Received-SPF: pass client-ip=95.85.24.50; envelope-from=bugs@gnu.support; helo=static.rcdrun.com X-detected-operating-system: by eggs.gnu.org: First seen = 2020/10/27 13:40:55 X-ACL-Warn: Detected OS = Linux 3.11 and newer [fuzzy] X-Spam_score_int: 6 X-Spam_score: 0.6 X-Spam_bar: / X-Spam_report: (0.6 / 5.0 requ) BAYES_00=-1.9, DATE_IN_PAST_12_24=1.049, RCVD_IN_SORBS_WEB=1.5, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001 autolearn=no autolearn_force=no X-Spam_action: no action X-BeenThere: emacs-devel@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Emacs development discussions." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Original-Sender: "Emacs-devel" Xref: news.gmane.io gmane.emacs.devel:258511 Archived-At: * Ivan Yonchovski [2020-10-26 21:14]: > > Jean Louis writes: > > > Both ways how the surve have been presented with the proprietary > > Javascript and with the download of the Org file, are not user > > friendly and cannot reach large sample. One also needs marketing > > skills. > > What number of responders will be considered large enough sample? That is not easy to determine. I would say that 1000 people would be minimum in each case and it would never be enough, as that comes from personal experience from work in two organizations, one was specifically a survey company and other was conducting always surveys for its own humanitarian purposes. From: https://www.cloudresearch.com/resources/guides/statistical-significance/determine-sample-size/ As you can see, even when a population is large, researchers can often understand the entire group with about 1,000 respondents. Population Size Sample Size Based on ±3% Sample Size Based on ±5% Sample Size Based on ±10% Margin of Error Margin of Error Margin of Error 500 345 220 80 1,000 525 285 90 3,000 810 350 100 5,000 910 370 100 10,000 1,000 385 100 100,00+ 1,100 400 100 ----- end of quote -------- Every survey should have its purpose, usually to improve the product or service, in this case Emacs. Improvements are constantly made and public opinion is looked upon. To discuss issues with people is human, friendly and vibrant activity and is way of taking opinions (bug reports, emails, opinions, package contributions) and putting them in reality (patches, improvements, ELPA...). To ask people questions online without opportunity for feedback is one-way, dead end type of a communication. There are few questions that look like there is question about accessibility yet we will see later what comes out of it. If website is not made well accessible those questions may not be productive. For solving usability issues, instead of 1000 people one could as well follow feedback from 5 users, reference: https://www.nngroup.com/articles/usability-101-introduction-to-usability/ Article refers to web, it may be applied on Emacs user interface. Quote: Usability is a quality attribute that assesses how easy user interfaces are to use. The word "usability" also refers to methods for improving ease-of-use during the design process. Usability is defined by 5 quality components: - Learnability: How easy is it for users to accomplish basic tasks the first time they encounter the design? - Efficiency: Once users have learned the design, how quickly can they perform tasks? - Memorability: When users return to the design after a period of not using it, how easily can they reestablish proficiency? - Errors: How many errors do users make, how severe are these errors, and how easily can they recover from the errors? - Satisfaction: How pleasant is it to use the design? -- Jean Louis