From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.org!not-for-mail From: "Stephen J. Turnbull" Newsgroups: gmane.emacs.devel Subject: Re: Emacs Lisp's future Date: Tue, 14 Oct 2014 02:18:23 +0900 Message-ID: <87egubopls.fsf@uwakimon.sk.tsukuba.ac.jp> References: <87d2ahm3nw.fsf@fencepost.gnu.org> <871tqneyvl.fsf@netris.org> <87zjd9swfj.fsf@uwakimon.sk.tsukuba.ac.jp> <87oatnqpml.fsf@uwakimon.sk.tsukuba.ac.jp> <874mvdrj45.fsf@uwakimon.sk.tsukuba.ac.jp> <20141009044917.GA19957@fencepost.gnu.org> <83lhopisfr.fsf@gnu.org> <87ppe1pldu.fsf@uwakimon.sk.tsukuba.ac.jp> <8761ft5wpo.fsf@fencepost.gnu.org> <83k349b0vj.fsf@gnu.org> <83bnph96kh.fsf@gnu.org> <87ppdwo7ll.fsf@uwakimon.sk.tsukuba.ac.jp> <543BE7CB.9040801@cs.ucla.edu> NNTP-Posting-Host: plane.gmane.org Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8 X-Trace: ger.gmane.org 1413220752 16764 80.91.229.3 (13 Oct 2014 17:19:12 GMT) X-Complaints-To: usenet@ger.gmane.org NNTP-Posting-Date: Mon, 13 Oct 2014 17:19:12 +0000 (UTC) Cc: emacs-devel@gnu.org To: Paul Eggert Original-X-From: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Mon Oct 13 19:19:03 2014 Return-path: Envelope-to: ged-emacs-devel@m.gmane.org Original-Received: from lists.gnu.org ([208.118.235.17]) by plane.gmane.org with esmtp (Exim 4.69) (envelope-from ) id 1XdjGv-0000IW-4w for ged-emacs-devel@m.gmane.org; Mon, 13 Oct 2014 19:19:01 +0200 Original-Received: from localhost ([::1]:34562 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1XdjGu-0002uR-Nf for ged-emacs-devel@m.gmane.org; Mon, 13 Oct 2014 13:19:00 -0400 Original-Received: from eggs.gnu.org ([2001:4830:134:3::10]:56445) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1XdjGa-0002tS-SX for emacs-devel@gnu.org; Mon, 13 Oct 2014 13:18:48 -0400 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1XdjGT-00047b-Cv for emacs-devel@gnu.org; Mon, 13 Oct 2014 13:18:40 -0400 Original-Received: from shako.sk.tsukuba.ac.jp ([130.158.97.161]:58106) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1XdjGT-000454-35 for emacs-devel@gnu.org; Mon, 13 Oct 2014 13:18:33 -0400 Original-Received: from uwakimon.sk.tsukuba.ac.jp (uwakimon.sk.tsukuba.ac.jp [130.158.99.156]) by shako.sk.tsukuba.ac.jp (Postfix) with ESMTP id 9498A1C399C; Tue, 14 Oct 2014 02:18:23 +0900 (JST) Original-Received: by uwakimon.sk.tsukuba.ac.jp (Postfix, from userid 1000) id 867471A2888; Tue, 14 Oct 2014 02:18:23 +0900 (JST) In-Reply-To: <543BE7CB.9040801@cs.ucla.edu> X-Mailer: VM undefined under 21.5 (beta34) "kale" acf1c26e3019 XEmacs Lucid (x86_64-unknown-linux) X-detected-operating-system: by eggs.gnu.org: GNU/Linux 3.x X-Received-From: 130.158.97.161 X-BeenThere: emacs-devel@gnu.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Emacs development discussions." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Original-Sender: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Xref: news.gmane.org gmane.emacs.devel:175331 Archived-At: Paul Eggert writes: > Stephen J. Turnbull wrote: > > The file or application is truly local, provided with the OS or > > created by the user. In that case on a well-maintained system, > > the encoding should be valid > > It could easily be mixed. For example, in the Emacs source code > the output of the shell command "grep -r she *" produces some text > that is UTF-8 and some that is 8-bit EUC. So the shell command's > output is not valid even though all its input files are valid. > This type of thing is not uncommon. Not uncommon, but no more (and no less) sensible than "zgrep she /vmlinuz". Both commands are useful in some contexts, but neither command's output should be thought of as "encoded text" in the sense that any codec I know of can handle and produce useful output for all of the encodings (or even more than one). If you're planning further processing you shouldn't allow something as mechanical as a codec anywhere near that stuff: you should accept it into a buffer as binary, and do your own conversions based on any useful heuristics you have.