From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.org!not-for-mail From: Richard Stallman Newsgroups: gmane.emacs.devel Subject: Re: Tokenizing Date: Sun, 21 Sep 2014 09:35:36 -0400 Message-ID: References: Reply-To: rms@gnu.org NNTP-Posting-Host: plane.gmane.org Content-Type: text/plain; charset=ISO-8859-15 X-Trace: ger.gmane.org 1411307112 672 80.91.229.3 (21 Sep 2014 13:45:12 GMT) X-Complaints-To: usenet@ger.gmane.org NNTP-Posting-Date: Sun, 21 Sep 2014 13:45:12 +0000 (UTC) Cc: emacs-devel@gnu.org To: Vladimir Kazanov Original-X-From: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Sun Sep 21 15:45:05 2014 Return-path: Envelope-to: ged-emacs-devel@m.gmane.org Original-Received: from lists.gnu.org ([208.118.235.17]) by plane.gmane.org with esmtp (Exim 4.69) (envelope-from ) id 1XVhRo-0006WI-1m for ged-emacs-devel@m.gmane.org; Sun, 21 Sep 2014 15:45:04 +0200 Original-Received: from localhost ([::1]:39330 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1XVhRn-0008UF-IN for ged-emacs-devel@m.gmane.org; Sun, 21 Sep 2014 09:45:03 -0400 Original-Received: from eggs.gnu.org ([2001:4830:134:3::10]:38770) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1XVhRJ-0008Qm-4g for emacs-devel@gnu.org; Sun, 21 Sep 2014 09:44:35 -0400 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1XVhRG-00015X-0s for emacs-devel@gnu.org; Sun, 21 Sep 2014 09:44:33 -0400 Original-Received: from fencepost.gnu.org ([2001:4830:134:3::e]:35470) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1XVhRF-00010Y-UX for emacs-devel@gnu.org; Sun, 21 Sep 2014 09:44:29 -0400 Original-Received: from rms by fencepost.gnu.org with local (Exim 4.71) (envelope-from ) id 1XVhIe-0001I5-3g; Sun, 21 Sep 2014 09:35:36 -0400 In-reply-to: (message from Vladimir Kazanov on Sat, 20 Sep 2014 19:36:16 +0300) X-detected-operating-system: by eggs.gnu.org: Error: Malformed IPv6 address (bad octet value). X-Received-From: 2001:4830:134:3::e X-BeenThere: emacs-devel@gnu.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Emacs development discussions." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Original-Sender: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Xref: news.gmane.org gmane.emacs.devel:174599 Archived-At: [[[ To any NSA and FBI agents reading my email: please consider ]]] [[[ whether defending the US Constitution against all enemies, ]]] [[[ foreign or domestic, requires you to follow Snowden's example. ]]] I suggest the following plan: 1) try to implement the tokenizer using available text property mechanics; 2) see if there are slow-downs or problems, or space for improvements on the Emacs side. Yes. At various points you might have ideas for more convenient or faster predefined functions for accessing the text properties. It will be very nice to add them for Emacs and thus make this sort of tokenizing more convenient. -- Dr Richard Stallman President, Free Software Foundation 51 Franklin St Boston MA 02110 USA www.fsf.org www.gnu.org Skype: No way! That's nonfree (freedom-denying) software. Use Ekiga or an ordinary phone call.