From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.org!not-for-mail From: Stephen Leake Newsgroups: gmane.emacs.devel Subject: Re: Overlay mechanic improvements Date: Sat, 20 Sep 2014 11:28:12 -0500 Message-ID: <8561gife8z.fsf@stephe-leake.org> References: NNTP-Posting-Host: plane.gmane.org Mime-Version: 1.0 Content-Type: text/plain X-Trace: ger.gmane.org 1411230523 23949 80.91.229.3 (20 Sep 2014 16:28:43 GMT) X-Complaints-To: usenet@ger.gmane.org NNTP-Posting-Date: Sat, 20 Sep 2014 16:28:43 +0000 (UTC) To: emacs-devel@gnu.org Original-X-From: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Sat Sep 20 18:28:36 2014 Return-path: Envelope-to: ged-emacs-devel@m.gmane.org Original-Received: from lists.gnu.org ([208.118.235.17]) by plane.gmane.org with esmtp (Exim 4.69) (envelope-from ) id 1XVNWV-0001rk-Nu for ged-emacs-devel@m.gmane.org; Sat, 20 Sep 2014 18:28:35 +0200 Original-Received: from localhost ([::1]:35357 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1XVNWV-0000IL-CV for ged-emacs-devel@m.gmane.org; Sat, 20 Sep 2014 12:28:35 -0400 Original-Received: from eggs.gnu.org ([2001:4830:134:3::10]:37396) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1XVNWM-0000HA-Ja for emacs-devel@gnu.org; Sat, 20 Sep 2014 12:28:32 -0400 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1XVNWG-0002jC-N8 for emacs-devel@gnu.org; Sat, 20 Sep 2014 12:28:26 -0400 Original-Received: from dnvrco-outbound-snat.email.rr.com ([107.14.73.231]:43908 helo=dnvrco-oedge-vip.email.rr.com) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1XVNWG-0002iV-Ib for emacs-devel@gnu.org; Sat, 20 Sep 2014 12:28:20 -0400 Original-Received: from [70.94.38.149] ([70.94.38.149:58067] helo=TAKVER) by dnvrco-oedge02 (envelope-from ) (ecelerity 3.5.0.35861 r(Momo-dev:tip)) with ESMTP id D4/E1-08316-E1BAD145; Sat, 20 Sep 2014 16:28:15 +0000 In-Reply-To: (Richard Stallman's message of "Sat, 20 Sep 2014 09:21:02 -0400") User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/24.3 (windows-nt) X-RR-Connecting-IP: 107.14.64.130:25 X-Authority-Analysis: v=2.1 cv=ReIeCjdv c=1 sm=1 tr=0 a=AppmJ/7ZOOFWL/q6u6u93g==:117 a=AppmJ/7ZOOFWL/q6u6u93g==:17 a=ayC55rCoAAAA:8 a=9XSUBuVRJI8A:10 a=tKuehWVcQmgA:10 a=o_R75loqY_IA:10 a=9i_RQKNPAAAA:8 a=mDV3o1hIAAAA:8 a=1nif6smim_z4kMFMVOAA:9 a=ii61gXl28gQA:10 X-Cloudmark-Score: 0 X-detected-operating-system: by eggs.gnu.org: BaiduSpider X-Received-From: 107.14.73.231 X-BeenThere: emacs-devel@gnu.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Emacs development discussions." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Original-Sender: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Xref: news.gmane.org gmane.emacs.devel:174588 Archived-At: Richard Stallman writes: > [[[ To any NSA and FBI agents reading my email: please consider ]]] > [[[ whether defending the US Constitution against all enemies, ]]] > [[[ foreign or domestic, requires you to follow Snowden's example. ]]] > > The problem here is that tokens are not just lexemes(token text). To > be general and granular enough one also has to remember dependencies > between tokens. So, a token is: ["lexeme", lookback, lookahead, > position]. > > Ok, but why is it a "problem"? It seems easy enough to construct a > list (LEXEME LOOKBACK LOOKAHEAD) and put it as the value of the > `token' property for all the characters in the token. > > There is no need to include POSITION in this list, since you can > find the start of the token by calling > `previous-char-property-change'. No need to store LEXME, either; just call buffer-substring-no-properties when you need the text. -- -- Stephe