From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.org!not-for-mail From: Vladimir Kazanov Newsgroups: gmane.emacs.devel Subject: Re: Tokenizing Date: Sat, 20 Sep 2014 19:40:53 +0300 Message-ID: References: <85a95ufeec.fsf@stephe-leake.org> NNTP-Posting-Host: plane.gmane.org Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Trace: ger.gmane.org 1411231292 32347 80.91.229.3 (20 Sep 2014 16:41:32 GMT) X-Complaints-To: usenet@ger.gmane.org NNTP-Posting-Date: Sat, 20 Sep 2014 16:41:32 +0000 (UTC) Cc: emacs-devel@gnu.org To: Stephen Leake Original-X-From: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Sat Sep 20 18:41:25 2014 Return-path: Envelope-to: ged-emacs-devel@m.gmane.org Original-Received: from lists.gnu.org ([208.118.235.17]) by plane.gmane.org with esmtp (Exim 4.69) (envelope-from ) id 1XVNiu-0007fk-SH for ged-emacs-devel@m.gmane.org; Sat, 20 Sep 2014 18:41:24 +0200 Original-Received: from localhost ([::1]:35402 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1XVNiu-0001vH-Dx for ged-emacs-devel@m.gmane.org; Sat, 20 Sep 2014 12:41:24 -0400 Original-Received: from eggs.gnu.org ([2001:4830:134:3::10]:39502) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1XVNiq-0001vC-EC for emacs-devel@gnu.org; Sat, 20 Sep 2014 12:41:21 -0400 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1XVNip-0005rz-LO for emacs-devel@gnu.org; Sat, 20 Sep 2014 12:41:20 -0400 Original-Received: from mail-ig0-x235.google.com ([2607:f8b0:4001:c05::235]:55593) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1XVNip-0005rp-Fm for emacs-devel@gnu.org; Sat, 20 Sep 2014 12:41:19 -0400 Original-Received: by mail-ig0-f181.google.com with SMTP id h18so697454igc.8 for ; Sat, 20 Sep 2014 09:41:13 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-type:content-transfer-encoding; bh=YejZu3GlqgfVyJqTOw8l5eVl0hN/Z58394MdnoLk6QY=; b=s1a3Vl/SEzsOtvg8N0kK5PvpatS3Fqwymt3Tx0EwF/cz2j38haUqdhZmB2gDGhAPPi o1QGZDxpEQvRZAfasoOlW7WUt47nGy0a/qcoXgqTVnPcvkJDANOb5/a56uaOip7TGtRT ZdSCHkjK4c9eIDG44eIjhZLuUCO7jujXeRereB/0w9SjCLMhFFcdTS7dNEiMdoJxKSzl UOXPd+WwhDU2UBmOVkDqAlfcTarpa5kZFTt85XC0TzAhkj5k14D9QxQFaxCiknQvTU4Y Y48ZmSelED39fQiESxY4nVEXy2N9XD7DBfKUwoyO0dpIplLI0Huiz0dtSGgXmf5/sg5f KSiQ== X-Received: by 10.50.154.5 with SMTP id vk5mr2782868igb.39.1411231273576; Sat, 20 Sep 2014 09:41:13 -0700 (PDT) Original-Received: by 10.107.18.133 with HTTP; Sat, 20 Sep 2014 09:40:53 -0700 (PDT) In-Reply-To: <85a95ufeec.fsf@stephe-leake.org> X-detected-operating-system: by eggs.gnu.org: Error: Malformed IPv6 address (bad octet value). X-Received-From: 2607:f8b0:4001:c05::235 X-BeenThere: emacs-devel@gnu.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Emacs development discussions." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Original-Sender: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Xref: news.gmane.org gmane.emacs.devel:174590 Archived-At: > Tokenizing the whole buffer after any change is easily fast enough (on > modern hardware), even on a 7000 line buffer. Semantic parsing gets a > lot slower. > This is what I do right now in my prototype of a smarter Python mode. The tokenizing process itself is usually fast enough. But parsing is more complicated, and may take some time to rebuild the parse tree. Incremental approach is a natural step here. --=20 Yours sincerely, Vladimir Kazanov -- =D0=A1 =D1=83=D0=B2=D0=B0=D0=B6=D0=B5=D0=BD=D0=B8=D0=B5=D0=BC, =D0=92=D0=BB=D0=B0=D0=B4=D0=B8=D0=BC=D0=B8=D1=80 =D0=9A=D0=B0=D0=B7=D0=B0= =D0=BD=D0=BE=D0=B2