From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: "Perry E. Metzger" Newsgroups: gmane.emacs.devel Subject: Re: Tree Sitter (was Re: cc-mode fontification feels random) Date: Thu, 22 Jul 2021 09:18:54 -0400 Message-ID: References: <83o8cge4lg.fsf@gnu.org> <62e438b5-d27f-1d3c-69c6-11fe29a76d74@dancol.org> <83fsxsdxhu.fsf@gnu.org> <179f22a44d8.2816.cc5b3318d7e9908e2c46732289705cb0@dancol.org> <179f38c0370.2816.cc5b3318d7e9908e2c46732289705cb0@dancol.org> <236e62c2-be9b-b26d-8cd0-4b5a1a86e19a@dancol.org> <86mtqsoh3f.fsf@stephe-leake.org> <286d815e-d1a1-07ca-6696-a7f51923ab4e@piermont.com> <86wnpl6f0y.fsf@stephe-leake.org> <865yx45y7g.fsf@stephe-leake.org> <0c575ca7-d287-4699-02bd-65822c11bf5d@piermont.com> <2e5ead63-624e-57bf-feaa-996f078fc782@dancol.org> Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="29091"; mail-complaints-to="usenet@ciao.gmane.io" User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:91.0) Gecko/20100101 Thunderbird/91.0 Cc: emacs-devel@gnu.org To: Daniel Colascione , Stefan Monnier , Stephen Leake Original-X-From: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Thu Jul 22 15:20:12 2021 Return-path: Envelope-to: ged-emacs-devel@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1m6YcW-0007Jt-Sp for ged-emacs-devel@m.gmane-mx.org; Thu, 22 Jul 2021 15:20:12 +0200 Original-Received: from localhost ([::1]:36194 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1m6YcV-0008Sw-QC for ged-emacs-devel@m.gmane-mx.org; Thu, 22 Jul 2021 09:20:11 -0400 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]:33670) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1m6YbJ-0007Ee-IH for emacs-devel@gnu.org; Thu, 22 Jul 2021 09:18:57 -0400 Original-Received: from hacklheber.piermont.com ([166.84.7.14]:47156) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1m6YbH-0000fp-Qb for emacs-devel@gnu.org; Thu, 22 Jul 2021 09:18:57 -0400 Original-Received: from snark.cb.piermont.com (localhost [127.0.0.1]) by hacklheber.piermont.com (Postfix) with UTF8SMTP id A9EAE15B; Thu, 22 Jul 2021 09:18:54 -0400 (EDT) Original-Received: from [10.160.2.107] (jabberwock.cb.piermont.com [10.160.2.107]) by snark.cb.piermont.com (Postfix) with UTF8SMTP id 7A77B2DE7E8; Thu, 22 Jul 2021 09:18:54 -0400 (EDT) Content-Language: en-US In-Reply-To: <2e5ead63-624e-57bf-feaa-996f078fc782@dancol.org> Received-SPF: pass client-ip=166.84.7.14; envelope-from=perry@piermont.com; helo=hacklheber.piermont.com X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, NICE_REPLY_A=-0.203, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: emacs-devel@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Emacs development discussions." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Original-Sender: "Emacs-devel" Xref: news.gmane.io gmane.emacs.devel:271463 Archived-At: On 7/21/21 21:16, Daniel Colascione wrote: > > On 7/21/21 12:15 PM, Perry E. Metzger wrote: >> On 7/21/21 12:21, Daniel Colascione wrote: >>> There is indeed a big literature! I wish there were a bigger >>> literature on *composable* incremental parsers though. IMHO, what we >>> need is an incremental GLR system (yes, GLR is bad worst-case, but >>> it's not a practical concern) that spits out a parse *forest* which >>> we then pare down to a parse tree with ad-hoc syntactic consistency >>> rules. Something like this naturally supports multi-language modes >>> and incorporation of out-of-band semantic information. >>> >> Tree sitter handles GLR. >> > > Cool. How does it prune the parse forest? I'd read the papers it is based on (and the documentation), they'll do a better job than me. Perry