Re: master d995429e7bc: Use SBYTES instead of strlen in treesit.c

[Eli Zaretskii <eliz@gnu.org>]

> From: Stefan Kangas <stefankangas@gmail.com>
> Date: Mon, 22 Jul 2024 04:06:30 -0700
> 
> Po Lu <luangruo@yahoo.com> writes:
> 
> > Have you verified that these functions accept strings holding '\0'?
> 
> AFAIK, SBYTES returns the string length excluding '\0', same as strlen.

That's not the issue here.  The issue is that Emacs Lisp strings can
include embedded null bytes, which strlen will exclude, but SBYTES
will not.

There's perhaps a more general issue here: since tree-sitter accepts
UTF-8 encoded strings, we should encode the Lisp strings before we
pass them to tree-sitter.

Yuan, can you please look into this?

Btw, where does the tree-sitter docs say that all strings are supposed
to be in UTF-8 and that their length is supposed to be passed as
byte-counts, not character-counts?