From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: Philip Kaludercic Newsgroups: gmane.emacs.devel Subject: Re: [NonGNU ELPA] New package: llm Date: Tue, 08 Aug 2023 05:42:24 +0000 Message-ID: <871qgexf7j.fsf@posteo.net> References: Mime-Version: 1.0 Content-Type: text/plain Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="22569"; mail-complaints-to="usenet@ciao.gmane.io" Cc: Emacs-Devel devel To: Andrew Hyatt Original-X-From: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Tue Aug 08 07:43:40 2023 Return-path: Envelope-to: ged-emacs-devel@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1qTFVM-0005ff-2T for ged-emacs-devel@m.gmane-mx.org; Tue, 08 Aug 2023 07:43:40 +0200 Original-Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1qTFUH-0004cR-KQ; Tue, 08 Aug 2023 01:42:33 -0400 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1qTFUF-0004cG-6s for emacs-devel@gnu.org; Tue, 08 Aug 2023 01:42:31 -0400 Original-Received: from mout02.posteo.de ([185.67.36.66]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1qTFUC-0003UF-PR for emacs-devel@gnu.org; Tue, 08 Aug 2023 01:42:30 -0400 Original-Received: from submission (posteo.de [185.67.36.169]) by mout02.posteo.de (Postfix) with ESMTPS id 19CEE240104 for ; Tue, 8 Aug 2023 07:42:26 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=posteo.net; s=2017; t=1691473346; bh=yxlFyuYvr2I0qHwzG7IZiIaRcUY7VtUP/1zdR6IRQIg=; h=From:To:Cc:Subject:Autocrypt:Date:Message-ID:MIME-Version:From; b=EA6Umh2BmjJ/nFj/0v6RQ8osznEl5SDulY+iUvJXMV9vNKE6f02PLeP7OQ9WwviOR PIFTsbBt4f4UgccPt1WlSF23j6FvFevUT0UtJPXBPQmx9QTJdTwII3rbB0NMac/D33 SCspff6EYD1UZB0CqChqZ8vMqacoxVDAE6nCXQ+avjRxokyJNpjgixjbe3JAX5gFEx fgGR4azFMNTGqyV9mXEXoe+2zE6fcLI9epZgIWVdVfF4vigSbMhWIu1f/CcLm+Smc2 FWh7KEHKHTX6NAKT+b3rFNoZJfsfHRrecwf2iDR8hhkHNy7xXGqTdVgrFL4+hBpQfH rLY64MlEylgAA== Original-Received: from customer (localhost [127.0.0.1]) by submission (posteo.de) with ESMTPSA id 4RKhsY4rYkz6twm; Tue, 8 Aug 2023 07:42:25 +0200 (CEST) In-Reply-To: (Andrew Hyatt's message of "Mon, 7 Aug 2023 19:54:50 -0400") Autocrypt: addr=philipk@posteo.net; keydata= mDMEZBBQQhYJKwYBBAHaRw8BAQdAHJuofBrfqFh12uQu0Yi7mrl525F28eTmwUDflFNmdui0QlBo aWxpcCBLYWx1ZGVyY2ljIChnZW5lcmF0ZWQgYnkgYXV0b2NyeXB0LmVsKSA8cGhpbGlwa0Bwb3N0 ZW8ubmV0PoiWBBMWCAA+FiEEDg7HY17ghYlni8XN8xYDWXahwukFAmQQUEICGwMFCQHhM4AFCwkI BwIGFQoJCAsCBBYCAwECHgECF4AACgkQ8xYDWXahwulikAEA77hloUiSrXgFkUVJhlKBpLCHUjA0 mWZ9j9w5d08+jVwBAK6c4iGP7j+/PhbkxaEKa4V3MzIl7zJkcNNjHCXmvFcEuDgEZBBQQhIKKwYB BAGXVQEFAQEHQI5NLiLRjZy3OfSt1dhCmFyn+fN/QKELUYQetiaoe+MMAwEIB4h+BBgWCAAmFiEE Dg7HY17ghYlni8XN8xYDWXahwukFAmQQUEICGwwFCQHhM4AACgkQ8xYDWXahwukm+wEA8cml4JpK NeAu65rg+auKrPOP6TP/4YWRCTIvuYDm0joBALw98AMz7/qMHvSCeU/hw9PL6u6R2EScxtpKnWof z4oM Received-SPF: pass client-ip=185.67.36.66; envelope-from=philipk@posteo.net; helo=mout02.posteo.de X-Spam_score_int: -43 X-Spam_score: -4.4 X-Spam_bar: ---- X-Spam_report: (-4.4 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_MED=-2.3, RCVD_IN_MSPIKE_H5=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: emacs-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Emacs development discussions." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Original-Sender: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Xref: news.gmane.io gmane.emacs.devel:308432 Archived-At: Andrew Hyatt writes: > Hi everyone, > > I've created a new package called llm, for the purpose of abstracting the > interface to various large language model providers. There are many LLM > packages already, but it would be wasteful for all of them to try to be > compatible with a range of LLM providers API (local LLMs such as Llama 2, > API providers such as Open AI and Google Cloud's Vertex). This package > attempts to solve this problem by defining generic functions which can then > be implemented by different LLM providers. I have started with just two: > Open AI and Vertex. Llama 2 would be a next choice, but I don't yet have > it working on my system. In addition, I'm starting with just two core > functionality: chat and embeddings. Extending to async is probably > something that I will do next. Llama was the model that could be executed locally, and the other two are "real" services, right? > You can see the code at https://github.com/ahyatt/llm. > > I prefer that this is NonGNU, because I suspect people would like to > contribute interfaces to different LLM, and not all of them will have FSF > papers. I cannot estimate how important or not LLM will be in the future, but it might be worth having something like this in the core, at some point. Considering the size of a module at around 150-200 lines it seems, and the relative infrequency of new models (at least to my understanding), I don't know if the "advantage" of accepting contributions from people who haven't signed the CA has that much weight, opposed to the general that all users may enjoy from having the technology integrated into Emacs itself, in a way that other packages (and perhaps even the core-help system) could profit from it. > Your thoughts would be appreciated, thank you!