From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: Andrew Hyatt Newsgroups: gmane.emacs.devel Subject: [NonGNU ELPA] New package: llm Date: Mon, 7 Aug 2023 19:54:50 -0400 Message-ID: Mime-Version: 1.0 Content-Type: multipart/alternative; boundary="0000000000008a8a4d06025df93f" Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="21312"; mail-complaints-to="usenet@ciao.gmane.io" To: Emacs-Devel devel Original-X-From: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Tue Aug 08 01:56:04 2023 Return-path: Envelope-to: ged-emacs-devel@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1qTA4y-0005MV-Ll for ged-emacs-devel@m.gmane-mx.org; Tue, 08 Aug 2023 01:56:04 +0200 Original-Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1qTA45-0006l0-Fc; Mon, 07 Aug 2023 19:55:09 -0400 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1qTA43-0006kj-JB for emacs-devel@gnu.org; Mon, 07 Aug 2023 19:55:08 -0400 Original-Received: from mail-lf1-x134.google.com ([2a00:1450:4864:20::134]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1qTA41-0003oK-In for emacs-devel@gnu.org; Mon, 07 Aug 2023 19:55:07 -0400 Original-Received: by mail-lf1-x134.google.com with SMTP id 2adb3069b0e04-4fe1c285690so7848125e87.3 for ; Mon, 07 Aug 2023 16:55:04 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1691452502; x=1692057302; h=to:subject:message-id:date:from:mime-version:from:to:cc:subject :date:message-id:reply-to; bh=S6tiA+nzG628YFwqB3rM9l/1PiHqMUbvUvCRVQhtt6c=; b=j/GOi3igoquM5NQLWM+cZPbKuimZGj1PMFAYYGQKDjOGhl27NsOUk3j+dOVBzzN5WK BwUxU0UsZ4DRIXpcVk6t7AvgGnKWkPixocSB1kIxCKaMKE60mllMZJawWrgjw++rWQxX cZMHzmQeOF4A5NgyrFT4gPNxaWsZnKstPLA2eUeLAZgN2/NMz9A+HJrem4HZymF6Y5nK bOvDoFxkN/5MG6ARfwRB3EwutwTKHVBZAk9y1E8LJPyGi756LrstFOzpUG325ZKmYySu xqW8EIbwVEzNQKKEf1OULqli1sbOuxchDqnkLDyhyf7Xu8T1ERGGBiKvWFhQPaiAkI2x Ey5w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1691452502; x=1692057302; h=to:subject:message-id:date:from:mime-version:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=S6tiA+nzG628YFwqB3rM9l/1PiHqMUbvUvCRVQhtt6c=; b=U+feDkTThb18dwgb+O5LPCdIdh9fimOfTpQozlNA6l2nRYOIxICQr1dCIPstwxPwdX NrOtypM8lmOp/tUbvZ2Z+Bov+1BihPkhIwwI88Q/WOijEz5alZLkj9Eny5Tjz7uqyiT+ 25PMthoPH37Fhw16cgeUwJDD8i9IhJSLXiK6AO22Q3PKEnfuVaaNTk7kCUZ+aZ1HIKHZ uD+M6100SsQZN/wc0H98l7Mih/3+55HoRaXZUphcyuIorfq1AXPvljeiD+LItcBXVfyx sxYizxnwrMoyzHCRtdNnmeXaU6IrZAaSUnLnbc5xhXCyvCT8Y+7CIH4o25QQVQIf+rvP FPRQ== X-Gm-Message-State: AOJu0YwNtW++275ouF+vMx7TyYANVAk+nBSJ2hlh4xGOsR8aXCHc+fAL QzFU5xPo8LUJL//G+o+JAO7dIaTjSd9aBOH0wVUsjW12tdI= X-Google-Smtp-Source: AGHT+IFDQCfSBDz4XMhyVTebJBEw5EOxNAhH/pyvGgS6Cl6U51l1gfwnyafdhaKsnF6aTZZyXBlSvVM6HDkoP5fqtGs= X-Received: by 2002:ac2:4f14:0:b0:4fb:91c5:fd38 with SMTP id k20-20020ac24f14000000b004fb91c5fd38mr7219190lfr.0.1691452502082; Mon, 07 Aug 2023 16:55:02 -0700 (PDT) Received-SPF: pass client-ip=2a00:1450:4864:20::134; envelope-from=ahyatt@gmail.com; helo=mail-lf1-x134.google.com X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: emacs-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Emacs development discussions." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Original-Sender: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Xref: news.gmane.io gmane.emacs.devel:308424 Archived-At: --0000000000008a8a4d06025df93f Content-Type: text/plain; charset="UTF-8" Hi everyone, I've created a new package called llm, for the purpose of abstracting the interface to various large language model providers. There are many LLM packages already, but it would be wasteful for all of them to try to be compatible with a range of LLM providers API (local LLMs such as Llama 2, API providers such as Open AI and Google Cloud's Vertex). This package attempts to solve this problem by defining generic functions which can then be implemented by different LLM providers. I have started with just two: Open AI and Vertex. Llama 2 would be a next choice, but I don't yet have it working on my system. In addition, I'm starting with just two core functionality: chat and embeddings. Extending to async is probably something that I will do next. You can see the code at https://github.com/ahyatt/llm. I prefer that this is NonGNU, because I suspect people would like to contribute interfaces to different LLM, and not all of them will have FSF papers. Your thoughts would be appreciated, thank you! --0000000000008a8a4d06025df93f Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hi everyone,

I've created a new pac= kage called llm, for the purpose of abstracting the interface to various la= rge=C2=A0language model providers.=C2=A0 There are many LLM packages alread= y, but it would be wasteful for all of them to try to be compatible with a = range of LLM providers API (local LLMs such as Llama 2, API providers such = as Open AI and Google Cloud's Vertex).=C2=A0 This package attempts to s= olve this problem by defining generic functions which can then be implement= ed by different LLM providers.=C2=A0 I have started with just two: Open AI = and Vertex.=C2=A0 Llama 2 would be a next choice, but I don't yet have = it working on my system.=C2=A0 In addition, I'm starting with just two = core functionality: chat and embeddings.=C2=A0 Extending to async is probab= ly something that I will do next.

You can see the = code at https://github.com/ahyatt= /llm.

I prefer that this is NonGNU, becaus= e I suspect people would like to contribute interfaces to different LLM, an= d not all of them will have FSF papers.

Your thoug= hts would=C2=A0be appreciated, thank you!

--0000000000008a8a4d06025df93f--