From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: Karthik Chikmagalur Newsgroups: gmane.emacs.devel Subject: Re: [NonGNU ELPA] Add package gptel Date: Mon, 29 Apr 2024 10:21:55 -0700 Message-ID: <87frv484p8.fsf@gmail.com> References: <877cgi9m4w.fsf@gmail.com> <87ttjlsxro.fsf@posteo.net> <871q6pa0ts.fsf@gmail.com> <87le4wn12q.fsf@posteo.net> <87le4w8xun.fsf@gmail.com> <87h6fkmxse.fsf@posteo.net> Mime-Version: 1.0 Content-Type: text/plain Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="2673"; mail-complaints-to="usenet@ciao.gmane.io" Cc: emacs-devel@gnu.org To: Philip Kaludercic Original-X-From: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Mon Apr 29 19:22:53 2024 Return-path: Envelope-to: ged-emacs-devel@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1s1UiK-0000Rp-Lm for ged-emacs-devel@m.gmane-mx.org; Mon, 29 Apr 2024 19:22:52 +0200 Original-Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1s1Uha-0004JC-C8; Mon, 29 Apr 2024 13:22:06 -0400 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1s1UhW-0004IX-M3 for emacs-devel@gnu.org; Mon, 29 Apr 2024 13:22:03 -0400 Original-Received: from mail-pl1-x636.google.com ([2607:f8b0:4864:20::636]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1s1UhS-0000mo-Gq for emacs-devel@gnu.org; Mon, 29 Apr 2024 13:22:02 -0400 Original-Received: by mail-pl1-x636.google.com with SMTP id d9443c01a7336-1e3ca546d40so39993515ad.3 for ; Mon, 29 Apr 2024 10:21:58 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1714411317; x=1715016117; darn=gnu.org; h=mime-version:message-id:date:references:in-reply-to:subject:cc:to :from:from:to:cc:subject:date:message-id:reply-to; bh=7iH/MdHf4SkNw5piwZdxorcGmSSFjVk3g6Xt8noG2QA=; b=bVRJxyAEh3Bvv5qjdsHQ9UAzdtMhZcb7uOQazb6sfOxvbgR+NZrXaUwAtgp4EHx5f9 kOFqFNnauAqezgPchCEgVxQmluaRA/pGhGvuzs7+p/2QREiRNgOoh+KEHZzDh9ngmIrX IcEYVQCexf/eC06HjoV5R8sShM1dNwM+0pMxDjU67WJqIWUqdtH0brKGw/tfd6m9rA5Y Sv9jNDk1Ny92RG/rcd5r7luia2txeJ9KfiwbSGP8UQc+35McjnmTytGyStfqLgQufbYX H1jJFY/ciLyZqNM/W3d+1rA3hZeUmM0bhw6TbYxolW73ovhxkG7vfHz+GZxzNnA1IXSA 3vtQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1714411317; x=1715016117; h=mime-version:message-id:date:references:in-reply-to:subject:cc:to :from:x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=7iH/MdHf4SkNw5piwZdxorcGmSSFjVk3g6Xt8noG2QA=; b=NPTo8rLVhjpFHYj4Rsf8S0m72RyGc4LGJlzNf86vgpICvMSf8HJ1uzSfGnKLCUz1BN 71S2OrKH9kV+2/khSy6+L43wYYj5DhJa2lYJRRE83+HN4qNcgY0uNBiG7L3/1HvhW1Aw tv0iwwpw3twlcSsM5NB4qKcusjEKCdO78f0x41wMjTirefMt7rSDvDKhQblLwEzL6Vqz PRXZ+mZCF2fUIump53fTTiTS5RIkHgkrqp5GDyB+DB2oNMGhIR5fqHZ8zkMVzmHLLkfR +sj1edAwpGdt0WZ/JivYY5zF//ca5VzI8LVhoCK0V+oJIkI28R2kEQZD8S5q1Z/2CYZT r9hg== X-Gm-Message-State: AOJu0YzgxgykpzSSQyKfvWiq0renbesRoNeUFfUhfUpwXWdYE0zeldVv O9hSz6e9mx/ZT5JRSblqj3KeM+X/hHnDTsRlvuS8r0nPy0CMYgtWFCj6WQ== X-Google-Smtp-Source: AGHT+IHL1LLqQN52XQx8ouSZgUfQg0hErKC3G2l3Iu3zTPqHaf6yQnhxhikoOF++e9JVUKbg80xGgw== X-Received: by 2002:a17:902:a705:b0:1e4:9ad5:7537 with SMTP id w5-20020a170902a70500b001e49ad57537mr258927plq.34.1714411316702; Mon, 29 Apr 2024 10:21:56 -0700 (PDT) Original-Received: from localhost (169-231-138-255.wireless.ucsb.edu. [169.231.138.255]) by smtp.gmail.com with ESMTPSA id p2-20020a1709027ec200b001e0e5722788sm21045222plb.17.2024.04.29.10.21.56 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 29 Apr 2024 10:21:56 -0700 (PDT) In-Reply-To: <87h6fkmxse.fsf@posteo.net> Received-SPF: pass client-ip=2607:f8b0:4864:20::636; envelope-from=karthikchikmagalur@gmail.com; helo=mail-pl1-x636.google.com X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: emacs-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Emacs development discussions." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Original-Sender: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Xref: news.gmane.io gmane.emacs.devel:318366 Archived-At: >> This is no more dangerous than having that line of text at the top of >> the buffer and sending the buffer contents as a query. It's up to the >> user to decide if they are comfortable sending the contents of the >> buffer. > > What do you mean by the top of the buffer? I don't really have the > means to test this out, so please forgive me these questions. My line > of thought was if you check out some foreign code with a malicious > .dir-locals.el, you wouldn't realise that it could change this option. > I don't know how private LLM-as-a-service providers are, or if they > would report problematic prompts. It is essentially prepended to the buffer text in the query payload. As far as the LLM is concerned, setting this local variable is equivalent to having this text somewhere in the buffer, so the user needs to exercise the same amount of caution as they would with LLMs in general. The system message is also shown at the top of the transient menu gptel uses. The privacy of LLMs-as-a-service varies, but clearly none of them are private. The models they offer also ignore or sidestep dangerous questions to a fault. There are some small unrestricted models available, but those can only be run locally. >>> Does this have any significance? I am not familiar with the timeline. >> >> Only in that I expect many more users are familiar with gptel as a >> result. > > Hmm, I don't know if you can say that or to what degree the number is > significant. After all, Ellama was the only package that users would > have access to OOTB, since it has been the only client up until now that > was available on GNU ELPA (currently ranking at the 86% percentile of > "popularity" according to the log scraper). Okay. >> Ollama, GPT4All and Llama.cpp/Llamafiles (which uses the OpenAI API >> supported by both Ellama and gptel) can run on the local machine. > > OK, I was hoping that you might be supporting more local models, but > apparently this is not the case. These are the only local options with HTTP APIs available right now. There are several more local web applications with bespoke interfaces but no API. When there are more I'll add support for them to gptel. > I recently uploaded a video to https://spectra.video/ and it was easy. > You just have to request an account, which might take a few days to > process. I'll take a look at available instances. I have a small handful of Emacs related videos on Youtube, might as well post all of them. > But no, none of this is blocking. I am just trying to help improve the > package before we add it. The only blocking issue would be if it broke > the NonGNU ELPA rules, e.g. by having a hard dependency on non-free > software or SaaSS. Okay. Karthik