Re: Including AI into Emacs

[Bruno Barbier <brubar.cs@gmail.com>]

Jean Louis <bugs@gnu.support> writes:

> * Bruno Barbier <brubar.cs@gmail.com> [2024-12-10 01:57]:
>> The package repository has a nice video that shows this package in
>> action.  I think it will answer your questions better than I could
>> (I discovered this package recently; I just tried it out of curiosity,
>> no real needs).
>
> I have so much real need. It is indispensable, and I can't wait buying
> strong GPU to run it locally and fast. It already works locally, just
> it is so slow as I don't have GPU. I will upgrade memory, GPU so that
> I can run free LLMs locally.

That's why I pick asynchronous calls when possible: I don't have to care
about how fast I will get the result.

> ...
> I can't agree to asynchronous injection of text, it sounds dangerous
> to me. When there is any lag in computer, my text anyway doesn't get
> well written due to whatever problems and often my speed writing.

Emacs does this all the time when running processes asynchronously.

> And I am often using temporary buffers for that reason that I do not
> disturb my other buffers with whatever changes.

Then asynchronous injection should be 100% safe.

> My LLM usage is such that I just do C-u F5 and then text will be added
> to the previous text, or I do F5 and text will be inserted, if region
> was marked it is used as part of the prompt.
>
> Everything is logged in the database, so I can convert each response
> later to other objects.
>
> Basically I get fundamentally same result as gptel with just few
> functions in background.

That's all that matters!

Best regards,

Bruno