Help building Pen.el (GPT for emacs)

Help building Pen.el (GPT for emacs)

[Shane Mulligan]

[-- Attachment #1: Type: text/plain, Size: 599 bytes --]

Hey guys. It looks like OpenAI is collaborating with GitHub on their GPT
stuff, so any assistance in building an editor in emacs would be greatly
appreciated. I made a start 4 months ago, link below:

   -

   https://github.com/semiosis/pen.el/
   -

   https://copilot.github.com/
   -

   https://news.ycombinator.com/item?id=27676266

GPT-3+vscode is an emacs killer, but emacs is a much better platform for
building this stuff, so please help! Thanks.

Shane

How to contact me:
🇦🇺 00 61 421 641 250
🇳🇿 00 64 21 1462 759 <+64-21-1462-759>
mullikine@gmail.com

[-- Attachment #2: Type: text/html, Size: 4720 bytes --]

Re: Help building Pen.el (GPT for emacs)

[Jean Louis]

* Shane Mulligan <mullikine@gmail.com> [2021-06-30 07:31]:
> Hey guys. It looks like OpenAI is collaborating with GitHub on their GPT
> stuff, so any assistance in building an editor in emacs would be greatly
> appreciated. I made a start 4 months ago, link below:
> 
>    https://github.com/semiosis/pen.el/

In regards to licensing, it is recommended that you apply properly the
license in each file, not just main one file. There is reason for
that, files may be re-used and distributed not only in the
package. Each file should point to the license.

Please do {C-h C-c} and search for it. I will do more of review when I
get it to work.

            How to Apply These Terms to Your New Programs

  If you develop a new program, and you want it to be of the greatest
possible use to the public, the best way to achieve this is to make it
free software which everyone can redistribute and change under these terms.

  To do so, attach the following notices to the program.  It is safest
to attach them to the start of each source file to most effectively
state the exclusion of warranty; and each file should have at least
the "copyright" line and a pointer to where the full notice is found.

    <one line to give the program's name and a brief idea of what it does.>
    Copyright (C) <year>  <name of author>

    This program is free software: you can redistribute it and/or modify
    it under the terms of the GNU General Public License as published by
    the Free Software Foundation, either version 3 of the License, or
    (at your option) any later version.

    This program is distributed in the hope that it will be useful,
    but WITHOUT ANY WARRANTY; without even the implied warranty of
    MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
    GNU General Public License for more details.

    You should have received a copy of the GNU General Public License
    along with this program.  If not, see <https://www.gnu.org/licenses/>.

Also add information on how to contact you by electronic and paper mail.

  If the program does terminal interaction, make it output a short
notice like this when it starts in an interactive mode:

    <program>  Copyright (C) <year>  <name of author>
    This program comes with ABSOLUTELY NO WARRANTY; for details type `show w'.
    This is free software, and you are welcome to redistribute it
    under certain conditions; type `show c' for details.

The hypothetical commands `show w' and `show c' should show the appropriate
parts of the General Public License.  Of course, your program's commands
might be different; for a GUI interface, you would use an "about box".

  You should also get your employer (if you work as a programmer) or school,
if any, to sign a "copyright disclaimer" for the program, if necessary.
For more information on this, and how to apply and follow the GNU GPL, see
<https://www.gnu.org/licenses/>.


-- 
Jean

Take action in Free Software Foundation campaigns:
https://www.fsf.org/campaigns

In support of Richard M. Stallman
https://stallmansupport.org/

Re: Help building Pen.el (GPT for emacs)

[Jean Louis]

* Shane Mulligan <mullikine@gmail.com> [2021-06-30 07:31]:
> Hey guys. It looks like OpenAI is collaborating with GitHub on their GPT
> stuff, so any assistance in building an editor in emacs would be greatly
> appreciated. I made a start 4 months ago, link below:
> 
>    https://github.com/semiosis/pen.el/

I could install `openai' by using `pip', so far so good. 

Though using your API key I have to reject for privacy purposes, so I
have applied on their website.

-- 
Jean

Take action in Free Software Foundation campaigns:
https://www.fsf.org/campaigns

In support of Richard M. Stallman
https://stallmansupport.org/

Re: Help building Pen.el (GPT for emacs)

[Jean Louis]

* Shane Mulligan <mullikine@gmail.com> [2021-06-30 07:31]:
> Hey guys. It looks like OpenAI is collaborating with GitHub on their GPT
> stuff, so any assistance in building an editor in emacs would be greatly
> appreciated. I made a start 4 months ago, link below:

>    https://github.com/semiosis/pen.el/

Sadly, I canot istall the requiremet depedency, I cannot find libclang
in the list of my packages.

error: failed to run custom build command for `emacs_module v0.10.0`

Caused by:
  process didn't exit successfully: `/home/data1/protected/Programming/git/emacs-yamlmod/target/release/build/emacs_module-a4300f25c129cfa5/build-script-build` (exit code: 101)
  --- stderr
  thread 'main' panicked at 'Unable to find libclang: "couldn\'t find any valid shared libraries matching: [\'libclang.so\', \'libclang-*.so\', \'libclang.so.*\'], set the `LIBCLANG_PATH` environment variable to a path where one of these files can be found (invalid: [])"', /home/data1/protected/.cargo/registry/src/github.com-1ecc6299db9ec823/bindgen-0.48.1/src/lib.rs:1652:31
  note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace


-- 
Jean

Take action in Free Software Foundation campaigns:
https://www.fsf.org/campaigns

In support of Richard M. Stallman
https://stallmansupport.org/

Re: Help building Pen.el (GPT for emacs)

[Shane Mulligan]

[-- Attachment #1: Type: text/plain, Size: 1664 bytes --]

Hi Jean,

Thanks for emailing me to help. I'm actively trying to set up a docker
image to make this whole thing much easier. Hopefully I can get this done
in the next few days.
I will let you know when I have made progress.

Thank you,

On Sat, Jul 3, 2021 at 2:03 AM Jean Louis <bugs@gnu.support> wrote:

> * Shane Mulligan <mullikine@gmail.com> [2021-06-30 07:31]:
> > Hey guys. It looks like OpenAI is collaborating with GitHub on their GPT
> > stuff, so any assistance in building an editor in emacs would be greatly
> > appreciated. I made a start 4 months ago, link below:
>
> >    https://github.com/semiosis/pen.el/
>
> Sadly, I canot istall the requiremet depedency, I cannot find libclang
> in the list of my packages.
>
> error: failed to run custom build command for `emacs_module v0.10.0`
>
> Caused by:
>   process didn't exit successfully:
> `/home/data1/protected/Programming/git/emacs-yamlmod/target/release/build/emacs_module-a4300f25c129cfa5/build-script-build`
> (exit code: 101)
>   --- stderr
>   thread 'main' panicked at 'Unable to find libclang: "couldn\'t find any
> valid shared libraries matching: [\'libclang.so\', \'libclang-*.so\',
> \'libclang.so.*\'], set the `LIBCLANG_PATH` environment variable to a path
> where one of these files can be found (invalid: [])"',
> /home/data1/protected/.cargo/registry/src/github.com-1ecc6299db9ec823/bindgen-0.48.1/src/lib.rs:1652
> :31
>   note: run with `RUST_BACKTRACE=1` environment variable to display a
> backtrace
>
>
> --
> Jean
>
> Take action in Free Software Foundation campaigns:
> https://www.fsf.org/campaigns
>
> In support of Richard M. Stallman
> https://stallmansupport.org/
>

[-- Attachment #2: Type: text/html, Size: 2412 bytes --]

Re: Help building Pen.el (GPT for emacs)

[Jean Louis]

* Shane Mulligan <mullikine@gmail.com> [2021-07-03 15:06]:
> Hi Jean,
> 
> Thanks for emailing me to help. I'm actively trying to set up a docker
> image to make this whole thing much easier. Hopefully I can get this done
> in the next few days.
> I will let you know when I have made progress.

I don't know how is that easier. Not that it will be easier for me, I
cannot use docker.

You should maybe describe dependencies without relying that everybody
should use apt package manager, describe URLs for dependencies in
addition to their possible package names, but not how to build them.

That way every user can reach for source independently of package
manager.

Please also think on BSD and other systems where maybe docker does not work.

-- 
Jean

Take action in Free Software Foundation campaigns:
https://www.fsf.org/campaigns

In support of Richard M. Stallman
https://stallmansupport.org/

Re: Help building Pen.el (GPT for emacs)

[Arthur Miller]

Jean Louis <bugs@gnu.support> writes:

> Please also think on BSD and other systems where maybe docker does not work.

https://wiki.freebsd.org/Docker

Re: Help building Pen.el (GPT for emacs)

[Jean Louis]

* Arthur Miller <arthur.miller@live.com> [2021-07-04 02:26]:
> Jean Louis <bugs@gnu.support> writes:
> 
> > Please also think on BSD and other systems where maybe docker does not work.
> 
> https://wiki.freebsd.org/Docker

Not on DragonFlyBSD -- and even FreeBSD is broken as you read.

-- 
Jean

Take action in Free Software Foundation campaigns:
https://www.fsf.org/campaigns

In support of Richard M. Stallman
https://stallmansupport.org/

Re: Help building Pen.el (GPT for emacs)

[Shane Mulligan]

[-- Attachment #1: Type: text/plain, Size: 826 bytes --]

Hi Jean,

I have working setup instructions for Debian 10 and a working docker image.

https://github.com/semiosis/pen.el/blob/master/installation.org
https://github.com/semiosis/pen.el/blob/master/Dockerfile

I will also try to get working on other platforms in the future.

Shane

On Sun, Jul 4, 2021 at 11:45 AM Jean Louis <bugs@gnu.support> wrote:

> * Arthur Miller <arthur.miller@live.com> [2021-07-04 02:26]:
> > Jean Louis <bugs@gnu.support> writes:
> >
> > > Please also think on BSD and other systems where maybe docker does not
> work.
> >
> > https://wiki.freebsd.org/Docker
>
> Not on DragonFlyBSD -- and even FreeBSD is broken as you read.
>
> --
> Jean
>
> Take action in Free Software Foundation campaigns:
> https://www.fsf.org/campaigns
>
> In support of Richard M. Stallman
> https://stallmansupport.org/
>

[-- Attachment #2: Type: text/html, Size: 1739 bytes --]

Re: Help building Pen.el (GPT for emacs)

[Richard Stallman]

[[[ To any NSA and FBI agents reading my email: please consider    ]]]
[[[ whether defending the US Constitution against all enemies,     ]]]
[[[ foreign or domestic, requires you to follow Snowden's example. ]]]

What does pen.el do?
What is its relation to GPT-3?

-- 
Dr Richard Stallman (https://stallman.org)
Chief GNUisance of the GNU Project (https://gnu.org)
Founder, Free Software Foundation (https://fsf.org)
Internet Hall-of-Famer (https://internethalloffame.org)

Re: Help building Pen.el (GPT for emacs)

[Stefan Kangas]

Shane Mulligan <mullikine@gmail.com> writes:

> Hey guys. It looks like OpenAI is collaborating with GitHub on their GPT stuff, so any assistance in building an editor in emacs would be greatly appreciated. I made a start 4 months ago, link below:
>
> https://github.com/semiosis/pen.el/
>
> https://copilot.github.com/
>
> https://news.ycombinator.com/item?id=27676266
>
> GPT-3+vscode is an emacs killer, but emacs is a much better platform for building this stuff, so please help! Thanks.

Could you briefly elaborate on the capabilities of "GPT-3+vscode" and
why you think it is an Emacs killer?

What are (briefly) the capabilities of your package so far, and how
does it compare to what the competition has?  How much work remains if
we would want to catch up?

Thanks.

Re: Help building Pen.el (GPT for emacs)

[dick]

SK> Could you briefly elaborate on the capabilities of "GPT-3+vscode" and why
SK> you think it is an Emacs killer?

“If the people believe there’s an imaginary river out there, you don’t tell
them there’s no river there. You build an imaginary bridge over the imaginary
river.” -- Nikita Kruschev

The Copilot brouhaha takes the premature optimization and pointless
speculation endemic to emacs-devel to another level.

Re: Help building Pen.el (GPT for emacs)

[Shane Mulligan]

[-- Attachment #1: Type: text/plain, Size: 4714 bytes --]

Hi Stefan and dick,

* Reponse to Stefan
** Capabilities of "GPT-3+vscode" (Copilot)
Copilot uses a specialised version of GPT-3 called codex which is optimised
to generate code.
Copilot is technologically capable of also querying (classifying) code.
The simulateous usage of both AI generation and classification completely
changes the way you use an editing environment.

*** Why it's an emacs killer
I must coin a term, imaginary programming, for the sake of shortening my
explanation.  Imaginary programming is imaginary in the mathematical and
creative sense. It's a dimension of programming non-existent in emacs.  It's
stochastic and allows you to predict what will happen without needing to
write
correct code.

Clear demonstration here:
http://semiosis.github.io/posts/nlsh-natural-language-shell/

- meta-prompts (see below)
- there is no GPT support for emacs.
  - This is the elephant in the room.
  - Asides from what me, a single person in the world is struggling to put
    together. I'm rate-limited. There needs to be core support for
integrating
    and designing prompts.
    - I'm working on core features rather than building prompts.
- An analogy: Copilot + GPT-3 + vscode are now firmly in the area of
imaginary programming.
    completely missing with emacs. And that's very worrisome.
  - It's the cause of anxiety about what is the future of programming and
is it going to make all coders redundant.
    - It's closed source so people are literally unable to see the way
ahead.
- It's an attack against open-source.

** Risky capabilities of Copilot in the near future
- meta-prompts that encode the provenance of text. This is an existential
risk
  to coding, generally, because right now, today, GitHub (Microsoft) and
OpenAI
  (the not-for-profit turned for-profit) are encoding using Copilot the way
  that people are solving problems in order to further automate that
process,
  and it's closed-source.
- imaginary generation of user interfaces, such as emacs. There are decades
  worth of text from emacs online and on GitHub. That means GPT-3 and codex
are
  quite capable of already imagining at least part of the emacs user
interface
  via prompting. The question is, do you want emacs to be in control of your
  system or a copilot that you can't control?

** Capabilities of "Pen.el"
My vision for Pen.el has always been much broader.
- n-many language models
- n-many prompts (classification and generation)
- sharing prompts, open-source
- file format for encoding the provenance of text
  - https://github.com/semiosis/ink.el
- fully transparent
- Use emacs as an interface to remain in control of conversations, whether
they
  be infinitely many chatbots or solving communication barriers between
people.
  - When I use words such as infinite, I mean it in the truest sense, and
it's
    not hype. I've done my best to be a harbinger.
    - Literally, just select any topic and create a chatbot for it.
    -
https://semiosis.github.io/posts/gpt-3-for-building-mind-maps-with-an-ai-tutor-for-any-topic/

*** To catch up and surpass and save open-source
- We need a centralised repository of 'prompts', like melpa
  - This doesn't exist yet because the technology is closed-source inside
    GitHub copilot and there are not any standard formats.
  - I have made a start with this
    - https://github.com/semiosis/prompts/
- Pen needs to be integrated (working on this currently)
- GPT-j needs to be integrated (working on this currently)

I have many blog articles now of me trying to demonstrate what the
capabilities of Pen are.

https://mullikine.github.io/tags/pen/

* In reponse to dick's message:
"The Copilot brouhaha takes the premature optimization and pointless
speculation endemic to emacs-devel to another level."

I do not believe this is pointless speculation.


On Thu, Jul 15, 2021 at 11:58 PM Stefan Kangas <stefan@marxist.se> wrote:

> Shane Mulligan <mullikine@gmail.com> writes:
>
> > Hey guys. It looks like OpenAI is collaborating with GitHub on their GPT
> stuff, so any assistance in building an editor in emacs would be greatly
> appreciated. I made a start 4 months ago, link below:
> >
> > https://github.com/semiosis/pen.el/
> >
> > https://copilot.github.com/
> >
> > https://news.ycombinator.com/item?id=27676266
> >
> > GPT-3+vscode is an emacs killer, but emacs is a much better platform for
> building this stuff, so please help! Thanks.
>
> Could you briefly elaborate on the capabilities of "GPT-3+vscode" and
> why you think it is an Emacs killer?
>
> What are (briefly) the capabilities of your package so far, and how
> does it compare to what the competition has?  How much work remains if
> we would want to catch up?
>
> Thanks.
>

[-- Attachment #2: Type: text/html, Size: 6287 bytes --]

Re: Help building Pen.el (GPT for emacs)

[tomas]

[-- Attachment #1: Type: text/plain, Size: 1104 bytes --]

On Fri, Jul 16, 2021 at 11:52:41AM +1200, Shane Mulligan wrote:
> Hi Stefan and dick,
> 
> * Reponse to Stefan
> ** Capabilities of "GPT-3+vscode" (Copilot)
> Copilot uses a specialised version of GPT-3 called codex which is optimised
> to generate code.

GPT-3 is not free software [1]. Only the service is accessible to us,
mere mortals.

As for Copilot, one could even argue that it harvests [2] free software
at the costs of all of us.

As far as I am concerned, I'll put as much distance as I can between
myself and Copilot (or Github, for the same reasons).

I often asked myself how Github could have been worth $7 billion to
Microsoft. Now I begin to understand.

Cheers

[1] "Microsoft announced on September 22, 2020 that it had licensed
    'exclusive' use of GPT-3; others can still use the public API to
    receive output, but only Microsoft has access to GPT-3’s underlying
    code."
    https://en.wikipedia.org/wiki/GPT-3

[2] https://mjg59.dreamwidth.org/
    https://juliareda.eu/2021/07/github-copilot-is-not-infringing-your-copyright/  

 - tomás

[-- Attachment #2: Digital signature --]
[-- Type: application/pgp-signature, Size: 198 bytes --]

Re: Help building Pen.el (GPT for emacs)

[Shane Mulligan]

[-- Attachment #1: Type: text/plain, Size: 1576 bytes --]

I completely agree with Tomas. The neural network weights should be given
the same software license as the code it has been trained on and they need
to do more to support and FOSS analog, as the technology.
I am expecting a conversation with Nat Fridman on a collaboration to bring
Copilot to emacs. If he contacts me I will raise this issue.

On Fri, Jul 16, 2021 at 7:30 PM <tomas@tuxteam.de> wrote:

> On Fri, Jul 16, 2021 at 11:52:41AM +1200, Shane Mulligan wrote:
> > Hi Stefan and dick,
> >
> > * Reponse to Stefan
> > ** Capabilities of "GPT-3+vscode" (Copilot)
> > Copilot uses a specialised version of GPT-3 called codex which is
> optimised
> > to generate code.
>
> GPT-3 is not free software [1]. Only the service is accessible to us,
> mere mortals.
>
> As for Copilot, one could even argue that it harvests [2] free software
> at the costs of all of us.
>
> As far as I am concerned, I'll put as much distance as I can between
> myself and Copilot (or Github, for the same reasons).
>
> I often asked myself how Github could have been worth $7 billion to
> Microsoft. Now I begin to understand.
>
> Cheers
>
> [1] "Microsoft announced on September 22, 2020 that it had licensed
>     'exclusive' use of GPT-3; others can still use the public API to
>     receive output, but only Microsoft has access to GPT-3’s underlying
>     code."
>     https://en.wikipedia.org/wiki/GPT-3
>
> [2] https://mjg59.dreamwidth.org/
>
> https://juliareda.eu/2021/07/github-copilot-is-not-infringing-your-copyright/
>
>
>  - tomás
>

[-- Attachment #2: Type: text/html, Size: 2435 bytes --]

Re: Help building Pen.el (GPT for emacs)

[tomas]

[-- Attachment #1: Type: text/plain, Size: 200 bytes --]

On Sat, Jul 17, 2021 at 12:33:30PM +1200, Shane Mulligan wrote:
> I completely agree with Tomas [...]

Thanks for the links in your other post. It'll take me a while to
mull over them :)

Cheers
 - t

[-- Attachment #2: Digital signature --]
[-- Type: application/pgp-signature, Size: 198 bytes --]

Re: Help building Pen.el (GPT for emacs)

[Jean Louis]

* tomas@tuxteam.de <tomas@tuxteam.de> [2021-07-16 10:31]:
> On Fri, Jul 16, 2021 at 11:52:41AM +1200, Shane Mulligan wrote:
> > Hi Stefan and dick,
> > 
> > * Reponse to Stefan
> > ** Capabilities of "GPT-3+vscode" (Copilot)
> > Copilot uses a specialised version of GPT-3 called codex which is optimised
> > to generate code.
> 
> GPT-3 is not free software [1]. Only the service is accessible to us,
> mere mortals.
> 
> As for Copilot, one could even argue that it harvests [2] free software
> at the costs of all of us.
> 
> As far as I am concerned, I'll put as much distance as I can between
> myself and Copilot (or Github, for the same reasons).
> 
> I often asked myself how Github could have been worth $7 billion to
> Microsoft. Now I begin to understand.

👍👍👍


-- 
Jean

Take action in Free Software Foundation campaigns:
https://www.fsf.org/campaigns

In support of Richard M. Stallman
https://stallmansupport.org/

Re: Help building Pen.el (GPT for emacs)

[Richard Stallman]

[[[ To any NSA and FBI agents reading my email: please consider    ]]]
[[[ whether defending the US Constitution against all enemies,     ]]]
[[[ foreign or domestic, requires you to follow Snowden's example. ]]]

The idea of "GPT for Emacs" is, alas, not an option.  GPT-3 is nonfree
software.  I think it is not even released.  Thus, we cannot include
it in a free system; we cannot distribute it with Emacs.

It would be possible to utilize GPT-3 running on Microsoft's server by
sending it questions -- but that is SaaSS, which is an injustice
similar to nonfree software.  For explanation of this issue, see
https://gnu.org/philosophy/who-does-that-server-really-serve.html.

For ethical reasons we don't recommend SaaSS in GNU software, and a
fortiori we don't distribute or recommend code to invoke SaaSS.


-- 
Dr Richard Stallman (https://stallman.org)
Chief GNUisance of the GNU Project (https://gnu.org)
Founder, Free Software Foundation (https://fsf.org)
Internet Hall-of-Famer (https://internethalloffame.org)

Re: Help building Pen.el (GPT for emacs)

[Shane Mulligan]

[-- Attachment #1: Type: text/plain, Size: 3104 bytes --]

Thank you for tuning in Richard. :)

I think the end-goal should be to have a close collaboration with
EleutherAI, who already have an open-source alternative to the Copilot
model. It's called GPT-j.
ελευθερία is a greek word that means Freedom. EleutherAI are open-sourcing
language models.
The problem is that there are very few people within EleutherAI using emacs
and few people who can help.

If you'd please excuse my speculative musings, emacs has 40 years of design
waiting to be augmented with GPT3 and I believe that emacs is way ahead of
the competition. It's a gold rush really.
Name a package and I can name an augmentation. GPT is orthogonal to coding
the way macros are orthoganal to functions.
emacs has tens of thousands of packages which are essentially just a
skeleton for GPT to become the body, so this is why I recommend fostering a
prompts repository right now.
For example, take nano-emacs and turn it into the best writers environment
ever.
Take 'erc' and make it the first IRC client to automatically translate all
messages into any type of dialect -- French, Klingon or Pirate.
Company-mode + GPT = Copilot.
Org-roam + GPT = A multiversal prose editor (
https://github.com/socketteer/loom)
Org-brain + GPT = a mind map, which automatically generates and suggests
nodes, then lets you talk to a chatbot tutor on any weird topic you can
think of.
VSCode literally cant do this stuff because it doesn't have the structure
created yet.
The biggest bottleneck to unlocking GPT-3's potential is the latency of the
human imagination to cope with anything that departs from realism.

I'm a little overwhelmed building Pen.el, but EleutherAI has been very
helpful in supporting my project in guiding me to the right projects.
It is, in my humble opinion, still important to foster a FOSS prompts
repository in the meantime.

https://www.eleuther.ai/projects/gpt-neox/


On Sat, Jul 17, 2021 at 12:51 PM Richard Stallman <rms@gnu.org> wrote:

> [[[ To any NSA and FBI agents reading my email: please consider    ]]]
> [[[ whether defending the US Constitution against all enemies,     ]]]
> [[[ foreign or domestic, requires you to follow Snowden's example. ]]]
>
> The idea of "GPT for Emacs" is, alas, not an option.  GPT-3 is nonfree
> software.  I think it is not even released.  Thus, we cannot include
> it in a free system; we cannot distribute it with Emacs.
>
> It would be possible to utilize GPT-3 running on Microsoft's server by
> sending it questions -- but that is SaaSS, which is an injustice
> similar to nonfree software.  For explanation of this issue, see
> https://gnu.org/philosophy/who-does-that-server-really-serve.html.
>
> For ethical reasons we don't recommend SaaSS in GNU software, and a
> fortiori we don't distribute or recommend code to invoke SaaSS.
>
>
> --
> Dr Richard Stallman (https://stallman.org)
> Chief GNUisance of the GNU Project (https://gnu.org)
> Founder, Free Software Foundation (https://fsf.org)
> Internet Hall-of-Famer (https://internethalloffame.org)
>
>
>

[-- Attachment #2: Type: text/html, Size: 4152 bytes --]

Re: Help building Pen.el (GPT for emacs)

[Eli Zaretskii]

> From: Shane Mulligan <mullikine@gmail.com>
> Date: Sat, 17 Jul 2021 14:36:15 +1200
> Cc: Stefan Kangas <stefan@marxist.se>, Emacs developers <emacs-devel@gnu.org>
> 
> I think the end-goal should be to have a close collaboration with EleutherAI, who already have an
> open-source alternative to the Copilot model. It's called GPT-j.
> ελευθερία is a greek word that means Freedom. EleutherAI are open-sourcing language models.
> The problem is that there are very few people within EleutherAI using emacs and few people who can help. 

I'm not sure I understand what features in Emacs this could enable.
And the references you provided don't seem to answer this question (or
maybe the answer is buried deeper than I'm prepared to dig at this
point).  I understand that EleutherAI doesn't seem to support
programming at this point, only natural language (is that true?), but
that still means there could be any number of useful features where it
could help.  But what are they?  The stuff on the EleutherAI site is
oriented towards people who work in the machine learning domain, not
to programmers who design applications that could take advantage of
those capabilities, so it's not easy to understand what these
capabilities have in store for Emacs.

Thus, description of relevant Emacs features, whether existing or
imaginary, with enough details for us to be able to discuss that
intelligently, will be appreciated.  I don't think this discussion
will be meaningful without at least some idea of what we are trying to
accomplish.

> If you'd please excuse my speculative musings, emacs has 40 years of design waiting to be augmented with
> GPT3 and I believe that emacs is way ahead of the competition. It's a gold rush really.

Why do you think Emacs is better fitted to this than other editors?
It sounds like most of the processing is done server-side, so what
exactly is the significance of Emacs being the client?

> Name a package and I can name an augmentation.

Is this based on what these services (EleutherAI in particular) can
do, or are these just unrelated fantasies?  We need ideas based on
capabilities that exist, not on what could exist years from now.  AI
history is chock-full of ideas that didn't work out.

> Take 'erc' and make it the first IRC client to automatically translate all messages into any type of dialect --
> French, Klingon or Pirate.

How is this different from existing translation servers?

> Company-mode + GPT = Copilot.

I don't see how this is true.  Copilot is not just generalized
completion, and AFAIU doesn't fit into the presentation methods used
by Company.  What am I missing?

> Org-roam + GPT = A multiversal prose editor (https://github.com/socketteer/loom)

I couldn't understand what that does, looking at the above URL.  Any
details how it works and how it helps the writer?

> Org-brain + GPT = a mind map, which automatically generates and suggests nodes, then lets you talk to a
> chatbot tutor on any weird topic you can think of.

Does this capability really exist?

Thanks.

Re: Help building Pen.el (GPT for emacs)

[Shane Mulligan]

[-- Attachment #1: Type: text/plain, Size: 6933 bytes --]

Hi Eli,
It's nice to talk again.

At this stage I am only seeking to inform you of this new technology
which will be transformative to programming and open-source and show you
that we have some quick catching up to do to integrate into emacs so
Microsoft does not have a monopoly on the technology.


"I understand that EleutherAI doesn't seem to support
programming at this point, only natural language (is that true?)"

The existing models which are not optimised to do code, can still do
code well.

GPT-j is EleutherAI's code model. It's designed as a direct
competitor to codex (the Copilot model) and trained on open-source code.

The other part of Copilot is the automatic fine-tuning of the model to
enable it to learn your behaviour.

This would be trickier to distribute as a service open source and
probably isn't necessary, but GPT-j supports it.

"any number of useful features where it could help."
Name an emacs package and I can explain how GPT will affect that package.
For `dired-git-info-mode`, for instance, a model connected to GPT can
explain what files are for.

"Name a package and I can name an augmentation."
This is not fantasy. I have many examples.

I have blogged for this exact purpose, to explain to people what OpenAI
will be working on behind closed doors, to build a version for emacs.

- https://mullikine.github.io/posts/explainshell-with-gpt-3/
- https://mullikine.github.io/posts/nlsh-natural-language-shell/
- https://mullikine.github.io/posts/context-menus-based-on-gpt-3/
-
https://mullikine.github.io/posts/autocompleting-anything-with-gpt-3-in-emacs/
-
https://mullikine.github.io/posts/translating-haskell-to-clojure-with-gpt-3/
-
https://mullikine.github.io/posts/a-natural-language-database-using-a-single-gpt-prompt/
- https://mullikine.github.io/posts/imaginary-programming-with-gpt-3/
-
https://mullikine.github.io/posts/creating-a-playground-for-gpt-3-in-emacs/

"How is this different from existing translation servers?"
GPT can replace Google search, Google translate, and many other
services, and GPT can repond to requests with equal time for each
request. It can also be used like stackoverflow to answer questions to
many common problems.

"Org-brain + GPT = a mind map, which automatically generates and
suggests nodes, then lets you talk to a
> chatbot tutor on any weird topic you can think of."

Does this capability really exist?

Yes it does I have demonstated it.

-
https://mullikine.github.io/posts/gpt-3-for-building-mind-maps-with-an-ai-tutor-for-any-topic/

This is on my readme for my GPT project for emacs which supports GPT-3
and EleutherAI.

https://github.com/semiosis/pen.el

At its heart, emacs is an operating system based on a tty, which is a
text stream.

emacs supports a text-only mode. This makes it ideally suited for
training a LM such as a GPT (Generative Pre-trained Transformer).

emacs lisp provides a skeleton on which NLP functions can built around.
Ultimately, emacs will become a fractal in the latent space of a future
LM (language model). A graphical editor would not benefit from this
effect until much later on.

emacs could, if supported, become the vehicle for controllable text
generation, or has the potential to become that, only actually surpassed
when the imaginary programming environment is normal and other
interfaces can be prompted into existence.

Between then and now we can write prompt functions to help preserve
emacs.

This is my inspiration for the project. It sounds like science fiction, I
know.


On Sat, Jul 17, 2021 at 9:01 PM Eli Zaretskii <eliz@gnu.org> wrote:

> > From: Shane Mulligan <mullikine@gmail.com>
> > Date: Sat, 17 Jul 2021 14:36:15 +1200
> > Cc: Stefan Kangas <stefan@marxist.se>, Emacs developers <
> emacs-devel@gnu.org>
> >
> > I think the end-goal should be to have a close collaboration with
> EleutherAI, who already have an
> > open-source alternative to the Copilot model. It's called GPT-j.
> > ελευθερία is a greek word that means Freedom. EleutherAI are
> open-sourcing language models.
> > The problem is that there are very few people within EleutherAI using
> emacs and few people who can help.
>
> I'm not sure I understand what features in Emacs this could enable.
> And the references you provided don't seem to answer this question (or
> maybe the answer is buried deeper than I'm prepared to dig at this
> point).  I understand that EleutherAI doesn't seem to support
> programming at this point, only natural language (is that true?), but
> that still means there could be any number of useful features where it
> could help.  But what are they?  The stuff on the EleutherAI site is
> oriented towards people who work in the machine learning domain, not
> to programmers who design applications that could take advantage of
> those capabilities, so it's not easy to understand what these
> capabilities have in store for Emacs.
>
> Thus, description of relevant Emacs features, whether existing or
> imaginary, with enough details for us to be able to discuss that
> intelligently, will be appreciated.  I don't think this discussion
> will be meaningful without at least some idea of what we are trying to
> accomplish.
>
> > If you'd please excuse my speculative musings, emacs has 40 years of
> design waiting to be augmented with
> > GPT3 and I believe that emacs is way ahead of the competition. It's a
> gold rush really.
>
> Why do you think Emacs is better fitted to this than other editors?
> It sounds like most of the processing is done server-side, so what
> exactly is the significance of Emacs being the client?
>
> > Name a package and I can name an augmentation.
>
> Is this based on what these services (EleutherAI in particular) can
> do, or are these just unrelated fantasies?  We need ideas based on
> capabilities that exist, not on what could exist years from now.  AI
> history is chock-full of ideas that didn't work out.
>
> > Take 'erc' and make it the first IRC client to automatically translate
> all messages into any type of dialect --
> > French, Klingon or Pirate.
>
> How is this different from existing translation servers?
>
> > Company-mode + GPT = Copilot.
>
> I don't see how this is true.  Copilot is not just generalized
> completion, and AFAIU doesn't fit into the presentation methods used
> by Company.  What am I missing?
>
> > Org-roam + GPT = A multiversal prose editor (
> https://github.com/socketteer/loom)
>
> I couldn't understand what that does, looking at the above URL.  Any
> details how it works and how it helps the writer?
>
> > Org-brain + GPT = a mind map, which automatically generates and suggests
> nodes, then lets you talk to a
> > chatbot tutor on any weird topic you can think of.
>
> Does this capability really exist?
>
> Thanks.
>

[-- Attachment #2: Type: text/html, Size: 8973 bytes --]

Re: Help building Pen.el (GPT for emacs)

[Shane Mulligan]

[-- Attachment #1: Type: text/plain, Size: 8712 bytes --]

The following is why emacs needs open-source prompts -- ones that don't
learn from you or are sold to you

- Ones that you write for yourself.
- An open-source prompts melpa at the very least!

As I tried to describe before, it's a fundamentally new way of programming.
An extension of Donald Knuth's literate programming becoming imaginary
programming, but being hijacked by microsoft.

Microsft GPT is an attack on the innermost workings of emacs -- the text
stream. So embracing the OpenSource alternatives from EleutherAI is crucial.

I have said enough. I leave you with this article.

https://venturebeat.com/2021/07/16/openai-disbands-its-robotics-research-team/

"""
OpenAI said recently that GPT-3 is now being
used in more than 300 different apps by “tens
of thousands” of developers and producing 4.5
billion words per day.) Toward the end of
2020, Microsoft announced that it would
exclusively license GPT-3 to develop and
deliver AI solutions for customers, as well as
creating new products that harness the power
of NLG.

Microsoft recently announced that GPT-3 will
be integrated “deeply” with Power Apps, its
low-code app development platform —
specifically for formula generation. The AI-
powered features will allow a user building an
ecommerce app, for example, to describe a
programming goal using conversational language
like “find products where the name starts with
‘kids.'”
""""


On Sat, Jul 17, 2021 at 9:27 PM Shane Mulligan <mullikine@gmail.com> wrote:

> Hi Eli,
> It's nice to talk again.
>
> At this stage I am only seeking to inform you of this new technology
> which will be transformative to programming and open-source and show you
> that we have some quick catching up to do to integrate into emacs so
> Microsoft does not have a monopoly on the technology.
>
>
> "I understand that EleutherAI doesn't seem to support
> programming at this point, only natural language (is that true?)"
>
> The existing models which are not optimised to do code, can still do
> code well.
>
> GPT-j is EleutherAI's code model. It's designed as a direct
> competitor to codex (the Copilot model) and trained on open-source code.
>
> The other part of Copilot is the automatic fine-tuning of the model to
> enable it to learn your behaviour.
>
> This would be trickier to distribute as a service open source and
> probably isn't necessary, but GPT-j supports it.
>
> "any number of useful features where it could help."
> Name an emacs package and I can explain how GPT will affect that package.
> For `dired-git-info-mode`, for instance, a model connected to GPT can
> explain what files are for.
>
> "Name a package and I can name an augmentation."
> This is not fantasy. I have many examples.
>
> I have blogged for this exact purpose, to explain to people what OpenAI
> will be working on behind closed doors, to build a version for emacs.
>
> - https://mullikine.github.io/posts/explainshell-with-gpt-3/
> - https://mullikine.github.io/posts/nlsh-natural-language-shell/
> - https://mullikine.github.io/posts/context-menus-based-on-gpt-3/
> -
> https://mullikine.github.io/posts/autocompleting-anything-with-gpt-3-in-emacs/
> -
> https://mullikine.github.io/posts/translating-haskell-to-clojure-with-gpt-3/
> -
> https://mullikine.github.io/posts/a-natural-language-database-using-a-single-gpt-prompt/
> - https://mullikine.github.io/posts/imaginary-programming-with-gpt-3/
> -
> https://mullikine.github.io/posts/creating-a-playground-for-gpt-3-in-emacs/
>
> "How is this different from existing translation servers?"
> GPT can replace Google search, Google translate, and many other
> services, and GPT can repond to requests with equal time for each
> request. It can also be used like stackoverflow to answer questions to
> many common problems.
>
> "Org-brain + GPT = a mind map, which automatically generates and
> suggests nodes, then lets you talk to a
> > chatbot tutor on any weird topic you can think of."
>
> Does this capability really exist?
>
> Yes it does I have demonstated it.
>
> -
> https://mullikine.github.io/posts/gpt-3-for-building-mind-maps-with-an-ai-tutor-for-any-topic/
>
> This is on my readme for my GPT project for emacs which supports GPT-3
> and EleutherAI.
>
> https://github.com/semiosis/pen.el
>
> At its heart, emacs is an operating system based on a tty, which is a
> text stream.
>
> emacs supports a text-only mode. This makes it ideally suited for
> training a LM such as a GPT (Generative Pre-trained Transformer).
>
> emacs lisp provides a skeleton on which NLP functions can built around.
> Ultimately, emacs will become a fractal in the latent space of a future
> LM (language model). A graphical editor would not benefit from this
> effect until much later on.
>
> emacs could, if supported, become the vehicle for controllable text
> generation, or has the potential to become that, only actually surpassed
> when the imaginary programming environment is normal and other
> interfaces can be prompted into existence.
>
> Between then and now we can write prompt functions to help preserve
> emacs.
>
> This is my inspiration for the project. It sounds like science fiction, I
> know.
>
>
> On Sat, Jul 17, 2021 at 9:01 PM Eli Zaretskii <eliz@gnu.org> wrote:
>
>> > From: Shane Mulligan <mullikine@gmail.com>
>> > Date: Sat, 17 Jul 2021 14:36:15 +1200
>> > Cc: Stefan Kangas <stefan@marxist.se>, Emacs developers <
>> emacs-devel@gnu.org>
>> >
>> > I think the end-goal should be to have a close collaboration with
>> EleutherAI, who already have an
>> > open-source alternative to the Copilot model. It's called GPT-j.
>> > ελευθερία is a greek word that means Freedom. EleutherAI are
>> open-sourcing language models.
>> > The problem is that there are very few people within EleutherAI using
>> emacs and few people who can help.
>>
>> I'm not sure I understand what features in Emacs this could enable.
>> And the references you provided don't seem to answer this question (or
>> maybe the answer is buried deeper than I'm prepared to dig at this
>> point).  I understand that EleutherAI doesn't seem to support
>> programming at this point, only natural language (is that true?), but
>> that still means there could be any number of useful features where it
>> could help.  But what are they?  The stuff on the EleutherAI site is
>> oriented towards people who work in the machine learning domain, not
>> to programmers who design applications that could take advantage of
>> those capabilities, so it's not easy to understand what these
>> capabilities have in store for Emacs.
>>
>> Thus, description of relevant Emacs features, whether existing or
>> imaginary, with enough details for us to be able to discuss that
>> intelligently, will be appreciated.  I don't think this discussion
>> will be meaningful without at least some idea of what we are trying to
>> accomplish.
>>
>> > If you'd please excuse my speculative musings, emacs has 40 years of
>> design waiting to be augmented with
>> > GPT3 and I believe that emacs is way ahead of the competition. It's a
>> gold rush really.
>>
>> Why do you think Emacs is better fitted to this than other editors?
>> It sounds like most of the processing is done server-side, so what
>> exactly is the significance of Emacs being the client?
>>
>> > Name a package and I can name an augmentation.
>>
>> Is this based on what these services (EleutherAI in particular) can
>> do, or are these just unrelated fantasies?  We need ideas based on
>> capabilities that exist, not on what could exist years from now.  AI
>> history is chock-full of ideas that didn't work out.
>>
>> > Take 'erc' and make it the first IRC client to automatically translate
>> all messages into any type of dialect --
>> > French, Klingon or Pirate.
>>
>> How is this different from existing translation servers?
>>
>> > Company-mode + GPT = Copilot.
>>
>> I don't see how this is true.  Copilot is not just generalized
>> completion, and AFAIU doesn't fit into the presentation methods used
>> by Company.  What am I missing?
>>
>> > Org-roam + GPT = A multiversal prose editor (
>> https://github.com/socketteer/loom)
>>
>> I couldn't understand what that does, looking at the above URL.  Any
>> details how it works and how it helps the writer?
>>
>> > Org-brain + GPT = a mind map, which automatically generates and
>> suggests nodes, then lets you talk to a
>> > chatbot tutor on any weird topic you can think of.
>>
>> Does this capability really exist?
>>
>> Thanks.
>>
>

[-- Attachment #2: Type: text/html, Size: 11394 bytes --]

Re: Help building Pen.el (GPT for emacs)

[Jean Louis]

Issues related to AI:
=====================

- obviously there are licensing issues, taking snippets from
  everywhere without contribution and licensing compliance have caused
  recently so much discussion and protest. I am actually glad for that
  as people are getting aware that GPL is protecting their work and it
  is now clear how much Github is abusing the GPL and other free
  software.

- And I do not think it should be in GNU ELPA due to above reasons.

To try the software functionality, I have pulled your Git
again. However, now there is directory change and installation is not
straight forward. Why don't you simply make an Emacs package as .tar
as described in Emacs Lisp manual?

See: (info "(elisp) Multi-file Packages")

or at least make sure that user can add the load path:

(add-to-list 'load-path (expand-file-name "."))
	     
and then:

M-x load-library RET pen RET

I cannot load it that way as it currently it asks for the package
`projectile' is it really necessary?


-- 
Jean

Take action in Free Software Foundation campaigns:
https://www.fsf.org/campaigns

In support of Richard M. Stallman
https://stallmansupport.org/

Re: Help building Pen.el (GPT for emacs)

[Jean Louis]

* Shane Mulligan <mullikine@gmail.com> [2021-07-18 00:03]:
> Microsft GPT is an attack on the innermost workings of emacs -- the text
> stream. So embracing the OpenSource alternatives from EleutherAI is
> crucial.

How does that solves the licensing problems?


-- 
Jean

Take action in Free Software Foundation campaigns:
https://www.fsf.org/campaigns

In support of Richard M. Stallman
https://stallmansupport.org/

Re: Help building Pen.el (GPT for emacs)

[Eli Zaretskii]

> Date: Sun, 18 Jul 2021 08:38:52 +0300
> From: Jean Louis <bugs@gnu.support>
> Cc: Eli Zaretskii <eliz@gnu.org>, Stefan Kangas <stefan@marxist.se>,
>   rms@gnu.org, Emacs developers <emacs-devel@gnu.org>
> 
> * Shane Mulligan <mullikine@gmail.com> [2021-07-18 00:03]:
> > Microsft GPT is an attack on the innermost workings of emacs -- the text
> > stream. So embracing the OpenSource alternatives from EleutherAI is
> > crucial.
> 
> How does that solves the licensing problems?

Please take discussions of the GPT and OpenAI licensing to
emacs-tangents.  It isn't relevant to this list.

Re: Help building Pen.el (GPT for emacs)

[Shane Mulligan]

[-- Attachment #1: Type: text/plain, Size: 4706 bytes --]

* Thank you all for your attention
I will move my conversations into emacs-
tangents@gnu.org until asked otherwise to
return.

** Response to Juri Linkov
> Can it help to write git commit messages from diffs?
> Has anyone tried to train a model on the existing
> git commit logs?  This would be a killer feature.

Now you are catching on. I already have a task
for myself to do this when I have to time. I
am focusing on core features though.

** Response to Richard Stallman

*** What does pen.el do?
Pen.el stands for Prompt Engineering in emacs.
Prompt Engineering is the art of describing what you would
like a language model (transformer) to do. It is a new type of programming,
example oriented;
like literate programming, but manifested automatically.

A transformer takes some text (called a
prompt) and continues it. However, the
continuation is the superset of all NLP tasks,
as the generation can also be a
classification, for instance. Those NLP tasks
extend beyond world languages and into
programming languages (whatever has been
'indexed' or 'learned') from these large LMs.

Pen.el is an editing environment for designing
'prompts' to LMs. It is better than anything
that exists, even at OpenAI or at Microsoft. I
have been working on it and preparing for this
for a long time.

These prompts are example- based tasks. There
are a number of design patterns which Pen.el
is seeking to encode into a domain-specific
language called 'examplary' for example-
oriented programming.

Pen.el creates functions 1:1 for a prompt to
an emacs lisp function.

Emacs is Grammarly, Google Translate, Copilot,
Stackoveflow and infinitely many other
services all rolled into one and allows you to
have a private parallel to all these services
that is completely private and open source --
that is if you have downloaded the EleutherAI
model locally.

*** What is its relation to GPT-3?
Pen.el is GPL and completely separate from
GPT-3 but currently GPT-3 is the only
standardised service in which to model the
the prompt-engineering workflow towards. No
such API or standard exists yet and so I am
designing my own interface and prompt format standard.

*** "Perhaps that is a good path, but we need to know more."
I encourage GNU to look into EleutherAI. I
will continue to work with EleutherAI and make
it a priority to bring this technology to
emacs.

However, I have absolutely no support by
anyone and this project is too big for me
alone. I'm focusing on core Pen.el features
right now and will seek help from the
EleutherAI community to build the open-source
component and host the free GPT.

** Response to Jean Louis
- And I do not think it should be in GNU ELPA due to above reasons.

I am glad I have forewarned you guys. This is
my current goal. Help in my project would be
appreciated. I cannot do it alone and I cannot
convince all of you.

> Why don't you simply make an Emacs package as .tar as described in Emacs
Lisp manual?
Thank you for taking a look at my emacs
package. It's not ready net for Melpa merge. I
hope that I will be able to find some help in
order to prepare it, but the rules are very
strict and this may not happen.

> How does that solves the licensing problems?
The current EleutherAI model which competes with GPT-3 is GPT-Neo.
It is MIT licensed.
Also the data it has been trained on is MIT licensed.

The current EleutherAI model which competes with Codex is GPT-j.
It is licensed with Apache-2.0 License

Both models are trained on The Pile, which is licensed MIT.

https://github.com/EleutherAI/the-pile

> "AI-related developments out there, and who purchased whom and for how
much, is not appropriate."
Understood.

** Thank you all for your time
Best of luck and contact me any time.

Sincerely,
Shane

Shane Mulligan

How to contact me:
🇦🇺 00 61 421 641 250
🇳🇿 00 64 21 1462 759 <+64-21-1462-759>
mullikine@gmail.com


On Sun, Jul 18, 2021 at 7:03 PM Eli Zaretskii <eliz@gnu.org> wrote:

> > Date: Sun, 18 Jul 2021 08:38:52 +0300
> > From: Jean Louis <bugs@gnu.support>
> > Cc: Eli Zaretskii <eliz@gnu.org>, Stefan Kangas <stefan@marxist.se>,
> >   rms@gnu.org, Emacs developers <emacs-devel@gnu.org>
> >
> > * Shane Mulligan <mullikine@gmail.com> [2021-07-18 00:03]:
> > > Microsft GPT is an attack on the innermost workings of emacs -- the
> text
> > > stream. So embracing the OpenSource alternatives from EleutherAI is
> > > crucial.
> >
> > How does that solves the licensing problems?
>
> Please take discussions of the GPT and OpenAI licensing to
> emacs-tangents.  It isn't relevant to this list.
>

[-- Attachment #2: Type: text/html, Size: 7249 bytes --]

Re: Help building Pen.el (GPT for emacs)

[Eli Zaretskii]

> From: Shane Mulligan <mullikine@gmail.com>
> Date: Sun, 18 Jul 2021 09:02:17 +1200
> Cc: rms@gnu.org, Stefan Kangas <stefan@marxist.se>, Emacs developers <emacs-devel@gnu.org>
> 
> The following is why emacs needs open-source prompts -- ones that don't learn from you or are sold to you
> 
> - Ones that you write for yourself.
> - An open-source prompts melpa at the very least!
> 
> As I tried to describe before, it's a fundamentally new way of programming. An extension of Donald Knuth's
> literate programming becoming imaginary programming, but being hijacked by microsoft.
> 
> Microsft GPT is an attack on the innermost workings of emacs -- the text stream. So embracing the
> OpenSource alternatives from EleutherAI is crucial.
> 
> I have said enough. I leave you with this article.
> 
> https://venturebeat.com/2021/07/16/openai-disbands-its-robotics-research-team/

We have a special mailing list for such Emacs "tangents":
emacs-tangents@gnu.org.  Please post this stuff there, and reserve
posting to this list for stuff that directly pertains to Emacs
development.  For example, with the issues you raise here, if you have
specific suggestions to provide such capabilities in Emacs, describing
that would be appropriate.  By contrast, articles about AI-related
developments out there, and who purchased whom and for how much, is
not appropriate.

Please help us keeping the signal-to-noise ratio of this list as high
as possible.

TIA

Re: Help building Pen.el (GPT for emacs)

[Juri Linkov]

> "any number of useful features where it could help."
> Name an emacs package and I can explain how GPT will affect that package.
> For `dired-git-info-mode`, for instance, a model connected to GPT can
> explain what files are for.

Can it help to write git commit messages from diffs?
Has anyone tried to train a model on the existing
git commit logs?  This would be a killer feature.

Re: Help building Pen.el (GPT for emacs)

[Richard Stallman]

[[[ To any NSA and FBI agents reading my email: please consider    ]]]
[[[ whether defending the US Constitution against all enemies,     ]]]
[[[ foreign or domestic, requires you to follow Snowden's example. ]]]

  > I think the end-goal should be to have a close collaboration with
  > EleutherAI, who already have an open-source alternative to the Copilot
  > model. It's called GPT-j.

Perhaps that is a good path, but we need to know more.

You've described this as an "open-source alternative".  Most of the
time, when developers describe their work as "open-source", it is
because they don't share our ethical principles and criteria.  For
instance, most open-source programs are free/libre, but there are
exceptions.

So we need to look at what they are developing to see what software it
consists of, and whether it consists entirely of free software that
can be included in a version of the GNU system.

See https://gnu.org/philosophy/open-source-misses-the-point.html.

  > The problem is that there are very few people within EleutherAI using emacs
  > and few people who can help.

Assuming they are heading for the right goal, it would be great for
you to offer your help, and I'm sure they will find plenty of people
here who would like to do that.

If they could make their system keep track of licenses from which text
was obtained, they could implement something to avoid one of the
pitfalls of Copilot: that it gives you a substantial amount of code
that is substantially similar to one copyright work and thus leads
you unknowing into infringement.



-- 
Dr Richard Stallman (https://stallman.org)
Chief GNUisance of the GNU Project (https://gnu.org)
Founder, Free Software Foundation (https://fsf.org)
Internet Hall-of-Famer (https://internethalloffame.org)