From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: Mikael Djurfeldt Newsgroups: gmane.lisp.guile.devel Subject: Re: GPT-4 knows Guile! :) Date: Sat, 18 Mar 2023 10:03:15 +0100 Message-ID: References: Reply-To: mikael@djurfeldt.com Mime-Version: 1.0 Content-Type: multipart/alternative; boundary="00000000000084f6d705f728f780" Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="27454"; mail-complaints-to="usenet@ciao.gmane.io" Cc: guile-devel@gnu.org To: tomas@tuxteam.de Original-X-From: guile-devel-bounces+guile-devel=m.gmane-mx.org@gnu.org Sat Mar 18 10:03:42 2023 Return-path: Envelope-to: guile-devel@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1pdSTV-0006xK-0Y for guile-devel@m.gmane-mx.org; Sat, 18 Mar 2023 10:03:41 +0100 Original-Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1pdSTL-0003w3-JI; Sat, 18 Mar 2023 05:03:31 -0400 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1pdSTK-0003vg-3s for guile-devel@gnu.org; Sat, 18 Mar 2023 05:03:30 -0400 Original-Received: from mail-ed1-f48.google.com ([209.85.208.48]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1pdSTI-0003MA-A2 for guile-devel@gnu.org; Sat, 18 Mar 2023 05:03:29 -0400 Original-Received: by mail-ed1-f48.google.com with SMTP id r11so28920162edd.5 for ; Sat, 18 Mar 2023 02:03:27 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; t=1679130207; h=cc:to:subject:message-id:date:from:reply-to:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=7M4YAcWV8Qe35rVew+XKO5J3jf48w+wVQxKcu8zz0z4=; b=L1OkZ7xEVX4pNxY87PYfgB3U8wW9Ekt1KP3KH+uJoNDtLAD4B4EUsYMvZGAJ3zcQnB P8z6Ek4BV/sQ8FdsOfJQHn4kV01jn2cGo9GS1i0XdjYFu3VaeGeS4brW//if3vR/cNK2 C21lMsGIPWcnMEWWwJrrN/A/49pGUYdzNzCMZ6tNPNNjaWcig1k7h7AXjR/9o1I7N8m4 jRrQDAEMzWIBdi1VJgsKWXRXej6NFSLGGYf5iXLc723vkrHb8bERWX52oxU8cydAivtO z28cnq9fv6lCJVoT9rj8yZTRNzLoD1tkFIYhZNoO4BY9mZ5Ig34cNMUV752oeos/KK0u 87Zw== X-Gm-Message-State: AO0yUKVK61jjlbQ9HBhvuMGYk+p7sguh9YewgB1rit1WBgXQQfIbEccT tOMumuubkXOmQq7MjRvfMXeADh9uInYfUmFE3fb7Bu8L X-Google-Smtp-Source: AK7set8Jb9rzsMNgNP8OuOghlqT6EFd+9AlcRpBLaCnDMt87aNliMPwRGIListaZOwnMF5U8fHVipitmqfmNpwHHl/s= X-Received: by 2002:a17:906:6805:b0:8b1:28f6:8ab3 with SMTP id k5-20020a170906680500b008b128f68ab3mr1031085ejr.15.1679130206991; Sat, 18 Mar 2023 02:03:26 -0700 (PDT) In-Reply-To: Received-SPF: pass client-ip=209.85.208.48; envelope-from=mdjurfeldt@gmail.com; helo=mail-ed1-f48.google.com X-Spam_score_int: -13 X-Spam_score: -1.4 X-Spam_bar: - X-Spam_report: (-1.4 / 5.0 requ) BAYES_00=-1.9, FREEMAIL_FORGED_FROMDOMAIN=0.25, FREEMAIL_FROM=0.001, HEADER_FROM_DIFFERENT_DOMAINS=0.25, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=no autolearn_force=no X-Spam_action: no action X-BeenThere: guile-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Developers list for Guile, the GNU extensibility library" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guile-devel-bounces+guile-devel=m.gmane-mx.org@gnu.org Original-Sender: guile-devel-bounces+guile-devel=m.gmane-mx.org@gnu.org Xref: news.gmane.io gmane.lisp.guile.devel:21793 Archived-At: --00000000000084f6d705f728f780 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Sat, Mar 18, 2023 at 9:58=E2=80=AFAM Mikael Djurfeldt wrote: > On Sat, Mar 18, 2023 at 9:46=E2=80=AFAM wrote: > >> On Sat, Mar 18, 2023 at 09:41:37AM +0100, Mikael Djurfeldt wrote: >> > On Sat, Mar 18, 2023 at 9:36=E2=80=AFAM wrote: >> >> [...] >> >> > > Perhaps you didn't know, but you are training the model :-) >> > > >> > >> > Unfortunately not. I'm prompting it within its 32000 token (GPT-4) >> > attention span. Next conversation the model is back to exactly the sam= e >> > state again. Then, of course, it is possible that OpenAI chooses to >> filter >> > out something from the dialogs it has had. >> >> You don't think that those coversations end up as raw data for the >> next model? I'd be surprised, but you know definitely more than me. >> > > I know very little apart from knowing what deep learning is and having > skimmed the "Attention is all you need"-paper. I only meant that you are > not training the model during and between sessions. It is certainly > possible that OpenAI filters out things from the dialogs to use as part o= f > training for the next version. They warn you that they may take data from > the dialogs. If and how they do that I don't know. > Or, as GPT-4 would phrase it: I apologize for the confusion in my previous answer. You may be right that I'm training the next version of the model. := ) --00000000000084f6d705f728f780 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
On Sat, Mar 18, 2023 at 9:58=E2=80=AFAM M= ikael Djurfeldt <mikael@djurfeld= t.com> wrote:
On Sat, Mar 1= 8, 2023 at 9:46=E2=80=AFAM <tomas@tuxteam.de> wrote:
On Sat, Mar 18, 2023 at = 09:41:37AM +0100, Mikael Djurfeldt wrote:
> On Sat, Mar 18, 2023 at 9:36=E2=80=AFAM <tomas@tuxteam.de> wrote:

[...]

> > Perhaps you didn't know, but you are training the model :-) > >
>
> Unfortunately not. I'm prompting it within its 32000 token (GPT-4)=
> attention span. Next conversation the model is back to exactly the sam= e
> state again. Then, of course, it is possible that OpenAI chooses to fi= lter
> out something from the dialogs it has had.

You don't think that those coversations end up as raw data for the
next model? I'd be surprised, but you know definitely more than me.
=

I know very little apart from knowing what= deep learning is and having skimmed the "Attention is all you need&qu= ot;-paper. I only meant that you are not training the model during and betw= een sessions. It is certainly possible that OpenAI filters out things from = the dialogs to use as part of training for the next version. They warn you = that they may take data from the dialogs. If and how they do that I don'= ;t know.

Or, as GPT-4 wou= ld phrase it: I apologize for the confusion in my previous answer. You may = be right that I'm training the next version of the model. :)
= =C2=A0
--00000000000084f6d705f728f780--