From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: Damien Mattei Newsgroups: gmane.lisp.guile.devel,gmane.lisp.guile.user Subject: Re: GPT-4 knows Guile! :) Date: Sat, 18 Mar 2023 10:23:11 +0100 Message-ID: References: Mime-Version: 1.0 Content-Type: multipart/alternative; boundary="000000000000d0a0b405f7293eb1" Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="39642"; mail-complaints-to="usenet@ciao.gmane.io" Cc: tomas@tuxteam.de, guile-devel@gnu.org, guile-user To: mikael@djurfeldt.com Original-X-From: guile-devel-bounces+guile-devel=m.gmane-mx.org@gnu.org Sat Mar 18 10:24:06 2023 Return-path: Envelope-to: guile-devel@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1pdSnG-000A75-Cj for guile-devel@m.gmane-mx.org; Sat, 18 Mar 2023 10:24:06 +0100 Original-Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1pdSmf-0007RP-Mq; Sat, 18 Mar 2023 05:23:29 -0400 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1pdSmd-0007Qs-MZ; Sat, 18 Mar 2023 05:23:27 -0400 Original-Received: from mail-ed1-x52d.google.com ([2a00:1450:4864:20::52d]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1pdSmb-00074c-Tk; Sat, 18 Mar 2023 05:23:27 -0400 Original-Received: by mail-ed1-x52d.google.com with SMTP id w9so29072562edc.3; Sat, 18 Mar 2023 02:23:25 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; t=1679131403; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=jm9fwI6DEyBYNypMq7PSl+3n55SY85UbqIDYFY6InrM=; b=eTol55kbEuclxNiVCEBbVIQooLblQHAtn08yM1iHFV4dRW1ZJtVyKvqiR5V1myzYc0 o2vK+vSWwZAJPT9Uu6cslLwMKWf0DjcipAy1+2RAMyawTz+TIRPHZSsQN+bFbFYKzLjM k5/CH1xYdHRJtHS7NJk7lAjczkk8chPIncPwewBpwaXWh5CTfi8R7wk1yF8D5+t9U7Z9 9R0kgv8AV5sYmZyhLn6d0tWkfzJCJ5JcuE1wq7RmX+hd5g+TlJEUgeZhM9TU6STISVZi GncviQv/N+FSOZXADgzWKF9zokZ9fmTP/m/UrTtJTY0o6N0Z/Kmb1LXKQ4ZHVbkxioSN NXNg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; t=1679131403; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=jm9fwI6DEyBYNypMq7PSl+3n55SY85UbqIDYFY6InrM=; b=QMcaEf1axaMgB90stYWD43VLGY/d4i0vul/Us4Y+uavbiASBKqmqEoRsPgpG/S3ZKZ 9i2SXyVM3x/uHkiN6fTxzR6QSn5kxR1Zrg0Yd0am8ePuFpgC47cf/LN0z0OuCkNaxtoq IPJXdsudm2BWc6OLrA255N+m8HCnTS1egSzUFUz5RjxQ8FvOwOP3acrHoX7GdWQ65U89 TlRaoz2I6o5l+ApNtR3oLMJEpnOSb52GWYYaw1BRy+WLgpvXPKtqFwdpjZvKnsx1TPM2 og/KoLkomJQrM3y6IBLTcqDLVQyL6mHMnAZnO+EgAU6GZl6KeMaU+RZycjEW2oNGCztM 6Xzw== X-Gm-Message-State: AO0yUKXXFOgaAae6emHCY/RPB4LI4MN/ukbrsBicAwDBqO7eXZh/QMFk bXMuyE/ZvuLlnQEkGqbfrGaeAUW9LFjpllnSbUo= X-Google-Smtp-Source: AK7set8aRVmXQIt/EzVhUASrTI0nKdUkdjA6WUWf05a8auH2WfITu+9JqnyxQm6syd0rIL0xCHvA0LsQWx/nHvv2MLI= X-Received: by 2002:a50:9e6a:0:b0:4fb:3dd5:e822 with SMTP id z97-20020a509e6a000000b004fb3dd5e822mr3182941ede.8.1679131403131; Sat, 18 Mar 2023 02:23:23 -0700 (PDT) In-Reply-To: Received-SPF: pass client-ip=2a00:1450:4864:20::52d; envelope-from=damien.mattei@gmail.com; helo=mail-ed1-x52d.google.com X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guile-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Developers list for Guile, the GNU extensibility library" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guile-devel-bounces+guile-devel=m.gmane-mx.org@gnu.org Original-Sender: guile-devel-bounces+guile-devel=m.gmane-mx.org@gnu.org Xref: news.gmane.io gmane.lisp.guile.devel:21794 gmane.lisp.guile.user:18937 Archived-At: --000000000000d0a0b405f7293eb1 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable chatGPT is using the "static" 2021 free data available on internet ,free databases,... it knows poorly after 2021 as "they" say. Without the human intelligence that has create all the data chatGPT can do nothing. Now people use chatGPT to create poor quality data stored on the internet web page instead of making the web page content by intelligent humans. In the next release of chatGPT it will use those new "poor data" in its training data set to deliver answers of lesser quality again. On Sat, Mar 18, 2023 at 10:03=E2=80=AFAM Mikael Djurfeldt wrote: > On Sat, Mar 18, 2023 at 9:58=E2=80=AFAM Mikael Djurfeldt > wrote: > >> On Sat, Mar 18, 2023 at 9:46=E2=80=AFAM wrote: >> >>> On Sat, Mar 18, 2023 at 09:41:37AM +0100, Mikael Djurfeldt wrote: >>> > On Sat, Mar 18, 2023 at 9:36=E2=80=AFAM wrote: >>> >>> [...] >>> >>> > > Perhaps you didn't know, but you are training the model :-) >>> > > >>> > >>> > Unfortunately not. I'm prompting it within its 32000 token (GPT-4) >>> > attention span. Next conversation the model is back to exactly the sa= me >>> > state again. Then, of course, it is possible that OpenAI chooses to >>> filter >>> > out something from the dialogs it has had. >>> >>> You don't think that those coversations end up as raw data for the >>> next model? I'd be surprised, but you know definitely more than me. >>> >> >> I know very little apart from knowing what deep learning is and having >> skimmed the "Attention is all you need"-paper. I only meant that you are >> not training the model during and between sessions. It is certainly >> possible that OpenAI filters out things from the dialogs to use as part = of >> training for the next version. They warn you that they may take data fro= m >> the dialogs. If and how they do that I don't know. >> > > Or, as GPT-4 would phrase it: I apologize for the confusion in my previou= s > answer. You may be right that I'm training the next version of the model.= :) > > --000000000000d0a0b405f7293eb1 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
cha= tGPT is using the "static" 2021 free data available on internet ,= free databases,...=C2=A0 it knows poorly after 2021 as "they" say= .

Without the human = intelligence that has create all the data chatGPT can do nothing.

Now people use chatGPT to create p= oor quality data stored on the=C2=A0 internet web page instead of making th= e web page content by intelligent humans. In the next release of chatGPT it= will use those new "poor data" in its training data set=C2=A0 to= deliver answers of lesser quality again.

On Sat, Mar 18, 2023 at = 10:03=E2=80=AFAM Mikael Djurfeldt <mikael@djurfeldt.com> wrote:
On Sat, Mar 18, 20= 23 at 9:58=E2=80=AFAM Mikael Djurfeldt <mikael@djurfeldt.com> wrote:
On Sat, Mar 18, 2023 at 9:46=E2=80=AFAM <tomas@tuxteam.de>= wrote:
On Sat, Mar 18, 2023 at 09:41:37AM +0100, Mikael Djurfeldt w= rote:
> On Sat, Mar 18, 2023 at 9:36=E2=80=AFAM <tomas@tuxteam.de> wrote:

[...]

> > Perhaps you didn't know, but you are training the model :-) > >
>
> Unfortunately not. I'm prompting it within its 32000 token (GPT-4)=
> attention span. Next conversation the model is back to exactly the sam= e
> state again. Then, of course, it is possible that OpenAI chooses to fi= lter
> out something from the dialogs it has had.

You don't think that those coversations end up as raw data for the
next model? I'd be surprised, but you know definitely more than me.
=

I know very little apart from knowing what= deep learning is and having skimmed the "Attention is all you need&qu= ot;-paper. I only meant that you are not training the model during and betw= een sessions. It is certainly possible that OpenAI filters out things from = the dialogs to use as part of training for the next version. They warn you = that they may take data from the dialogs. If and how they do that I don'= ;t know.

Or, as GPT-4 wou= ld phrase it: I apologize for the confusion in my previous answer. You may = be right that I'm training the next version of the model. :)
= =C2=A0
--000000000000d0a0b405f7293eb1--