From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: Richard Stallman Newsgroups: gmane.emacs.tangents Subject: Re: Collaborative training of Libre LLMs (was: Is ChatGTP SaaSS? (was: [NonGNU ELPA] New package: llm)) Date: Sat, 09 Sep 2023 20:22:35 -0400 Message-ID: References: <87v8d0iqa5.fsf@posteo.net> <87cyz3vaws.fsf@localhost> <87a5tzsbvl.fsf@localhost> <87fs3n7i98.fsf@localhost> Reply-To: rms@gnu.org Content-Type: text/plain; charset=Utf-8 Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="30272"; mail-complaints-to="usenet@ciao.gmane.io" Cc: emacs-tangents@gnu.org, jporterbugs@gmail.com, ahyatt@gmail.com, team@khoj.dev To: Ihor Radchenko Original-X-From: emacs-tangents-bounces+get-emacs-tangents=m.gmane-mx.org@gnu.org Sun Sep 10 02:22:53 2023 Return-path: Envelope-to: get-emacs-tangents@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1qf8E0-0007dB-M6 for get-emacs-tangents@m.gmane-mx.org; Sun, 10 Sep 2023 02:22:52 +0200 Original-Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1qf8Dm-0008WT-AF; Sat, 09 Sep 2023 20:22:38 -0400 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1qf8Dk-0008Vs-BY for emacs-tangents@gnu.org; Sat, 09 Sep 2023 20:22:36 -0400 Original-Received: from fencepost.gnu.org ([2001:470:142:3::e]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1qf8Dj-0007zB-E1; Sat, 09 Sep 2023 20:22:35 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=Date:References:Subject:In-Reply-To:To:From: mime-version; bh=YWa3Ashq5eHeytYHJHLaCTwS0O4ebYRJ7Tw8NGhYUZg=; b=el61jeITV8A9 qzNSLORJgSpfbN/44FX+WNVE2ItMcjW631AkTX1buaKvv7t/gp/exbBZKuFf9GQHpw464/Iwq+TSN RVvqW79KrEDgq9O1DB64JR3SoYoQxAhqeUSDV2Vtqsvn+Sg9YTY0VVn/ObuY5WK5MWVbkoIMG5qLT p+hmj6R4MTT5YffaQzQOTPMebubOfsV6J5a/SrA6H+ZOlwBbxZcxhjd7wAHPiwxo0rFYEGxLgTMqg 3PxYCH7WVEsUmE+EEdFSQXgDtuyzmVDMu+QcgvFVWdMiRcaIYnvkkqKOH8gQgep0rf3uvOL3jKHts Y6YQaPltvOrZEZ5HFsntyg==; Original-Received: from rms by fencepost.gnu.org with local (Exim 4.90_1) (envelope-from ) id 1qf8Dj-0000ay-02; Sat, 09 Sep 2023 20:22:35 -0400 In-Reply-To: <87fs3n7i98.fsf@localhost> (message from Ihor Radchenko on Sat, 09 Sep 2023 10:28:35 +0000) X-BeenThere: emacs-tangents@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Emacs news and miscellaneous discussions outside the scope of other Emacs mailing lists List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-tangents-bounces+get-emacs-tangents=m.gmane-mx.org@gnu.org Original-Sender: emacs-tangents-bounces+get-emacs-tangents=m.gmane-mx.org@gnu.org Xref: news.gmane.io gmane.emacs.tangents:1061 Archived-At: [[[ To any NSA and FBI agents reading my email: please consider ]]] [[[ whether defending the US Constitution against all enemies, ]]] [[[ foreign or domestic, requires you to follow Snowden's example. ]]] > However, if the "patching" technology can only serve a single "patch" + > main model, there is a problem. Improving libre neural networks will > become difficult, unless people utilize collaborative server to > continuously improve a model. > Such collaborative server, similar to ChatGPT, will combine "editing" > (training) and "consulting" together. And, unlike Wikipedia, these > activities are hard to separate. If the users in this "community" can't move their work outside of a private "collaborative server", they are in effect prisoners of that server. Whoever keeps them stuck there will have power, and that will tempt per to mistreat them with it. > This raises a moral question about practical ways to improve libre > neural networks without falling into SaaSS practices. >From the example above, I conclude it is crucial that people who use a particular platform to modify and run the model have the feasible freedom of copying their modified versions off that platform and onto any other platform that satisfies the specs needed to run these models. -- Dr Richard Stallman (https://stallman.org) Chief GNUisance of the GNU Project (https://gnu.org) Founder, Free Software Foundation (https://fsf.org) Internet Hall-of-Famer (https://internethalloffame.org)