From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: Lynn Winebarger Newsgroups: gmane.emacs.devel Subject: Re: Loading tramp for dump goes into infinite regress Date: Sun, 24 Jul 2022 09:30:34 -0400 Message-ID: References: <8735erhrlg.fsf@gmx.de> <83wnc2g0n8.fsf@gnu.org> Mime-Version: 1.0 Content-Type: text/plain; charset="UTF-8" Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="27802"; mail-complaints-to="usenet@ciao.gmane.io" Cc: michael.albinus@gmx.de, emacs-devel@gnu.org To: Eli Zaretskii Original-X-From: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Sun Jul 24 15:32:30 2022 Return-path: Envelope-to: ged-emacs-devel@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1oFbif-00071A-U8 for ged-emacs-devel@m.gmane-mx.org; Sun, 24 Jul 2022 15:32:29 +0200 Original-Received: from localhost ([::1]:52370 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1oFbie-0003Yt-Ez for ged-emacs-devel@m.gmane-mx.org; Sun, 24 Jul 2022 09:32:28 -0400 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]:34898) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1oFbh7-0002kJ-MF for emacs-devel@gnu.org; Sun, 24 Jul 2022 09:30:54 -0400 Original-Received: from mail-ot1-x32f.google.com ([2607:f8b0:4864:20::32f]:40774) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1oFbh4-000203-3H; Sun, 24 Jul 2022 09:30:51 -0400 Original-Received: by mail-ot1-x32f.google.com with SMTP id z12-20020a056830128c00b0061c8168d3faso6781148otp.7; Sun, 24 Jul 2022 06:30:49 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=EMvYcd8zJ7L8ZDXj301KcomabBtD3hOYMtxLq2GFrGY=; b=EldHo/DWtvifBwlmdt4hMCgP0BLC5Q3EEa9wcbz+oco/2vDt2U1+Bu3cxrVg2lk6p4 qldwf0uy9MZT7SsI6Qmoj8r0rNjSz7AvQC2ZD5h4/PfXrwa6ncT8lgyPO7z/ZEgNW0sH zMprpfkVDWUSMr2EQXqTLn6UdJNAe50dzrwHfysBc1IgjMNldoW2eynnuEtdqVY8/wy+ 2OEq02KA2ZowzWeKjXRh23kbmZM+5P2s7A86/epUwN7O0jysD+LuZgVtm7jm/6iA7NuV JpJpmmZJUIgznGvMDDtmi1BykOnK01YbTYMTiSBlExrGovZscOan7TtdV2LV0a+GnwMi 8GYA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=EMvYcd8zJ7L8ZDXj301KcomabBtD3hOYMtxLq2GFrGY=; b=vHieMV9mlXh6VObZVLjodFHd9N01biWoNmg4BQKSGYNynqynrmlXZ552ixOxWb5ujq PyGKQY14vT7yxCF1th9GBDc2s48LN/RfQUAx9V+rhP7tCCYzZ34iYeaUZwzqOv8FIbHz 35Vk/eFIQss0iflu9f7wK0GeLXHOeMmkhf+UYRL9RPVghoNvYcksDL+FWLDwCTuB6dQx VK0YNdhNEjzNA5dPle2ZgmSDVbm57LdXDn1mVQ7pWNmpFnzmgtJsfCXe/6A4Iv//N14q 0+OZbuUzbhnCeJ5+TCrp6TadoOXRyzohZFWVQEO+sgajwowf6w9NJUPxyyZusoyPeirI emzg== X-Gm-Message-State: AJIora9afIOAPQubpDObHRf9xMD/bZxhqBEklkDZp/YiEmta4qfe3zZU PXflvPL8X8ng3Ir6HMNoPDSlR+RRGDU6EkS7nwSXhBkg X-Google-Smtp-Source: AGRyM1uVwuuGFn0VycHyC1tqXEJw4YYS7RGAqitF/QqkYVQOWrYZy2Rf2pDMM+9BrxL4I7tnO+jgFm66GFp4izLoImQ= X-Received: by 2002:a9d:7749:0:b0:61c:88a1:4d54 with SMTP id t9-20020a9d7749000000b0061c88a14d54mr3179462otl.5.1658669447697; Sun, 24 Jul 2022 06:30:47 -0700 (PDT) In-Reply-To: <83wnc2g0n8.fsf@gnu.org> Received-SPF: pass client-ip=2607:f8b0:4864:20::32f; envelope-from=owinebar@gmail.com; helo=mail-ot1-x32f.google.com X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: emacs-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Emacs development discussions." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Original-Sender: "Emacs-devel" Xref: news.gmane.io gmane.emacs.devel:292586 Archived-At: On Sun, Jul 24, 2022 at 8:23 AM Eli Zaretskii wrote: > > > From: Lynn Winebarger > > Date: Sun, 24 Jul 2022 08:05:30 -0400 > > Cc: emacs-devel > > > > I don't even understand what you're trying. Could you pls give the > > commands you're calling, that I have a chance to reproduce? > > > > Good point. I'm trying to dump a "fully-loaded" emacs 28.1 that includes several hundred packages from the > > various elpas. I've modified those packages so they reside in site-lisp, use cl-lib instead of cl, and use an > > explicit data directory instead of loading files relative to the location of an installed .el file. > > I verified these all "work" by having about 1000 require statements in my .emacs file to explicitly require > > them. I then took the load history and separated the files into ones from the lisp directory and ones from > > site-lisp. I created a site-load.el and site-lisp-load.el (loaded at the end of site-load.el) to explicitly load the > > files in something resembling dependency order, then running make in the emacs build directory to create > > the build. > > Note that Micheal asked you to show specific commands you used, so he > could try reproducing the problems you see, but you haven't provided > any such commands, only a rather general description of what you are > trying to do. > > Can you please show the shell commands that you use to do the loading > step? That would be "make -j$(nproc)", which seems unhelpful. A more detailed setup (from memory, since I did this on my employer's system) would be: ------------------------ tar -xzf emacs-28.1-.tar.gz cd emacs-28.1 ./autogen.sh mkdir BUILD cd BUILD ../configure --prefix=/does/not/exist --with-native-compilation make -j$(nproc) find ../lisp -name '*.el' | while read src; do ./src/emacs --batch --eval "(batch-byte+native-compile)" $(src); done < follow the steps I described to create the lisp/site-load.el file > < create a file site-load.mk based on the shell commands in src/Makefile.in for lisp.mk > rm etc/DOC ( cd src; make ../etc/DOC ) ./lib-src/make-docfile -d lisp -a etc/DOC $( > > I've also compiled every ELISP source file using batch-byte+native-compile. That was really painful since, > > as far as I know, the files can't be native compiled in parallel in arbitrary order because of potential race > > conditions, and I haven't made a Makefile for the .ELN files with the correct dependencies to native compile > > them in dependency order using make to build them in parallel. > > I'm not aware of any such problems. IME, native compilation can run > in parallel in any order, and no race conditions of any kind are > supposed to happen. Ok, great. I thought I read, in either the gccemacs blog or the emacs-devel archive, some concern about race conditions in building eln files, probably in relation to the async scheduling. Maybe I am mistaken or that concern was resolved in the interim. I'd still like to create that Makefile to do the compilaton in order. I mean, I have created a file recording the dependencies to the extent lib-require.el can determine them, but I haven't produced a working Makefile as of yet. Lynn