From mboxrd@z Thu Jan 1 00:00:00 1970 From: Ricardo Wurmus Subject: bug#27476: guix pull fails on powerful server Date: Fri, 13 Oct 2017 23:04:31 +0200 Message-ID: <874lr2u5cw.fsf@elephly.net> References: <87h8vvp1q7.fsf@elephly.net> <87377esu1a.fsf@gnu.org> <87k20nz18u.fsf@igalia.com> <87a81jj5gg.fsf@gnu.org> <87bmlyzxj7.fsf@elephly.net> <87shf44ny0.fsf@elephly.net> <877ew0o5br.fsf@gnu.org> Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit Return-path: Received: from eggs.gnu.org ([2001:4830:134:3::10]:54973) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1e379h-000454-8N for bug-guix@gnu.org; Fri, 13 Oct 2017 17:06:06 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1e379e-0005Iw-0b for bug-guix@gnu.org; Fri, 13 Oct 2017 17:06:05 -0400 Received: from debbugs.gnu.org ([208.118.235.43]:58055) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1e379d-0005Il-So for bug-guix@gnu.org; Fri, 13 Oct 2017 17:06:01 -0400 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1e379d-0004rT-LV for bug-guix@gnu.org; Fri, 13 Oct 2017 17:06:01 -0400 Sender: "Debbugs-submit" Resent-Message-ID: In-reply-to: <877ew0o5br.fsf@gnu.org> List-Id: Bug reports for GNU Guix List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-guix-bounces+gcggb-bug-guix=m.gmane.org@gnu.org Sender: "bug-Guix" To: Ludovic =?UTF-8?Q?Court=C3=A8s?= Cc: Andy Wingo , help-guix@gnu.org, 27476@debbugs.gnu.org Hi Ludo, > The patch below seems to fix the problem: (guix monads) has shared state > (hash tables) used both at expansion-time and run-time, and it wasn’t > protected. > > My hypothesis is that this was causing random memory corruption. The > weird thing, though, is that the errors we were getting were not so > random. Also, the load phase of ‘guix pull’ is sequential. > > Could you test it and report back? This doesn’t seem to be enough to fix the problem. I patched ~/guix and ran “guix pull --url=$PWD” from ~/guix: --8<---------------cut here---------------start------------->8--- [rwurmus@murphy:~/guix] (335) $ time ./pre-inst-env guix pull --url=$PWD guile: warning: failed to install locale warning: failed to install locale: Invalid argument Updating from Git repository at '/home/rwurmus/guix'... Building from Git commit d24c69d86670bfad0c6bb147162c918e9fcdccc2... substitute: guile: warning: failed to install locale substitute: warning: failed to install locale: Invalid argument guix pull: warning: failed to load '(bimsb packages bioinformatics-nonfree)': ERROR: no code for module (gnu packages zip) guix pull: warning: failed to load '(bimsb packages staging)': ERROR: no code for module (gnu packages zip) substitute: updating list of substitutes from 'https://mirror.hydra.gnu.org'... 100.0% The following derivation will be built: /gnu/store/y54b92jj44li36743fgxzy0iagi6gb9n-guix-latest.drv copying and compiling to '/gnu/store/p5zlw7fas26bickkqz4d68g8bxnjr14z-guix-latest' with Guile 2.2.2... loading... 25.8% of 640 filesrandom seed for tests: 1507927861 loading... 99.8% of 640 files compiling... 18.6% of 640 filesIn thread: ERROR: In procedure return: return used outside of 'with-monad'Error while printing exception. compiling... 70.0% of 640 files --8<---------------cut here---------------end--------------->8--- The higher the percentage of completion, the slower this all gets. It hasn’t actually finished yet, even though it has been running for over 13 minutes. -- Ricardo GPG: BCA6 89B6 3655 3801 C3C6 2150 197A 5888 235F ACAC https://elephly.net