* GNU Guile 2.0.6 released @ 2012-07-09 17:02 David Pirotte 2012-07-10 8:18 ` Guile build failure Ludovic Courtès 0 siblings, 1 reply; 14+ messages in thread From: David Pirotte @ 2012-07-09 17:02 UTC (permalink / raw) To: guile-devel Hello, It compiles fine here, from git, debian testing on both 32/64bit boxes. Make check fails on our 64bit box though, with the following message ... please note that here our /usr/local is an nfs mounting point [there were some problems that Mark addressed about half a year ago]. [the 32bit box on which make check pass does not use nfs] i'll be happy to give more info and offer some time on irc to help you debug if needed ... Cheers, David ;; -- ... Running load.test Backtrace: In ice-9/boot-9.scm: 157: 12 [catch #t #<catch-closure be6960> ...] In unknown file: ?: 11 [apply-smob/1 #<catch-closure be6960>] In ice-9/boot-9.scm: 63: 10 [call-with-prompt prompt0 ...] In ice-9/eval.scm: 414: 9 [eval # #] 414: 8 [eval # #] In ice-9/boot-9.scm: 693: 7 [for-each #<procedure 10b1690 at ice-9/eval.scm:403:13 (a)> #] In ice-9/eval.scm: 463: 6 [lp (#<fluid 22>) (("load.test"))] In ice-9/boot-9.scm: 2131: 5 [save-module-excursion #<procedure 348d200 at ice-9/boot-9.scm:3660:3 ()>] 3665: 4 [#<procedure 348d200 at ice-9/boot-9.scm:3660:3 ()>] 1456: 3 [%start-stack load-stack ...] 1461: 2 [#<procedure 3499810 ()>] In unknown file: ?: 1 [primitive-load "/usr/local/src/guile/git-clone/test-suite/tests/load.test"] ?: 0 [rmdir "/mnt/galia/linux/64/local/src/guile/git-clone/load-test.dir"] ERROR: In procedure rmdir: ERROR: In procedure rmdir: Directory not empty FAIL: check-guile ================================== 1 of 1 test failed Please report to bug-guile@gnu.org ================================== make[3]: *** [check-TESTS] Error 1 make[3]: Leaving directory `/mnt/galia/linux/64/local/src/guile/git-clone' make[2]: *** [check-am] Error 2 make[2]: Leaving directory `/mnt/galia/linux/64/local/src/guile/git-clone' make[1]: *** [check-recursive] Error 1 make[1]: Leaving directory `/mnt/galia/linux/64/local/src/guile/git-clone' make: *** [check] Error 2 david@automatix:/usr/local/src/guile/git-clone 24 $ ^ permalink raw reply [flat|nested] 14+ messages in thread
* Guile build failure 2012-07-09 17:02 GNU Guile 2.0.6 released David Pirotte @ 2012-07-10 8:18 ` Ludovic Courtès 2012-07-10 15:50 ` David Pirotte 0 siblings, 1 reply; 14+ messages in thread From: Ludovic Courtès @ 2012-07-10 8:18 UTC (permalink / raw) To: David Pirotte; +Cc: guile-devel Hi David, David Pirotte <david@altosw.be> skribis: > It compiles fine here, from git, Which branch is it? Did you try the 2.0.6 tarball? [...] > ?: 1 [primitive-load "/usr/local/src/guile/git-clone/test-suite/tests/load.test"] > ?: 0 [rmdir "/mnt/galia/linux/64/local/src/guile/git-clone/load-test.dir"] Could you rm -rf this directory and try again? Thanks, Ludo’. ^ permalink raw reply [flat|nested] 14+ messages in thread
* Re: Guile build failure 2012-07-10 8:18 ` Guile build failure Ludovic Courtès @ 2012-07-10 15:50 ` David Pirotte 2012-07-11 9:43 ` Ludovic Courtès 0 siblings, 1 reply; 14+ messages in thread From: David Pirotte @ 2012-07-10 15:50 UTC (permalink / raw) To: Ludovic Courtès; +Cc: guile-devel Hi Ludovic, > Which branch is it? Did you try the 2.0.6 tarball? This was using stable. No I didn't try the tarball, but since you asked i just did and did in 2 different locations: /opt [no nfs] and /usr/local/src [uses nfs] and make check passes on /opt but fails on /usr/local/src ... Totals for this test run: passes: 34490 failures: 0 unexpected passes: 0 expected failures: 30 unresolved test cases: 564 untested test cases: 1 unsupported test cases: 9 errors: 0 PASS: check-guile ============= 1 test passed ============= make[3]: Leaving directory `/opt/guile-2.0.6' make[2]: Leaving directory `/opt/guile-2.0.6' make[1]: Leaving directory `/opt/guile-2.0.6' david@automatix:/opt/guile-2.0.6 28 $ Here is in /usr/local/src... ... In ice-9/boot-9.scm: 2131: 5 [save-module-excursion #<procedure 4209480 at ice-9/boot-9.scm:3660:3 ()>] 3665: 4 [#<procedure 4209480 at ice-9/boot-9.scm:3660:3 ()>] 1456: 3 [%start-stack load-stack ...] 1461: 2 [#<procedure 4214630 ()>] In unknown file: ?: 1 [primitive-load "/usr/local/src/guile/guile-2.0.6/test-suite/tests/load.test"] ?: 0 [rmdir "/mnt/galia/linux/64/local/src/guile/guile-2.0.6/load-test.dir"] ERROR: In procedure rmdir: ERROR: In procedure rmdir: Directory not empty FAIL: check-guile ================================== 1 of 1 test failed Please report to bug-guile@gnu.org ================================== make[3]: *** [check-TESTS] Error 1 make[3]: Leaving directory `/mnt/galia/linux/64/local/src/guile/guile-2.0.6' make[2]: *** [check-am] Error 2 make[2]: Leaving directory `/mnt/galia/linux/64/local/src/guile/guile-2.0.6' make[1]: *** [check-recursive] Error 1 make[1]: Leaving directory `/mnt/galia/linux/64/local/src/guile/guile-2.0.6' make: *** [check] Error 2 david@automatix:/usr/local/src/guile/guile-2.0.6 9 $ > > ?: 1 [primitive-load > > "/usr/local/src/guile/git-clone/test-suite/tests/load.test"] ?: 0 [rmdir > > "/mnt/galia/linux/64/local/src/guile/git-clone/load-test.dir"] > > Could you rm -rf this directory and try again? I did try that before to send the email, but it didn't help Cheers, David ^ permalink raw reply [flat|nested] 14+ messages in thread
* Re: Guile build failure 2012-07-10 15:50 ` David Pirotte @ 2012-07-11 9:43 ` Ludovic Courtès 2012-07-19 13:59 ` David Pirotte 0 siblings, 1 reply; 14+ messages in thread From: Ludovic Courtès @ 2012-07-11 9:43 UTC (permalink / raw) To: David Pirotte; +Cc: guile-devel Hi, David Pirotte <david@altosw.be> skribis: > This was using stable. No I didn't try the tarball, but since you asked i just did > and did in 2 different locations: /opt [no nfs] and /usr/local/src [uses nfs] and > make check passes on /opt but fails on /usr/local/src So the problem seems to be NFS-related. Could you check rmdir "/mnt/galia/linux/64/local/src/guile/guile-2.0.6/load-test.dir" fails? Thanks, Ludo’. ^ permalink raw reply [flat|nested] 14+ messages in thread
* Re: Guile build failure 2012-07-11 9:43 ` Ludovic Courtès @ 2012-07-19 13:59 ` David Pirotte 2012-07-19 16:02 ` Ludovic Courtès 0 siblings, 1 reply; 14+ messages in thread From: David Pirotte @ 2012-07-19 13:59 UTC (permalink / raw) To: Ludovic Courtès; +Cc: guile-devel Hello Ludovic, > So the problem seems to be NFS-related. Could you check rmdir > "/mnt/galia/linux/64/local/src/guile/guile-2.0.6/load-test.dir" fails? Yes, but I'd rather say it is a guile NFS related problem: rmdir /mnt/galia/linux/64/local/src/guile/guile-2.0.6/load-test.dir works fine. Cheers, David ^ permalink raw reply [flat|nested] 14+ messages in thread
* Re: Guile build failure 2012-07-19 13:59 ` David Pirotte @ 2012-07-19 16:02 ` Ludovic Courtès 2012-07-19 16:45 ` David Pirotte 0 siblings, 1 reply; 14+ messages in thread From: Ludovic Courtès @ 2012-07-19 16:02 UTC (permalink / raw) To: David Pirotte; +Cc: guile-devel Hi David, David Pirotte <david@altosw.be> skribis: >> So the problem seems to be NFS-related. Could you check rmdir >> "/mnt/galia/linux/64/local/src/guile/guile-2.0.6/load-test.dir" fails? I meant, could you run the thing through strace? Like: strace -f -o log ./check-guile and then send the part of the log surrounding the failing rmdir(2) call. Thanks! Ludo’. ^ permalink raw reply [flat|nested] 14+ messages in thread
* Re: Guile build failure 2012-07-19 16:02 ` Ludovic Courtès @ 2012-07-19 16:45 ` David Pirotte 2012-07-21 11:15 ` Ludovic Courtès 0 siblings, 1 reply; 14+ messages in thread From: David Pirotte @ 2012-07-19 16:45 UTC (permalink / raw) To: Ludovic Courtès; +Cc: guile-devel [-- Attachment #1: Type: text/plain, Size: 127 bytes --] > strace -f -o log ./check-guile > and then send the part of the log surrounding the failing rmdir(2) call. sure, attached [-- Attachment #2: log.bz2 --] [-- Type: application/x-bzip, Size: 3062 bytes --] ^ permalink raw reply [flat|nested] 14+ messages in thread
* Re: Guile build failure 2012-07-19 16:45 ` David Pirotte @ 2012-07-21 11:15 ` Ludovic Courtès 2012-07-28 15:55 ` David Pirotte 0 siblings, 1 reply; 14+ messages in thread From: Ludovic Courtès @ 2012-07-21 11:15 UTC (permalink / raw) To: David Pirotte; +Cc: guile-devel [-- Attachment #1: Type: text/plain, Size: 564 bytes --] Hi! Sorry, I’m still pretty clueless. Can you try the attached patch, and run “./check-guile load.test” with this NFS setup? For me, it displays this: ;;; (remaining "/home/ludo/src/guile/load-test.dir/dir3" ("." "..")) ;;; (remaining "/home/ludo/src/guile/load-test.dir/dir1/subdir1" ("." "..")) ;;; (remaining "/home/ludo/src/guile/load-test.dir/dir1" ("." "..")) ;;; (remaining "/home/ludo/src/guile/load-test.dir/dir2" ("." "..")) ;;; (remaining "/home/ludo/src/guile/load-test.dir" ("." "..")) Thanks, Ludo’. [-- Warning: decoded text below may be mangled, UTF-8 assumed --] [-- Attachment #2: Type: text/x-patch, Size: 659 bytes --] diff --git a/test-suite/tests/load.test b/test-suite/tests/load.test index 1cf8d65..a43573c 100644 --- a/test-suite/tests/load.test +++ b/test-suite/tests/load.test @@ -20,7 +20,8 @@ (define-module (test-suite test-load) #:use-module (test-suite lib) #:use-module (test-suite guile-test) - #:use-module (system base compile)) + #:use-module (system base compile) + #:use-module (ice-9 ftw)) (define temp-dir (data-file-name "load-test.dir")) @@ -61,6 +62,7 @@ (delete-tree name) (loop)))))) (closedir dir) + (pk 'remaining tree (scandir tree)) (rmdir tree))) ((file-exists? tree) (delete-file tree)) ^ permalink raw reply related [flat|nested] 14+ messages in thread
* Re: Guile build failure 2012-07-21 11:15 ` Ludovic Courtès @ 2012-07-28 15:55 ` David Pirotte 2012-08-09 13:57 ` Ludovic Courtès 0 siblings, 1 reply; 14+ messages in thread From: David Pirotte @ 2012-07-28 15:55 UTC (permalink / raw) To: Ludovic Courtès; +Cc: guile-devel Heya Ludovic, Sorry for the delay. > Can you try the attached patch, and run “./check-guile load.test” with > this NFS setup? Running load.test ;;; (remaining "/mnt/galia/linux/64/local/src/guile/guile-2.0.6/load-test.dir/dir3" ("." "..")) ;;; (remaining "/mnt/galia/linux/64/local/src/guile/guile-2.0.6/load-test.dir/dir2" ("." "..")) ;;; (remaining "/mnt/galia/linux/64/local/src/guile/guile-2.0.6/load-test.dir/dir1/subdir1" ("." "..")) ;;; (remaining "/mnt/galia/linux/64/local/src/guile/guile-2.0.6/load-test.dir/dir1" ("." "..")) ;;; (remaining "/mnt/galia/linux/64/local/src/guile/guile-2.0.6/load-test.dir" ("." ".." ".nfs00000000121e01b200000019" ".nfs00000000121e01b30000001a")) Backtrace: In ice-9/boot-9.scm: 157: 12 [catch #t #<catch-closure ffaae0> ...] Cheers, David ^ permalink raw reply [flat|nested] 14+ messages in thread
* Re: Guile build failure 2012-07-28 15:55 ` David Pirotte @ 2012-08-09 13:57 ` Ludovic Courtès 2013-01-21 9:26 ` Andy Wingo 0 siblings, 1 reply; 14+ messages in thread From: Ludovic Courtès @ 2012-08-09 13:57 UTC (permalink / raw) To: David Pirotte; +Cc: guile-devel Hi David, and sorry for the delay, David Pirotte <david@altosw.be> skribis: > ;;; (remaining "/mnt/galia/linux/64/local/src/guile/guile-2.0.6/load-test.dir" ("." ".." ".nfs00000000121e01b200000019" ".nfs00000000121e01b30000001a")) Aaah, those hidden files are the culprit. I’ll guess we’ll have to live with the fact that those tests won’t work over some NFS implementations, because I don’t see what could be done to work around it. Thanks, Ludo’. ^ permalink raw reply [flat|nested] 14+ messages in thread
* Re: Guile build failure 2012-08-09 13:57 ` Ludovic Courtès @ 2013-01-21 9:26 ` Andy Wingo 2013-01-21 10:47 ` Ludovic Courtès 0 siblings, 1 reply; 14+ messages in thread From: Andy Wingo @ 2013-01-21 9:26 UTC (permalink / raw) To: Ludovic Courtès; +Cc: guile-devel, David Pirotte On Thu 09 Aug 2012 15:57, ludo@gnu.org (Ludovic Courtès) writes: > Hi David, and sorry for the delay, > > David Pirotte <david@altosw.be> skribis: > >> ;;; (remaining "/mnt/galia/linux/64/local/src/guile/guile-2.0.6/load-test.dir" ("." ".." ".nfs00000000121e01b200000019" ".nfs00000000121e01b30000001a")) > > Aaah, those hidden files are the culprit. From http://www.redhat.com/archives/rhelv5-list/2008-May/msg00156.html: .nfs000* are the ghosts of departed files. For example, if you have a file handle for /home/user/foo open on an nfs client and the file gets removed somewhere else, then the .nfs* file shows up/is used by the original process until it closes the file handle. Use "fuser .nfs*" to see which process is using it. Could Guile be keeping a handle open to these files? Andy -- http://wingolog.org/ ^ permalink raw reply [flat|nested] 14+ messages in thread
* Re: Guile build failure 2013-01-21 9:26 ` Andy Wingo @ 2013-01-21 10:47 ` Ludovic Courtès 2013-01-21 11:39 ` Andy Wingo 0 siblings, 1 reply; 14+ messages in thread From: Ludovic Courtès @ 2013-01-21 10:47 UTC (permalink / raw) To: Andy Wingo; +Cc: guile-devel, David Pirotte Hi, Andy Wingo <wingo@pobox.com> skribis: > On Thu 09 Aug 2012 15:57, ludo@gnu.org (Ludovic Courtès) writes: > >> Hi David, and sorry for the delay, >> >> David Pirotte <david@altosw.be> skribis: >> >>> ;;; (remaining "/mnt/galia/linux/64/local/src/guile/guile-2.0.6/load-test.dir" ("." ".." ".nfs00000000121e01b200000019" ".nfs00000000121e01b30000001a")) >> >> Aaah, those hidden files are the culprit. > > From http://www.redhat.com/archives/rhelv5-list/2008-May/msg00156.html: > > .nfs000* are the ghosts of departed files. For example, if you have a > file handle for /home/user/foo open on an nfs client and the file gets > removed somewhere else, then the .nfs* file shows up/is used by the > original process until it closes the file handle. > > Use "fuser .nfs*" to see which process is using it. > > Could Guile be keeping a handle open to these files? ‘load.test’ uses ‘compile-file’, and it seems that ‘compile-file’ does an ‘open-input-file’ with no corresponding ‘close-port’. That may be the problem. Ludo’. ^ permalink raw reply [flat|nested] 14+ messages in thread
* Re: Guile build failure 2013-01-21 10:47 ` Ludovic Courtès @ 2013-01-21 11:39 ` Andy Wingo 2013-01-22 16:43 ` David Pirotte 0 siblings, 1 reply; 14+ messages in thread From: Andy Wingo @ 2013-01-21 11:39 UTC (permalink / raw) To: David Pirotte; +Cc: guile-devel Hi David, On Mon 21 Jan 2013 11:47, ludo@gnu.org (Ludovic Courtès) writes: > ‘load.test’ uses ‘compile-file’, and it seems that ‘compile-file’ does > an ‘open-input-file’ with no corresponding ‘close-port’. That may be > the problem. Can you try the following patch? ./check-guile load.test on your NFS machine should do it. Andy diff --git a/module/system/base/compile.scm b/module/system/base/compile.scm index afcb55a..d6a57e6 100644 --- a/module/system/base/compile.scm +++ b/module/system/base/compile.scm @@ -1,6 +1,6 @@ ;;; High-level compiler interface -;; Copyright (C) 2001, 2009, 2010, 2011, 2012 Free Software Foundation, Inc. +;; Copyright (C) 2001, 2009, 2010, 2011, 2012, 2013 Free Software Foundation, Inc. ;;; This library is free software; you can redistribute it and/or ;;; modify it under the terms of the GNU Lesser General Public @@ -150,6 +150,7 @@ (read-and-compile in #:env env #:from from #:to to #:opts opts) port)) file) + (close-port in) comp))) (define* (compile-and-load file #:key (from 'scheme) (to 'value) @@ -200,6 +201,7 @@ (let ((x ((language-reader (current-language)) port cenv))) (cond ((eof-object? x) + (close-port port) (compile ((language-joiner joint) (reverse exps) env) #:from joint #:to to ;; env can be false if no expressions were read. -- http://wingolog.org/ ^ permalink raw reply related [flat|nested] 14+ messages in thread
* Re: Guile build failure 2013-01-21 11:39 ` Andy Wingo @ 2013-01-22 16:43 ` David Pirotte 0 siblings, 0 replies; 14+ messages in thread From: David Pirotte @ 2013-01-22 16:43 UTC (permalink / raw) To: Andy Wingo; +Cc: guile-devel [-- Attachment #1: Type: text/plain, Size: 2918 bytes --] Hi Andy, > > ‘load.test’ uses ‘compile-file’, and it seems that ‘compile-file’ does > > an ‘open-input-file’ with no corresponding ‘close-port’. That may be > > the problem. > > Can you try the following patch? ./check-guile load.test on your NFS > machine should do it. I did try and it still raise a bug. I had to manually apply the patch[*] and could have missed a place though: to make sure, here is the compile.scm i used [attached]. note that since the close-port have been added, [1] the remaining trace shows one .nfs* file - there were two in the trace I sent to Ludovic - and [2] checking manually the directory just after the trace, it is empty [see below] Cheers, David [*] i did a git pull before and compile.scm changed ... i could only find one place to add, (close-port in) [in (define (compile-file ...))], it seems you already added the other (close-port port). ;; ;; trace ... ;; david@idefix:/usr/local/src/guile/git-clone 61 $ ./check-guile load.test Testing /usr/local/src/guile/git-clone/meta/guile ... load.test with GUILE_LOAD_PATH=/usr/local/src/guile/git-clone/test-suite Running load.test ;;; (remaining "/mnt/galia/linux/64/local/src/guile/git-clone/load-test.dir/dir3" ("." "..")) ;;; (remaining "/mnt/galia/linux/64/local/src/guile/git-clone/load-test.dir/dir2" ("." "..")) ;;; (remaining "/mnt/galia/linux/64/local/src/guile/git-clone/load-test.dir/dir1/subdir1" ("." "..")) ;;; (remaining "/mnt/galia/linux/64/local/src/guile/git-clone/load-test.dir/dir1" ("." "..")) ;;; (remaining "/mnt/galia/linux/64/local/src/guile/git-clone/load-test.dir" ("." ".." ".nfs00000000138c196300000041")) Backtrace: In ice-9/boot-9.scm: 157: 12 [catch #t #<catch-closure baf280> ...] In unknown file: ?: 11 [apply-smob/1 #<catch-closure baf280>] In ice-9/boot-9.scm: 63: 10 [call-with-prompt prompt0 ...] In ice-9/eval.scm: 432: 9 [eval # #] 432: 8 [eval # #] In ice-9/boot-9.scm: 696: 7 [for-each #<procedure cb1f60 at ice-9/eval.scm:416:20 (a)> ("load.test")] In ice-9/eval.scm: 481: 6 [lp (#<fluid 23>) (("load.test"))] In ice-9/boot-9.scm: 2131: 5 [save-module-excursion #<procedure f53380 at ice-9/boot-9.scm:3771:3 ()>] 3776: 4 [#<procedure f53380 at ice-9/boot-9.scm:3771:3 ()>] 1456: 3 [%start-stack load-stack #<procedure f579c0 at ice-9/boot-9.scm:3767:10 ()>] 1461: 2 [#<procedure cb1cf0 ()>] In unknown file: ?: 1 [primitive-load "/usr/local/src/guile/git-clone/test-suite/tests/load.test"] ?: 0 [rmdir "/mnt/galia/linux/64/local/src/guile/git-clone/load-test.dir"] ERROR: In procedure rmdir: ERROR: In procedure rmdir: Directory not empty david@idefix:/usr/local/src/guile/git-clone 62 $ ls -lsa load-test.dir/ total 8 4 drwxrwxr-x 2 david alto 4096 Jan 22 14:35 ./ 4 drwxr-xr-x 21 david alto 4096 Jan 22 14:35 ../ david@idefix:/usr/local/src/guile/git-clone 63 $ [-- Attachment #2: compile.scm --] [-- Type: text/x-scheme, Size: 9898 bytes --] ;;; High-level compiler interface ;; Copyright (C) 2001, 2009, 2010, 2011, 2012, 2013 Free Software Foundation, Inc. ;;; This library is free software; you can redistribute it and/or ;;; modify it under the terms of the GNU Lesser General Public ;;; License as published by the Free Software Foundation; either ;;; version 3 of the License, or (at your option) any later version. ;;; ;;; This library is distributed in the hope that it will be useful, ;;; but WITHOUT ANY WARRANTY; without even the implied warranty of ;;; MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU ;;; Lesser General Public License for more details. ;;; ;;; You should have received a copy of the GNU Lesser General Public ;;; License along with this library; if not, write to the Free Software ;;; Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA ;;; Code: (define-module (system base compile) #:use-module (system base syntax) #:use-module (system base language) #:use-module (system base message) #:use-module (system vm vm) ;; FIXME: there's a reason for this, can't remember why tho #:use-module (ice-9 regex) #:use-module (ice-9 optargs) #:use-module (ice-9 receive) #:export (compiled-file-name compile-file compile-and-load read-and-compile compile decompile)) ;;; ;;; Compiler ;;; (define (call-once thunk) (let ((entered #f)) (dynamic-wind (lambda () (if entered (error "thunk may only be entered once: ~a" thunk)) (set! entered #t)) thunk (lambda () #t)))) ;; (put 'call-with-output-file/atomic 'scheme-indent-function 1) (define* (call-with-output-file/atomic filename proc #:optional reference) (let* ((template (string-append filename ".XXXXXX")) (tmp (mkstemp! template))) (call-once (lambda () (with-throw-handler #t (lambda () (proc tmp) (chmod tmp (logand #o0666 (lognot (umask)))) (close-port tmp) (rename-file template filename)) (lambda args (delete-file template))))))) (define (ensure-language x) (if (language? x) x (lookup-language x))) ;; Throws an exception if `dir' is not writable. The mkdir occurs ;; before the check, so that we avoid races (possibly due to parallel ;; compilation). ;; (define (ensure-directory dir) (catch 'system-error (lambda () (mkdir dir)) (lambda (k subr fmt args rest) (let ((errno (and (pair? rest) (car rest)))) (cond ((eqv? errno EEXIST) ;; Assume it's a writable directory, to avoid TOCTOU errors, ;; as well as UID/EUID mismatches that occur with access(2). #t) ((eqv? errno ENOENT) (ensure-directory (dirname dir)) (ensure-directory dir)) (else (throw k subr fmt args rest))))))) ;;; This function is among the trickiest I've ever written. I tried many ;;; variants. In the end, simple is best, of course. ;;; ;;; After turning this around a number of times, it seems that the ;;; desired behavior is that .go files should exist in a path, for ;;; searching. That is orthogonal to this function. For writing .go ;;; files, either you know where they should go, in which case you tell ;;; compile-file explicitly, as in the srcdir != builddir case; or you ;;; don't know, in which case this function is called, and we just put ;;; them in your own ccache dir in ~/.cache/guile/ccache. ;;; ;;; See also boot-9.scm:load. (define (compiled-file-name file) ;; FIXME: would probably be better just to append SHA1(canon-path) ;; to the %compile-fallback-path, to avoid deep directory stats. (define (canonical->suffix canon) (cond ((string-prefix? "/" canon) canon) ((and (> (string-length canon) 2) (eqv? (string-ref canon 1) #\:)) ;; Paths like C:... transform to /C... (string-append "/" (substring canon 0 1) (substring canon 2))) (else canon))) (define (compiled-extension) (cond ((or (null? %load-compiled-extensions) (string-null? (car %load-compiled-extensions))) (warn "invalid %load-compiled-extensions" %load-compiled-extensions) ".go") (else (car %load-compiled-extensions)))) (and %compile-fallback-path (let ((f (string-append %compile-fallback-path (canonical->suffix (canonicalize-path file)) (compiled-extension)))) (and (false-if-exception (ensure-directory (dirname f))) f)))) (define* (compile-file file #:key (output-file #f) (from (current-language)) (to 'objcode) (env (default-environment from)) (opts '()) (canonicalization 'relative)) (with-fluids ((%file-port-name-canonicalization canonicalization)) (let* ((comp (or output-file (compiled-file-name file) (error "failed to create path for auto-compiled file" file))) (in (open-input-file file)) (enc (file-encoding in))) ;; Choose the input encoding deterministically. (set-port-encoding! in (or enc "UTF-8")) (ensure-directory (dirname comp)) (call-with-output-file/atomic comp (lambda (port) ((language-printer (ensure-language to)) (read-and-compile in #:env env #:from from #:to to #:opts opts) port)) file) (close-port in) comp))) (define* (compile-and-load file #:key (from (current-language)) (to 'value) (env (current-module)) (opts '()) (canonicalization 'relative)) (with-fluids ((%file-port-name-canonicalization canonicalization)) (read-and-compile (open-input-file file) #:from from #:to to #:opts opts #:env env))) \f ;;; ;;; Compiler interface ;;; (define (compile-passes from to opts) (map cdr (or (lookup-compilation-order from to) (error "no way to compile" from "to" to)))) (define (compile-fold passes exp env opts) (let lp ((passes passes) (x exp) (e env) (cenv env) (first? #t)) (if (null? passes) (values x e cenv) (receive (x e new-cenv) ((car passes) x e opts) (lp (cdr passes) x e (if first? new-cenv cenv) #f))))) (define (find-language-joint from to) (let lp ((in (reverse (or (lookup-compilation-order from to) (error "no way to compile" from "to" to)))) (lang to)) (cond ((null? in) to) ((language-joiner lang) lang) (else (lp (cdr in) (caar in)))))) (define (default-language-joiner lang) (lambda (exps env) (if (and (pair? exps) (null? (cdr exps))) (car exps) (error "Multiple expressions read and compiled, but language has no joiner" lang)))) (define (read-and-parse lang port cenv) (let ((exp ((language-reader lang) port cenv))) (cond ((eof-object? exp) exp) ((language-parser lang) => (lambda (parse) (parse exp))) (else exp)))) (define* (read-and-compile port #:key (from (current-language)) (to 'objcode) (env (default-environment from)) (opts '())) (let ((from (ensure-language from)) (to (ensure-language to))) (let ((joint (find-language-joint from to))) (parameterize ((current-language from)) (let lp ((exps '()) (env #f) (cenv env)) (let ((x (read-and-parse (current-language) port cenv))) (cond ((eof-object? x) (close-port port) (compile ((or (language-joiner joint) (default-language-joiner joint)) (reverse exps) env) #:from joint #:to to ;; env can be false if no expressions were read. #:env (or env (default-environment joint)) #:opts opts)) (else ;; compile-fold instead of compile so we get the env too (receive (jexp jenv jcenv) (compile-fold (compile-passes (current-language) joint opts) x cenv opts) (lp (cons jexp exps) jenv jcenv)))))))))) (define* (compile x #:key (from (current-language)) (to 'value) (env (default-environment from)) (opts '())) (let ((warnings (memq #:warnings opts))) (if (pair? warnings) (let ((warnings (cadr warnings))) ;; Sanity-check the requested warnings. (for-each (lambda (w) (or (lookup-warning-type w) (warning 'unsupported-warning #f w))) warnings)))) (receive (exp env cenv) (compile-fold (compile-passes from to opts) x env opts) exp)) \f ;;; ;;; Decompiler interface ;;; (define (decompile-passes from to opts) (map cdr (or (lookup-decompilation-order from to) (error "no way to decompile" from "to" to)))) (define (decompile-fold passes exp env opts) (if (null? passes) (values exp env) (receive (exp env) ((car passes) exp env opts) (decompile-fold (cdr passes) exp env opts)))) (define* (decompile x #:key (env #f) (from 'value) (to 'assembly) (opts '())) (decompile-fold (decompile-passes from to opts) x env opts)) ^ permalink raw reply [flat|nested] 14+ messages in thread
end of thread, other threads:[~2013-01-22 16:43 UTC | newest] Thread overview: 14+ messages (download: mbox.gz follow: Atom feed -- links below jump to the message on this page -- 2012-07-09 17:02 GNU Guile 2.0.6 released David Pirotte 2012-07-10 8:18 ` Guile build failure Ludovic Courtès 2012-07-10 15:50 ` David Pirotte 2012-07-11 9:43 ` Ludovic Courtès 2012-07-19 13:59 ` David Pirotte 2012-07-19 16:02 ` Ludovic Courtès 2012-07-19 16:45 ` David Pirotte 2012-07-21 11:15 ` Ludovic Courtès 2012-07-28 15:55 ` David Pirotte 2012-08-09 13:57 ` Ludovic Courtès 2013-01-21 9:26 ` Andy Wingo 2013-01-21 10:47 ` Ludovic Courtès 2013-01-21 11:39 ` Andy Wingo 2013-01-22 16:43 ` David Pirotte
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox; as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).