Can't configure guix, no guile-sqlite3

Can't configure guix, no guile-sqlite3

[Thorsten Wilms]

Hi!

I wanted to add a package, test it and send in a patch. The docs are not 
quite as clear as they should be on the right steps to take, but since 
helpful and knowledgable people are never far on #guix, it became clear 
that it should be (I hope):

git clone https://git.savannah.gnu.org/git/guix.git
cd guix
*add package definition, commit right here, or maybe later*
guix environment guix
./bootstrap
./configure --localstatedir=/var
./pre-inst-env guix package -i *new-package*

configure fails with:
checking whether Guile-Sqlite3 is available and recent enough... no

It does so even within `guix environment guix --ad-hoc guile-sqlite3`
I'm aware of recent discussions regarding `./pre-inst-env guix system`. 
My understanding is that with a recent version, `guix environment guix` 
should be sufficient.


$: which guix => /home/thorwil/.config/guix/current/bin/guix

$: guix pull -l
...
   Generation 8	Jun 17 2018 20:01:23	(current)
     guix b4eae99
       repository URL: https://git.savannah.gnu.org/git/guix.git
       branch: origin/master
       commit: b4eae997fe5b928f179c34d281e9f2c3eccd3670

I also did `git pull` today, so both the installed guix and the local 
tree are current.

What am I missing? Any ideas on further diagnosis?


-- 
Thorsten Wilms

thorwil's design for free software:
http://thorwil.wordpress.com/

Re: Can't configure guix, no guile-sqlite3

[Ludovic Courtès]

Hi Thorsten,

Thorsten Wilms <t_w_@freenet.de> skribis:

> configure fails with:
> checking whether Guile-Sqlite3 is available and recent enough... no

[...]

> $: which guix => /home/thorwil/.config/guix/current/bin/guix
>
> $: guix pull -l
> ...
>   Generation 8	Jun 17 2018 20:01:23	(current)
>     guix b4eae99
>       repository URL: https://git.savannah.gnu.org/git/guix.git
>       branch: origin/master
>       commit: b4eae997fe5b928f179c34d281e9f2c3eccd3670

Add this commit, the ‘guix’ package definitely has ‘guile-sqlite3’ as an
input.  Could you run ‘guix edit guix’ to double-check?

Perhaps you need to run “hash guix” (in Bash) or something?

HTH,
Ludo’.

Re: Can't configure guix, no guile-sqlite3

[Pierre Neidhardt]

[-- Attachment #1: Type: text/plain, Size: 461 bytes --]


I have a similar issue.

> which guix
/run/current-system/profile/bin/guix

> guix edit guix
# The package definition is in 
# /home/ambrevar/.config/guix/latest/gnu/packages/package-management.scm

So guix is using "latest" instead of "current".
I suppose that if `guix' is not in my user profile, then the system guix
has to be updated via a `guix system reconfigure`.
Correct?

Or should `sudo guix pull` be enough?

-- 
Pierre Neidhardt

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 487 bytes --]

Re: Can't configure guix, no guile-sqlite3

[swedebugia]

Hi

On June 18, 2018 10:12:03 PM GMT+02:00, Pierre Neidhardt <ambrevar@gmail.com> wrote:
>
>I have a similar issue.
>
>> which guix
>/run/current-system/profile/bin/guix

What is your path? 
I pulled the same commit as Thorsten and had to upgrate my path manually to be able to use the guix that was pulled. 

Please report the output of:
ls -l ~/.config/guix
And
~/.config/guix/current/bin/guix pull -l

-- 
Cheers Swedebugia

Re: Can't configure guix, no guile-sqlite3

[Pierre Neidhardt]

[-- Attachment #1: Type: text/plain, Size: 1139 bytes --]


> What is your path? 
/home/ambrevar/.guix-profile/bin
/home/ambrevar/.guix-profile/sbin
/run/setuid-programs
/run/current-system/profile/bin
/run/current-system/profile/sbin

> I pulled the same commit as Thorsten and had to upgrate my path manually to be able to use the guix that was pulled. 

We should not have to do that, should we?

> ls -l ~/.config/guix
total 0
lrwxrwxrwx   1 ambrevar       users    42 2018-06-16 19:06 current -> /home/ambrevar/.config/guix/current-1-link
lrwxrwxrwx   1 ambrevar       users    51 2018-06-16 19:06 current-1-link -> /gnu/store/icn1zds8bb635iikdh3vbcbc1mirndl7-profile
lrwxrwxrwx   1 ambrevar       users    66 2018-06-11 19:52 latest -> /gnu/store/qy77ay990bz53g2jk7kk3f1xqllf0zy7-guix-b19950a18-modules

> ~/.config/guix/current/bin/guix pull -l

guile: warning: failed to install locale
warning: failed to install locale: Invalid argument
Generation 1	Jun 16 2018 19:06:03	(current)
  guix 806f599
    repository URL: https://git.savannah.gnu.org/git/guix.git
    branch: origin/master
    commit: 806f599c5bc630362359809e66ee8d6f275580c3

-- 
Pierre Neidhardt

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 487 bytes --]

Re: Can't configure guix, no guile-sqlite3

[Thorsten Wilms]

On 18.06.2018 21:58, Ludovic Courtès wrote:
> Add this commit, the ‘guix’ package definitely has ‘guile-sqlite3’ as an
> input.  Could you run ‘guix edit guix’ to double-check?

"guile-sqlite3" appears twice within (define-public guix), inside
   (add-after 'install 'wrap-program ...)
and also
   (propagated-inputs
        `(("gnutls" ,gnutls)
          ("guile-json" ,guile-json)
          ("guile-sqlite3" ,guile-sqlite3)
          ("guile-ssh" ,guile-ssh)
          ("guile-git" ,guile-git)))

./configure does find guile, (gnutls), (git) and (json) before it 
stumbles over guile-sqlite3.


> Perhaps you need to run “hash guix” (in Bash) or something?

~: hash -r
~: hash
hash: hash table empty
~: hash guix
~: hash
hits	command
    0	/home/thorwil/.config/guix/current/bin/guix

The same from the 2nd line within `guix environment guix`.


-- 
Thorsten Wilms

thorwil's design for free software:
http://thorwil.wordpress.com/

Re: Can't configure guix, no guile-sqlite3

[swedebugia]

Hi

On June 19, 2018 12:32:43 PM GMT+02:00, Pierre Neidhardt <ambrevar@gmail.com> wrote:
>
>> What is your path? 
>/home/ambrevar/.guix-profile/bin
>/home/ambrevar/.guix-profile/sbin
>/run/setuid-programs
>/run/current-system/profile/bin
>/run/current-system/profile/sbin

This lacks the path to the guix pulled with the new pull. 

After pulling, guix proposed that you update the path manually by
export PATH="./home/ambrevar/.config/guix/current/bin:./home/ambrevar/.config/guix/current/sbin:$PATH


>> I pulled the same commit as Thorsten and had to upgrate my path
>manually to be able to use the guix that was pulled. 
>
>We should not have to do that, should we?

No. It's a bug that the correct path is not automatically set by guix pull when switching from the old guix pull to thr new. 

>> ls -l ~/.config/guix
>total 0
>lrwxrwxrwx   1 ambrevar       users    42 2018-06-16 19:06 current ->
>/home/ambrevar/.config/guix/current-1-link
>lrwxrwxrwx   1 ambrevar       users    51 2018-06-16 19:06
>current-1-link -> /gnu/store/icn1zds8bb635iikdh3vbcbc1mirndl7-profile
>lrwxrwxrwx   1 ambrevar       users    66 2018-06-11 19:52 latest ->
>/gnu/store/qy77ay990bz53g2jk7kk3f1xqllf0zy7-guix-b19950a18-modules

Seems good. 

>
>> ~/.config/guix/current/bin/guix pull -l
>
>guile: warning: failed to install locale
>warning: failed to install locale: Invalid argument
>Generation 1	Jun 16 2018 19:06:03	(current)
>  guix 806f599
>    repository URL: https://git.savannah.gnu.org/git/guix.git
>    branch: origin/master
>    commit: 806f599c5bc630362359809e66ee8d6f275580c3

Resembles mine. 

You new guix is working fine. You can run it directly with 

/home/ambrevar/.config/guix/current bin/guix

-- 
Cheers Swedebugia

Re: Can't configure guix, no guile-sqlite3

[Pierre Neidhardt]

[-- Attachment #1: Type: text/plain, Size: 364 bytes --]


OK, I get it now.  I had missed that message about the PATH.

I think those kinds of breakage would deserve some proper annoucements,
either on the mailing list or on the website.

What do you people think?

-- 
Pierre Neidhardt

Nothing is easier than to denounce the evildoer; nothing is more difficult
than to understand him.
- Fyodor Dostoevski

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 487 bytes --]

How to announce important changes

[Ludovic Courtès]

Hello,

Pierre Neidhardt <ambrevar@gmail.com> skribis:

> OK, I get it now.  I had missed that message about the PATH.
>
> I think those kinds of breakage would deserve some proper annoucements,
> either on the mailing list or on the website.
>
> What do you people think?

I agree.  The patch for the new ‘guix pull’ was discussed 2-3 weeks
before being applied, and the principle was discussed even earlier than
this, but for someone not following the mailing list, I understand this
is a problem.

Perhaps it’s time for an announcement mailing list, and/or blog posts.
What do people think?

Thanks,
Ludo’.

Re: How to announce important changes

[Pierre Neidhardt]

[-- Attachment #1: Type: text/plain, Size: 447 bytes --]

Indeed, actually I _am_ following the mailing list, but I must confess that I
don't always read the e-mails as carefully as I should, not the least because I
am not necessarily involved in the said conversation.  Well... Case in point!

Proper announcement would have that they make it clear for everyone: "this is addressed to you" :)

-- 
Pierre Neidhardt

On the road, ZIPPY is a pinhead without a purpose, but never without a POINT.

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 487 bytes --]

Re: How to announce important changes

[myglc2]

Hi Ludo’,

> I agree.  The patch for the new ‘guix pull’ was discussed 2-3 weeks
> before being applied, and the principle was discussed even earlier than
> this, but for someone not following the mailing list, I understand this
> is a problem.
>
> Perhaps it’s time for an announcement mailing list, and/or blog posts.
> What do people think?

I think you did a good job of providing a "heads up" for the new 'guix
pull'.  From your posts it was obvious it was a significant Guix change
and that there could/would be glitches.

So I applied my standard "self help" for this situation: I stopped doing
pulls and I am watching the lists to seen when it is safe to resume
pulling changes into my systems ;-)

I think the users that have had problems didn't see your posts, didn't
understand what they meant, or didn't know how to respond. ISTM the best
thing you could do for these users is to send an alert like "major
update about to happen, hold off on updates if you are risk adverse",
followed by a "coast is clear" or "workaround" alert. IMO the best way
to send such alerts is a cross-post to all the existing lists.

- George

Re: How to announce important changes

[Ricardo Wurmus]

Ludovic Courtès <ludo@gnu.org> writes:

> Perhaps it’s time for an announcement mailing list, and/or blog posts.
> What do people think?

I think it might be good to have a low-volume announcement mailing list
to announce new releases and breaking changes that require user
intervention (restricting posting to that list to a subset of people who
have push access on Savannah?).

We can also publish those announcements on the blog, though that
requires a little more effort at the moment.  (I hope we can change this
soon by moving the blog away from GNU infrastructure.)

--
Ricardo

Re: Can't configure guix, no guile-sqlite3

[Thorsten Wilms]

On 17.06.2018 22:24, Thorsten Wilms wrote:

> git clone https://git.savannah.gnu.org/git/guix.git
> cd guix
> *add package definition, commit right here, or maybe later*
> guix environment guix
> ./bootstrap
> ./configure --localstatedir=/var
> ./pre-inst-env guix package -i *new-package*
> 
> configure fails with:
> checking whether Guile-Sqlite3 is available and recent enough... no

Since there was no solution, I completely removed guix (in particlar, 
rm'ed the store and stuff below /var) and started again with the 0.15.0 
binary tarball.


On trying to bring everything in my manifest back, I got:
---
guix package: error: build failed: some substitutes for the outputs of 
derivation 
`/gnu/store/wzb55yvxjyymzivya50nkjcyxnmysm3r-nss-certs-3.38.drv' failed 
(usually happens due to networking issues); try `--fallback' to build 
derivation from source
---

OK, that happened last time, too, same solution:
guix package --fallback -i nss-certs.


Back to main concern: configure now (after several guix pull) fails with:
---
configure: error: Package requirements (sqlite3 >= 3.6.19) were not met:
No package 'sqlite3' found
---


-- 
Thorsten Wilms

thorwil's design for free software:
http://thorwil.wordpress.com/

Re: Can't configure guix, no guile-sqlite3

[Chris Marusich]

[-- Attachment #1: Type: text/plain, Size: 2575 bytes --]

Hi Thorsten!

Thorsten Wilms <t_w_@freenet.de> writes:

> On 17.06.2018 22:24, Thorsten Wilms wrote:
>
>> git clone https://git.savannah.gnu.org/git/guix.git
>> cd guix
>> *add package definition, commit right here, or maybe later*
>> guix environment guix
>> ./bootstrap
>> ./configure --localstatedir=/var
>> ./pre-inst-env guix package -i *new-package*
>>
>> configure fails with:
>> checking whether Guile-Sqlite3 is available and recent enough... no
>
> Since there was no solution, I completely removed guix (in particlar,
> rm'ed the store and stuff below /var) and started again with the
> 0.15.0 binary tarball.

That sucks.  I'm sorry you had to go through all that effort - and it
still didn't work!  I've definitely been there before.  :-(

> Back to main concern: configure now (after several guix pull) fails with:
> ---
> configure: error: Package requirements (sqlite3 >= 3.6.19) were not met:
> No package 'sqlite3' found
> ---

It sounds like you're saying this error occurs when you've run "guix
environment guix", and then you run "./configure --localstatedir=/var".
Is that right?

I would try the following things if you haven't already:

* Run "guix pull" at least twice - without using ./pre-inst-env.  It
  sounds like you've already done this.  The reason why I'd recommend
  running it twice is because in some cases (but not always), it might
  take more than one "guix pull" to fully upgrade your installed Guix
  from a sufficiently old version.

* Start from a clean slate.  Make sure you have a backup of the things
  you've changed in your repository, and then run this command to
  destroy everything and return the repository to a clean state
  (WARNING: this will destroy any changes you have left in the
  repository!!!):

      make distclean
      git clean -dfx
      git reset --hard

* Make sure you're using a recent Guix:

      git pull

* Now try to build again:

      ./bootstrap
      ./configure --localstatedir=/var
      make -j
      ./pre-inst-env guix --version

* Assuming it works, re-introduce your changes, and try installing the
  new package again.

FWIW, you might also consider trying to develop your packages by putting
the package definitions on your own GUIX_PACKAGE_PATH (see "Package
Modules" in the manual), rather than using ./pre-inst-env.
GUIX_PACKAGE_PATH is the recommended way for adding custom packages,
while ./pre-inst-env is technically an unsupported hack that is
primarily useful for developing Guix itself.

-- 
Chris

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 832 bytes --]

Re: Can't configure guix, no guile-sqlite3

[Thorsten Wilms]

On 02.08.2018 09:12, Chris Marusich wrote:

>> configure: error: Package requirements (sqlite3 >= 3.6.19) were not met:
>> No package 'sqlite3' found
>> ---
> 
> It sounds like you're saying this error occurs when you've run "guix
> environment guix", and then you run "./configure --localstatedir=/var".
> Is that right?

Yes.



> * Run "guix pull" at least twice - without using ./pre-inst-env.

Done.


> * Start from a clean slate.

>        make distclean
>        git clean -dfx
>        git reset --hard
> * Make sure you're using a recent Guix:
> 
>        git pull

Done

> * Now try to build again:
> 
>        ./bootstrap
>        ./configure --localstatedir=/var

For the sake of completeness, without `guix environment guix`, this happens:
configure.ac:89: error: possibly undefined macro: GUILE_MODULE_AVAILABLE

With `guix environment guix` it's again:
---
checking for sqlite3 >= 3.6.19... no
configure: error: Package requirements (sqlite3 >= 3.6.19) were not met:

No package 'sqlite3' found

Consider adjusting the PKG_CONFIG_PATH environment variable if you
installed software in a non-standard prefix.

Alternatively, you may set the environment variables SQLITE3_CFLAGS
and SQLITE3_LIBS to avoid the need to call pkg-config.
See the pkg-config man page for more details.
---


> FWIW, you might also consider trying to develop your packages by putting
> the package definitions on your own GUIX_PACKAGE_PATH (see "Package
> Modules" in the manual), rather than using ./pre-inst-env.
> GUIX_PACKAGE_PATH is the recommended way for adding custom packages,
> while ./pre-inst-env is technically an unsupported hack that is
> primarily useful for developing Guix itself.

I have to wonder about "unsupported hack". If it is one, then
https://www.gnu.org/software/guix/manual/en/html_node/Packaging-Guidelines.html#Packaging-Guidelines
needs to be altered.

In this case (a rather obscure Emacs package), it would make sense to 
use GUIX_PACKAGE_PATH and perhaps not even bother sending a patch. 
However, for any chance of later, more involved and worthwhile 
contributions, I figured I should get the process down as described. 
Especially since even my limited experience tells me any deviation 
between a test run and later use introduces a risk of some silly mistake 
to slip in.


Been there before, but checking again:
Within or outside of `guix environment guix`, same result:
    which guix
=> /home/thorwil/.config/guix/current/bin/guix
    ls -l /home/thorwil/.config/guix/current/bin/guix
=> lrwxrwxrwx 2 root root 56 Jan  1  1970 
/home/thorwil/.config/guix/current/bin/guix -> 
/gnu/store/aldvc43h0gyqmpl08yzpfgmcz77539sk-guix-command
    stat /gnu/store/aldvc43h0gyqmpl08yzpfgmcz77539sk-guix-command
=> <snip> Change: 2018-08-02 12:05:49.134396623 +0200


Still, thanks for your detailed email, Chris!

-- 
Thorsten Wilms

thorwil's design for free software:
http://thorwil.wordpress.com/

Re: Can't configure guix, no guile-sqlite3

[Ricardo Wurmus]

Thorsten Wilms <t_w_@freenet.de> writes:

>> * Run "guix pull" at least twice - without using ./pre-inst-env.
>
> Done.
[…]
> With `guix environment guix` it's again:
> ---
> checking for sqlite3 >= 3.6.19... no
> configure: error: Package requirements (sqlite3 >= 3.6.19) were not met:
>
> No package 'sqlite3' found

Which “guix” are you using?  “guix pull” installs “guix” in
~/.config/guix/current/bin.  Make sure that the “guix” in “guix
environment guix” is taken from there.

--
Ricardo

Re: Can't configure guix, no guile-sqlite3

[Thorsten Wilms]

On 02.08.2018 14:18, Ricardo Wurmus wrote:
> Which “guix” are you using?  “guix pull” installs “guix” in
> ~/.config/guix/current/bin.  Make sure that the “guix” in “guix
> environment guix” is taken from there.


Tripple checked. I'm fully expecting some silly mistake, but well, I 
can't find it. Before or after `guix environment guix`, the guix on the 
path is
/home/thorwil/.config/guix/current/bin/guix
which points to
/gnu/store/aldvc43h0gyqmpl08yzpfgmcz77539sk-guix-command
which has been changed today:

~: guix environment guix

~: which guix
/home/thorwil/.config/guix/current/bin/guix
~: ls -l /home/thorwil/.config/guix/current/bin/guix
lrwxrwxrwx 2 root root 56 Jan  1  1970 
/home/thorwil/.config/guix/current/bin/guix -> 
/gnu/store/aldvc43h0gyqmpl08yzpfgmcz77539sk-guix-command
~: stat /gnu/store/aldvc43h0gyqmpl08yzpfgmcz77539sk-guix-command
... Change: 2018-08-02 12:05:49.134396623 +0200

What puzzles me is that there are 4 additional *-guix-command in the 
store, all changed at 2018-07-23. Even after
~: guix package --delete-generations
~: guix gc --collect-garbage


-- 
Thorsten Wilms

thorwil's design for free software:
http://thorwil.wordpress.com/

Re: Can't configure guix, no guile-sqlite3

[Maxim Cournoyer]

Hi,

Thorsten Wilms <t_w_@freenet.de> writes:

> On 02.08.2018 14:18, Ricardo Wurmus wrote:
>> Which “guix” are you using?  “guix pull” installs “guix” in
>> ~/.config/guix/current/bin.  Make sure that the “guix” in “guix
>> environment guix” is taken from there.

Based on the above discussion, it seems this shouldn't be required if
you are using a very recent Guix, but I too struggled on this error at
some point and the (not-so-pretty) workaround was to issue a 'guix
package -i guile-sqlite3'.

HTH,

Maxim

Re: Can't configure guix, no guile-sqlite3

[Thorsten Wilms]

On 19.08.2018 23:31, Maxim Cournoyer wrote:
> Based on the above discussion, it seems this shouldn't be required if
> you are using a very recent Guix, but I too struggled on this error at
> some point and the (not-so-pretty) workaround was to issue a 'guix
> package -i guile-sqlite3'.

I mean to recall that was one of the first things I tried. Anyway, once 
more with double `guix pull`, clean/latest git tree. Before and after 
`guix package -i guile-sqlite3`, I still get:

---
configure: error: Package requirements (sqlite3 >= 3.6.19) were not met:

No package 'sqlite3' found

Consider adjusting the PKG_CONFIG_PATH environment variable if you
installed software in a non-standard prefix.

Alternatively, you may set the environment variables SQLITE3_CFLAGS
and SQLITE3_LIBS to avoid the need to call pkg-config.
See the pkg-config man page for more details.nfigure: error: Package 
requirements (sqlite3 >= 3.6.19) were not met:
---

Still, thanks for the suggestion.


-- 
Thorsten Wilms

thorwil's design for free software:
http://thorwil.wordpress.com/