unofficial mirror of bug-guix@gnu.org 
 help / color / mirror / code / Atom feed
* bug#41709: installed-os test failing
@ 2020-06-04 14:36 Mathieu Othacehe
  2020-06-04 16:12 ` Mathieu Othacehe
  2020-06-06 13:29 ` Ludovic Courtès
  0 siblings, 2 replies; 6+ messages in thread
From: Mathieu Othacehe @ 2020-06-04 14:36 UTC (permalink / raw)
  To: 41709


Hello

The installed-os test is failing because the image closure is (again)
bigger than the allocated 1.4GiB in the test partition.

--8<---------------cut here---------------start------------->8---
guix size $(./pre-inst-env guix system build gnu/system/examples/bare-bones.tmpl)
--8<---------------cut here---------------end--------------->8---

reports 1397.3 MiB.

By reverting this commit 0eed77127592323d89f56c215a15374a1aaae110
(introducing an extra glibc to %default-locale-libcs), it drops down to:

1305.5 MiB.

Now multiple options:

* Revert this commit.
* Find other system closure improvements.
* Up the limit to 1.5GiB.

WDYT?

Thanks,

Mathieu




^ permalink raw reply	[flat|nested] 6+ messages in thread

* bug#41709: installed-os test failing
  2020-06-04 14:36 bug#41709: installed-os test failing Mathieu Othacehe
@ 2020-06-04 16:12 ` Mathieu Othacehe
  2020-06-05 17:01   ` Mathieu Othacehe
  2020-06-06 13:29 ` Ludovic Courtès
  1 sibling, 1 reply; 6+ messages in thread
From: Mathieu Othacehe @ 2020-06-04 16:12 UTC (permalink / raw)
  To: 41709


> Now multiple options:
>
> * Revert this commit.
> * Find other system closure improvements.
> * Up the limit to 1.5GiB.
>
> WDYT?

Digging a bit more, I discovered multiple culprits in the image closure
size.

* "openssh" is dragging "xauth" which drags some X libraries (but this
does not account for much).

* "sudo" is dragging "python" for about 100MiB.

* "info-reader" is dragging "perl" (and is in fact the same size as
"texinfo" because of a mistake that I introduced with
614a1e3fa2d731d4719f03912b1b87fb4fd309cb) for about 100MiB.

* The switch to non-canonical version of "glibc" and "coreutils" to fix
system cross-compilation in dfc8ccbf5da96a67eb1cade499f0def21e7fdb02 is
also responsible for about 100MiB.

All in all, fixing all of this makes the closure size to drop below 1GiB
which is already a good first step.

I'll try to provide patches soon.

Thanks,

Mathieu





^ permalink raw reply	[flat|nested] 6+ messages in thread

* bug#41709: installed-os test failing
  2020-06-04 16:12 ` Mathieu Othacehe
@ 2020-06-05 17:01   ` Mathieu Othacehe
  2020-07-30 19:02     ` Mathieu Othacehe
  0 siblings, 1 reply; 6+ messages in thread
From: Mathieu Othacehe @ 2020-06-05 17:01 UTC (permalink / raw)
  To: 41709


> All in all, fixing all of this makes the closure size to drop below 1GiB
> which is already a good first step.
>
> I'll try to provide patches soon.

I also discovered that enabling CONFIG_MODULE_COMPRESS, the size of
linux-libre is reduced by 63%.

This makes the image way lighter.

--8<---------------cut here---------------start------------->8---
/gnu/store/6p01ki4iwdxp2bmlr2n27hfry3hp7yac-guix-1.1.0-6.da1b79f   477.4   278.3  29.5%
/gnu/store/158nawzghm4lwm7q7ah8zhh7624fw7zb-locale-2.31             91.9    91.9   9.7%
/gnu/store/la3bzdd032892xrm6sq5zz64rzjhp1yg-linux-libre-5.4.44      79.7    79.7   8.4%
...
total: 943.2 MiB
--8<---------------cut here---------------end--------------->8---

Now, the big source of improvement could be Guix itself (278MiB without
dependencies).

I think we can go further!

Thanks,

Mathieu





^ permalink raw reply	[flat|nested] 6+ messages in thread

* bug#41709: installed-os test failing
  2020-06-04 14:36 bug#41709: installed-os test failing Mathieu Othacehe
  2020-06-04 16:12 ` Mathieu Othacehe
@ 2020-06-06 13:29 ` Ludovic Courtès
  2020-06-09 15:40   ` Mathieu Othacehe
  1 sibling, 1 reply; 6+ messages in thread
From: Ludovic Courtès @ 2020-06-06 13:29 UTC (permalink / raw)
  To: Mathieu Othacehe; +Cc: 41709

Hi!

Mathieu Othacehe <othacehe@gnu.org> skribis:

> By reverting this commit 0eed77127592323d89f56c215a15374a1aaae110
> (introducing an extra glibc to %default-locale-libcs), it drops down to:
>
> 1305.5 MiB.
>
> Now multiple options:
>
> * Revert this commit.
> * Find other system closure improvements.
> * Up the limit to 1.5GiB.

Let’s just set the ‘locale-libcs’ field in (gnu tests) so that it
contains a single libc.  WDYT?

> * "openssh" is dragging "xauth" which drags some X libraries (but this
> does not account for much).

Yes, but that’s necessary for “ssh -X”, so I think we consciously made
that choice long ago.

> * "sudo" is dragging "python" for about 100MiB.

Comes from the Python plugin added in
452244e670467afe0e8ccdfb9ca2980d5a3b4694.  No idea what it buys us.

> * "info-reader" is dragging "perl" (and is in fact the same size as
> "texinfo" because of a mistake that I introduced with
> 614a1e3fa2d731d4719f03912b1b87fb4fd309cb) for about 100MiB.

Ah would be nice to fix and add a #:disallowed-references flag there!

> * The switch to non-canonical version of "glibc" and "coreutils" to fix
> system cross-compilation in dfc8ccbf5da96a67eb1cade499f0def21e7fdb02 is
> also responsible for about 100MiB.

Yeah, that’s the price to pay.  :-/

> I also discovered that enabling CONFIG_MODULE_COMPRESS, the size of
> linux-libre is reduced by 63%.

Woohoo!

> Now, the big source of improvement could be Guix itself (278MiB without
> dependencies).

Yep, see my recent message on this topic.  :-)

Thanks,
Ludo’.




^ permalink raw reply	[flat|nested] 6+ messages in thread

* bug#41709: installed-os test failing
  2020-06-06 13:29 ` Ludovic Courtès
@ 2020-06-09 15:40   ` Mathieu Othacehe
  0 siblings, 0 replies; 6+ messages in thread
From: Mathieu Othacehe @ 2020-06-09 15:40 UTC (permalink / raw)
  To: Ludovic Courtès; +Cc: 41709


Hey,

> Let’s just set the ‘locale-libcs’ field in (gnu tests) so that it
> contains a single libc.  WDYT?

I'll see first if I can get the closure smaller by other means. I think
it would be preferable to keep the tested operating-system as close as
possible to the default one.

>> * "openssh" is dragging "xauth" which drags some X libraries (but this
>> does not account for much).
>
> Yes, but that’s necessary for “ssh -X”, so I think we consciously made
> that choice long ago.

Ok, I proposed a work around by introducing openssh-sans-x.

>> * "sudo" is dragging "python" for about 100MiB.
>
> Comes from the Python plugin added in
> 452244e670467afe0e8ccdfb9ca2980d5a3b4694.  No idea what it buys us.

Some python bindings to sudo API, but I moved them to a separate
"python" output.

>
>> * "info-reader" is dragging "perl" (and is in fact the same size as
>> "texinfo" because of a mistake that I introduced with
>> 614a1e3fa2d731d4719f03912b1b87fb4fd309cb) for about 100MiB.
>
> Ah would be nice to fix and add a #:disallowed-references flag there!

In fact there were a #:disallowed-references already, but its argument
was also wrong so it went unnoticed. I fixed all of that on core-updates
branch.

>
>> * The switch to non-canonical version of "glibc" and "coreutils" to fix
>> system cross-compilation in dfc8ccbf5da96a67eb1cade499f0def21e7fdb02 is
>> also responsible for about 100MiB.
>
> Yeah, that’s the price to pay.  :-/

I'd like to re-introduce "canonical-packages", without breaking the
system cross-compilation, by using "let-system". See:
https://lists.gnu.org/archive/html/guix-devel/2020-06/msg00093.html.


>> Now, the big source of improvement could be Guix itself (278MiB without
>> dependencies).
>
> Yep, see my recent message on this topic.  :-)

Yes, thanks for your first analysis :)

Thanks,

Mathieu




^ permalink raw reply	[flat|nested] 6+ messages in thread

* bug#41709: installed-os test failing
  2020-06-05 17:01   ` Mathieu Othacehe
@ 2020-07-30 19:02     ` Mathieu Othacehe
  0 siblings, 0 replies; 6+ messages in thread
From: Mathieu Othacehe @ 2020-07-30 19:02 UTC (permalink / raw)
  To: 41709-done


Closing this one as the installed-os test has been fixed.

Mathieu




^ permalink raw reply	[flat|nested] 6+ messages in thread

end of thread, other threads:[~2020-07-30 19:03 UTC | newest]

Thread overview: 6+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2020-06-04 14:36 bug#41709: installed-os test failing Mathieu Othacehe
2020-06-04 16:12 ` Mathieu Othacehe
2020-06-05 17:01   ` Mathieu Othacehe
2020-07-30 19:02     ` Mathieu Othacehe
2020-06-06 13:29 ` Ludovic Courtès
2020-06-09 15:40   ` Mathieu Othacehe

Code repositories for project(s) associated with this public inbox

	https://git.savannah.gnu.org/cgit/guix.git

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).