unofficial mirror of bug-guix@gnu.org 
 help / color / mirror / Atom feed
* bug#50353: Excessive temproots size when running guix build
@ 2021-09-03  9:53 Christopher Baines
  2021-09-06 21:18 ` Ludovic Courtès
  0 siblings, 1 reply; 3+ messages in thread
From: Christopher Baines @ 2021-09-03  9:53 UTC (permalink / raw)
  To: 50353

[-- Attachment #1: Type: text/plain, Size: 811 bytes --]

I spotted a problem with data.guix.gnu.org trying to process this old
revision [1]

1: https://data.guix.gnu.org/revision/75dabac633bb9a33efbebf859f8aa4bb3b9582b2

The machine ran out of disk space, as a ~30GiB file had been created in
/var/guix/temproots.

I think I can reproduce the situation by running this command.

  guix time-machine --commit=75dabac633bb9a33efbebf859f8aa4bb3b9582b2 -- build --system=armhf-linux guix

It's the build of the guix package that seems to be involved.

For some reason though, I can't reproduce this on my local machine, I
get a build failure for [2].

2: /gnu/store/cz4sr5whzf3qhp8c47bzlfzcxxwl485i-python2-2.7.15.drv

Any ideas? Is there a known issue (perhaps with grafts) for old
revisions of Guix which could lead to excessive temproots file sizes in
some situations?

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 987 bytes --]

^ permalink raw reply	[flat|nested] 3+ messages in thread

* bug#50353: Excessive temproots size when running guix build
  2021-09-03  9:53 bug#50353: Excessive temproots size when running guix build Christopher Baines
@ 2021-09-06 21:18 ` Ludovic Courtès
  2021-09-07  9:45   ` Maxime Devos
  0 siblings, 1 reply; 3+ messages in thread
From: Ludovic Courtès @ 2021-09-06 21:18 UTC (permalink / raw)
  To: Christopher Baines; +Cc: 50353

Hi,

Christopher Baines <mail@cbaines.net> skribis:

> I spotted a problem with data.guix.gnu.org trying to process this old
> revision [1]
>
> 1: https://data.guix.gnu.org/revision/75dabac633bb9a33efbebf859f8aa4bb3b9582b2
>
> The machine ran out of disk space, as a ~30GiB file had been created in
> /var/guix/temproots.

Sounds fishy.  Those files contain a nul-separated list of GC roots
(store file names).  Thus, a file in there is proportional to the number
of ‘add-temp-root’ RPCs made by the client during the session.

A client with a long-running session (‘guix publish’, Coordinator, Data
Service, Cuirass, etc.) that regularly adds temp roots makes that file
grow endlessly.

HTH!

Ludo’.




^ permalink raw reply	[flat|nested] 3+ messages in thread

* bug#50353: Excessive temproots size when running guix build
  2021-09-06 21:18 ` Ludovic Courtès
@ 2021-09-07  9:45   ` Maxime Devos
  0 siblings, 0 replies; 3+ messages in thread
From: Maxime Devos @ 2021-09-07  9:45 UTC (permalink / raw)
  To: Ludovic Courtès, Christopher Baines; +Cc: 50353

[-- Attachment #1: Type: text/plain, Size: 1250 bytes --]

Ludovic Courtès schreef op ma 06-09-2021 om 23:18 [+0200]:
> Hi,
> 
> Christopher Baines <mail@cbaines.net> skribis:
> 
> > I spotted a problem with data.guix.gnu.org trying to process this old
> > revision [1]
> > 
> > 1: https://data.guix.gnu.org/revision/75dabac633bb9a33efbebf859f8aa4bb3b9582b2
> > 
> > The machine ran out of disk space, as a ~30GiB file had been created in
> > /var/guix/temproots.
> 
> Sounds fishy.  Those files contain a nul-separated list of GC roots
> (store file names).  Thus, a file in there is proportional to the number
> of ‘add-temp-root’ RPCs made by the client during the session.
> 
> A client with a long-running session (‘guix publish’, Coordinator, Data
> Service, Cuirass, etc.) that regularly adds temp roots makes that file
> grow endlessly.

FWIW, temp roots are added in ‘DerivationGoal::DerivationGoal’
when building things, and ‘DerivationGOal::haveDerivation’,
‘SubstitutionGoal::init’, ‘LocalStore::optimiseStore’
‘LocalStore::addToStoreFromDump’, ‘LocalStore::addTextToStore’,
‘LocalStore::createTempDirInStore’ and ‘LocalStore::importPath’.

I.e., temp roots are not only added from the add-temp-root RPC.

Greetings,
Maxime.

[-- Attachment #2: This is a digitally signed message part --]
[-- Type: application/pgp-signature, Size: 260 bytes --]

^ permalink raw reply	[flat|nested] 3+ messages in thread

end of thread, other threads:[~2021-09-07  9:47 UTC | newest]

Thread overview: 3+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2021-09-03  9:53 bug#50353: Excessive temproots size when running guix build Christopher Baines
2021-09-06 21:18 ` Ludovic Courtès
2021-09-07  9:45   ` Maxime Devos

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).