From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp2 ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id uE2NOuNMn2E6PgAAgWs5BA (envelope-from ) for ; Thu, 25 Nov 2021 09:44:19 +0100 Received: from aspmx1.migadu.com ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp2 with LMTPS id sKZKNuNMn2HPKAAAB5/wlQ (envelope-from ) for ; Thu, 25 Nov 2021 08:44:19 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 7FEF636447 for ; Thu, 25 Nov 2021 09:44:19 +0100 (CET) Received: from localhost ([::1]:38090 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1mqAMc-0000Ru-0I for larch@yhetil.org; Thu, 25 Nov 2021 03:44:18 -0500 Received: from eggs.gnu.org ([209.51.188.92]:44818) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mqAMN-0000Rj-1B for bug-guix@gnu.org; Thu, 25 Nov 2021 03:44:03 -0500 Received: from debbugs.gnu.org ([209.51.188.43]:44150) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1mqAML-0002KJ-Rd for bug-guix@gnu.org; Thu, 25 Nov 2021 03:44:02 -0500 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1mqAML-0004AO-QK for bug-guix@gnu.org; Thu, 25 Nov 2021 03:44:01 -0500 X-Loop: help-debbugs@gnu.org Subject: bug#46212: ci.guix.gnu.org narinfos with excessive NarSize Resent-From: Christopher Baines Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Thu, 25 Nov 2021 08:44:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 46212 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: Ludovic =?UTF-8?Q?Court=C3=A8s?= Received: via spool by 46212-submit@debbugs.gnu.org id=B46212.163782982815988 (code B ref 46212); Thu, 25 Nov 2021 08:44:01 +0000 Received: (at 46212) by debbugs.gnu.org; 25 Nov 2021 08:43:48 +0000 Received: from localhost ([127.0.0.1]:55696 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1mqAM8-00049o-Bz for submit@debbugs.gnu.org; Thu, 25 Nov 2021 03:43:48 -0500 Received: from mira.cbaines.net ([212.71.252.8]:47048) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1mqAM4-00049d-Pn for 46212@debbugs.gnu.org; Thu, 25 Nov 2021 03:43:46 -0500 Received: from localhost (unknown [217.155.61.229]) by mira.cbaines.net (Postfix) with ESMTPSA id EA0F827BBE9; Thu, 25 Nov 2021 08:43:43 +0000 (GMT) Received: from capella (localhost [127.0.0.1]) by localhost (OpenSMTPD) with ESMTP id d8567111; Thu, 25 Nov 2021 08:43:41 +0000 (UTC) References: <87zh0pf9ip.fsf@cbaines.net> <87tum4sj45.fsf@cbaines.net> <87pmwjh5ao.fsf@gnu.org> <87zgptf806.fsf@gnu.org> User-agent: mu4e 1.6.6; emacs 27.2 From: Christopher Baines Date: Thu, 25 Nov 2021 08:42:25 +0000 In-reply-to: <87zgptf806.fsf@gnu.org> Message-ID: <875ysg39s2.fsf@cbaines.net> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha512; protocol="application/pgp-signature" X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-BeenThere: bug-guix@gnu.org List-Id: Bug reports for GNU Guix List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Mathieu Othacehe , 46212@debbugs.gnu.org Errors-To: bug-guix-bounces+larch=yhetil.org@gnu.org Sender: "bug-Guix" X-Migadu-Flow: FLOW_IN ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1637829859; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:resent-cc:resent-from:resent-sender: resent-message-id:in-reply-to:in-reply-to:references:references: list-id:list-help:list-unsubscribe:list-subscribe:list-post; bh=+GzjPjawvGXFZrRG825KEwBP2ljYOzIaa3NPcMVVi8Q=; b=aUB2lbl6b9zXofNQYcdmPD4p+DW2RwSU2XKNQ1PWjUcV0DSJmU3feUuuVVaTBOHtAjp5CA b2DZ0M6VYl68ItF2z4BbkE5T0G2hMR8uutrYEPgN4UCiRBJdZrfNDegE4w2Vaaj6UoIqB6 6CRQVoRhr7p248NLuE02UN135xK359b8SBAMjiZiTBOG4bhTVN2aAT3Ac+knaZ4la4bgk4 l80iSJXMCP0vA5Bg73runkt8k+inTmcqqFen0asmI9rj/mA+BZX2KH6roucZG5sp0CGYfs x0B722b1XNuthMqi8Nk384zPMDYoaJdO9akZnozukmdGRKlYyCRKhaIGX0O4SA== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1637829859; a=rsa-sha256; cv=none; b=eUCaCP8CgPAISDjOKW/KBV1M3sfEABl5kJwfarmU4CuPb2zS6uqP0FtSUnJ/SCAQqM4MFF MkqR8Ixj3aGGW3EjLPyAMVvE6UwM7zkCaxfe6pVFsM/n/LmoRcU0SmsNf/F7YHfyYkbdGT hsIVsOqmlZfSXArS2Uca0wndTJRsMd4g9wyELf/M2wX/rO+QKHY1jjbMjgkmSEiMXWA7sX qzZ2AbdIPJV2GhY6xxPwGm8Mz3qOis6d3Ludis18TWl6k3zEj+3RcbSmbbKsASWZhV71D3 cx8sLoI2lIO1pzlWPbQW0tLyG+hdUZuGIpLRaX7o1I8cioQmnpHolSAqg6xlgg== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=none; spf=pass (aspmx1.migadu.com: domain of bug-guix-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=bug-guix-bounces@gnu.org X-Migadu-Spam-Score: -4.99 Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of bug-guix-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=bug-guix-bounces@gnu.org X-Migadu-Queue-Id: 7FEF636447 X-Spam-Score: -4.99 X-Migadu-Scanner: scn1.migadu.com X-TUID: pSTKyNCsjTgG --=-=-= Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Ludovic Court=C3=A8s writes: > Hi, > > Ludovic Court=C3=A8s skribis: > >> This is what I get for the last one: >> >> sqlite> select * from validpaths where path =3D '/gnu/store/q6qa5s2z2l20= q25qpxyfv1wni5wwhk24-flightgear-2018.3.5'; >> 48732920|/gnu/store/q6qa5s2z2l20q25qpxyfv1wni5wwhk24-flightgear-2018.3.5= |sha256:86426115e1f49835a24612ae89a180e87ac835332b4e83d19ecbd43211336cd2|16= 23360391|/gnu/store/722yyaa1qvkaakn6p7ywwr4dnm5wmddz-flightgear-2018.3.5.dr= v|-1610199336 >> >> >> The registration date is: >> >> scheme@(guile-user)> ,use(srfi srfi-19) >> scheme@(guile-user)> (date->string (time-utc->date (make-time time-utc 0= 1623360391)) "~1" ) >> $164 =3D "2021-06-10" >> >>> I think there were safeguards put in place to avoid bad data making it's >>> way in to the store database? >> >> I thought so too (commit 13a7d2a538b00aa0a8cf9b999f1a4ff3e5959af9)! >> So we must be using another code path. > > At last I found the culprit (me! :-)). This is fixed by commit > f9b1bb916c284bea00dd5549a43e0894b219d650. Awesome :) > The reason ci.guix would experience it and not bayfront is because the > Cuirass worker mechanism relies on substitutes to retrieve files from a > worker, and this is how it would end up storing a negative size. > > We=E2=80=99ll have to upgrade the =E2=80=98guix=E2=80=99 package and depl= oy it on berlin. I > don=E2=80=99t think it=E2=80=99s easily feasible to fix existing entries = in the store > database and (more importantly) narinfos so I=E2=80=99d just leave them a= round; > the bogus nar size propagates but it=E2=80=99s harmless and doesn=E2=80= =99t prevent > substitution. > > Thoughts? I thought this did prevent substitution, at least I have problems: =E2=86=92 guix build --substitute-urls=3Dhttps://ci.guix.gnu.org /gnu/store= /q6qa5s2z2l20q25qpxyfv1wni5wwhk24-flightgear-2018.3.5 substitute: updating substitutes from 'https://ci.guix.gnu.org'... 100.0% guix build: error: integer expected from stream Maybe the database could be queried to find the affected items, then they could be GC'd? --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQKlBAEBCgCPFiEEPonu50WOcg2XVOCyXiijOwuE9XcFAmGfTL1fFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldDNF ODlFRUU3NDU4RTcyMEQ5NzU0RTBCMjVFMjhBMzNCMEI4NEY1NzcRHG1haWxAY2Jh aW5lcy5uZXQACgkQXiijOwuE9Xc0tw/+MYQlRA8NY0RSRbiOPWZwpeqh88OjwDkd DxGPISERNI/JE+aIYwf4YUHr1cIlY6IUZV4os4F+yq/C03VbGU24vmFklyTjOztA h1cmW65srs4xMCEpqbXZMG0dvolQKtIM+k7oVX27OJfMFB6wbfmJp+rJ9oT/jBrC GtcKKr55wBkuJ4YgYGf7vE56eL48fXf+g8wq35HcLgyKjnH3pSndXRYpeIVsUUIa PTVVvbO9Qtlh8NvaMxgjgnFlTCHPnvkWpehqt0TflhRHxAThn9ErqP8fjWcSmXDV P/Y+plo4fg2mmaUOe6pr/HE+5AxKU681RQcq17NDwHcck9GHBgwNXeq6z5CHCD+w PLBPPBgNKgR+xBkIuWSIiEjMxmiIRvlF4vT85fkqUe/IOlkGJG8Xa0rMVpuQ8xsg ORpH0DxnZj8dOL9qurmoLnk0vs6VekyHt5SDAAuulyey/3sLvCfLXMGM3xTVANZN d6LD9O/wihJv6OEUn+VnCCNjfg1evRKx6tTSgH9UdH92yVhcR6JM5WVd1HS0NVRC queIxiMIN/HQUltmZVfZRcmCcBFoG3VPhsopWs2jJ2KmBtNANSu7AQJ7CFEijs3q TKXMoWiujj+8ZL4dYQiPkaTaEbJ1UNkc/xhiTfkqGkwPOyR1ua8YXptF96jXVrej 1ffHTB9Wq8g= =llN1 -----END PGP SIGNATURE----- --=-=-=--