From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp2 ([2001:41d0:2:bcc0::]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id OH8tObzKZWD5pwAAgWs5BA (envelope-from ) for ; Thu, 01 Apr 2021 15:29:32 +0200 Received: from aspmx1.migadu.com ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp2 with LMTPS id qPIYM7zKZWD3LgAAB5/wlQ (envelope-from ) for ; Thu, 01 Apr 2021 13:29:32 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 235141A849 for ; Thu, 1 Apr 2021 15:29:32 +0200 (CEST) Received: from localhost ([::1]:50466 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1lRxO7-0002XL-9o for larch@yhetil.org; Thu, 01 Apr 2021 09:29:31 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:40562) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1lRxMK-0000Q7-Le for gwl-devel@gnu.org; Thu, 01 Apr 2021 09:27:40 -0400 Received: from sender4-of-o51.zoho.com ([136.143.188.51]:21149) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1lRxMA-0003p9-6h for gwl-devel@gnu.org; Thu, 01 Apr 2021 09:27:40 -0400 ARC-Seal: i=1; a=rsa-sha256; t=1617283638; cv=none; d=zohomail.com; s=zohoarc; b=hwpBXOWzxzNCTmgVCtGzG6Sikl7WTLmWSq/T73wJxXu2KRxq0CCVEkBMo6mS7CEml3kpSfTaOmZjaDNnFAxQgTwjCzwwoZMJCDwyw1VwiEcePylZB8yMvAjnOuOIZngH+zuOl7FUuaw9pzYo5A+VLW07o8LbOHhWTqI8IN2QjF0= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zohomail.com; s=zohoarc; t=1617283638; h=Content-Type:Content-Transfer-Encoding:Cc:Date:From:In-Reply-To:MIME-Version:Message-ID:References:Subject:To; bh=iaVJQbAsR8neoD2UtVVzUEuDhwW6n0newBK2mVNGV6c=; b=nVE4o3Kc5wDtJ35e88dGM+hsxPAQuUWKc2wTxQ4W4w+uGzy560+2fxHI25apD5B5NXWFxFvZdqFst+vriVl1A/Npn2TMPhvzc6YRzAgA0sd5dOCUqNtaHyodppdjobmQ5019jRSLux3uUhDg7M+BCp4ePSrkE4uHEvXyguxigAA= ARC-Authentication-Results: i=1; mx.zohomail.com; dkim=pass header.i=elephly.net; spf=pass smtp.mailfrom=rekado@elephly.net; dmarc=pass header.from= header.from= DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; t=1617283638; s=zoho; d=elephly.net; i=rekado@elephly.net; h=References:From:To:Cc:Subject:In-reply-to:Date:Message-ID:MIME-Version:Content-Type:Content-Transfer-Encoding; bh=iaVJQbAsR8neoD2UtVVzUEuDhwW6n0newBK2mVNGV6c=; b=KvaNebAMh/oelhtsfMdzTSkTZ3W6AlLptDy8yLS2zN7ef1WaqARzP5wsK0cQwVO6 obqS+HrJOa3tAc7wYIXiKhGRS1aENooKG2+KnqkYUkDdwX1IidwYZ3/TkdqdNGIqhn5 cjxHZS9DsGfFZUKQ8hNBQLowLJvTztQFQ6XzegnY= Received: from localhost (p54ad4e71.dip0.t-ipconnect.de [84.173.78.113]) by mx.zohomail.com with SMTPS id 1617283636574468.3260467707968; Thu, 1 Apr 2021 06:27:16 -0700 (PDT) References: <87r1k2ti7k.fsf@elephly.net> <87czvmt5w3.fsf@elephly.net> User-agent: mu4e 1.4.15; emacs 27.2 From: Ricardo Wurmus To: Konrad Hinsen Subject: Re: Managing data files in workflows In-reply-to: X-URL: https://elephly.net X-PGP-Key: https://elephly.net/rekado.pubkey X-PGP-Fingerprint: BCA6 89B6 3655 3801 C3C6 2150 197A 5888 235F ACAC Date: Thu, 01 Apr 2021 15:27:13 +0200 Message-ID: <87h7kq2kzy.fsf@elephly.net> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-ZohoMailClient: External Received-SPF: pass client-ip=136.143.188.51; envelope-from=rekado@elephly.net; helo=sender4-of-o51.zoho.com X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: gwl-devel@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: gwl-devel@gnu.org Errors-To: gwl-devel-bounces+larch=yhetil.org@gnu.org Sender: "gwl-devel" X-Migadu-Flow: FLOW_IN ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1617283772; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-unsubscribe:list-subscribe:list-post:dkim-signature; bh=iaVJQbAsR8neoD2UtVVzUEuDhwW6n0newBK2mVNGV6c=; b=ZN7gT/oFtGrk7dlUd9Fs82aMS9zXvOH4NPa9fN/xtAUJvG2y9EUyuWwUckO3I596mCP7GJ ELJNaysALjqqEnAu2q9Q4iijxKT8kVy0BJ+YLifomaSsuvsu5vBvdw0YK+XmCXzrKHMuqf BbHjoYD4fMtxgdUDghm/GsRivjri70AMe3S+qYV9h2aosnuwaSbgweV89Y8n8g9k2H9x3s avwSkbyiS9Cx5SqgU/zVZTgYukAxw9UrTb7q80zeLB4jYlNvGr93hJHQ0JlcPg+XY+cyM0 UFT2wh2xPo8TpBQ3ZAI0A+sYrA0GYDwAz9PtI6gIBGQblb2jgc46REXvT/vUFA== ARC-Seal: i=2; s=key1; d=yhetil.org; t=1617283772; a=rsa-sha256; cv=pass; b=ECS7TyeOZmBdReFSH7hNyIfThASg/USXFGa2ThDBvP8kPqV76k9hxJt/KhKsRcnnFTk06m JDDhjZTPxhRAwKc0zpk3l+hzHJUeRwrzIi8YG3vuHAAM1UK2I8tdorPAFprhwAlmNhWh4T schUsoJqvRgNDK1QGOH6qLOVtSckq1yHnx8/rACbj/PySDzLGo9cfaaDe5Yx9Mvpd2HTkc sveOqCWzc9snFPmJ4T6ICC41SdGh6OvKcWElp2u2LlgCdUvrUmHFjkG8j30H76/dM6Imuw 3YdKUWskt3gqBTOg4I7xU4sT6SoWX6H7aSEfiOFeQS2Fk/XIy+QY4cqz2KKQSg== ARC-Authentication-Results: i=2; aspmx1.migadu.com; dkim=pass header.d=elephly.net header.s=zoho header.b=KvaNebAM; arc=pass ("zohomail.com:s=zohoarc:i=1"); dmarc=none; spf=pass (aspmx1.migadu.com: domain of gwl-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=gwl-devel-bounces@gnu.org X-Migadu-Spam-Score: -3.63 Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=elephly.net header.s=zoho header.b=KvaNebAM; arc=pass ("zohomail.com:s=zohoarc:i=1"); dmarc=none; spf=pass (aspmx1.migadu.com: domain of gwl-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=gwl-devel-bounces@gnu.org X-Migadu-Queue-Id: 235141A849 X-Spam-Score: -3.63 X-Migadu-Scanner: scn0.migadu.com X-TUID: D2wwO8ZQV+6Q Hi Konrad, > Ricardo Wurmus writes: > >> In my test case this file exists: >> >> /tmp/gwl/lf6uca7zcyyldkcrxn3zwc275ax3ip676aqgjo75ybwojtl4emoq/data/w= eekly-incidence.csv > > And that's the one that causes the error message for me when I run the > workflow a second time (see below). But as I understand now, the mistake > happens earlier, as this step shouldn't be executed at all. > >> At least that happens in my case. I wonder why it doesn=E2=80=99t work = in your >> case. > > Is there anything I can do to debug this? Maybe. You could run with =E2=80=9C--dry-run=E2=80=9D to see what GWL clai= ms it would do to confirm that it considers the file to be =E2=80=9Cnot cached=E2=80=9D. Also enable more log events (in particular cache events) with =E2=80=9C--log-events=3Derror,info,execute,cache,debug=E2=80=9D The backtrace makes it seem that caching the downloaded file fails. That=E2=80=99s surprising, because (@ (gwl cache) cache!) will delete an existing file in the cache before linking a file to the cache prefix. --=20 Ricardo