From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp12.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms9.migadu.com with LMTPS id iCENNc8DD2SMYQEASxT56A (envelope-from ) for ; Mon, 13 Mar 2023 12:06:55 +0100 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp12.migadu.com with LMTPS id WEPfNM8DD2RBnQAAauVa8A (envelope-from ) for ; Mon, 13 Mar 2023 12:06:55 +0100 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 3FC4E8F1C for ; Mon, 13 Mar 2023 12:06:50 +0100 (CET) Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1pbg0E-0001ki-76; Mon, 13 Mar 2023 07:06:06 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1pbg06-0001YA-Gp for guix-science@gnu.org; Mon, 13 Mar 2023 07:05:59 -0400 Received: from sender4-of-o50.zoho.com ([136.143.188.50]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1pbg03-0004yZ-PM for guix-science@gnu.org; Mon, 13 Mar 2023 07:05:58 -0400 ARC-Seal: i=1; a=rsa-sha256; t=1678705550; cv=none; d=zohomail.com; s=zohoarc; b=Ts73nonfQkZ1NEcpJZDWeHaaF3ikaW2w5cymxt5in2CV2AySRJhr1zc1Zzjw6vUlh6q6z/FZST0DqhlitV+bGTnljruS04GKaIUQwuPqVic7Dv84eFPBEtSBoiRsVmKxoUrwzVS9hiO9vGL9JxaF/8pJyfZYCBvjKrP3J7VpiGA= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zohomail.com; s=zohoarc; t=1678705550; h=Content-Type:Content-Transfer-Encoding:Cc:Date:From:In-Reply-To:MIME-Version:Message-ID:References:Subject:To; bh=pjfp56gehNNltVReNxopa076v7lFm5Opa0ht3p0bRts=; b=ZMi2EY6IjXwOK+NtwwRx7GTYNf8h5Y3RUawK764enL9REujbTELXgYPAQqMm0oLNHjRf1tlMal7GMZILMUkamvThVGb3xRu9OPGgslmbHMwOun17klrHNsHpe0e7f8VXKSH5xPnaVpNAbVw9LfRSJqq8mBDhoksZT8cpFOiM1cc= ARC-Authentication-Results: i=1; mx.zohomail.com; dkim=pass header.i=elephly.net; spf=pass smtp.mailfrom=rekado@elephly.net; dmarc=pass header.from= DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; t=1678705550; s=zoho; d=elephly.net; i=rekado@elephly.net; h=References:From:From:To:To:Cc:Cc:Subject:Subject:Date:Date:In-reply-to:Message-ID:MIME-Version:Content-Type:Content-Transfer-Encoding:Message-Id:Reply-To; bh=pjfp56gehNNltVReNxopa076v7lFm5Opa0ht3p0bRts=; b=LQbTndxf6S74ux2hRFCtQZDzJduP8EOJycZ+MrrcuBNrGdCPahvSncDjIwqPAU/p gnpys9htnSqNLAeM04wyIbaRYuUtk4GWUYLPUH9te/KlZMPxExfaz8W5zlRjqKdbSOc 2R0gvYEaBsd8nHtxYsKK6JSotsBmCjCcppyfoQ5M= Received: from localhost (59-108-142-46.pool.kielnet.net [46.142.108.59]) by mx.zohomail.com with SMTPS id 1678705547700638.1958604496353; Mon, 13 Mar 2023 04:05:47 -0700 (PDT) References: <87pmd7ar8k.fsf@imperial.ac.uk> <87zgcayre2.fsf@imperial.ac.uk> <86y1rt5xoz.fsf@gmail.com> <87fsdfejfv.fsf@imperial.ac.uk> <87a60jy2e7.fsf@gnu.org> User-agent: mu4e 1.8.13; emacs 28.2 From: Ricardo Wurmus To: "Lestang, Thibault" Cc: Simon Tournier , Ludovic =?utf-8?Q?Court?= =?utf-8?Q?=C3=A8s?= , guix-science@gnu.org Subject: Re: Conda environments and reproducibility Date: Mon, 13 Mar 2023 12:00:17 +0100 In-reply-to: X-URL: https://elephly.net X-PGP-Key: https://elephly.net/rekado.pubkey X-PGP-Fingerprint: BCA6 89B6 3655 3801 C3C6 2150 197A 5888 235F ACAC Message-ID: <87r0ts3o8n.fsf@elephly.net> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-ZohoMailClient: External Received-SPF: pass client-ip=136.143.188.50; envelope-from=rekado@elephly.net; helo=sender4-of-o50.zoho.com X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-science@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-science-bounces+larch=yhetil.org@gnu.org Sender: guix-science-bounces+larch=yhetil.org@gnu.org X-Migadu-Country: US X-Migadu-Flow: FLOW_IN ARC-Authentication-Results: i=2; aspmx1.migadu.com; dkim=pass header.d=elephly.net header.s=zoho header.b=LQbTndxf; spf=pass (aspmx1.migadu.com: domain of "guix-science-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-science-bounces+larch=yhetil.org@gnu.org"; dmarc=none; arc=pass ("zohomail.com:s=zohoarc:i=1") ARC-Seal: i=2; s=key1; d=yhetil.org; t=1678705615; a=rsa-sha256; cv=pass; b=VLPo4nYoHv3Zt+C0B+9jdjPXbggj75oEPMdrwvP+g5umyZJVtU+TvoAtliIv5j2tFNeXcG +N+a+eRqgnetQPVrWAyjDW6gJK9D2cwDTh7vn9Df/pkEh5OW/FFJOg6jCNKXzWhgRnMZDd MhKMK/vNN2AP6MG4Zeu8chtQkURzVQjjUpXSmjsO7JLNO2F1CPitlqNv5FccwTApwWCKlK TQ5AKvJjdmSZiietWX6aM+PCgXcF4Ywzhvj703gzCW6N8YLvockADjDXttBJNDGlQrweuT A2J/tgD/jeYRy0FbFKCQg9nI2VLT4yMgkO/TZDv5tu/L7CbTDAUObskMxphb4A== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1678705615; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-unsubscribe:list-subscribe:list-post:dkim-signature; bh=pjfp56gehNNltVReNxopa076v7lFm5Opa0ht3p0bRts=; b=sCzOF8EL7Ns5OkYRaRA4Yr8YtMMDOIrMiosLvn71nUHPLi4L8VWUcJdshL66pWhCRgiEY8 LwJ2FJa9NVW3bFSk0s+oBldNpk53cEcC8zx/6+puVHyxpYhHErRoOJJo4D4VpJ7N/DaZcz EdvduAq4S9kmq766m7DgbjUnE8C62Perk4uLOelyiT3F1FPi0iohw2hnQQOubF7G18ceUo WF1P67tPVyV8SGiDrDplh6Om8oblSaDv9shrlkYDLffho8u06rGVF+csbP5p0FEVctGJ+0 ek8rC6b/iCPyv1ap7in+nKzhCq4pd72KSCLjmpyZT7jhfK9aqMhP0wHx3EXByQ== X-Migadu-Spam-Score: -3.21 X-Spam-Score: -3.21 X-Migadu-Queue-Id: 3FC4E8F1C X-Migadu-Scanner: scn1.migadu.com Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=elephly.net header.s=zoho header.b=LQbTndxf; spf=pass (aspmx1.migadu.com: domain of "guix-science-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-science-bounces+larch=yhetil.org@gnu.org"; dmarc=none; arc=pass ("zohomail.com:s=zohoarc:i=1") X-TUID: VhdVyrs6x0k8 "Lestang, Thibault" writes: > Ludovic Court=C3=A8s writes: > >> Any findings so far? Looking at the pipelines, it seems to be all >> green, right? > > Timely reply - all green until 3 days ago when the job timed out after 70= min.=20 > However, I re-ran the job manually this morning and it succeeded within a= couple of minutes. Not=20 > quite sure what happened but probably not related to conda. Not logs avai= lable unfortunately. > > If the process of reproducing the environment is going to fail at some po= int, I=20 > wonder if we could accelerate this process by defining a more complex env= ironment.=20 > Any ideas? A more complex environment would increase the chance of failure because it increases the complexity of the challenge to the resolver. While it would be a useful demonstration to see the resolver fail I think it is the least damning kind of failure. As Simon suggests, changing the underlying system that *currently* satisfies all the implicit assumptions that Conda artefacts contain would likely yield a more realistic and interesting kind of failure. > > Simon Tournier writes: > >> 1. also use the image continuumio/miniconda3:latest >> 2. install Miniconda on the top of the Docker image of Debian >> unstable and run "apt update && apt upgrade" >>=20 >> And I expect that #2 will break first, then #1 and last the current >> one. > > Could you elaborate on this? For context the current pipeline=20 > pulls a pinned miniconda image then updates conda (=3Dconda update conda= =3D).=20=20 > Do you expect system libraries (I mean software installed through apt, no= t=20 > managed by conda) to influence the conda environment creation? My curren= t=20 > understanding is that conda brings its own copies of these libraries wit= hout relying=20 > on whatever was/will be installed through other ways (e.g. apt). This depends on the packages. There are packages that do link with system libraries, and these are provided by a base image in which the binary artefacts are built. --=20 Ricardo