From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp0 ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id PtXDJ3x10GCc0AAAgWs5BA (envelope-from ) for ; Mon, 21 Jun 2021 13:18:20 +0200 Received: from aspmx1.migadu.com ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp0 with LMTPS id GF/ZInx10GCZFwAA1q6Kng (envelope-from ) for ; Mon, 21 Jun 2021 11:18:20 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id C180A1E6E5 for ; Mon, 21 Jun 2021 13:18:19 +0200 (CEST) Received: from localhost ([::1]:41980 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1lvHwX-0008G3-QL for larch@yhetil.org; Mon, 21 Jun 2021 07:18:17 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:50416) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1lvHwI-0008Fp-33 for guix-devel@gnu.org; Mon, 21 Jun 2021 07:18:02 -0400 Received: from mailrelay.tugraz.at ([129.27.2.202]:45405) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1lvHwE-0001OI-07 for guix-devel@gnu.org; Mon, 21 Jun 2021 07:18:01 -0400 Received: from nijino.local (62-116-34-49.adsl.highway.telekom.at [62.116.34.49]) by mailrelay.tugraz.at (Postfix) with ESMTPSA id 4G7n7f01Lcz1LBSW; Mon, 21 Jun 2021 13:17:49 +0200 (CEST) DKIM-Filter: OpenDKIM Filter v2.11.0 mailrelay.tugraz.at 4G7n7f01Lcz1LBSW DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=tugraz.at; s=mailrelay; t=1624274270; bh=fdra1f3lUXlv+xw1XuGERVPVYi5E+5FuQFg4kysYg5o=; h=Subject:From:To:Cc:Date:In-Reply-To:References:From; b=fO950U1rimo8TnYovgof0+1Qi2pxeq1P5B32BKuR0uJ0moYcl1c4/Dkzbtg0W0dSM 9XZC0H6+dzECFG2kR8JaXYn7W9qvjF+rV7mB577UR+ti+J1jBjNoP0KwdjiAXrt8eq JhZHmWN+1P/7DtotsHOF3P422xfLxBjawK1Qvt5o= Message-ID: <593efbaff28e705201de15767234439cd7708faf.camel@student.tugraz.at> Subject: Re: python-distlib vs python-distlib/next From: Leo Prikler To: Ricardo Wurmus , Tanguy Le Carrour Date: Mon, 21 Jun 2021 13:17:48 +0200 In-Reply-To: <87mtrjy0cq.fsf@mdc-berlin.de> References: <87mtrjy0cq.fsf@mdc-berlin.de> Content-Type: text/plain; charset="UTF-8" User-Agent: Evolution 3.34.2 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-TUG-Backscatter-control: bt4lQm5Tva3SBgCuw0EnZw X-Spam-Scanner: SpamAssassin 3.003001 X-Spam-Score-relay: -1.9 X-Scanned-By: MIMEDefang 2.74 on 129.27.10.116 Received-SPF: pass client-ip=129.27.2.202; envelope-from=leo.prikler@student.tugraz.at; helo=mailrelay.tugraz.at X-Spam_score_int: -42 X-Spam_score: -4.3 X-Spam_bar: ---- X-Spam_report: (-4.3 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_MED=-2.3, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: guix-devel@gnu.org Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: "Guix-devel" X-Migadu-Flow: FLOW_IN ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1624274300; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-unsubscribe:list-subscribe:list-post:dkim-signature; bh=fdra1f3lUXlv+xw1XuGERVPVYi5E+5FuQFg4kysYg5o=; b=ZvMePYmqwBt32eCfkVZ10li1bpTLOSoSQncRDcPD4ORGEOeX3d2uuIfnxsJcEf1VvV2dKw qszl8yNBmVytikR/52v80NuW4xJ2q0uXBRdBwQmM+ILH2apJUF/M6TQ7S9sTzRKHfu9v53 guCJxG55qsYX9UqlCrlGE3pZMlQZk170fkz4Nt0alvivmvIKQAqkX+PjisagI2V2CRax4M JLvydLCv/QsKd/IS3NAGVuDMMNma7aEVph+n0yUJjHSA65OfgpuNHoXyh5OI8OqDRIO/58 4y/F10xwRNZ8ceZlAPijInVs3EVHaJcjkFMY71eVDyGtlB33orQc5F8LP07y/g== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1624274300; a=rsa-sha256; cv=none; b=fsdwuQtIcAsbMudowO2PCdHm2rtciKDGlMj7RgY+2AQ7TEfavadHw82ql7ByXb8wJQEdmJ w60ddKfxwRuEOxqj62PGdrqwK+SA00lVDFsRayT7Bf6ls93elLmW3n9uyb0XXxc84/CDv7 Q+Bi0kgT/m+BNHvqI8UDlJRzIU1zEhygfGekJY675P3063JIPSKd1Li5tkK8/YVIgs1gDS lyaFPO91U2XRR44dUkddtiy0YPH4Vy+B0OcxDKTyhvZDaCwO7IDtlfkqcj1xXgp7VylqU8 1RWMi4IlG5jBg/S33F7H6+NicxRYSk/FYBgpsZeAb1NKO6wiz8hUkfDWfKh29Q== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=pass header.d=tugraz.at header.s=mailrelay header.b=fO950U1r; dmarc=pass (policy=none) header.from=student.tugraz.at; spf=pass (aspmx1.migadu.com: domain of guix-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-devel-bounces@gnu.org X-Migadu-Spam-Score: -3.12 Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=tugraz.at header.s=mailrelay header.b=fO950U1r; dmarc=pass (policy=none) header.from=student.tugraz.at; spf=pass (aspmx1.migadu.com: domain of guix-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-devel-bounces@gnu.org X-Migadu-Queue-Id: C180A1E6E5 X-Spam-Score: -3.12 X-Migadu-Scanner: scn0.migadu.com X-TUID: 1K9ZqaiFZmeX Hi, Am Montag, den 21.06.2021, 12:32 +0200 schrieb Ricardo Wurmus: > Hi, > > commit ce6efff6eca0ed88cb9538803f5d1252c91a3b5e updated > virtualenv. As part of this change python-distlib was replaced > with python-distlib/next. > > This broke the *installation* (not the build) of other packages > such as python-pygenometracks. The reason is that the closure of > python-pygenometracks would include both python-distlib and > python-distlib/next. Guix would then prevent the installation of > python-pygenometracks into user profiles: > > > guix package: error: profile contains conflicting entries for > > python-distlib > > guix package: error: first entry: python-distlib@0.3.1 > > /gnu/store/mypg42bass5n61liwyq7llrwla4w8bny-python-distlib-0.3.1 > > guix package: error: ... propagated from > > python-virtualenv@20.2.1 > > guix package: error: ... propagated from python-tox@3.20.0 > > guix package: error: ... propagated from > > python-argh@0.26.2-1.dcd3253 > > guix package: error: ... propagated from > > python-gffutils@0.9-1.4034c54 > > guix package: error: ... propagated from > > python-pygenometracks@3.3 > > guix package: error: second entry: python-distlib@0.3.0 > > /gnu/store/fwya18dazamh2cjdkgh5wpxi7lqn4fcm-python-distlib-0.3.0 > > guix package: error: ... propagated from > > python-sortedcontainers@2.1.0 > > guix package: error: ... propagated from > > python-intervaltree@3.0.2 > > guix package: error: ... propagated from > > python-pygenometracks@3.3 > > We can’t easily detect these problems because they only strike at > installation time. This means that we may not do partial upgrades > in the Python world due to the quirks of propagation. There may > be other packages that are broken in a similar fashion right now. > > How can we make this more robust and avoid problems like this in > the future? I think we can detect this and similar breakages through the use of graph algorithms. Start with all versions of your input package as nodes and no edges. For all packages P, add packages P' that immediately propagate P as nodes to G and PP' as edge. Repeat this until closure is reached. Your closure should now have as many components as you had versions. If not, then by the pigeonhole principle you have a propagation conflict. If you want to be eager, you can also try to colour your graph, such that each component gets a unique colour, which is assigned to the initial P a priori (use BFS to propagate colours). If a package would receive two colours from that operation, you again have a propagation conflict, but you also know which packages cause it. I think we should be able to implement one of those algorithms in `guix graph`. Then people could check whether their change to a propagated input breaks anything, whether in Python or elsewhere. Regards, Leo