From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp0 ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id k37jCIVoemEc3gAAgWs5BA (envelope-from ) for ; Thu, 28 Oct 2021 11:08:21 +0200 Received: from aspmx1.migadu.com ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp0 with LMTPS id +BcABIVoemHBUAAA1q6Kng (envelope-from ) for ; Thu, 28 Oct 2021 09:08:21 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id D07532AAAC for ; Thu, 28 Oct 2021 11:08:20 +0200 (CEST) Received: from localhost ([::1]:48662 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1mg1OV-0001AT-UP for larch@yhetil.org; Thu, 28 Oct 2021 05:08:19 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:40540) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mg1O6-00019C-6z for guix-devel@gnu.org; Thu, 28 Oct 2021 05:07:54 -0400 Received: from mail-wr1-x436.google.com ([2a00:1450:4864:20::436]:44868) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1mg1O4-0005Kv-CJ for guix-devel@gnu.org; Thu, 28 Oct 2021 05:07:53 -0400 Received: by mail-wr1-x436.google.com with SMTP id d13so8860210wrf.11 for ; Thu, 28 Oct 2021 02:07:52 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=from:to:subject:in-reply-to:references:date:message-id:mime-version :content-transfer-encoding; bh=98+gKs8WA+lFVt7xdZwY65QkfyxBP+1VbTsUo9DOIxM=; b=ozFR3xn6jlU+GbDAHswXnCPCpN8ln9ePIIgBLMxuYMvYOeT9C+7nTKAu8cFRwqnUiq tplHKc930MOMU0D2TDkNasT2cZOTB6cD+2wWF3ifLoGuhkag4myRzomtE0d3DwhV6EcP ZQ08BMkU0ROT+LY4/ZoHNSpqs5xR8A3ODcOMCie6U4MeuTr6wNZV+obFGDX5LuHvzfM2 y62SrD0MULBs3wk9VEFcnea6vbVQ4jiVg3rp7zNvYnYfvLpqphr5QlycEFGVNe29h63q c97PP5ejGQgKjXSC4Ajuiy6r10UGY3KGLhIrKhIlbXT+ElsIvHuJQ4meqS+8Lu+YIG8C HMIQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:from:to:subject:in-reply-to:references:date :message-id:mime-version:content-transfer-encoding; bh=98+gKs8WA+lFVt7xdZwY65QkfyxBP+1VbTsUo9DOIxM=; b=sIwwy82Jw2SpaVvnao1zU04RdY4zKPIdGbJHcFFV1IC96RvLIlAEKL/jJ7njf/nKF0 Xi2i22sme42plITC5Q9zh44MMR7twWo1hPtVzB7X1YHnXqAkdKOBbzH5+e2zhGwykBbX dOhIYO2/fpJmevjiOIBPsVxuzXRzpcNy01Vub0kGpmEBDyGMFNw2D5tR0hvTCleSC4bt 6oy7lknUXyoEpOeZW9FdRK8BCWcGsS82VTE7mPHFNeqTiRj4p1IUa9YGcNzk2noFJKtP EKMpc0hv4ZaoVh0t1bR5RE634G6dFqEeo9nh3yS0tsfyzOVV2sYlMlVsSdpCZufyKPta pxfQ== X-Gm-Message-State: AOAM532J43aAMHyLesx2JKrzz6X4yP5XfI2PMw8lAeXt6CmzK6AUBAcm 3c6MxifjFnmJ9GqDkTaCdzg2lNilUfA= X-Google-Smtp-Source: ABdhPJxxTAPfBvMl7Xn51vBhcJSNVcthEQPdEjrew/nIwltZRjxuadkAz+aDYpqwc31ByYDampOTTw== X-Received: by 2002:a5d:64cf:: with SMTP id f15mr3995539wri.40.1635412070938; Thu, 28 Oct 2021 02:07:50 -0700 (PDT) Received: from lili ([2a01:e0a:59b:9120:65d2:2476:f637:db1e]) by smtp.gmail.com with ESMTPSA id s3sm5542992wmh.30.2021.10.28.02.07.50 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 28 Oct 2021 02:07:50 -0700 (PDT) From: zimoun To: Ludovic =?utf-8?Q?Court=C3=A8s?= , Guix Devel Subject: Re: Accuracy of importers? In-Reply-To: <878ryd8we4.fsf@inria.fr> References: <878ryd8we4.fsf@inria.fr> Date: Thu, 28 Oct 2021 11:06:35 +0200 Message-ID: <86fsslecx0.fsf@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Received-SPF: pass client-ip=2a00:1450:4864:20::436; envelope-from=zimon.toutoune@gmail.com; helo=mail-wr1-x436.google.com X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: "Guix-devel" X-Migadu-Flow: FLOW_IN ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1635412100; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-unsubscribe:list-subscribe:list-post:dkim-signature; bh=98+gKs8WA+lFVt7xdZwY65QkfyxBP+1VbTsUo9DOIxM=; b=DAF/6PJjNz08kpSd1QfG4XTf/hi7DP89ORl2qzWy/59JLKQKB+7SYa4nnhAPFCdfWQLjK0 2SnwjDxuq+Y18OCueiLe8OnCbOD2NijeyvLSO3Jv2ojJ2PGFwOFt031OU99P2xJeZTsO+m b+0iBrDImsPGrpnWLlzPuf9ILw13Gnuxkgct0ULSdvi1u0WOrxh/i6+o2sWgEF9YgyHSWV GZV/FD/m2GxrIIVwJntU0QHpiy55H3T/jq6eGBbKx+dUhXQXvvPHRauG2SXmTQ78jVNOe5 NlmiKSTAgI+xu/C9AGZMqai46OxARzRQSyFsfyuCfYFcRsPJRQRmpspSILuu7Q== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1635412100; a=rsa-sha256; cv=none; b=TTiYEXOZInOp5i1J3SxjCf2jK15T9wZnFpS26x36OAwxaJTvHc9riB3EXxgqzKbCzmyfXl s8hy8ptbO0IO8ZAl2FbieqJ8tHMskSRI81XuH7GaGxPEp2NKLAvx2V8DLVskrnN0OczLCH CAQ74ZITJ8INcBX2bsmMjbx0Ov0P/KeYoJiKBJzb0Xe4dxJD+TALgSqRBKBEQUfvmezGLY ++3/P2wdyY+3cBPeGv8US+mTpaFXm2KiywPvS/uehWplBMDV7zm1xeU9p+Pjo42PQy5zBr U15ei5RqPwBoYpo9Q9YtJ/62KoiL06tZ3Fao9CXbL1a1TFYmvX+Y7HvFrRTA5A== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=pass header.d=gmail.com header.s=20210112 header.b=ozFR3xn6; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (aspmx1.migadu.com: domain of guix-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-devel-bounces@gnu.org X-Migadu-Spam-Score: -2.12 Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=gmail.com header.s=20210112 header.b=ozFR3xn6; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (aspmx1.migadu.com: domain of guix-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-devel-bounces@gnu.org X-Migadu-Queue-Id: D07532AAAC X-Spam-Score: -2.12 X-Migadu-Scanner: scn0.migadu.com X-TUID: 5dTveNy/wKx7 Hi, On Thu, 28 Oct 2021 at 09:02, Ludovic Court=C3=A8s wrote: > My understanding is that most of them require manual intervention=E2=80= =94i.e., > one has to tweak what =E2=80=98guix import=E2=80=99 produces, even if we = ignore > synopsis/description/license, to set the right inputs, etc. If we were > to estimate the fraction of imported packages for which manual changes > are needed, what would it look like? Manual intervention depends on how it is packaged upstream, i.e., the availability of metadata. Therefore, it depends on the upstream archive. PyPI is messier than CRAN for instance but I find hard to back this claim with numbers =E2=80=93 just intuition. :-) > importer fraction of imported packages needing changes > > gnu 90% (doesn=E2=80=99t know about dependencies) > pypi 50% (some miss source distro, =E2=80=9Csdist=E2=80=9D; so= me have > non-Python deps) > cpan ? > hackage ? > stackage (Lars?) > egg (Xinglu?) > elpa (Nicolas?) > gem ? > go (Sarah? Leo? Raghav?) > cran 5% (Ricardo? Simon? seems to almost always work?) > crate 10% (Efraim?) > texlive (Ricardo? Thiago? Marius?) > opam (Julien?) > minetest (Maxime? Vivien?) > julia (WIP) (Simon?) > npm (WIP) (Jelle? Timothy?) For the ones I use =E2=80=9Ccran=E2=80=9D and =E2=80=9Ccran -a bioconductor= =E2=80=9C, and from the feedback I get from users in my lab, one regular complaint is the missing prefix =E2=80=99license:=E2=80=99 =E2=80=93 if that=E2=80=99s the i= ssue, it means the importer works pretty well. :-) About Julia, it is often not clear how to extract =E2=80=9Cdependencies=E2= =80=9D, which means the run-time ones vs the test-time other ones. > (Lower is better.) What would be your estimate? For all cases, to have a good estimation, I would examine how many packages already in Guix have a non-default =E2=80=99argument=E2=80=99 and = modified phases. It means that these packages require manual fix. Missing or incorrect dependencies happen. But they are impossible to evaluate. However, special =E2=80=99argument=E2=80=99 are something eval-a= ble and for now, none importer tweaks that, IIUC, thus it would sketch the picture =C2=ABhow well our importers are doing=C2=BB. For instance, filtered on build-system. For sure, all python-build-system packages do not come from PyPI, r-build-system from CRAM/Bioconductor, etc. but, IMHO, such stats would provide a good estimation for how upstream archives ELPA, PyPI, CRAN/Bioconducor, Hackage/Stackage, TexLive, etc. are ready for Guix without manual intervention. Cheers, simon