From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp10.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms9.migadu.com with LMTPS id 6LVFNf4aJmRwswAASxT56A (envelope-from ) for ; Fri, 31 Mar 2023 01:27:58 +0200 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp10.migadu.com with LMTPS id OAFgNP4aJmTxWAEAG6o9tA (envelope-from ) for ; Fri, 31 Mar 2023 01:27:58 +0200 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 92F92CBB5 for ; Fri, 31 Mar 2023 01:27:58 +0200 (CEST) Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1pi1gG-0000ag-0f; Thu, 30 Mar 2023 19:27:44 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1pi1gE-0000aU-CY for guix-devel@gnu.org; Thu, 30 Mar 2023 19:27:42 -0400 Received: from mail-qv1-xf35.google.com ([2607:f8b0:4864:20::f35]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1pi1gC-00064C-Hc for guix-devel@gnu.org; Thu, 30 Mar 2023 19:27:41 -0400 Received: by mail-qv1-xf35.google.com with SMTP id kr22so1335444qvb.5 for ; Thu, 30 Mar 2023 16:27:40 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=terpmail.umd.edu; s=google; t=1680218859; x=1682810859; h=content-transfer-encoding:in-reply-to:from:references:cc:to :content-language:subject:mime-version:date:message-id:from:to:cc :subject:date:message-id:reply-to; bh=q8aM26ifOs90G2pkKMEf3UMdz7QVglvAfyj/nESJhbA=; b=E9k/Dv5Eu2d50ctUjN+VS04dWAM6SxyQspQAiNqplrAVCvShgF9VvKXpqHOdZ6thJ3 GJ1CLeDjPg352yQOLtoxKv6qLlpKVt9ffQ1Nzlj2R8N9nuTaDNwdz5FpihPq42lF2yJz 8Uiam1mDNIhXhaJ72LhaSCirii7PbdNlF+h3CDArgKkUG86Ziq/4ttLaiNx9/xUIJDoW RZlZL5jw7GEtaxq7hnyIuUsaQ+TEW7aNr9a1kTpfUTkCtVrw7p5PZAktNPC7AKtHcZA2 Eyb4kA71T1ma4FaB19Gy7v5PMFkvUvNMhTsRgn6JWqWWuG4YmONEij/e4dAaQfaQMpwu ZStQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; t=1680218859; x=1682810859; h=content-transfer-encoding:in-reply-to:from:references:cc:to :content-language:subject:mime-version:date:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=q8aM26ifOs90G2pkKMEf3UMdz7QVglvAfyj/nESJhbA=; b=CABKM/z9mfakyJFqOXprIPWmjI2XW+QJKNhvKEChRM8TcrXr3OVkBh8+35anTRohjd 2Pv/3ygXZ/OqXltlUthwNIlw9sJK5Jfeh4McX13A2QF8vv/vxZdZCfrJK+l3U9yI/tJs weuUhSn8kJ5rP2TwaeNdRy+sFHSLt4jT6f69TnWu2aR6ZPPbw/APOgPEOxT0eNVDt859 NlQUg6HYVT1UvdF7PIkM8dA2ArqelvhUE1Ro8tjnIKBlhTBjuo9btp+IyiWLF53flLy9 yyO3maRkl4WYyhoANBuh2hEEa2bE1G/lp00Ng75LpIaXydBBjJdMzJs+ouOtr5aKpTxh Q1eA== X-Gm-Message-State: AAQBX9dT/eWGe1yvN9yuE3RAJ2YrnsWaZrUK8oiujFTk5ZLv5Dt0OZOC IiPn4ByT3N9Nm93r1nh6u09aIw== X-Google-Smtp-Source: AKy350bWWPAu4XbhXSDgXCsDxUAwV6P5ZZYajpNvzbVAua45SuEwTV31nyp4js8TqTu0spDHMoF5mg== X-Received: by 2002:a05:6214:1cc2:b0:5ac:239a:91ed with SMTP id g2-20020a0562141cc200b005ac239a91edmr38955181qvd.9.1680218859478; Thu, 30 Mar 2023 16:27:39 -0700 (PDT) Received: from [10.104.59.23] ([129.2.192.23]) by smtp.gmail.com with ESMTPSA id lf8-20020a0562142cc800b005dd8b9345c2sm181430qvb.90.2023.03.30.16.27.39 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Thu, 30 Mar 2023 16:27:39 -0700 (PDT) Message-ID: Date: Thu, 30 Mar 2023 19:27:37 -0400 MIME-Version: 1.0 Subject: Re: Google Summer of Code 2023 Inquiry Content-Language: en-US To: Ricardo Wurmus Cc: Simon Tournier , guix-devel@gnu.org, Kyle Andrews References: <6d30ee7b-f1f0-9199-fea8-efd434c8611c@terpmail.umd.edu> <86sfeb9zx8.fsf@gmail.com> <87ttycir7r.fsf@elephly.net> <87zg81hki5.fsf@mdc-berlin.de> From: Spencer Skylar Chan In-Reply-To: <87zg81hki5.fsf@mdc-berlin.de> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit Received-SPF: pass client-ip=2607:f8b0:4864:20::f35; envelope-from=schan12@terpmail.umd.edu; helo=mail-qv1-xf35.google.com X-Spam_score_int: -19 X-Spam_score: -2.0 X-Spam_bar: -- X-Spam_report: (-2.0 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: guix-devel-bounces+larch=yhetil.org@gnu.org X-Migadu-Country: US X-Migadu-Flow: FLOW_IN ARC-Seal: i=1; s=key1; d=yhetil.org; t=1680218878; a=rsa-sha256; cv=none; b=X4NF0vdMBXmfkmLp/43QHptgoXlfUCvPmCWXqYtTdBqDkee1jeF83eIFf8Y8Hd7Dt1wBg3 mhvawUWJFlR0JZ+y0w0HuAwMLMrY2jnuXMT4TgyTC0dZa9y8USkk2AMhpTD5AJuggT8EDi 3ZdWLaBSBi0VOR+zF7qeX4e6xgU5hHXnK+3bEm+HQJzF4VvF3sSfEic/QbN/pgRQzuMcof eDR/cqu0Uh9J1+jcZ/5qKn+ps6fZKmlg7mMDN/gpXJcsJ7Ph4ramK8VZMaONi0OlP3T2+X bnIRR3n++y1C2Qv88oKsDnAapg8aNF81LtNRVPRGUZTwkXQ6riUOqQ9megFcPA== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=pass header.d=terpmail.umd.edu header.s=google header.b="E9k/Dv5E"; dmarc=pass (policy=none) header.from=terpmail.umd.edu; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1680218878; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-unsubscribe:list-subscribe:list-post:dkim-signature; bh=q8aM26ifOs90G2pkKMEf3UMdz7QVglvAfyj/nESJhbA=; b=LYtA599k0yxdrKWynQWKiXCMNZyf4AsDpwllTJowPrBdHfhvVw8M6EeRI6q+shGDbKlpMk tT2YSMbWX3dGziclV9jb/TCBVhcUBAZAnhoF7sTIL90qeOPXXIGi5DbhGtCA9fzifD5Z93 /OCtusBGnsGBS4K56rjmV8/grnvP9Sm1dNyW0U1/dJnAJODhNnRF9VV6+6zS6KjMZFcsIH 5IQX4M3YKMvYAzan99UEKGDBwnCpDTyMv1brpPY5g3CvJ48Gn2s3UUTIIV9N78d58iidCu qY48Hki7rGmAIofIbXUlTF2n//W8PTAn1l5xLq3PPqZOnHJHDx5XwMa7xR5cgQ== X-Migadu-Spam-Score: -4.18 X-Migadu-Scanner: scn1.migadu.com Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=terpmail.umd.edu header.s=google header.b="E9k/Dv5E"; dmarc=pass (policy=none) header.from=terpmail.umd.edu; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" X-Spam-Score: -4.18 X-Migadu-Queue-Id: 92F92CBB5 X-TUID: KqQGOI93V2we Hi Ricardo, On 3/23/23 03:58, Ricardo Wurmus wrote: > Hi, > > Spencer Skylar Chan writes: > >> One approach could be to add CWL import/export capabilities to >> GWL. Then Snakemake/GWL conversion would be a 2 step process, using >> CWL as an intermediate step: >> >> 1. Snakemake -> CWL >> 2. CWL -> GWL > > This seems doable. Great! I've been reading the chapter in Evolutionary Genomics on different scalable workflows to understand this process better. >> However, CWL is not as expressive as Snakemake. There may be some >> details that are lost from Snakemake workflows. >> >> So a 1-step Snakemake/GWL transpiler could be interesting, as both >> Snakemake/GWL use a domain-specific language inside a general purpose >> language (Python/Guile respectively). There may be a possibility to >> achieve more "accurate" translations between workflows. > > Compared to the previous approach this seems vastly more complex. It’s > one thing to *execute* Snakemake code without running it through Python, > but quite a bit more challenging to transpile Python to Scheme. > > Personally, I wouldn’t know where to start. Do you have an idea > already? > Actually I was hoping you might have some ideas :) I do think that if the execution of the pipeline is more important than its representation (Snakemake or otherwise), then it would make more sense to focus efforts on increasing GWL's capabilities. Thanks, Skylar