From mboxrd@z Thu Jan 1 00:00:00 1970 From: taylanbayirli@gmail.com (Taylan Ulrich =?utf-8?Q?Bay=C4=B1rl=C4=B1?= =?utf-8?Q?=2FKammer?=) Subject: Re: Workflow management with GNU Guix Date: Thu, 12 May 2016 13:41:03 +0200 Message-ID: <874ma3mrlc.fsf@T420.taylan> References: <87wpmzhdk2.fsf@gnu.org> Mime-Version: 1.0 Content-Type: text/plain Return-path: Received: from eggs.gnu.org ([2001:4830:134:3::10]:44739) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1b0ozO-0000jK-GB for guix-devel@gnu.org; Thu, 12 May 2016 07:41:11 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1b0ozM-0003pQ-6G for guix-devel@gnu.org; Thu, 12 May 2016 07:41:09 -0400 In-Reply-To: <87wpmzhdk2.fsf@gnu.org> (Roel Janssen's message of "Thu, 12 May 2016 10:43:09 +0200") List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+gcggd-guix-devel=m.gmane.org@gnu.org Sender: "Guix-devel" To: Roel Janssen Cc: guix-devel@gnu.org Roel Janssen writes: > The usage of a pipeline/workflow is somewhat different from the > package construction, because we want to run the sequence of commands > on different data sets (as opposed to running it on the same source > code). Is this not conceptually the same thing as changing the 'source' field of a package recipe? With the new package transformation feature[0], this can be done "on the fly" like: guix build emacs --with-source=emacs-25.1-alpha.tar.xz Maybe a "process" can just be a build phase, and a "workflow" a build system, as they currently exist in Guix. Not sure what a "script" would be, though build phases can easily execute shell commands, scripts, and so on within the build directory. That means one could write a "package recipe" that doesn't really build a package from source code, but rather creates arbitrary output files from arbitrary input files. (Same thing to Guix anyway.) The 'source' field of the recipe would contain some dummy value, and one would specify the real input like: guix build processed-data --with-source=raw-data-2016-05-12.txt So maybe Guix already has everything you need? :-) Not sure if I fully understand the problem domain though, so apologies if I'm missing the point. Taylan [0] https://lists.gnu.org/archive/html/guix-devel/2016-02/msg00001.html