[PATCH]: gnu: shogun: Remove non-free source files.

[PATCH]: gnu: shogun: Remove non-free source files.

[Ricardo Wurmus]

[-- Attachment #1: Type: text/plain, Size: 351 bytes --]

Thanks to Bavier for bringing this issue to my attention.  This patch
removes two source files that are released under a non-free license.

There are functions in src/shogun/kernel/Kernel.{cpp,h} that are also
released under non-free terms, but they are enclosed in #ifdef
statements and the make flags we pass disable these functions at build
time.


[-- Warning: decoded text below may be mangled, UTF-8 assumed --]
[-- Attachment #2: 0001-gnu-shogun-Remove-non-free-source-files.patch --]
[-- Type: text/x-patch, Size: 1228 bytes --]

From 0cc65499601910f4fdd55e93292124920a7e645d Mon Sep 17 00:00:00 2001
From: Ricardo Wurmus <ricardo.wurmus@mdc-berlin.de>
Date: Fri, 8 May 2015 16:53:28 +0200
Subject: [PATCH] gnu: shogun: Remove non-free source files.

* gnu/packages/bioinformatics.scm (shogun)[source]: Add snippet to remove
  non-free sources.
---
 gnu/packages/bioinformatics.scm | 8 +++++++-
 1 file changed, 7 insertions(+), 1 deletion(-)

diff --git a/gnu/packages/bioinformatics.scm b/gnu/packages/bioinformatics.scm
index fa7ff4c..1e93905 100644
--- a/gnu/packages/bioinformatics.scm
+++ b/gnu/packages/bioinformatics.scm
@@ -1605,7 +1605,13 @@ against local background noises.")
              "/sources/shogun-" version ".tar.bz2"))
        (sha256
         (base32
-         "159nlijnb7mnrv9za80wnm1shwvy45hgrqzn51hxy7gw4z6d6fdb"))))
+         "159nlijnb7mnrv9za80wnm1shwvy45hgrqzn51hxy7gw4z6d6fdb"))
+       (modules '((guix build utils)))
+       (snippet
+        ;; Remove non-free sources.
+        '(for-each delete-file
+                   (find-files "src/shogun/classifier/svm/"
+                               "SVMLight\\.(cpp|h)")))))
     (build-system cmake-build-system)
     (arguments
      '(#:tests? #f ;no check target
-- 
2.1.0

Re: [PATCH]: gnu: shogun: Remove non-free source files.

[Ludovic Courtès]

Ricardo Wurmus <ricardo.wurmus@mdc-berlin.de> skribis:

> Thanks to Bavier for bringing this issue to my attention.  This patch
> removes two source files that are released under a non-free license.
>
> There are functions in src/shogun/kernel/Kernel.{cpp,h} that are also
> released under non-free terms, but they are enclosed in #ifdef
> statements and the make flags we pass disable these functions at build
> time.

OK.

> From 0cc65499601910f4fdd55e93292124920a7e645d Mon Sep 17 00:00:00 2001
> From: Ricardo Wurmus <ricardo.wurmus@mdc-berlin.de>
> Date: Fri, 8 May 2015 16:53:28 +0200
> Subject: [PATCH] gnu: shogun: Remove non-free source files.
>
> * gnu/packages/bioinformatics.scm (shogun)[source]: Add snippet to remove
>   non-free sources.

Sure, please push.

Thanks,
Ludo’.

Re: [PATCH]: gnu: shogun: Remove non-free source files.

[Mark H Weaver]

Ricardo Wurmus <ricardo.wurmus@mdc-berlin.de> writes:

> Thanks to Bavier for bringing this issue to my attention.  This patch
> removes two source files that are released under a non-free license.

Sounds good, thanks!

> There are functions in src/shogun/kernel/Kernel.{cpp,h} that are also
> released under non-free terms, but they are enclosed in #ifdef
> statements and the make flags we pass disable these functions at build
> time.

This is not sufficient.  We will need to completely remove the non-free
functions from the source code using a snippet.  We cannot use a patch
because the patch would contain the non-free code.

     Mark

Re: [PATCH]: gnu: shogun: Remove non-free source files.

[Ludovic Courtès]

Mark H Weaver <mhw@netris.org> skribis:

> Ricardo Wurmus <ricardo.wurmus@mdc-berlin.de> writes:

[...]

>> There are functions in src/shogun/kernel/Kernel.{cpp,h} that are also
>> released under non-free terms, but they are enclosed in #ifdef
>> statements and the make flags we pass disable these functions at build
>> time.
>
> This is not sufficient.  We will need to completely remove the non-free
> functions from the source code using a snippet.  We cannot use a patch
> because the patch would contain the non-free code.

Indeed (I thought Kernel.{cpp,h} were the files being removed.)

I guess there are two ways to address this: have a snippet that reads
these two files line by line (with ‘read-line’ from (ice-9 rdelim)) and
dismisses files within the #ifdef.

If that turns out to be impractical, for instance because there are
nested #ifdefs or computed conditionals, then we’ll have to host a
cleaned up source tarball or repo somewhere.

Ricardo: could you look into it?

Thanks,
Ludo’.

Re: [PATCH]: gnu: shogun: Remove non-free source files.

[Mark H Weaver]

ludo@gnu.org (Ludovic Courtès) writes:

> Mark H Weaver <mhw@netris.org> skribis:
>
>> Ricardo Wurmus <ricardo.wurmus@mdc-berlin.de> writes:
>
> [...]
>
>>> There are functions in src/shogun/kernel/Kernel.{cpp,h} that are also
>>> released under non-free terms, but they are enclosed in #ifdef
>>> statements and the make flags we pass disable these functions at build
>>> time.
>>
>> This is not sufficient.  We will need to completely remove the non-free
>> functions from the source code using a snippet.  We cannot use a patch
>> because the patch would contain the non-free code.
>
> Indeed (I thought Kernel.{cpp,h} were the files being removed.)
>
> I guess there are two ways to address this: have a snippet that reads
> these two files line by line (with ‘read-line’ from (ice-9 rdelim)) and
> dismisses files within the #ifdef.
>
> If that turns out to be impractical, for instance because there are
> nested #ifdefs or computed conditionals, then we’ll have to host a
> cleaned up source tarball or repo somewhere.

There's another option that might be better: instead of reading the file
line-by-line, read the entire file into a single string, and then use
regexps to find the relevant section and remove it.  It might even be
possible to do it with a single regexp substitution.

      Mark

Re: [PATCH]: gnu: shogun: Remove non-free source files.

[Ricardo Wurmus]

Ludovic Courtès writes:

>>> There are functions in src/shogun/kernel/Kernel.{cpp,h} that are also
>>> released under non-free terms, but they are enclosed in #ifdef
>>> statements and the make flags we pass disable these functions at build
>>> time.
>>
>> This is not sufficient.  We will need to completely remove the non-free
>> functions from the source code using a snippet.  We cannot use a patch
>> because the patch would contain the non-free code.

> Ricardo: could you look into it?

Yes, I'll take care of this.  I'll try to have a patch ready in a couple
of days.

~~ Ricardo

Re: [PATCH]: gnu: shogun: Remove non-free source files.

[Ricardo Wurmus]

>>>> There are functions in src/shogun/kernel/Kernel.{cpp,h} that are also
>>>> released under non-free terms, but they are enclosed in #ifdef
>>>> statements and the make flags we pass disable these functions at build
>>>> time.
>>>
>>> This is not sufficient.  We will need to completely remove the non-free
>>> functions from the source code using a snippet.  We cannot use a patch
>>> because the patch would contain the non-free code.

Just a quick update: I've added snippets to remove all non-free stuff
and it's compiling (after I applied a patch to R 3.2.0 which I will send
to the ML later).

Sadly, the RUNPATH validation is failing, so I first need to find some
time to fix this.  Would you like me to submit the patch to remove the
non-free parts first even though the RUNPATH validation is still
failing, or would you like me to submit this all at once instead?

~~ Ricardo

Re: [PATCH]: gnu: shogun: Remove non-free source files.

[Ludovic Courtès]

Ricardo Wurmus <ricardo.wurmus@mdc-berlin.de> skribis:

>>>>> There are functions in src/shogun/kernel/Kernel.{cpp,h} that are also
>>>>> released under non-free terms, but they are enclosed in #ifdef
>>>>> statements and the make flags we pass disable these functions at build
>>>>> time.
>>>>
>>>> This is not sufficient.  We will need to completely remove the non-free
>>>> functions from the source code using a snippet.  We cannot use a patch
>>>> because the patch would contain the non-free code.
>
> Just a quick update: I've added snippets to remove all non-free stuff
> and it's compiling (after I applied a patch to R 3.2.0 which I will send
> to the ML later).

Great.

> Sadly, the RUNPATH validation is failing, so I first need to find some
> time to fix this.  Would you like me to submit the patch to remove the
> non-free parts first even though the RUNPATH validation is still
> failing, or would you like me to submit this all at once instead?

If the two are unrelated, feel free to commit the snippets already.

Thanks,
Ludo’.

Re: [PATCH]: gnu: shogun: Remove non-free source files.

[Ricardo Wurmus]

[-- Attachment #1: Type: text/plain, Size: 118 bytes --]

Attached is a patch to remove non-free source files as well as anything
in a "#ifdef USE_SVMLIGHT ... #endif" block.


[-- Warning: decoded text below may be mangled, UTF-8 assumed --]
[-- Attachment #2: 0001-gnu-shogun-Remove-non-free-source-files.patch --]
[-- Type: text/x-patch, Size: 2700 bytes --]

From d409756bd2fc2db396d6257cfed42a213f6f43f6 Mon Sep 17 00:00:00 2001
From: Ricardo Wurmus <ricardo.wurmus@mdc-berlin.de>
Date: Fri, 8 May 2015 16:53:28 +0200
Subject: [PATCH] gnu: shogun: Remove non-free source files.

* gnu/packages/bioinformatics.scm (shogun)[source]: Add snippet to remove
  non-free sources.
---
 gnu/packages/bioinformatics.scm | 36 +++++++++++++++++++++++++++++++++++-
 1 file changed, 35 insertions(+), 1 deletion(-)

diff --git a/gnu/packages/bioinformatics.scm b/gnu/packages/bioinformatics.scm
index fa7ff4c..e1dfda1 100644
--- a/gnu/packages/bioinformatics.scm
+++ b/gnu/packages/bioinformatics.scm
@@ -1605,7 +1605,41 @@ against local background noises.")
              "/sources/shogun-" version ".tar.bz2"))
        (sha256
         (base32
-         "159nlijnb7mnrv9za80wnm1shwvy45hgrqzn51hxy7gw4z6d6fdb"))))
+         "159nlijnb7mnrv9za80wnm1shwvy45hgrqzn51hxy7gw4z6d6fdb"))
+       (modules '((guix build utils)
+                  (ice-9 rdelim)))
+       (snippet
+        '(begin
+           ;; Remove non-free sources and files referencing them
+           (for-each delete-file
+                     (find-files "src/shogun/classifier/svm/"
+                                 "SVMLight\\.(cpp|h)"))
+           (for-each delete-file
+                     (find-files "examples/undocumented/libshogun/"
+                                 (string-append
+                                  "(classifier_.*svmlight.*|"
+                                  "evaluation_cross_validation_locked_comparison).cpp")))
+           ;; Remove non-free functions.
+           (for-each
+            (lambda (file)
+              (with-atomic-file-replacement file
+                (lambda (in out)
+                  (let loop ((line (read-line in 'concat))
+                             (skipping? #f))
+                    (if (eof-object? line)
+                        #t
+                        (let ((skip-next?
+                               (or (and skipping?
+                                        (not (string-prefix?
+                                              "#endif //USE_SVMLIGHT" line)))
+                                   (string-prefix?
+                                    "#ifdef USE_SVMLIGHT" line))))
+                          (when (or (not skipping?)
+                                    (and skipping? (not skip-next?)))
+                            (display line out))
+                          (loop (read-line in 'concat) skip-next?)))))))
+            (find-files "src/shogun/kernel/"
+                        "^Kernel\\.(cpp|h)"))))))
     (build-system cmake-build-system)
     (arguments
      '(#:tests? #f ;no check target
-- 
2.1.0

Re: [PATCH]: gnu: shogun: Remove non-free source files.

[Ludovic Courtès]

Ricardo Wurmus <ricardo.wurmus@mdc-berlin.de> skribis:

> Attached is a patch to remove non-free source files as well as anything
> in a "#ifdef USE_SVMLIGHT ... #endif" block.

Good!

> From d409756bd2fc2db396d6257cfed42a213f6f43f6 Mon Sep 17 00:00:00 2001
> From: Ricardo Wurmus <ricardo.wurmus@mdc-berlin.de>
> Date: Fri, 8 May 2015 16:53:28 +0200
> Subject: [PATCH] gnu: shogun: Remove non-free source files.
>
> * gnu/packages/bioinformatics.scm (shogun)[source]: Add snippet to remove
>   non-free sources.

[...]

> +           ;; Remove non-free functions.
> +           (for-each
> +            (lambda (file)
> +              (with-atomic-file-replacement file
> +                (lambda (in out)
> +                  (let loop ((line (read-line in 'concat))
> +                             (skipping? #f))
> +                    (if (eof-object? line)
> +                        #t
> +                        (let ((skip-next?
> +                               (or (and skipping?
> +                                        (not (string-prefix?
> +                                              "#endif //USE_SVMLIGHT" line)))
> +                                   (string-prefix?
> +                                    "#ifdef USE_SVMLIGHT" line))))
> +                          (when (or (not skipping?)
> +                                    (and skipping? (not skip-next?)))
> +                            (display line out))
> +                          (loop (read-line in 'concat) skip-next?)))))))
> +            (find-files "src/shogun/kernel/"
> +                        "^Kernel\\.(cpp|h)"))))))

It would be nicer to give the lambda a name, like:

  (define (delete-ifdefs file)
    ...)

  ...

  (for-each delete-ifdefs (find-files ...))

OK to push with this change.

Thanks for working on it!

Ludo’.

Re: [PATCH]: gnu: shogun: Remove non-free source files.

[Ludovic Courtès]

You may actually be eligible for a GNU buck.  :-)

  http://www.gnu.org/help/gnu-bucks.html

Ludo’.