* [bug#62036] [PATCH] guix: packages: Consider 'patches' by 'package-direct-sources'.
@ 2023-03-07 17:18 Simon Tournier
2023-03-09 19:43 ` Josselin Poiret via Guix-patches via
2023-03-11 16:51 ` [bug#62036] [PATCH v2] " Simon Tournier
0 siblings, 2 replies; 6+ messages in thread
From: Simon Tournier @ 2023-03-07 17:18 UTC (permalink / raw)
To: 62036
Cc: Simon Tournier, Christopher Baines, Josselin Poiret, ludo,
Mathieu Othacehe, Ricardo Wurmus, Simon Tournier,
Tobias Geerinckx-Rice
* guix/packages.scm (package-direct-sources): Return 'origin' from 'patches'.
* tests/packages.scm: Test it.
---
guix/packages.scm | 10 ++++++++--
tests/packages.scm | 17 ++++++++++++++++-
2 files changed, 24 insertions(+), 3 deletions(-)
Hi,
This patch improves some coverage when listing all the origins (fixed outputs)
of some packages. The procedure 'packages-direct-sources' already lists the
'origin' as inputs but is missing the 'origin' as 'patches'. For an instance
of such, see the package 'ntp'.
Note that it is not recursive. If an 'origin' is listed in 'patches' or
'inputs' and that origin also contains 'patches' which is another 'origin'
then it will be missed. For now, it is not covered because it somehow adds
complexity without an instance (yet) of such case.
Cheers,
simon
diff --git a/guix/packages.scm b/guix/packages.scm
index 041a872f9d..0f88564ab4 100644
--- a/guix/packages.scm
+++ b/guix/packages.scm
@@ -9,6 +9,7 @@
;;; Copyright © 2021 Chris Marusich <cmmarusich@gmail.com>
;;; Copyright © 2022 Maxime Devos <maximedevos@telenet.be>
;;; Copyright © 2022 jgart <jgart@dismail.de>
+;;; Copyright © 2023 Simon Tournier <zimon.toutoune@gmail.com>
;;;
;;; This file is part of GNU Guix.
;;;
@@ -1239,8 +1240,13 @@ (define-syntax modify-inputs
(define (package-direct-sources package)
"Return all source origins associated with PACKAGE; including origins in
-PACKAGE's inputs."
- `(,@(or (and=> (package-source package) list) '())
+PACKAGE's inputs and patches."
+ (define (expand source)
+ (append
+ (list source)
+ (filter origin? (origin-patches source))))
+
+ `(,@(or (and=> (package-source package) expand) '())
,@(filter-map (match-lambda
((_ (? origin? orig) _ ...)
orig)
diff --git a/tests/packages.scm b/tests/packages.scm
index f58c47817b..27fb918f90 100644
--- a/tests/packages.scm
+++ b/tests/packages.scm
@@ -3,6 +3,7 @@
;;; Copyright © 2018 Jan (janneke) Nieuwenhuizen <janneke@gnu.org>
;;; Copyright © 2021 Maxim Cournoyer <maxim.cournoyer@gmail.com>
;;; Copyright © 2021 Maxime Devos <maximedevos@telenet.be>
+;;; Copyright © 2023 Simon Tournier <zimon.toutoune@gmail.com>
;;;
;;; This file is part of GNU Guix.
;;;
@@ -418,12 +419,15 @@ (define read-at
(let* ((o (dummy-origin))
(u (dummy-origin))
(i (dummy-origin))
+ (j (dummy-origin (patches (list o))))
(a (dummy-package "a"))
(b (dummy-package "b" (inputs (list a i))))
(c (package (inherit b) (source o)))
(d (dummy-package "d"
(build-system trivial-build-system)
- (source u) (inputs (list c)))))
+ (source u) (inputs (list c))))
+ (e (dummy-package "e" (source j)))
+ (f (package (inherit e) (inputs (list u)))))
(test-assert "package-direct-sources, no source"
(null? (package-direct-sources a)))
(test-equal "package-direct-sources, #f source"
@@ -437,6 +441,17 @@ (define read-at
(and (= (length (pk 's-sources s)) 2)
(member o s)
(member i s))))
+ (test-assert "package-direct-sources, with patches"
+ (let ((s (package-direct-sources e)))
+ (and (= (length (pk 's-sources s)) 2)
+ (member o s)
+ (member j s))))
+ (test-assert "package-direct-sources, with patches and inputs"
+ (let ((s (package-direct-sources f)))
+ (and (= (length (pk 's-sources s)) 3)
+ (member o s)
+ (member j s)
+ (member u s))))
(test-assert "package-transitive-sources"
(let ((s (package-transitive-sources d)))
(and (= (length (pk 'd-sources s)) 3)
base-commit: 723fc5df3e964fcecb09c7c6fd48f00f97e2e806
--
2.38.1
^ permalink raw reply related [flat|nested] 6+ messages in thread
* [bug#62036] [PATCH] guix: packages: Consider 'patches' by 'package-direct-sources'.
2023-03-07 17:18 [bug#62036] [PATCH] guix: packages: Consider 'patches' by 'package-direct-sources' Simon Tournier
@ 2023-03-09 19:43 ` Josselin Poiret via Guix-patches via
2023-03-10 11:33 ` Simon Tournier
2023-03-11 16:51 ` [bug#62036] [PATCH v2] " Simon Tournier
1 sibling, 1 reply; 6+ messages in thread
From: Josselin Poiret via Guix-patches via @ 2023-03-09 19:43 UTC (permalink / raw)
To: Simon Tournier, 62036
Cc: Tobias Geerinckx-Rice, Simon Tournier, Mathieu Othacehe, ludo,
Christopher Baines, Ricardo Wurmus
[-- Attachment #1: Type: text/plain, Size: 605 bytes --]
Hi Simon,
Simon Tournier <zimon.toutoune@gmail.com> writes:
> (define (package-direct-sources package)
> "Return all source origins associated with PACKAGE; including origins in
> -PACKAGE's inputs."
> - `(,@(or (and=> (package-source package) list) '())
> +PACKAGE's inputs and patches."
> + (define (expand source)
> + (append
> + (list source)
> + (filter origin? (origin-patches source))))
* cough * (cons source (filter ...)) * cough *
Other than that, LGTM! Tests worked fine on my end. No idea what this
is used for though :p
Best,
--
Josselin Poiret
[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 682 bytes --]
^ permalink raw reply [flat|nested] 6+ messages in thread
* [bug#62036] [PATCH] guix: packages: Consider 'patches' by 'package-direct-sources'.
2023-03-09 19:43 ` Josselin Poiret via Guix-patches via
@ 2023-03-10 11:33 ` Simon Tournier
2023-03-10 12:12 ` Josselin Poiret via Guix-patches via
0 siblings, 1 reply; 6+ messages in thread
From: Simon Tournier @ 2023-03-10 11:33 UTC (permalink / raw)
To: Josselin Poiret, 62036
Cc: Ricardo Wurmus, Mathieu Othacehe, ludo, Tobias Geerinckx-Rice,
Christopher Baines
Hi Josselin,
On jeu., 09 mars 2023 at 20:43, Josselin Poiret via Guix-patches via <guix-patches@gnu.org> wrote:
>> + (append
>> + (list source)
>> + (filter origin? (origin-patches source))))
>
> * cough * (cons source (filter ...)) * cough *
Ahah! Somehow I removed from my mental toolbox cons, car and cdr
because I am spending too much time explaining to non-lispers. :-)
Thanks for showing me the light. ;-)
> Other than that, LGTM! Tests worked fine on my end. No idea what this
> is used for though :p
For instance, it can be used to list all the ’origin’ of a package.
Consider the package ’tensorflow’, it reads,
--8<---------------cut here---------------start------------->8---
(native-inputs
[...]
;; The commit hashes and URLs for third-party source code are taken
;; from "tensorflow/workspace.bzl".
("boringssl-src"
,(let ((commit "ee7aa02")
(revision "1"))
(origin
(method git-fetch)
(uri (git-reference
(url "https://boringssl.googlesource.com/boringssl")
--8<---------------cut here---------------end--------------->8---
where some inputs are not packages but just ’origin’. Therefore, the
procedure allows to get all the ’origin’, the one from the field
’origin’ and also the ones from inputs.
--8<---------------cut here---------------start------------->8---
scheme@(guix-user)> ,use(gnu packages machine-learning)
scheme@(guix-user)> ,pp (map origin-uri (package-direct-sources tensorflow))
$1 = (#<<git-reference> url: "https://github.com/tensorflow/tensorflow" commit: "v1.9.0" recursive?: #f>
#<<git-reference> url: "https://boringssl.googlesource.com/boringssl" commit: "ee7aa02" recursive?: #f>
[...]
--8<---------------cut here---------------end--------------->8---
For some packages as ’ntp’, the patches are also a list of ’origin’,
--8<---------------cut here---------------start------------->8---
(origin
(method url-fetch)
(uri (list (string-append
"https://www.eecis.udel.edu/~ntp/ntp_spool/ntp4/ntp-"
[...]
;; Add an upstream patch to fix build with GCC 10. Taken from
;; <https://bugs.ntp.org/show_bug.cgi?id=3688>.
(patches (list (origin
(method url-fetch)
(uri "https://bugs.ntp.org/attachment.cgi?id=1760&action=diff&context=patch&collapsed=&headers=1&format=raw")
[...]
--8<---------------cut here---------------end--------------->8---
and the patch allows to also extract them:
--8<---------------cut here---------------start------------->8---
scheme@(guix-user)> ,use(gnu packages ntp)
scheme@(guix-user)> ,pp (map origin-uri (package-direct-sources ntp))
$2 = (("https://www.eecis.udel.edu/~ntp/ntp_spool/ntp4/ntp-4.2/ntp-4.2.8p15.tar.gz"
"http://archive.ntp.org/ntp4/ntp-4.2/ntp-4.2.8p15.tar.gz")
"https://bugs.ntp.org/attachment.cgi?id=1760&action=diff&context=patch&collapsed=&headers=1&format=raw"
"https://bugs.ntp.org/attachment.cgi?id=1814&action=diff&collapsed=&headers=1&format=raw")
--8<---------------cut here---------------end--------------->8---
This way it improves the coverage with Software Heritage. All the
source code (origin) is extracted and feed some SWH loader. The code is
there:
https://git.savannah.gnu.org/cgit/guix/maintenance.git/tree/hydra/build-package-metadata.scm#n58
Cheers,
simon
^ permalink raw reply [flat|nested] 6+ messages in thread
* [bug#62036] [PATCH] guix: packages: Consider 'patches' by 'package-direct-sources'.
2023-03-10 11:33 ` Simon Tournier
@ 2023-03-10 12:12 ` Josselin Poiret via Guix-patches via
0 siblings, 0 replies; 6+ messages in thread
From: Josselin Poiret via Guix-patches via @ 2023-03-10 12:12 UTC (permalink / raw)
To: Simon Tournier, 62036
Cc: Ricardo Wurmus, Mathieu Othacehe, ludo, Tobias Geerinckx-Rice,
Christopher Baines
[-- Attachment #1: Type: text/plain, Size: 408 bytes --]
Hi Simon,
Simon Tournier <zimon.toutoune@gmail.com> writes:
> This way it improves the coverage with Software Heritage. All the
> source code (origin) is extracted and feed some SWH loader. The code is
> there:
>
> https://git.savannah.gnu.org/cgit/guix/maintenance.git/tree/hydra/build-package-metadata.scm#n58
Ahh, that's the part I was missing. Great work!
Best,
--
Josselin Poiret
[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 682 bytes --]
^ permalink raw reply [flat|nested] 6+ messages in thread
* [bug#62036] [PATCH v2] guix: packages: Consider 'patches' by 'package-direct-sources'.
2023-03-07 17:18 [bug#62036] [PATCH] guix: packages: Consider 'patches' by 'package-direct-sources' Simon Tournier
2023-03-09 19:43 ` Josselin Poiret via Guix-patches via
@ 2023-03-11 16:51 ` Simon Tournier
2023-03-13 11:14 ` bug#62036: " Ludovic Courtès
1 sibling, 1 reply; 6+ messages in thread
From: Simon Tournier @ 2023-03-11 16:51 UTC (permalink / raw)
To: 62036
Cc: Josselin Poiret, Tobias Geerinckx-Rice, Simon Tournier,
Mathieu Othacehe, ludo, Christopher Baines, Ricardo Wurmus
* guix/packages.scm (package-direct-sources): Return 'origin' from 'patches'.
* tests/packages.scm: Test it.
---
guix/packages.scm | 10 ++++++++--
tests/packages.scm | 17 ++++++++++++++++-
2 files changed, 24 insertions(+), 3 deletions(-)
diff --git a/guix/packages.scm b/guix/packages.scm
index 041a872f9d..7b098e21f0 100644
--- a/guix/packages.scm
+++ b/guix/packages.scm
@@ -9,6 +9,7 @@
;;; Copyright © 2021 Chris Marusich <cmmarusich@gmail.com>
;;; Copyright © 2022 Maxime Devos <maximedevos@telenet.be>
;;; Copyright © 2022 jgart <jgart@dismail.de>
+;;; Copyright © 2023 Simon Tournier <zimon.toutoune@gmail.com>
;;;
;;; This file is part of GNU Guix.
;;;
@@ -1239,8 +1240,13 @@ (define-syntax modify-inputs
(define (package-direct-sources package)
"Return all source origins associated with PACKAGE; including origins in
-PACKAGE's inputs."
- `(,@(or (and=> (package-source package) list) '())
+PACKAGE's inputs and patches."
+ (define (expand source)
+ (cons
+ source
+ (filter origin? (origin-patches source))))
+
+ `(,@(or (and=> (package-source package) expand) '())
,@(filter-map (match-lambda
((_ (? origin? orig) _ ...)
orig)
diff --git a/tests/packages.scm b/tests/packages.scm
index f58c47817b..27fb918f90 100644
--- a/tests/packages.scm
+++ b/tests/packages.scm
@@ -3,6 +3,7 @@
;;; Copyright © 2018 Jan (janneke) Nieuwenhuizen <janneke@gnu.org>
;;; Copyright © 2021 Maxim Cournoyer <maxim.cournoyer@gmail.com>
;;; Copyright © 2021 Maxime Devos <maximedevos@telenet.be>
+;;; Copyright © 2023 Simon Tournier <zimon.toutoune@gmail.com>
;;;
;;; This file is part of GNU Guix.
;;;
@@ -418,12 +419,15 @@ (define read-at
(let* ((o (dummy-origin))
(u (dummy-origin))
(i (dummy-origin))
+ (j (dummy-origin (patches (list o))))
(a (dummy-package "a"))
(b (dummy-package "b" (inputs (list a i))))
(c (package (inherit b) (source o)))
(d (dummy-package "d"
(build-system trivial-build-system)
- (source u) (inputs (list c)))))
+ (source u) (inputs (list c))))
+ (e (dummy-package "e" (source j)))
+ (f (package (inherit e) (inputs (list u)))))
(test-assert "package-direct-sources, no source"
(null? (package-direct-sources a)))
(test-equal "package-direct-sources, #f source"
@@ -437,6 +441,17 @@ (define read-at
(and (= (length (pk 's-sources s)) 2)
(member o s)
(member i s))))
+ (test-assert "package-direct-sources, with patches"
+ (let ((s (package-direct-sources e)))
+ (and (= (length (pk 's-sources s)) 2)
+ (member o s)
+ (member j s))))
+ (test-assert "package-direct-sources, with patches and inputs"
+ (let ((s (package-direct-sources f)))
+ (and (= (length (pk 's-sources s)) 3)
+ (member o s)
+ (member j s)
+ (member u s))))
(test-assert "package-transitive-sources"
(let ((s (package-transitive-sources d)))
(and (= (length (pk 'd-sources s)) 3)
base-commit: 7376424844e0dc1103a9d86799c2fb9bd4aa35eb
--
2.38.1
^ permalink raw reply related [flat|nested] 6+ messages in thread
* bug#62036: [PATCH v2] guix: packages: Consider 'patches' by 'package-direct-sources'.
2023-03-11 16:51 ` [bug#62036] [PATCH v2] " Simon Tournier
@ 2023-03-13 11:14 ` Ludovic Courtès
0 siblings, 0 replies; 6+ messages in thread
From: Ludovic Courtès @ 2023-03-13 11:14 UTC (permalink / raw)
To: Simon Tournier
Cc: Josselin Poiret, Tobias Geerinckx-Rice, 62036-done,
Mathieu Othacehe, Christopher Baines, Ricardo Wurmus
Hello,
Simon Tournier <zimon.toutoune@gmail.com> skribis:
> * guix/packages.scm (package-direct-sources): Return 'origin' from 'patches'.
> * tests/packages.scm: Test it.
Applied, thanks!
Ludo’.
^ permalink raw reply [flat|nested] 6+ messages in thread
end of thread, other threads:[~2023-03-13 11:16 UTC | newest]
Thread overview: 6+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2023-03-07 17:18 [bug#62036] [PATCH] guix: packages: Consider 'patches' by 'package-direct-sources' Simon Tournier
2023-03-09 19:43 ` Josselin Poiret via Guix-patches via
2023-03-10 11:33 ` Simon Tournier
2023-03-10 12:12 ` Josselin Poiret via Guix-patches via
2023-03-11 16:51 ` [bug#62036] [PATCH v2] " Simon Tournier
2023-03-13 11:14 ` bug#62036: " Ludovic Courtès
Code repositories for project(s) associated with this public inbox
https://git.savannah.gnu.org/cgit/guix.git
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).