* [bug#71121] [PATCH 0/3] Update LibreWolf to 126.0-1 [security fixes]
@ 2024-05-22 14:53 Ian Eure
2024-05-22 14:59 ` [bug#71121] [PATCH 1/3] gnu: all-mozilla-locales: Add Santali locale; make public Ian Eure
2024-05-30 22:39 ` [bug#71121] [PATCH v2 1/3] gnu: all-mozilla-locales: Add Santali locale; make public Ian Eure
0 siblings, 2 replies; 12+ messages in thread
From: Ian Eure @ 2024-05-22 14:53 UTC (permalink / raw)
To: 71121; +Cc: Ian Eure
This patch series changes how LibreWolf is built, and updates it to 126.0-1,
which contains fixes for: CVE-2024-4367, CVE-2024-4764, CVE-2024-4765,
CVE-2024-4766, CVE-2024-4767, CVE-2024-4768, CVE-2024-4769, CVE-2024-4770,
CVE-2024-4771, CVE-2024-4772, CVE-2024-4773, CVE-2024-4774, CVE-2024-4775,
CVE-2024-4776, CVE-2024-4777, CVE-2024-4778.
Previously, LibreWolf has built from the upstream source release tarballs,
which are generated with an automated process: a script downloads the Firefox
source, patches it, and repacks it into the LibreWolf source tarball. This
process is now automated into the Guix package builds, so things are built
directly from the LibreWolf source repo and Firefox upstream release tarball.
This is how IceCat builds, and means we don't have to trust the results of an
external build process. This necessitated making all-mozilla-locales public
in (gnu packages gnuzilla), and adding the Santali locale to it.
LibreWolf 126.0-1 backports a fix for the encoding_rs library, needed to make
it build on newer versions of Rust. Unfortunately, this also fails to build
on Rust 1.75, which is what's currently in Guix. It was necessary to back
this out to get things building, and it'll likely need to be reapplied once
the rust-team branch merges.
Ian Eure (3):
gnu: all-mozilla-locales: Add Santali locale; make public.
gnu: librewolf: Rebuild source tarball
gnu: librewolf: Update to 126.0-1.
gnu/packages/gnuzilla.scm | 3 +-
gnu/packages/librewolf.scm | 127 +++++++++++++++++++++++++++++++++----
2 files changed, 116 insertions(+), 14 deletions(-)
--
2.41.0
^ permalink raw reply [flat|nested] 12+ messages in thread
* [bug#71121] [PATCH 1/3] gnu: all-mozilla-locales: Add Santali locale; make public.
2024-05-22 14:53 [bug#71121] [PATCH 0/3] Update LibreWolf to 126.0-1 [security fixes] Ian Eure
@ 2024-05-22 14:59 ` Ian Eure
2024-05-22 14:59 ` [bug#71121] [PATCH 2/3] gnu: librewolf: Rebuild source tarball Ian Eure
2024-05-22 14:59 ` [bug#71121] [PATCH 3/3] gnu: librewolf: Update to 126.0-1 Ian Eure
2024-05-30 22:39 ` [bug#71121] [PATCH v2 1/3] gnu: all-mozilla-locales: Add Santali locale; make public Ian Eure
1 sibling, 2 replies; 12+ messages in thread
From: Ian Eure @ 2024-05-22 14:59 UTC (permalink / raw)
To: 71121; +Cc: Ian Eure
* gnu/packages/gnuzilla.scm (all-mozilla-locales): Adds the Santali locale,
and makes all-mozilla-locales public, so it can be used with LibreWolf.
Change-Id: Ice49c9b37f8896b8fa963146a754ab28b8571b68
---
gnu/packages/gnuzilla.scm | 3 ++-
1 file changed, 2 insertions(+), 1 deletion(-)
diff --git a/gnu/packages/gnuzilla.scm b/gnu/packages/gnuzilla.scm
index 814b610bba..2188179128 100644
--- a/gnu/packages/gnuzilla.scm
+++ b/gnu/packages/gnuzilla.scm
@@ -414,7 +414,7 @@ (define (update-mozilla-locales changesets.json)
(format #t "~{~s~%~}" data)
data))))
-(define all-mozilla-locales
+(define-public all-mozilla-locales
(mozilla-locales
;; sha256 changeset locale
;;---------------------------------------------------------------------------
@@ -495,6 +495,7 @@ (define all-mozilla-locales
("0c8dl12n5fjdd3bjaf8idyaxsf8ppbma132vdw8bk2wqnh4cv69a" "92110fd6e211" "rm")
("0mxxy56kj0k5jhjxjv8v4zz57pha819mz7j803lcilax7w52wgca" "5eeba1f64743" "ro")
("0jrd95n108r4sxdwgy39zjynm5nlzzmiijsfpxxfwj7886wl4faz" "47131134e349" "ru")
+ ("1lwm5jv3hvjp84a70186x2083nhr3mfcl7kpmw5in9amaflfi41b" "a5cd6d3d67ee" "sat")
("1q6pn3iixzcas9blf61bhvwgppbsh0am0wdz6a6p9f9978894d73" "880b7986692a" "sc")
("0xndsph4v725q3xcpmxxjb9vxv19sssqnng82m9215cdsv9klgpb" "bf5f6e362f6f" "sco")
("0l70n8817mbmbc09fsnn2aqjj9k9dhad2gmzgphmiilf9mqm2dpf" "1f705c926a99" "si")
--
2.41.0
^ permalink raw reply related [flat|nested] 12+ messages in thread
* [bug#71121] [PATCH 2/3] gnu: librewolf: Rebuild source tarball
2024-05-22 14:59 ` [bug#71121] [PATCH 1/3] gnu: all-mozilla-locales: Add Santali locale; make public Ian Eure
@ 2024-05-22 14:59 ` Ian Eure
2024-05-30 1:30 ` Maxim Cournoyer
2024-05-22 14:59 ` [bug#71121] [PATCH 3/3] gnu: librewolf: Update to 126.0-1 Ian Eure
1 sibling, 1 reply; 12+ messages in thread
From: Ian Eure @ 2024-05-22 14:59 UTC (permalink / raw)
To: 71121; +Cc: Ian Eure
* gnu/packages/librewolf.scm (librewolf): This patch removes an intermediate
step in the build chain. The upstream source tarball is created with an
automated build process, where Firefox sources are fetched, patched, and
repacked. Rather than download the output of that process, as the package has
been, it’s now replicated within the build process, similar to how IceCat
works.
Change-Id: I0f1c2a10252cbbff9b3b3140f6ea3a594df0c97b
---
gnu/packages/librewolf.scm | 120 +++++++++++++++++++++++++++++++++----
1 file changed, 108 insertions(+), 12 deletions(-)
diff --git a/gnu/packages/librewolf.scm b/gnu/packages/librewolf.scm
index fa83857c96..bb8bc8a283 100644
--- a/gnu/packages/librewolf.scm
+++ b/gnu/packages/librewolf.scm
@@ -40,10 +40,12 @@
(define-module (gnu packages librewolf)
+ #:use-module ((srfi srfi-1) #:hide (zip))
#:use-module (guix build-system gnu)
#:use-module (guix build-system cargo)
#:use-module (guix build-system trivial)
#:use-module (guix download)
+ #:use-module (guix git-download)
#:use-module ((guix licenses) #:prefix license:)
#:use-module (guix gexp)
#:use-module (guix packages)
@@ -62,6 +64,7 @@ (define-module (gnu packages librewolf)
#:use-module (gnu packages gl)
#:use-module (gnu packages glib)
#:use-module (gnu packages gnome)
+ #:use-module (gnu packages gnuzilla)
#:use-module (gnu packages gtk)
#:use-module (gnu packages hunspell)
#:use-module (gnu packages icu4c)
@@ -81,6 +84,7 @@ (define-module (gnu packages librewolf)
#:use-module (gnu packages pkg-config)
#:use-module (gnu packages pulseaudio)
#:use-module (gnu packages python)
+ #:use-module (gnu packages python-xyz)
#:use-module (gnu packages rust)
#:use-module (gnu packages rust-apps)
#:use-module (gnu packages speech)
@@ -89,6 +93,109 @@ (define-module (gnu packages librewolf)
#:use-module (gnu packages xdisorg)
#:use-module (gnu packages xorg))
+(define (firefox-source-origin version hash)
+ (origin
+ (method url-fetch)
+ (uri (string-append
+ "https://ftp.mozilla.org/pub/firefox/releases/"
+ version "/source/" "firefox-" version
+ ".source.tar.xz"))
+ (sha256 (base32 hash))))
+
+(define (librewolf-source-origin version hash)
+ (origin
+ (method git-fetch)
+ (uri (git-reference
+ (url "https://codeberg.org/librewolf/source.git")
+ (commit version)
+ (recursive? #t)))
+ (file-name (git-file-name "librewolf-source" version))
+ (sha256 (base32 hash))))
+
+(define computed-origin-method (@@ (guix packages) computed-origin-method))
+
+(define librewolf-source
+ (let* ((ff-src (firefox-source-origin "125.0.2" "16gpd6n52lshvkkha41z7xicggj64dw0qhr5gd07bcxsc4rmdl39"))
+ (version "125.0.2-1")
+ (lw-src (librewolf-source-origin version "17i36s2ny1pv3cz44w0gz48fy4vjfw6vp9jk21j62f5d3dl726x8")))
+
+ (origin
+ (method computed-origin-method)
+ (file-name (string-append "librewolf-" version ".source.tar.gz"))
+ (sha256 #f)
+ (uri
+ (delay
+ (with-imported-modules '((guix build utils))
+ #~(begin
+ (use-modules (guix build utils))
+ (set-path-environment-variable
+ "PATH" '("bin")
+ (list #+python
+ #+(canonical-package bash)
+ #+(canonical-package gnu-make)
+ #+(canonical-package coreutils)
+ #+(canonical-package findutils)
+ #+(canonical-package patch)
+ #+(canonical-package xz)
+ #+(canonical-package sed)
+ #+(canonical-package grep)
+ #+(canonical-package gzip)
+ #+(canonical-package tar)))
+ (set-path-environment-variable
+ "PYTHONPATH"
+ (list #+(format #f "lib/python~a/site-packages"
+ (version-major+minor
+ (package-version python))))
+ '#+(cons python-jsonschema
+ (map second
+ (package-transitive-propagated-inputs
+ python-jsonschema))))
+
+ ;; Copy LibreWolf source into the build directory and make
+ ;; everything writable.
+ (copy-recursively #+lw-src ".")
+ (for-each make-file-writable (find-files "."))
+
+ ;; Patch Makefile to use the upstream source instead of downloading.
+ (substitute* '("Makefile")
+ (("^ff_source_tarball:=.*")
+ (string-append "ff_source_tarball:=" #+ff-src)))
+
+ ;; Stage locales
+ (begin
+ (format #t "Staging locales...~%")
+ (force-output)
+ (mkdir "l10n-staging")
+ (with-directory-excursion "l10n-staging"
+ (for-each
+ (lambda (locale-dir)
+ (let ((locale
+ (string-drop (basename locale-dir)
+ (+ 32 ; length of hash
+ (string-length "-mozilla-locale-")))))
+ (format #t " ~a~%" locale)
+ (force-output)
+ (copy-recursively locale-dir locale
+ #:log (%make-void-port "w"))
+ (for-each make-file-writable (find-files locale))
+ (with-directory-excursion locale
+ (when (file-exists? ".hgtags")
+ (delete-file ".hgtags")))))
+ '#+all-mozilla-locales)))
+
+ ;; Patch build script to use staged locales.
+ (begin
+ (substitute* '("scripts/generate-locales.sh")
+ (("wget") "# wget")
+ (("unzip") "# unzip")
+ (("mv browser/locales/l10n/\\$1-\\*/")
+ "mv ../l10n-staging/$1/")))
+
+ ;; Run the build script
+ (invoke "make" "all")
+ (copy-file (string-append "librewolf-" #$version ".source.tar.gz")
+ #$output))))))))
+
;; Define the versions of rust needed to build librewolf, trying to match
;; upstream. See the file taskcluster/ci/toolchain/rust.yml at
;; https://searchfox.org under the particular firefox release, like
@@ -104,18 +211,7 @@ (define-public librewolf
(package
(name "librewolf")
(version "125.0.2-1")
- (source
- (origin
- (method url-fetch)
-
- (uri (string-append "https://gitlab.com/api/v4/projects/32320088/"
- "packages/generic/librewolf-source/"
- version
- "/librewolf-"
- version
- ".source.tar.gz"))
- (sha256
- (base32 "09qzdaq9l01in9h4q14vyinjvvffycha2iyjqj5p4dd5jh6q5zma"))))
+ (source librewolf-source)
(build-system gnu-build-system)
(arguments
(list
--
2.41.0
^ permalink raw reply related [flat|nested] 12+ messages in thread
* [bug#71121] [PATCH 3/3] gnu: librewolf: Update to 126.0-1.
2024-05-22 14:59 ` [bug#71121] [PATCH 1/3] gnu: all-mozilla-locales: Add Santali locale; make public Ian Eure
2024-05-22 14:59 ` [bug#71121] [PATCH 2/3] gnu: librewolf: Rebuild source tarball Ian Eure
@ 2024-05-22 14:59 ` Ian Eure
1 sibling, 0 replies; 12+ messages in thread
From: Ian Eure @ 2024-05-22 14:59 UTC (permalink / raw)
To: 71121; +Cc: Ian Eure
* gnu/packages/librewolf.scm (librewolf): Update to 126.0-1. Fixes
CVE-2024-4367, CVE-2024-4764, CVE-2024-4765, CVE-2024-4766, CVE-2024-4767,
CVE-2024-4768, CVE-2024-4769, CVE-2024-4770, CVE-2024-4771, CVE-2024-4772,
CVE-2024-4773, CVE-2024-4774, CVE-2024-4775, CVE-2024-4776, CVE-2024-4777,
CVE-2024-4778.
Change-Id: Iec010e516651588da389f747074cbd10f8c14377
---
gnu/packages/librewolf.scm | 13 +++++++++----
1 file changed, 9 insertions(+), 4 deletions(-)
diff --git a/gnu/packages/librewolf.scm b/gnu/packages/librewolf.scm
index bb8bc8a283..c1fed6eef1 100644
--- a/gnu/packages/librewolf.scm
+++ b/gnu/packages/librewolf.scm
@@ -115,9 +115,9 @@ (define (librewolf-source-origin version hash)
(define computed-origin-method (@@ (guix packages) computed-origin-method))
(define librewolf-source
- (let* ((ff-src (firefox-source-origin "125.0.2" "16gpd6n52lshvkkha41z7xicggj64dw0qhr5gd07bcxsc4rmdl39"))
- (version "125.0.2-1")
- (lw-src (librewolf-source-origin version "17i36s2ny1pv3cz44w0gz48fy4vjfw6vp9jk21j62f5d3dl726x8")))
+ (let* ((ff-src (firefox-source-origin "126.0" "09l5hsyrkimmkd7wbhnamy5mwmwwxjfa742hpkjjkhlyk6hq43li"))
+ (version "126.0-1")
+ (lw-src (librewolf-source-origin version "1q8fjki6rgzrir84y7j2anra2w213bm0g74nw205gja9qsxlassc")))
(origin
(method computed-origin-method)
@@ -161,6 +161,11 @@ (define librewolf-source
(("^ff_source_tarball:=.*")
(string-append "ff_source_tarball:=" #+ff-src)))
+ ;; Remove encoding_rs patch, it doesn't build with Rust 1.75.
+ (substitute* '("assets/patches.txt")
+ (("patches/encoding_rs.patch\\\n$")
+ ""))
+
;; Stage locales
(begin
(format #t "Staging locales...~%")
@@ -210,7 +215,7 @@ (define %librewolf-build-id "20240427150329")
(define-public librewolf
(package
(name "librewolf")
- (version "125.0.2-1")
+ (version "126.0-1")
(source librewolf-source)
(build-system gnu-build-system)
(arguments
--
2.41.0
^ permalink raw reply related [flat|nested] 12+ messages in thread
* [bug#71121] [PATCH 2/3] gnu: librewolf: Rebuild source tarball
2024-05-22 14:59 ` [bug#71121] [PATCH 2/3] gnu: librewolf: Rebuild source tarball Ian Eure
@ 2024-05-30 1:30 ` Maxim Cournoyer
2024-05-30 1:48 ` Ian Eure
0 siblings, 1 reply; 12+ messages in thread
From: Maxim Cournoyer @ 2024-05-30 1:30 UTC (permalink / raw)
To: Ian Eure; +Cc: 71121
Hi Ian,
Ian Eure <ian@retrospec.tv> writes:
> * gnu/packages/librewolf.scm (librewolf): This patch removes an intermediate
> step in the build chain. The upstream source tarball is created with an
> automated build process, where Firefox sources are fetched, patched, and
> repacked. Rather than download the output of that process, as the package has
> been, it’s now replicated within the build process, similar to how IceCat
> works.
I think I'd rather keep using a human-prepared and vetted tarball, to
avoid anything going stale in our local recipe of how it's meant to be
prepared. It's also simpler and less maintenance, and arguably shields
the users better against non-free source code (although I don't think
there's anything non-free in the Firefox tree, so that point is more
moot than say, for linux) to use a tarball.
What do you or others think?
--
Thanks,
Maxim
^ permalink raw reply [flat|nested] 12+ messages in thread
* [bug#71121] [PATCH 2/3] gnu: librewolf: Rebuild source tarball
2024-05-30 1:30 ` Maxim Cournoyer
@ 2024-05-30 1:48 ` Ian Eure
2024-05-30 12:54 ` Maxim Cournoyer
0 siblings, 1 reply; 12+ messages in thread
From: Ian Eure @ 2024-05-30 1:48 UTC (permalink / raw)
To: Maxim Cournoyer; +Cc: 71121
Hi Maxim,
Maxim Cournoyer <maxim.cournoyer@gmail.com> writes:
> Hi Ian,
>
> Ian Eure <ian@retrospec.tv> writes:
>
>> * gnu/packages/librewolf.scm (librewolf): This patch removes an
>> intermediate
>> step in the build chain. The upstream source tarball is
>> created with an
>> automated build process, where Firefox sources are fetched,
>> patched, and
>> repacked. Rather than download the output of that process, as
>> the package has
>> been, it’s now replicated within the build process, similar to
>> how IceCat
>> works.
>
> I think I'd rather keep using a human-prepared and vetted
> tarball, to
> avoid anything going stale in our local recipe of how it's meant
> to be
> prepared.
>
The upstream tarball is built by scripts run under a CI system
which triggers when changes are pushed[1], and aren’t
human-prepared or vetted in the same way that many release
tarballs have tradionally been. This patchset uses the same
script as upstream, with modifications to make it reproduceable,
as the upstream process isn’t.
As noted in the commit messages, IceCat also builds this way[2],
including patching the upstream build script[3][4], so this seems
like a reasonable & accepted way to build. Though perhaps there’s
dissatisfaction with the IceCat build which I wasn’t aware of,
being a fairly new contributor.
> It's also simpler and less maintenance, and arguably shields
> the users better against non-free source code (although I don't
> think
> there's anything non-free in the Firefox tree, so that point is
> more
> moot than say, for linux) to use a tarball.
>
> What do you or others think?
>
It’s definitely simpler to use the upstream tarball in most cases,
which is why I went that direction when I initially packaged
LibreWolf. But, since IceCat builds this way, and the xz backdoor
was discovered hiding in the non-reproduceable build process, I’ve
been intending to update the package to control the full build,
rather than trusting an unreproducable external process. I
understand that if the build scripts are backdoored, it doesn’t
matter whether upstream runs them or Guix does, but I believe that
aligning with IceCat and having a reproduceable build directly
from the upstream source repo are worthwhile.
In the specific case of the 126.0-1 release, owning the whole
build process made things easier. Upstream backported a very
large Firefox change[5] which updates a bundled dependency to a
new version; that dependency doesn’t work with Rust 1.75, which is
what’s in Guix. With the Guix build process controlling what
patches get applied, I was able to solve the problem by removing
one line from the manifest of patches to apply to the Firefox
source. If the package builds from the 126.0-1 tarball, it’ll
need to ship a 22,000-line patch(!) to back out that change. That
may still be necessary, depending on the timing of the rust-team
branch merging and the next Firefox release, but at least for now,
things are simpler. Ideally, this wolud be solved by unbundling
that (and the other) vendored Rust libraries (and that’s something
I intend to look into), but I didn’t want to block security fixes
on work with unknown-but-probably-large scope -- there will almost
definitely be Rust libraries currently not packaged in Guix which
need to be addressed.
As far as maintenance burden or things getting stale, the risk is
that upstream alters their scripts, which requires updates to the
Guix patches for them. This doesn’t seem like a major drawback to
me, and I’m the one doing the maintenance. :) Overall, I think
it’s a reasonable tradeoff for the reproducability we gain. If
this approach to building LibreWolf in this patchset is acepted,
I’d like to work with upstream to make their build process more
flexible, ideally running it unmodified in the Guix build, which
would eliminate the risk.
Lastly: I noticed that I neglected to update %librewolf-build-id
when I sent this patchset in. If my arguments are compelling
enough for you, I think it’d make sense to update that when the
changes are pushed (it’s a one-line change & the command to print
an ID are in the comment above the variable). But, if you’d like
a v2 patchset, either just to update that, or to back out the
build process change and replace it with a 22kloc patch, I’d be
happy to handle it instead.
Thank you very much for your thoughts and the time you took to
respond.
— Ian
[1]: https://codeberg.org/librewolf/source/actions/runs/168/jobs/0
[2]:
https://git.savannah.gnu.org/cgit/guix.git/tree/gnu/packages/gnuzilla.scm?id=898b5f30f3d485d48275c920da172863da9524c6#n530
[3]:
https://git.savannah.gnu.org/cgit/guix.git/tree/gnu/packages/gnuzilla.scm?id=898b5f30f3d485d48275c920da172863da9524c6#n571
[4]:
https://git.savannah.gnu.org/cgit/guix.git/tree/gnu/packages/patches/icecat-makeicecat.patch
[5]:
https://codeberg.org/librewolf/source/commit/d292bdd2213a22e5b364339dfee68a27670f1b72
^ permalink raw reply [flat|nested] 12+ messages in thread
* [bug#71121] [PATCH 2/3] gnu: librewolf: Rebuild source tarball
2024-05-30 1:48 ` Ian Eure
@ 2024-05-30 12:54 ` Maxim Cournoyer
2024-06-01 16:30 ` Ian Eure
0 siblings, 1 reply; 12+ messages in thread
From: Maxim Cournoyer @ 2024-05-30 12:54 UTC (permalink / raw)
To: Ian Eure; +Cc: 71121
Hi Ian,
Ian Eure <ian@retrospec.tv> writes:
> Hi Maxim,
>
> Maxim Cournoyer <maxim.cournoyer@gmail.com> writes:
>
>> Hi Ian,
>>
>> Ian Eure <ian@retrospec.tv> writes:
>>
>>> * gnu/packages/librewolf.scm (librewolf): This patch removes an
>>> intermediate
>>> step in the build chain. The upstream source tarball is created
>>> with an
>>> automated build process, where Firefox sources are fetched,
>>> patched, and
>>> repacked. Rather than download the output of that process, as the
>>> package has
>>> been, it’s now replicated within the build process, similar to how
>>> IceCat
>>> works.
>>
>> I think I'd rather keep using a human-prepared and vetted tarball,
>> to
>> avoid anything going stale in our local recipe of how it's meant to
>> be
>> prepared.
>>
>
> The upstream tarball is built by scripts run under a CI system which
> triggers when changes are pushed[1], and aren’t human-prepared or
> vetted in the same way that many release tarballs have tradionally
> been. This patchset uses the same script as upstream, with
> modifications to make it reproduceable, as the upstream process isn’t.
Perhaps the modifications to make it reproducible could be shared to
upstream? We'd benefit all thee users of librewolf this way, not only
Guix ones.
> As noted in the commit messages, IceCat also builds this way[2],
> including patching the upstream build script[3][4], so this seems like
> a reasonable & accepted way to build. Though perhaps there’s
> dissatisfaction with the IceCat build which I wasn’t aware of, being a
> fairly new contributor.
The "dissatisfaction", if we can call it that, was about Linux-libre,
and voiced by some a few years ago, including the project maintainers,
if I recall correctly. The idea of linux-libre is to shield users from
blobs. In this sense it is valuable that they don't even have to touch
the pristine blobbed (there are a few array-defined firmwares in the
tree still, at least one old Apple one IIRC) Linux source, which is
considered problematic for some from a GNU FSDG perspective.
>> It's also simpler and less maintenance, and arguably shields
>> the users better against non-free source code (although I don't
>> think
>> there's anything non-free in the Firefox tree, so that point is more
>> moot than say, for linux) to use a tarball.
>>
>> What do you or others think?
>>
>
> It’s definitely simpler to use the upstream tarball in most cases,
> which is why I went that direction when I initially packaged
> LibreWolf. But, since IceCat builds this way, and the xz backdoor was
> discovered hiding in the non-reproduceable build process, I’ve been
> intending to update the package to control the full build, rather than
> trusting an unreproducable external process. I understand that if the
> build scripts are backdoored, it doesn’t matter whether upstream runs
> them or Guix does, but I believe that aligning with IceCat and having
> a reproduceable build directly from the upstream source repo are
> worthwhile.
Right.
> In the specific case of the 126.0-1 release, owning the whole build
> process made things easier. Upstream backported a very large Firefox
> change[5] which updates a bundled dependency to a new version; that
> dependency doesn’t work with Rust 1.75, which is what’s in Guix. With
> the Guix build process controlling what patches get applied, I was
> able to solve the problem by removing one line from the manifest of
> patches to apply to the Firefox source. If the package builds from
> the 126.0-1 tarball, it’ll need to ship a 22,000-line patch(!) to back
> out that change. That may still be necessary, depending on the timing
> of the rust-team branch merging and the next Firefox release, but at
> least for now, things are simpler. Ideally, this wolud be solved by
> unbundling that (and the other) vendored Rust libraries (and that’s
> something I intend to look into), but I didn’t want to block security
> fixes on work with unknown-but-probably-large scope -- there will
> almost definitely be Rust libraries currently not packaged in Guix
> which need to be addressed.
OK, this flexibility seems indeed useful here.
> As far as maintenance burden or things getting stale, the risk is that
> upstream alters their scripts, which requires updates to the Guix
> patches for them. This doesn’t seem like a major drawback to me, and
> I’m the one doing the maintenance. :) Overall, I think it’s a
> reasonable tradeoff for the reproducability we gain. If this approach
> to building LibreWolf in this patchset is acepted, I’d like to work
> with upstream to make their build process more flexible, ideally
> running it unmodified in the Guix build, which would eliminate the
> risk.
Yes, you are the one doing it (thank you!) until you won't :-)
(life...). Then someone else would have to pick it up and understand
it. The simpler the better.
> Lastly: I noticed that I neglected to update %librewolf-build-id when
> I sent this patchset in. If my arguments are compelling enough for
> you, I think it’d make sense to update that when the changes are
> pushed (it’s a one-line change & the command to print an ID are in the
> comment above the variable). But, if you’d like a v2 patchset, either
> just to update that, or to back out the build process change and
> replace it with a 22kloc patch, I’d be happy to handle it instead.
The 22kloc patch doesn't sound too good... I guess we can stick with the
self-made tarball for now.
> Thank you very much for your thoughts and the time you took to
> respond.
Sorry for the delay handling this security-sensitive issue (still better
than our ungoogled-chromium package which appears untouched for a full
year, though! We should probably open a security issue about that).
If you could send v2 with the build id thing, I'll try to apply it
quickly.
--
Thanks,
Maxim
^ permalink raw reply [flat|nested] 12+ messages in thread
* [bug#71121] [PATCH v2 1/3] gnu: all-mozilla-locales: Add Santali locale; make public.
2024-05-22 14:53 [bug#71121] [PATCH 0/3] Update LibreWolf to 126.0-1 [security fixes] Ian Eure
2024-05-22 14:59 ` [bug#71121] [PATCH 1/3] gnu: all-mozilla-locales: Add Santali locale; make public Ian Eure
@ 2024-05-30 22:39 ` Ian Eure
2024-05-30 22:39 ` [bug#71121] [PATCH v2 2/3] gnu: librewolf: Rebuild source tarball Ian Eure
2024-05-30 22:39 ` [bug#71121] [PATCH v2 3/3] gnu: librewolf: Update to 126.0-1 Ian Eure
1 sibling, 2 replies; 12+ messages in thread
From: Ian Eure @ 2024-05-30 22:39 UTC (permalink / raw)
To: 71121; +Cc: Ian Eure
* gnu/packages/gnuzilla.scm (all-mozilla-locales): Adds the Santali locale,
and makes all-mozilla-locales public, so it can be used with LibreWolf.
Change-Id: Ice49c9b37f8896b8fa963146a754ab28b8571b68
---
gnu/packages/gnuzilla.scm | 3 ++-
1 file changed, 2 insertions(+), 1 deletion(-)
diff --git a/gnu/packages/gnuzilla.scm b/gnu/packages/gnuzilla.scm
index 510cf1baab..abde3fb819 100644
--- a/gnu/packages/gnuzilla.scm
+++ b/gnu/packages/gnuzilla.scm
@@ -422,7 +422,7 @@ (define (update-mozilla-locales changesets.json)
(format #t "~{~s~%~}" data)
data))))
-(define all-mozilla-locales
+(define-public all-mozilla-locales
(mozilla-locales
;; sha256 changeset locale
;;---------------------------------------------------------------------------
@@ -503,6 +503,7 @@ (define all-mozilla-locales
("0c8dl12n5fjdd3bjaf8idyaxsf8ppbma132vdw8bk2wqnh4cv69a" "92110fd6e211" "rm")
("0mxxy56kj0k5jhjxjv8v4zz57pha819mz7j803lcilax7w52wgca" "5eeba1f64743" "ro")
("0jrd95n108r4sxdwgy39zjynm5nlzzmiijsfpxxfwj7886wl4faz" "47131134e349" "ru")
+ ("1lwm5jv3hvjp84a70186x2083nhr3mfcl7kpmw5in9amaflfi41b" "a5cd6d3d67ee" "sat")
("1q6pn3iixzcas9blf61bhvwgppbsh0am0wdz6a6p9f9978894d73" "880b7986692a" "sc")
("0xndsph4v725q3xcpmxxjb9vxv19sssqnng82m9215cdsv9klgpb" "bf5f6e362f6f" "sco")
("0l70n8817mbmbc09fsnn2aqjj9k9dhad2gmzgphmiilf9mqm2dpf" "1f705c926a99" "si")
--
2.41.0
^ permalink raw reply related [flat|nested] 12+ messages in thread
* [bug#71121] [PATCH v2 2/3] gnu: librewolf: Rebuild source tarball
2024-05-30 22:39 ` [bug#71121] [PATCH v2 1/3] gnu: all-mozilla-locales: Add Santali locale; make public Ian Eure
@ 2024-05-30 22:39 ` Ian Eure
2024-05-30 22:39 ` [bug#71121] [PATCH v2 3/3] gnu: librewolf: Update to 126.0-1 Ian Eure
1 sibling, 0 replies; 12+ messages in thread
From: Ian Eure @ 2024-05-30 22:39 UTC (permalink / raw)
To: 71121; +Cc: Ian Eure
* gnu/packages/librewolf.scm (librewolf): This patch removes an intermediate
step in the build chain. The upstream source tarball is created with an
automated build process, where Firefox sources are fetched, patched, and
repacked. Rather than download the output of that process, as the package has
been, it’s now replicated within the build process, similar to how IceCat
works.
Change-Id: I0f1c2a10252cbbff9b3b3140f6ea3a594df0c97b
---
gnu/packages/librewolf.scm | 120 +++++++++++++++++++++++++++++++++----
1 file changed, 108 insertions(+), 12 deletions(-)
diff --git a/gnu/packages/librewolf.scm b/gnu/packages/librewolf.scm
index fa83857c96..bb8bc8a283 100644
--- a/gnu/packages/librewolf.scm
+++ b/gnu/packages/librewolf.scm
@@ -40,10 +40,12 @@
(define-module (gnu packages librewolf)
+ #:use-module ((srfi srfi-1) #:hide (zip))
#:use-module (guix build-system gnu)
#:use-module (guix build-system cargo)
#:use-module (guix build-system trivial)
#:use-module (guix download)
+ #:use-module (guix git-download)
#:use-module ((guix licenses) #:prefix license:)
#:use-module (guix gexp)
#:use-module (guix packages)
@@ -62,6 +64,7 @@ (define-module (gnu packages librewolf)
#:use-module (gnu packages gl)
#:use-module (gnu packages glib)
#:use-module (gnu packages gnome)
+ #:use-module (gnu packages gnuzilla)
#:use-module (gnu packages gtk)
#:use-module (gnu packages hunspell)
#:use-module (gnu packages icu4c)
@@ -81,6 +84,7 @@ (define-module (gnu packages librewolf)
#:use-module (gnu packages pkg-config)
#:use-module (gnu packages pulseaudio)
#:use-module (gnu packages python)
+ #:use-module (gnu packages python-xyz)
#:use-module (gnu packages rust)
#:use-module (gnu packages rust-apps)
#:use-module (gnu packages speech)
@@ -89,6 +93,109 @@ (define-module (gnu packages librewolf)
#:use-module (gnu packages xdisorg)
#:use-module (gnu packages xorg))
+(define (firefox-source-origin version hash)
+ (origin
+ (method url-fetch)
+ (uri (string-append
+ "https://ftp.mozilla.org/pub/firefox/releases/"
+ version "/source/" "firefox-" version
+ ".source.tar.xz"))
+ (sha256 (base32 hash))))
+
+(define (librewolf-source-origin version hash)
+ (origin
+ (method git-fetch)
+ (uri (git-reference
+ (url "https://codeberg.org/librewolf/source.git")
+ (commit version)
+ (recursive? #t)))
+ (file-name (git-file-name "librewolf-source" version))
+ (sha256 (base32 hash))))
+
+(define computed-origin-method (@@ (guix packages) computed-origin-method))
+
+(define librewolf-source
+ (let* ((ff-src (firefox-source-origin "125.0.2" "16gpd6n52lshvkkha41z7xicggj64dw0qhr5gd07bcxsc4rmdl39"))
+ (version "125.0.2-1")
+ (lw-src (librewolf-source-origin version "17i36s2ny1pv3cz44w0gz48fy4vjfw6vp9jk21j62f5d3dl726x8")))
+
+ (origin
+ (method computed-origin-method)
+ (file-name (string-append "librewolf-" version ".source.tar.gz"))
+ (sha256 #f)
+ (uri
+ (delay
+ (with-imported-modules '((guix build utils))
+ #~(begin
+ (use-modules (guix build utils))
+ (set-path-environment-variable
+ "PATH" '("bin")
+ (list #+python
+ #+(canonical-package bash)
+ #+(canonical-package gnu-make)
+ #+(canonical-package coreutils)
+ #+(canonical-package findutils)
+ #+(canonical-package patch)
+ #+(canonical-package xz)
+ #+(canonical-package sed)
+ #+(canonical-package grep)
+ #+(canonical-package gzip)
+ #+(canonical-package tar)))
+ (set-path-environment-variable
+ "PYTHONPATH"
+ (list #+(format #f "lib/python~a/site-packages"
+ (version-major+minor
+ (package-version python))))
+ '#+(cons python-jsonschema
+ (map second
+ (package-transitive-propagated-inputs
+ python-jsonschema))))
+
+ ;; Copy LibreWolf source into the build directory and make
+ ;; everything writable.
+ (copy-recursively #+lw-src ".")
+ (for-each make-file-writable (find-files "."))
+
+ ;; Patch Makefile to use the upstream source instead of downloading.
+ (substitute* '("Makefile")
+ (("^ff_source_tarball:=.*")
+ (string-append "ff_source_tarball:=" #+ff-src)))
+
+ ;; Stage locales
+ (begin
+ (format #t "Staging locales...~%")
+ (force-output)
+ (mkdir "l10n-staging")
+ (with-directory-excursion "l10n-staging"
+ (for-each
+ (lambda (locale-dir)
+ (let ((locale
+ (string-drop (basename locale-dir)
+ (+ 32 ; length of hash
+ (string-length "-mozilla-locale-")))))
+ (format #t " ~a~%" locale)
+ (force-output)
+ (copy-recursively locale-dir locale
+ #:log (%make-void-port "w"))
+ (for-each make-file-writable (find-files locale))
+ (with-directory-excursion locale
+ (when (file-exists? ".hgtags")
+ (delete-file ".hgtags")))))
+ '#+all-mozilla-locales)))
+
+ ;; Patch build script to use staged locales.
+ (begin
+ (substitute* '("scripts/generate-locales.sh")
+ (("wget") "# wget")
+ (("unzip") "# unzip")
+ (("mv browser/locales/l10n/\\$1-\\*/")
+ "mv ../l10n-staging/$1/")))
+
+ ;; Run the build script
+ (invoke "make" "all")
+ (copy-file (string-append "librewolf-" #$version ".source.tar.gz")
+ #$output))))))))
+
;; Define the versions of rust needed to build librewolf, trying to match
;; upstream. See the file taskcluster/ci/toolchain/rust.yml at
;; https://searchfox.org under the particular firefox release, like
@@ -104,18 +211,7 @@ (define-public librewolf
(package
(name "librewolf")
(version "125.0.2-1")
- (source
- (origin
- (method url-fetch)
-
- (uri (string-append "https://gitlab.com/api/v4/projects/32320088/"
- "packages/generic/librewolf-source/"
- version
- "/librewolf-"
- version
- ".source.tar.gz"))
- (sha256
- (base32 "09qzdaq9l01in9h4q14vyinjvvffycha2iyjqj5p4dd5jh6q5zma"))))
+ (source librewolf-source)
(build-system gnu-build-system)
(arguments
(list
--
2.41.0
^ permalink raw reply related [flat|nested] 12+ messages in thread
* [bug#71121] [PATCH v2 3/3] gnu: librewolf: Update to 126.0-1.
2024-05-30 22:39 ` [bug#71121] [PATCH v2 1/3] gnu: all-mozilla-locales: Add Santali locale; make public Ian Eure
2024-05-30 22:39 ` [bug#71121] [PATCH v2 2/3] gnu: librewolf: Rebuild source tarball Ian Eure
@ 2024-05-30 22:39 ` Ian Eure
2024-06-01 11:33 ` bug#71121: " Maxim Cournoyer
1 sibling, 1 reply; 12+ messages in thread
From: Ian Eure @ 2024-05-30 22:39 UTC (permalink / raw)
To: 71121; +Cc: Ian Eure
* gnu/packages/librewolf.scm (librewolf): Update to 126.0-1. Fixes
CVE-2024-4367, CVE-2024-4764, CVE-2024-4765, CVE-2024-4766, CVE-2024-4767,
CVE-2024-4768, CVE-2024-4769, CVE-2024-4770, CVE-2024-4771, CVE-2024-4772,
CVE-2024-4773, CVE-2024-4774, CVE-2024-4775, CVE-2024-4776, CVE-2024-4777,
CVE-2024-4778.
Change-Id: Iec010e516651588da389f747074cbd10f8c14377
---
gnu/packages/librewolf.scm | 15 ++++++++++-----
1 file changed, 10 insertions(+), 5 deletions(-)
diff --git a/gnu/packages/librewolf.scm b/gnu/packages/librewolf.scm
index bb8bc8a283..80b942ec12 100644
--- a/gnu/packages/librewolf.scm
+++ b/gnu/packages/librewolf.scm
@@ -115,9 +115,9 @@ (define (librewolf-source-origin version hash)
(define computed-origin-method (@@ (guix packages) computed-origin-method))
(define librewolf-source
- (let* ((ff-src (firefox-source-origin "125.0.2" "16gpd6n52lshvkkha41z7xicggj64dw0qhr5gd07bcxsc4rmdl39"))
- (version "125.0.2-1")
- (lw-src (librewolf-source-origin version "17i36s2ny1pv3cz44w0gz48fy4vjfw6vp9jk21j62f5d3dl726x8")))
+ (let* ((ff-src (firefox-source-origin "126.0" "09l5hsyrkimmkd7wbhnamy5mwmwwxjfa742hpkjjkhlyk6hq43li"))
+ (version "126.0-1")
+ (lw-src (librewolf-source-origin version "1q8fjki6rgzrir84y7j2anra2w213bm0g74nw205gja9qsxlassc")))
(origin
(method computed-origin-method)
@@ -161,6 +161,11 @@ (define librewolf-source
(("^ff_source_tarball:=.*")
(string-append "ff_source_tarball:=" #+ff-src)))
+ ;; Remove encoding_rs patch, it doesn't build with Rust 1.75.
+ (substitute* '("assets/patches.txt")
+ (("patches/encoding_rs.patch\\\n$")
+ ""))
+
;; Stage locales
(begin
(format #t "Staging locales...~%")
@@ -205,12 +210,12 @@ (define rust-librewolf rust) ; 1.75 is the default in Guix, 1.65 is the minimum.
;; Update this id with every update to its release date.
;; It's used for cache validation and therefore can lead to strange bugs.
;; ex: date '+%Y%m%d%H%M%S'
-(define %librewolf-build-id "20240427150329")
+(define %librewolf-build-id "20240530072108")
(define-public librewolf
(package
(name "librewolf")
- (version "125.0.2-1")
+ (version "126.0-1")
(source librewolf-source)
(build-system gnu-build-system)
(arguments
--
2.41.0
^ permalink raw reply related [flat|nested] 12+ messages in thread
* bug#71121: [PATCH v2 3/3] gnu: librewolf: Update to 126.0-1.
2024-05-30 22:39 ` [bug#71121] [PATCH v2 3/3] gnu: librewolf: Update to 126.0-1 Ian Eure
@ 2024-06-01 11:33 ` Maxim Cournoyer
0 siblings, 0 replies; 12+ messages in thread
From: Maxim Cournoyer @ 2024-06-01 11:33 UTC (permalink / raw)
To: Ian Eure; +Cc: 71121-done
Hi Ian,
Ian Eure <ian@retrospec.tv> writes:
> * gnu/packages/librewolf.scm (librewolf): Update to 126.0-1. Fixes
> CVE-2024-4367, CVE-2024-4764, CVE-2024-4765, CVE-2024-4766, CVE-2024-4767,
> CVE-2024-4768, CVE-2024-4769, CVE-2024-4770, CVE-2024-4771, CVE-2024-4772,
> CVE-2024-4773, CVE-2024-4774, CVE-2024-4775, CVE-2024-4776, CVE-2024-4777,
> CVE-2024-4778.
>
> Change-Id: Iec010e516651588da389f747074cbd10f8c14377
I've moved some of the commit message explanations to match the
following template:
--8<---------------cut here---------------start------------->8---
$summary
$rationale/explanations
$gnu-changelog
--8<---------------cut here---------------end--------------->8---
along with some trivial adjustments, tested it could build reproducibly*
and pushed. Thank you for your work on this fine browser!
* as mentioned on IRC I did notice the build failing
non-deterministically when using a monstrous number of cores such as
180; that seems to be a shortcoming of cargo and/or the firefox build
system.
--
Thanks,
Maxim
^ permalink raw reply [flat|nested] 12+ messages in thread
* [bug#71121] [PATCH 2/3] gnu: librewolf: Rebuild source tarball
2024-05-30 12:54 ` Maxim Cournoyer
@ 2024-06-01 16:30 ` Ian Eure
0 siblings, 0 replies; 12+ messages in thread
From: Ian Eure @ 2024-06-01 16:30 UTC (permalink / raw)
To: Maxim Cournoyer; +Cc: 71121
Maxim Cournoyer <maxim.cournoyer@gmail.com> writes:
> Hi Ian,
>
> Ian Eure <ian@retrospec.tv> writes:
>
>> Hi Maxim,
>>
>> Maxim Cournoyer <maxim.cournoyer@gmail.com> writes:
>>
>>> Hi Ian,
>>>
>>> Ian Eure <ian@retrospec.tv> writes:
>>>
>>>> * gnu/packages/librewolf.scm (librewolf): This patch removes
>>>> an
>>>> intermediate
>>>> step in the build chain. The upstream source tarball is
>>>> created
>>>> with an
>>>> automated build process, where Firefox sources are fetched,
>>>> patched, and
>>>> repacked. Rather than download the output of that process,
>>>> as the
>>>> package has
>>>> been, it’s now replicated within the build process, similar
>>>> to how
>>>> IceCat
>>>> works.
>>>
>>> I think I'd rather keep using a human-prepared and vetted
>>> tarball,
>>> to
>>> avoid anything going stale in our local recipe of how it's
>>> meant to
>>> be
>>> prepared.
>>>
>>
>> The upstream tarball is built by scripts run under a CI system
>> which
>> triggers when changes are pushed[1], and aren’t human-prepared
>> or
>> vetted in the same way that many release tarballs have
>> tradionally
>> been. This patchset uses the same script as upstream, with
>> modifications to make it reproduceable, as the upstream process
>> isn’t.
>
> Perhaps the modifications to make it reproducible could be
> shared to
> upstream? We'd benefit all thee users of librewolf this way,
> not only
> Guix ones.
>
Yes, I plan to work with upstream on this. The current
modifications are Guix-specific, but I believe a mechanism which
allows for both better upstream reproducability and less hacky
Guix packaging is possible.
>> As noted in the commit messages, IceCat also builds this
>> way[2],
>> including patching the upstream build script[3][4], so this
>> seems like
>> a reasonable & accepted way to build. Though perhaps there’s
>> dissatisfaction with the IceCat build which I wasn’t aware of,
>> being a
>> fairly new contributor.
>
> The "dissatisfaction", if we can call it that, was about
> Linux-libre,
> and voiced by some a few years ago, including the project
> maintainers,
> if I recall correctly. The idea of linux-libre is to shield
> users from
> blobs. In this sense it is valuable that they don't even have
> to touch
> the pristine blobbed (there are a few array-defined firmwares in
> the
> tree still, at least one old Apple one IIRC) Linux source, which
> is
> considered problematic for some from a GNU FSDG perspective.
>
Gotcha. I agree that these are unlikely to apply here.
Thank you for pushing this, and I’ll try to get commit messages
closer to the convention in the future.
— Ian
^ permalink raw reply [flat|nested] 12+ messages in thread
end of thread, other threads:[~2024-06-01 16:35 UTC | newest]
Thread overview: 12+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2024-05-22 14:53 [bug#71121] [PATCH 0/3] Update LibreWolf to 126.0-1 [security fixes] Ian Eure
2024-05-22 14:59 ` [bug#71121] [PATCH 1/3] gnu: all-mozilla-locales: Add Santali locale; make public Ian Eure
2024-05-22 14:59 ` [bug#71121] [PATCH 2/3] gnu: librewolf: Rebuild source tarball Ian Eure
2024-05-30 1:30 ` Maxim Cournoyer
2024-05-30 1:48 ` Ian Eure
2024-05-30 12:54 ` Maxim Cournoyer
2024-06-01 16:30 ` Ian Eure
2024-05-22 14:59 ` [bug#71121] [PATCH 3/3] gnu: librewolf: Update to 126.0-1 Ian Eure
2024-05-30 22:39 ` [bug#71121] [PATCH v2 1/3] gnu: all-mozilla-locales: Add Santali locale; make public Ian Eure
2024-05-30 22:39 ` [bug#71121] [PATCH v2 2/3] gnu: librewolf: Rebuild source tarball Ian Eure
2024-05-30 22:39 ` [bug#71121] [PATCH v2 3/3] gnu: librewolf: Update to 126.0-1 Ian Eure
2024-06-01 11:33 ` bug#71121: " Maxim Cournoyer
Code repositories for project(s) associated with this external index
https://git.savannah.gnu.org/cgit/guix.git
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.