Reproducible Builds Status Summary for Guix

Reproducible Builds Status Summary for Guix

[Vagrant Cascadian]

[-- Attachment #1.1: Type: text/plain, Size: 4245 bytes --]

I've been working on Reproducible Builds in guix a fair amount this
month.

data.guix.gnu.org has proven invaluable for this work, big thanks for
that!

  https://data.guix.gnu.org/repository/1/branch/master/latest-processed-revision/package-reproducibility


I have cataloged many of the packages that are identified by
dowloading a .json file:

  https://data.guix.gnu.org/repository/1/branch/master/latest-processed-revision/package-derivation-outputs.json?output_consistency=not-matching&system=x86_64-linux&target=none&field=no-additional-fields&limit_results=10000'

And then running those packages in a guix challenge for loop...

  for a in $@ ; do
    diffoscope_out=${a}.diffoscope
    diffoscope_out_comp=${diffoscope_out}.zst
    package=${a}
    if [ -s "${diffoscope_out_comp}" ] ; then
        echo ${diffoscope_out_comp} already present, skipping...
    else
        guix challenge --verbose --diff=diffoscope ${a} 2>&1 | tee "${diffoscope_out}"
        test -s "${diffoscope_out}" && zstd --rm --threads=0 "${diffoscope_out}"
    fi
  done

A few times I ran into disk space issues, due to:

  guix challenge with diffoscope fails to clean up temporary directory
  https://issues.guix.gnu.org/55809

So had to manually clean up some files and re-run it a few times and
probably missed a few packages...


I've looked at each of these diffoscope outputs and tried to quickly
categorize them. Attached a .yaml file (we cannot possibly have enough
different file formats!) that includes a rough identifier for each
issue. It was a rough and quick best-effort pass through, so there may
be some discrepancies...


I've already pushed fixes for a handful of packages, and tried to
remember to mark them as fixed. I've probably left many of the fixed
ones out of this list, but not terribly worried about that.

Some rough summaries about the types of issues:

  * ecl-* packages account for nearly half of the issues (~500 out of
    ~1000 packages)

  * ~850 packages categorized (ecl-* accounting for most of them)

  * 19 packages embed kernel version

  * 63 packages embed timestamps

  * 52 packages embed dates (harder to reproduce that full timestamps)

  * 5 timestamps in python .pyc files

  * 12 timestamps in .jar files

  * 66 ordering issues

  * 3 ordering issues in .pyc files

  * 9 ordering in .jar files

  * 16 ordering in guile .go files

  * ~160 largely unidentified and inscrutible issues

That's unfortunately a lot of "unidentified" issues, but I figured I'd
at least mark the ones I looked at.

This does reveal that there are some opportunities for toolchain fixes,
fixing multiple packages at a time (and future packages too!), such as
ecl, sbcl, python, java, guile, clojure, texlive (see FORCE_SOURCE_DATE
proposal
https://lists.gnu.org/archive/html/guix-devel/2022-06/msg00171.html ).

I haven't done extensive cross-referencing with other distros, but
suspect there may be patches to fix some of these toolchain issues... If
you've savvy with any of the above languages, help fixing toolchain
issues would be amazing!


I'm not sure where to collaborate on this stuff, I've just got a local
git repository and it's a bit rough. I could also push a branch to
guix.git with something like this in it.

There is a rough proposal for using a multi-project "notes" format that
debian uses:

  https://salsa.debian.org/reproducible-builds/reproducible-notes/-/tree/master
  https://salsa.debian.org/reproducible-builds/reproducible-notes/-/blob/multi-project-syntax/ideas_on_sharing_notes_between_distros

... back in 2016, and touched on at later Reproducible Builds summits,
but not really adopted as far as I know. But I know some of the issues
are essentially the same across distros; yet some are surprisingly
different even with the same source code!


If you're looking to get your hands dirty with some reproducibility
fixes in guix, a fair number of the timestamp, date and kernel version
fixes are likely fairly easy, but you generally have to manually verify
that the date or kernel version aren't embedded, as "guix build
--rounds=2" will likely happen with the same kernel version and date.


Will be curious to see any new and exciting issues after the staging
merge!


live well,
  vagrant

[-- Attachment #1.2: guix-rb-notes.yml --]
[-- Type: application/octet-stream, Size: 24823 bytes --]

4ti2:
  - unidentified issues in bin and lib
abcl:
  - nondeterministic ordering in .abcl and .cl files inside of a .jar
akku:
  - nondeterministic ordering embedded in guile .go files
alacritty:
  - unidentified issues in bin
ant-apache-bcel:
  - timestamps in .jar
ant-junit:
  - timestamps in .jar
anthy:
  - ordering differences in lib/*.a
armagetronad:
  - ordering differences in bin/armagetronad-uninstall
artanis:
  - nondeterminism in guile .go files
aseba:
  - unidentified issues in bin
autogen:
  - https://issues.guix.gnu.org/55813 switch to guile 3
  - uid/gid in share/autogen/libopts-42.1.17.tar.gz
  fixed:
    - embedded date in manpage 89ab76b8109d494d204f81b6d934ea19c8bb7004
autokey:
  - timestamp in python .pyc
  - other issues in python .pyc
awesome:
  - html documentation links with non-deterministic anchors
  - randomness in .svg
axoloti-patcher-next:
  - randomness in embedded temporary file names e.g. ccXXXXXX.ltrans1.ltrans.o"
axoloti-runtime:
  - randomness in embedded temporary file names, e.g. ccXXXXXX.s
azimuth:
  - unidentified issues in bin/azimuth
bart:
  - unidentified issues in bin/bart
bcachefs-static:
  - unidentified issues in sbin/bcachefs
bcachefs-tools:
  - unidentified issues in libbcachefs.so and sbin/bcachefs
bcachefs-tools-static:
  - unidentified issues in sbin/bcachefs
bind:
  - timestamps in python .egg
blast+:
  - unidentified nondetermism
blueman:
  - unidentified nondeterminism in python .pyc
brltty:
  - randomly generated etc/brlapi.key
btanks:
  - sort order in share/btanks/resources.dat
buildapp:
  - unidentified issue in bin/buildapp
ccwl:
  - embedded temporary filenames with random string
cfunge:
  - embeds kernel version
chez-fmt:
  - unidentified issue in lib/chez-scheme/*.so
chez-irregex:
  - unidentified issue in lib/chez-scheme/*.so
chez-matchable:
  - unidentified issue in lib/chez-scheme/*.so
chez-mit:
  - unidentified issue in lib/chez-scheme/*.so
chez-nanopass:
  - unidentified issue in lib/chez-scheme/*.so
  - embedded date in user-guide.pdf
chez-scheme:
  - unidentified issue in lib/csv*
chez-scheme-for-racket:
  - unidentified issue in lib/csv*
chez-scmutils:
  - unidentified issue in lib/chez-scheme/*.so
chez-srfi:
  - unidentified issue in lib/chez-scheme/*.so
chibi-scheme:
  - ordering issue in share/chibi/*.meta
  - unidentified issue in share/chibi/*.img
circtools:
  - unidentified issue in bin/circtools
classpath:
  - timestamps in .zip (java?) files
clearsilver:
  - timestamps in manpages
clisp:
  - unidentified issue in lib/clisp-*/base/lispinit.mem
cl-metabang-bind:
  - summary of test suite results with timing information and date in filename
cl-metatilities-base:
  - summary of test suite results with timing information and date in filename
cl-moptilities:
  - summary of test suite results with timing information and date in filename
clojure:
  - timestamps in html documentation
  - ordering and/or nondeterminism in .class files
clojure-tools-deps-alpha:
  - ordering and/or nondeterminism in .class files
cloog:
  - unidentified issue in bin/cloog
  - ordering issues in libcloog-isl.a
clustal-omega:
  - unidentified issue in bin/clustalo
  - ordering issues in libclustalo.a
cl-yale-haskell:
  - differing number in bin/clisp-haskell
cl-yxorp-cli:
  - unidentified issue in bin/cl-yxorp
cuirass:
  - nondeterministic ordering embedded in guile .go files
dehydrated:
  - manpage compressed with gzip timestamp, pass --no-name to fix
deluge:
  - timestamps in python .egg files
didjvu:
  - unidentified issues in python .pyc
drip:
  - timestamps in .jar file
  - ordering in .jar file
ebusd:
  - embedded date in bin/ebusd
ecl-*:
  - unidentified issues with ecl
edi:
  - uid/gid in tarball
  - sort order in tarball
efitools:
  - unidentified issue in share/efitools/efi/LockDown.efi
efl:
  - unidentified issue in share/elementary/themes/default.edj
emacs:
  - embeds kernel version in libexec/emacs/*/*/emacs.pdmp
  - unidentified issue in share/emacs/*/lisp/gnus/gnus-start.elc
emacs-ddskk:
  - timestamp in share/emacs/site-lisp/skk-autoloads.el and skksetup.el
emacs-howm:
  - unidentified issue in howm-mode.elc
emacs-minimal:
  - embeds kernel version in libexec/emacs/*/*/emacs.pdmp
  - unidentified issue in *.elc
emacs-next:
  - embeds kernel version in libexec/emacs/*/*/emacs.pdmp
  - unidentified issue in *.elc
emacs-next-pgtk:
  - embeds kernel version in libexec/emacs/*/*/emacs.pdmp
  - unidentified issue in *.elc
emacs-no-x:
  - embeds kernel version in libexec/emacs/*/*/emacs.pdmp
  - unidentified issue in *.elc
emacs-no-x-toolkit:
  - probably embeds kernel version in libexec/emacs/*/*/emacs.pdmp
  - probably unidentified issue in *.elc
emacs-subed:
  - nondeterministic nubmers in subed-autoloads.el
emacs-treemacs:
  - date in treemacs.elc
emacs-treemacs-extra:
  - date in treemacs.elc
emacs-wide-int:
  - embeds kernel version in libexec/emacs/*/*/emacs.pdmp
  - unidentified issue in *.elc
enblend-enfuse:
  - unidentified issue in bin/enfuse bin/enblend
fbreader:
  - unidentified issue in bin/FBReader
fenics-dolfin:
  - different precision and rounding differences in floatig point numbers in *.h files
fennel:
  - ordering differences in bin/fennel and fennel.lua
fflas-ffpack:
  - bin/fflas-ffpack-config contains different cpu optimizations
filtlong:
  - unidentified issues in bin/filtlong
font-meera-inimai:
  - date in share/fonts/truetype/MeeraInimai-Regular.ttf
fortune-mod:
  - different linebreaks fortune.6 manpage
fpc:
  - dates embedded in bin/* and lib/fpc/*/units/*/pastojs/pas2jscompiler.o
fstrcmp:
  - timestamps in .pdf
fullswof-2d:
  - unidentified issue in bin/FullSWOF_2D
gap:
  - kernel embedded in config.log
  - ld warnings with random temporary filenames embedded in config.log
  - timestamp embedded fail.log and io-*.log
gavl:
  - unidentified issues in lib/libgavl.so.*
gcc-stripped-tarball:
  - unidentified issues in /bin/* in tarball
gcl:
  - different addresses for functions in lib/gcl-2.7.0/unixport/libansi_gcl.a
  - ordering issues in lib/*/unixport/saved_ansi_gcl
gerbil:
  - unidentified issues in lib
gf2x:
  - orderind issues in lib/libgf2x.a
  - unidentified issues in lib/libgf2x.so.1.0.2
givaro:
  - differing cpu optimizations in bin/givaro-makefile
  - unidentified issues in lib (possibly related to cpu optimizations?)
gnome-shell-extension-burn-my-windows:
  - ordering issues in
    share/gnome-shell/extensions/burn-my-windows@schneegans.github.com/resources/burn-my-windows.gresource.xml
gnome-vfs:
  - ordering issues in lib/gnome-vfs-2.0/modules/libhttp.a
gnucobol:
  - timestamp in lib/gnucobol/CBL_OC_DUMP.so
gprolog:
  - timestamps in .h files, share/gprolog/bin/*
  - randomized temporary filenames in share/gprolog/lib/*
gtkglext:
  - ordering issues in lib/libgdkglext-x11-1.0.a
guile:
  - nondeterministic ordering embedded in guile .go files
guile2.2-config:
  - unidentified issue in lib/guile/2.2/site-ccache/config/api.go
guile3.0-opengl:
  - nondeterministic ordering embedded in guile .go files
guile-chickadee:
  - nondeterministic ordering embedded in guile .go files
guile-config:
  - nondeterministic ordering embedded in guile .go files
guile-g-golf:
  - nondeterministic ordering embedded in guile .go files
guile-irc:
  - nondeterministic ordering embedded in guile .go files
guile-lib:
  - nondeterministic ordering embedded in guile .go files
guile-rdf:
  - nondeterministic ordering embedded in guile .go files
guile-sdl2:
  - nondeterministic ordering embedded in guile .go files
guix:
  - nondeterministic ordering embedded in guile .go files
guix-data-service:
  - nondeterministic ordering embedded in guile .go files
hashcat:
  - unidentified issue in bin/hashcat
haunt:
  - nondeterministic ordering embedded in guile .go files
hevea:
  - temporary randomized filename built with ocaml
hop:
  - lib/hop/3.2.0/Makefile.hopconfig embeds date in HOPDATE variable
  - date in .js files
icedtea-web@1.6.2:
  - timestamps in .jar
  - date in manpages
icu4c-build-root:
  - kernel version in config.log
  - ld warnings with random temporary filenames embedded in config.log
insight-toolkit:
  - unidentified issues in lib
intel-xed@12.0.1:
  - unidentified issues in bin
ipxe:
  - .iso file, possibly filesystem metadata
irods:
  - embeds random/arbitrary number in define include/irods/server_control_plane_command.hpp
isl:
  - unidentified issues in lib/libisl.so.*
itpp:
  - embedded date in share/doc/itpp/html/_formulas.log
java-cofoja:
  - dates embedded in filenames of .jar files (e.g. share/java/cofoja+asm-1.2-20220529.jar)
java-commons-daemon:
  - timestamp embedded in .html documentation made with javadoc
  - date embedded in .html (e.g. <meta name="date" content="2022-05-29">)
java-commons-httpclient:
  - timestamp embedded in .html documentation made with javadoc
  - date embedded in .html (e.g. <meta name="date" content="2022-05-29">)
  - ordering isues in documentation (parallelism?)
java-jblas:
  - timestamps in .jar
java-jdom@2.0.6.1:
  - dates embedded in filenames of .jar files (e.g. share/java/cofoja+asm-1.2-20220529.jar)
java-ngs:
  - timestamps in .jar
  - ordering in .jar
java-openmpi:
  - timestamp embedded in .html documentation made with javadoc
  - date embedded in .html (e.g. <meta name="date" content="2022-05-29">)
java-tomcat:
  - date embedded in .html docuimentation
java-xerces:
  - timestamp in .jar created by ant
java-xmlpull-api-v1:
  - timestamp embedded in .html documentation made with javadoc
  - date embedded in .html (e.g. <meta name="date" content="2022-05-29">)
kawa:
  - timestamps in .jar
  - ordering in .jar
keepalived:
  - non-determinim in share/info/keepalived.info.gz
kirigami:
  - uid/gid in tarball
  - sort order in tarball
lagrange:
  - timestamp in VERSION file embedded in share/lagrange/resources.lgr
laminar:
  - unidentified issue in sbin/laminard
lean:
  - unidentified issues in .olean files
lepton-eda:
  - hashed identifiers in .go files
libflame@5.2.0:
  - unidentified issue in lib/libflame.so.*
libgtop:
  - kernel version embedded in bin/libgtop_server2
libmpeg2:
  - ordering or cpu optimization in lib/libmpeg2.a
libnet:
  - date in manpage
libopensmtpd:
  - date in manpage
libosmo-dsp:
  - date and timestamp in _formulas.log
libphonenumber:
  - unidentified issues in lib
libpinyin:
  - unidentified issues in lib
libwebsockets:
  - random data in generated keys share/libwebsockets-test-server/libwebsockets-test-server*.pem
lilypond:
  - variable data in .png .svg .otf .woff
linbox:
  - cpu optimizations in bin/linbox-config
  - differences in lib possibly due to cpu optimizations
linux-libre:
  - unidentified differences in .ko files
  - unidentified differences in bzimage
lirc:
  - uid/gid in share/lirc/lirc-0.10.1.tar.gz
lokke:
  - sort order and arbitrary numeric identifiers in .go files
looking-glass-client:
  - unidentified issues in bin/.looking-glass-client-real
m4ri:
  - embedded cpu cache information in include/m4ri/m4ri_config.h
m4rie:
  - unidentified issues in lib/libm4rie-*.so
maradns:
  - random number, take upstream https://lists.gnu.org/archive/html/guix-devel/2022-06/msg00110.html
  - kernel version
  - timestamp
maven-compat@3.8.5:
  - ordering issues in META-INF/plexus/components.xml embedded in .jar
maven-model-builder@3.8.5:
  - ordering issues in META-INF/sisu/javax.inject.Named embedded in .jar
maven-resolver-provider:
  - ordering issues in META-INF/sisu/javax.inject.Named embedded in .jar
maven-settings-builder@3.8.5:
  - ordering issues in META-INF/sisu/javax.inject.Named embedded in .jar
maxima:
  - lib/maxima/5.45.1/binary-sbcl/maxima.core
mediasdk:
  - embedded kernel version (mediasdk_build_info)
mercurial:
  - ordering inside .pyc files
minced:
  - timestamps in .jar
mingw-w64-i686:
  - randomness in temporary filenames
mingw-w64-i686-winpthreads:
  - randomness in temporary filenames
mingw-w64-x86_64:
  - randomness in temporary filenames
mingw-w64-x86_64-winpthreads:
  - randomness in temporary filenames
miniupnpc:
  - embedded kernel version in User-Agent
mit-scheme:
  - unidentified issues
mkp224o:
  - unidentified issues in bin/mkp224o
mm-common:
  - uid/gid in share/doc/mm-common/skeletonmm.tar.xz
moarvm:
  - unidentified issues in lib/libmoar.so
mono:
  - unidentified issues
mruby:
  - unidentified issues
musl-cross:
  - unidentified issues
myrddin:
  - unidentified issues
mysql:
  - kernel version share/mysql/docs/INFO_BIN
  - timestamps in share/mysql/docs/INFO_BIN
nanomsg:
  - unidentified issues
nauty:
  - unidentified issues
ncdu2:
  - unidentified issues
ne:
  - date in bin/ne
netcdf-fortran:
  - timestamp in lib/libnetcdff.settings
nng:
  - unidentified issues
node:
  - ordering issues in include/node/config.gypi
node-addon-api:
  - ordering issues in lib/node_modules/node-addon-api/test/build/Makefile
  - ordering issues in lib/node_modules/node-addon-api/test/build/config.gypi
node-openzwave-shared:
  - ordering issues in lib/node_modules/openzwave-shared/build/Makefile
  - ordering issues in lib/node_modules/openzwave-shared/build/config.gypi
node-segfault-handler:
  - ordering issues in lib/node_modules/segfault-handler/build/Makefile
  - ordering issues in lib/node_modules/segfault-handler/build/config.gypi
node-serialport-bindings:
  - ordering issues in lib/node_modules/@serialport/bindings/build/Makefile
  - ordering issues in lib/node_modules/@serialport/bindings/build/config.gypi
node-sqlite3:
  - ordering issues in lib/node_modules/sqlite3/build/Makefile
  - ordering issues in lib/node_modules/sqlite3/build/config.gypi
nqp:
  - unidentified issues in .moarvm files
nss:
  - unidentified issues in .chk files
nushell:
  - unidentified issues in bin/nu
nyacc:
  - nondeterministic ordering embedded in guile .go files
ocaml4.09-dune-configurator:
  - unidentified issues in .cmt .cmti
ocaml-batteries:
  - unidentified issues in .cmt .cmti
ocaml-topkg:
  - unidentified issues in .cmt .cmti
ocrodjvu:
  - unidentified issues in .pyc
openblas:
  - unidentified issues
openblas-ilp64:
  - unidentified issues
opensmtpd-filter-dkimsign:
  - date in manpage
  - kernel version in manpage
patchwork:
  - ordering issue in share/patchwork/htdocs/staticfiles.json
perl6-tap-harness:
  - unidentified issues in precompiled perl6 files
perl6-zef:
  - unidentified issues in precompiled perl6 files
plover:
  - timestamp in .pyc
  - ordering issues in .pyc
polyml:
  - unidentified issues
porechop:
  - unidentified issues
pure:
  - ordering issues in lib/pkgconfig/pure.pc
pwsafe:
  - ordering issues in .zip files
pybind11:
  - unidentified issues in .pyc
python-blosc:
  - unidentified issues cypthon*.so
python-bwapy:
  - unidentified issues cypthon*.so
python-debian:
  fixed:
    - date-based version embedded in .egg-info 96d47797dce361bd7f3b1ce860b1ec4851e2db5a
python-gamera:
  - unidentified issues cypthon*.so
python-numba:
  - unidentified issues in .nbc and .nbi
python-numpy-next:
  - misc issues _multiarray_umath.cpython-39-x86_64-linux-gnu.so
python-pytest:
  - timestamp in python .pyc
python-shiboken-2:
  - unidentified issues cypthon*.so
python-xapian-bindings:
  - timestamp in python .pyc
quickjs:
  - unidentified issues in lib/quickjs/libquickjs.lto.a
racket:
  - differing hashes(?) in various .dep files
r-affycompatible:
  - issues in .rdb and .rdx files
rakudo:
  - unidentified issues in .moarvm files
r-bgx:
  - unidentified issue in site-library/bgx/libs/bgx.so
rc:
  - date embedded in bin/rc
r-cli:
  - pid embedded in site-library/cli/R/cli.rdb
rct:
  - undentified issues
r-dimred:
  - unidentified issues in .rdb files
restic:
  - differing GO BUILDID in bin/restic
r-laplacesdemon:
  - unidentified issues in .rdb and .rdx files
r-liger:
    - timestamps in .jar
r-lpsymphony:
  - unidentified issue in site-library/lpsymphony/libs/lpsymphony.so
r-minimal:
  - unidentified issues in .rdb and .rdx files
r-misha:
  - unidentified issues in site-library/misha/trackdb/test/.db.cache
r-omnipathr:
  - unidentified issues in .rdb files
r-quantmod:
  - unidentified issues in .rdb and .rdx files
r-rbowtie2:
  - unidentified issues in site-library/Rbowtie2/bowtie2*
r-rcppparallel:
  - unidentified issues in site-library/RcppParallel/lib/*.so.*
r-repr:
  - unidentified issues in .rdb files
r-reticulate:
  - timestamps in python .pyc
r-rgraphviz:
  - unidentified issues in site-library/Rgraphviz/libs/Rgraphviz.so
r-rhdf5filters:
  - unidentified issues in site-library/rhdf5filters/lib/libH5Zblosc.so
r-rjava:
  - timestamps in .jar file
  - ordering in .jar file
r-rsbml:
  - kernel version embedded in site-library/rsbml/SBML_odeSolver-*/config.log
r-tm:
  - unidentified issues in .rdb and .rdx files
r-topicmodels:
  - unidentified issues in .rdb and .rdx files
r-tractor-base:
  - unidentified issues in .rdb and .rdx files
r-tweenr:
  - BASEDATETIME number defined in site-library/tweenr/R/tweenr.rdb
ruby:
  - date and pid embedded in gem_make.out files
  - date and pid embedded in lib/ruby/gems/*/gems/debug-*/ext/*/Makefile
ruby-ae:
  - ordering in .gemspec
ruby-ansi:
  - ordering in .gemspec
ruby-citrus:
  - date in .gemspec
ruby-concurrent:
  - date in .gemspec
ruby-ffi:
  - ordering in HDRS in lib/ruby/vendor_ruby/gems/ffi-*/build/*/ffi_c/*/Makefile
ruby-oj:
  - date in .gemspec
  - ordering in .gemspec
ruby-patron:
    - ld warnings with random temporary filenames embedded in mkmf.log
ruby-rexml:
  - ordering in .gemspec
ruby-rjb:
  - ld warnings with random temporary filenames embedded in mkmf.log
ruby-sys-filesystem:
  - date in .gemspec
ruby-sys-uname:
  - date in .gemspec
ruby-terminfo:
  - date and random temporary filename embedded in gem_make.out files
ruby-treetop:
  - date in .gemspec
salmon:
  - hashed temporary filenames and/or ordering issues in lib/libsalmon_core.a
sbcl:
  - unidentified issues in .fasl files
sbcl-burgled-batteries3:
  - unidentified issues in .fasl files
sbcl-cffi:
  - unidentified issues in .fasl files
sbcl-cl-ana:
  - unidentified issues in .fasl files
sbcl-cl-charms:
  - unidentified issues in .fasl files
sbcl-cl-diskspace:
  - unidentified issues in .fasl files
sbcl-cl-freetype2:
  - unidentified issues in .fasl files
sbcl-clinenoise:
  - unidentified issues in .fasl files
sbcl-cl-libuv:
  - unidentified issues in .fasl files
sbcl-cl-rdkafka:
  - unidentified issues in .fasl files
sbcl-cl-unicode:
  - unidentified issues in .fasl files
sbcl-dexador:
  - unidentified issues in .fasl files
sbcl-gsll:
  - unidentified issues in .fasl files
sbcl-hdf5-cffi:
  - unidentified issues in .fasl files
sbcl-iolib:
  - unidentified issues in .fasl files
sbcl-metabang-bind:
  - date in filename and timing information in summary-*.sav
sbcl-metatilities-base:
  - date in filename and timing information in summary-*.sav
sbcl-montezuma:
  - unidentified issues in
    lib/common-lisp/sbcl/montezuma/tests/temp/fsdir/segments and
    lib/common-lisp/sbcl/montezuma/tests/unit/regression/tc-m2k-test-index/segments
sbcl-moptilities:
  - date in filename and timing information in summary-*.sav
  - timestamps and timing information in share/common-lisp/sbcl/moptilities/test-results/*.html
sbcl-osicat:
  - unidentified issues in .fasl files
sbcl-overlord:
  - unidentified issues in .fasl files
sbcl-png:
  - unidentified issues in .fasl files
sbcl-pzmq:
  - unidentified issues in .fasl files
sbcl-supertrace:
  - unidentified issues in .fasl files
scanmem:
  - sort order in python .pyc files
scheme48:
  - unidentified issue in lib/scheme48-*/scheme48.image
scrollkeeper:
  - timestamps in var/log/scrollkeeper.log
scsh:
  - unidentified issue in lib/scsh-*/scsh.image
segemehl:
  - unidentified issue in bin/*
serveez:
  - timestamps in bin/serveez
silc-toolkit:
  - unidentified issue in lib/*.so.*
simavr:
  - ordering differences in include/simavr/sim_core_decl.h
singularity:
  - timestamps in libexec/singularity/bootstrap-scripts/environment.tar
skribilo:
  - timestamps in .html files
  - timestamps in .pdf files
  - timestamps in .info files
slepc:
  - unidentified issues in lib/libslepc.so.*
slepc-complex:
  - unidentified issues in lib/libslepc.so.*
slepc-complex-openmpi:
  - unidentified issues in lib/libslepc.so.*
slepc-openmpi:
  - unidentified issues in lib/libslepc.so.*
smalltalk:
  - sort order in .star (embedded .zip)
  - timestamps in .star (embedded .zip)
smlnj:
  - unidentified issues in bin and lib
sonnet:
  - unidentified issues in lib/libKF5SonnetCore.so.*
srain:
  - ordering in share/doc/srain/html/.doctrees/environment.pickle
srecord:
  - timestamps in .pdf generated by ghostscript
star:
  - unidentified issues in bin/STAR
starlong:
  - unidentified issues in bin/STARlong
stex:
  - unidentified issues in lib/stex/ta6le/*
stumpwm:
  - unidentified issues in bin/stumpwm
stumpwm-with-slynk:
  - unidentified issues in bin/stumpwm
surge-synth:
  - ordering of and/or differing .svg files within Surge.so
swish-e:
  - maybe ordering issues in bin/swish-e and lib/libswish-e*.a, maybe locale related files
syslinux:
  - unidentified issues (maybe obscure timestamps?) in bin/syslinux, sbin/extlinux and share/syslinux/*
tao:
  - dates in tao_version in bin/tao-config
  - timestamps in DATE in share/tao/examples/Makefile
  - dates in TAO_VERSION and VERSION in share/tao/examples/Makefile
tensorflow:
  - ordering in .pyc files
tesseract-ocr:
  - unidentified issues in lib/libtesseract*
teximpatient:
  - timestamps in .dvi
  - timestamps in .pdf
  - dates in .pdf
texlive-amsfonts:
  - timestamps in .600gf files
texlive-cm:
  - timestamps in .log and .600gf files
texlive-etex:
  - timestamps in .log and .600gf files
texlive-fontinst:
  - timestamps in .log files
texlive-fonts-ec:
  - timestamps in .log and .600gf files
texlive-fonts-latex:
  - timestamps in .log and .600gf files
texlive-fonts-rsfs:
  - timestamps in .log and .600gf files
texlive-jadetex:
  - timestamps in .fmt files
texlive-knuth-lib:
  - timestamps in .log and .600gf files
texlive-latex-base:
  - timestamps in .log and .fmt files
texlive-latex-changepage:
  - dates in share/texmf-dist/tex/latex/changepage/changepage.sty
      and share/texmf-dist/tex/latex/changepage/chngpage.sty
texlive-latex-trimspaces:
  - date in share/texmf-dist/tex/latex/trimspaces/trimspaces.sty
texlive-latex-xkeyval:
  - date in share/texmf-dist/tex/latex/xkeyval/xkeyval.dvi
texlive-metafont:
  - date in share/texmf-dist/web2c/mf.base
texlive-metalogo:
  - date in share/doc/latex/metalogo/metalogo.pdf
texlive-mflogo:
  - date in share/texmf-dist/build/logosl8.600gf and
      share/texmf-dist/tex/latex/mflogo/logosl8.600gf
texlive-paralist:
  - date in share/doc/latex/paralist/paralist.pdf
texlive-xindy:
  - case differences (e.g. "DH" vs. "dh") in .xdy files
texlive-xmltex:
  - timestamp in share/texmf-dist/web2c/pdftex/pdfxmltex.fmt and
      share/texmf-dist/web2c/pdftex/xmltex.fmt
thc-ipv6:
  fixed:
    - dates in manpages
tinmop:
  - uniden in bin/tinmop
  - sort order in embedded .lisp and .scm files
tla2tools:
  - timestamp in share/java/tla2tools.jar
ugrep:
  - unidentified issues in bin
uim:
  - sort order of share/uim/loader.scm and share/uim/installed-modules.scm
uim-gtk:
  - sort order of share/uim/loader.scm and share/uim/installed-modules.scm
utox:
  - random strings in embedded temporary files "e.g. utox.XXXXXX.ltrans0.o"
vala@52:
  - unidentified issues in bin and lib
vala@54:
  - unidentified issues in bin and lib
vice:
  - unidentified issues in bin
virtuaoso-ose:
  - sort order or randomness in share/virtuoso/vad/isparql_dav.vad
vivid:
  - unidentified issues in bin/vivid
wine:
  - timestamps in *.dll.so, can be (partly?) mitigated using
      WIDL_TIME_OVERRIDE environment variable or patching out in
      tools/widl/write_msft.c
wine64:
  - timestamps in *.dll.so, can be (partly?) mitigated using
      WIDL_TIME_OVERRIDE environment variable or patching out in
      tools/widl/write_msft.c
wxwidgets@3.0:
  - kernel version in lib/wx/include/gtk3-unicode-3.0/wx/setup.h
      WXWIN_OS_DESCRIPTION
wxwidgets@2.8:
  - kernel version in
      lib/wx/include/gtk2-unicode-release-2.8/wx/setup.h
      WXWIN_OS_DESCRIPTION
wxwidgets-gtk2@3.0:
  - kernel version in lib/wx/include/gtk2-unicode-3.0/wx/setup.h
      WXWIN_OS_DESCRIPTION
xjackfreak:
  - unidentified issues in bin
xlispstat:
  - unidentified issue in lib/xlispstat/xlisp.wks
xscreensaver:
  - unidentified issues in bin
xsnow:
  - unidentified issues in bin
  - date embedded in share/metainfo/xsnow.appdata.xml
yadifa:
  - unidentified issues in bin, sbin and lib
z3:
  - unidentified issues in bin and lib
zeitgeist:
  - ordering issues in lib/libzeitgeist-2.0.so.0.0.0
zita-alsa-pcmi:
  - unidentified issues in lib/libzita-alsa-pcmi.so.0.3.2
zn-poly:
  - unidentified issues in lib
zynaddsubfx:
  - non-deterministic number in lib/lv2/ZynAddSubFX.lv2/presets.ttl pset:value

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 227 bytes --]

Re: Reproducible Builds Status Summary for Guix

[Ludovic Courtès]

Hi!

Vagrant Cascadian <vagrant@reproducible-builds.org> skribis:

> I've been working on Reproducible Builds in guix a fair amount this
> month.
>
> data.guix.gnu.org has proven invaluable for this work, big thanks for
> that!
>
>   https://data.guix.gnu.org/repository/1/branch/master/latest-processed-revision/package-reproducibility

Neat!

> A few times I ran into disk space issues, due to:
>
>   guix challenge with diffoscope fails to clean up temporary directory
>   https://issues.guix.gnu.org/55809

Should be fixed now.  :-)

> Some rough summaries about the types of issues:
>
>   * ecl-* packages account for nearly half of the issues (~500 out of
>     ~1000 packages)

This seems to be a problem with generated identifiers at first sight;
would be worth taking upstream.  Any Common Lisper here?  :-)

>   * ~850 packages categorized (ecl-* accounting for most of them)
>
>   * 19 packages embed kernel version
>
>   * 63 packages embed timestamps
>
>   * 52 packages embed dates (harder to reproduce that full timestamps)
>
>   * 5 timestamps in python .pyc files
>
>   * 12 timestamps in .jar files
>
>   * 66 ordering issues
>
>   * 3 ordering issues in .pyc files
>
>   * 9 ordering in .jar files
>
>   * 16 ordering in guile .go files
>
>   * ~160 largely unidentified and inscrutible issues
>
> That's unfortunately a lot of "unidentified" issues, but I figured I'd
> at least mark the ones I looked at.

Yes, that’s already an insightful breakdown.

> There is a rough proposal for using a multi-project "notes" format that
> debian uses:
>
>   https://salsa.debian.org/reproducible-builds/reproducible-notes/-/tree/master
>   https://salsa.debian.org/reproducible-builds/reproducible-notes/-/blob/multi-project-syntax/ideas_on_sharing_notes_between_distros
>
> ... back in 2016, and touched on at later Reproducible Builds summits,
> but not really adopted as far as I know. But I know some of the issues
> are essentially the same across distros; yet some are surprisingly
> different even with the same source code!

I was very optimistic about using this database cross-distro back at the
first R-B Summit!  I still look at it occasionally when an issue pops
up, but it’s not become the collaborative platform we were hoping for.
It’s never too late though!

(Debian is in sense stricter in that some things can be an issue there
(like store build file names) and not here, because the Guix build
environment is controlled and “canonicalized”.  So not all the issues in
there are relevant to us I guess.)

Thanks for the update!

Ludo’.

Re: Reproducible Builds Status Summary for Guix

[Guillaume Le Vaillant]

[-- Attachment #1: Type: text/plain, Size: 540 bytes --]

Ludovic Courtès <ludo@gnu.org> skribis:

> Hi!
>
> Vagrant Cascadian <vagrant@reproducible-builds.org> skribis:
>
>> Some rough summaries about the types of issues:
>>
>>   * ecl-* packages account for nearly half of the issues (~500 out of
>>     ~1000 packages)
>
> This seems to be a problem with generated identifiers at first sight;
> would be worth taking upstream.  Any Common Lisper here?  :-)
>

Hi,
There's an open issue about this upstream [1].

[1] https://gitlab.com/embeddable-common-lisp/ecl/-/issues/551

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 247 bytes --]

Re: Reproducible Builds Status Summary for Guix

[Ludovic Courtès]

Guillaume Le Vaillant <glv@posteo.net> skribis:

> Ludovic Courtès <ludo@gnu.org> skribis:
>
>> Hi!
>>
>> Vagrant Cascadian <vagrant@reproducible-builds.org> skribis:
>>
>>> Some rough summaries about the types of issues:
>>>
>>>   * ecl-* packages account for nearly half of the issues (~500 out of
>>>     ~1000 packages)
>>
>> This seems to be a problem with generated identifiers at first sight;
>> would be worth taking upstream.  Any Common Lisper here?  :-)
>>
>
> Hi,
> There's an open issue about this upstream [1].
>
> [1] https://gitlab.com/embeddable-common-lisp/ecl/-/issues/551

Nice, kudos for tracking it down and coming up with a fix!

Ludo’.

Re: Reproducible Builds Status Summary for Guix

[Vagrant Cascadian]

[-- Attachment #1.1: Type: text/plain, Size: 3932 bytes --]

On 2022-06-12, Vagrant Cascadian wrote:
> I've been working on Reproducible Builds in guix a fair amount this
> month.

I did another round of this...

I fixed a few packages recently, and noticed some other people fixing
packages too, yay!

As of this moment for x86_64, it looks like:

* ~83% matching (a.k.a. reproducible) for 18920 packages
* ~6% not matching (a.k.a. NOT reproducible) for 1337 packages
* ~11% unknown (e.g. not built on both build farms) for 2440 packages

  https://data.guix.gnu.org/repository/1/branch/master/latest-processed-revision/package-reproducibility

Ignoring the pesky unknown packages, it is more like ~93% reproducible
and ~7% unreproducible... that feels a bit better to me!

These numbers wander around over time, mostly due to packages moving
back into an "unknown" state while the build farms catch up with each
other... although the above numbers seem to have been pretty consistent
over the last few days.


> Some rough summaries about the types of issues:
>
>   * ecl-* packages account for nearly half of the issues (~500 out of
>     ~1000 packages)

More like ~570 out of ~1300 this time.

Apparently there is an upstream issue for ecl, which is referenced in
the summary.

>   * ~850 packages categorized (ecl-* accounting for most of them)

~990 packages reviewed (many duplicates from previous run). Slightly
higher number to review higher this time, mostly due to some previous
unknowns being reproducible/not reproducible.

There are a handful of older-versions of things (e.g. package@1.0 vs
package@2.0) that fail to build reproducibly and I didn't bother to
look, I only checked the most recent versions of packages, so there are
probably 300+ packages that could be reviewed.

>   * 19 packages embed kernel version

22 kernel version

>   * 63 packages embed timestamps

92 timestamps

>   * 52 packages embed dates (harder to reproduce that full timestamps)

46 dates

>   * 5 timestamps in python .pyc files

7 .pyc timestamps

>   * 12 timestamps in .jar files

12 .jar timestamps

>   * 66 ordering issues

82 ordering

>   * 3 ordering issues in .pyc files

3 .pyc ordering

>   * 9 ordering in .jar files

10 .jar ordering

>   * 16 ordering in guile .go files

13 guile .go ordering

>   * ~160 largely unidentified and inscrutible issues

193 unidentified


> This does reveal that there are some opportunities for toolchain fixes,
> fixing multiple packages at a time (and future packages too!), such as
> ecl, sbcl, python, java, guile, clojure, texlive (see FORCE_SOURCE_DATE
> proposal
> https://lists.gnu.org/archive/html/guix-devel/2022-06/msg00171.html ).

Still true!

I tried patching texlive directly and failed to come up with something
that worked, but haven't tried again recently.


> I haven't done extensive cross-referencing with other distros, but
> suspect there may be patches to fix some of these toolchain issues... If
> you've savvy with any of the above languages, help fixing toolchain
> issues would be amazing!

Did a little of this, but still more to do!


> If you're looking to get your hands dirty with some reproducibility
> fixes in guix, a fair number of the timestamp, date and kernel version
> fixes are likely fairly easy, but you generally have to manually verify
> that the date or kernel version aren't embedded, as "guix build
> --rounds=2" will likely happen with the same kernel version and date.

Still very true! Maybe I should arrange a little virtual hackfest or
something...

I should probably normalize these issues a bit more and simplify them,
but the full list I looked should be attached.

Would it be ok to maintain this and some of the relevent tooling in a
branch in guix.git, say, "reproducibility-notes"? Or make a new
repository just for this? It most likely wouldn't share history with the
other branches (much like the "keyring" branch), but presumably won't
grow too large either.


live well,
  vagrant

[-- Attachment #1.2: guix-rb-notes.yml --]
[-- Type: application/octet-stream, Size: 27531 bytes --]

4ti2:
  - unidentified issues in bin and lib
abcl:
  - nondeterministic ordering in .abcl and .cl files inside of a .jar
acpi-call-linux-module:
  - unidentified differences in .ko files
akku:
  - nondeterministic ordering embedded in guile .go files
alacritty:
  - unidentified issues in bin
ant-apache-bcel:
  - timestamps in .jar
anthy:
  - ordering issues in .a files
ant-junit:
  - timestamps in .jar
arcan:
  - unidentified issues
arcan-sdl:
  - unidentified issues
armagetronad:
  - ordering differences in bin/armagetronad-uninstall
artanis:
  - nondeterminism in guile .go files
asymptote:
  - randomness in share/asymptote/GUI/icons_rc.py
aseba:
  - unidentified issues in bin
autogen:
  - unidentified issues in bin
awesome:
  - html documentation links with non-deterministic anchors
  - randomness in .svg
axoloti-patcher-next:
  - randomness in embedded temporary file names e.g. ccXXXXXX.ltrans1.ltrans.o
axoloti-runtime:
  - randomness in embedded temporary file names e.g. ccXXXXXX.s
azimuth:
  - unidentified issues in bin/azimuth
bart:
  - unidentified issues in bin/bart
bcachefs-static:
  - unidentified issues in sbin/bcachefs
bcachefs-tools:
  - unidentified issues in libbcachefs.so and sbin/bcachefs
bcachefs-tools-static:
  - unidentified issues in sbin/bcachefs
blobwars:
  - possible ordering and/or parallelism issues
blueman:
  - unidentified nondeterminism in python .pyc
brltty:
  - randomly generated etc/brlapi.key
btanks:
  - sort order in share/btanks/resources.dat (.zip format)
  - timestamps in share/btanks/resources.dat (.zip format)
buildapp:
  - unidentified issue in bin/buildapp
cambalache:
  - timestamp in .pyc
cardpeek:
  - embedded time in version
carla:
  - randomness in share/carla/resources_rc.py
cctools:
  - timestamp in /bin/ld
cddlib:
  - timestamp in (texlive?) produced .dvi, .ps
cfunge:
  - embeds kernel version
chez-fmt:
  - unidentified issue in lib/chez-scheme/*.so
chez-irregex:
  - unidentified issue in lib/chez-scheme/*.so
chez-matchable:
  - unidentified issue in lib/chez-scheme/*.so
chez-mit:
  - unidentified issue in lib/chez-scheme/*.so
chez-nanopass:
  - unidentified issue in lib/chez-scheme/*.so
  - embedded date in user-guide.pdf
chez-scheme:
  - unidentified issue in lib/csv*
chez-scheme-for-racket:
  - unidentified issue in lib/csv*
chez-scmutils:
  - unidentified issue in lib/chez-scheme/*.so
chez-sockets:
  - unidentified issue in lib/chez-scheme/*.so
chez-srfi:
  - unidentified issue in lib/chez-scheme/*.so
chez-web:
  - unidentified issue in lib/chez-scheme/*.so
chibi-scheme:
  - ordering issue in share/chibi/*.meta
  - unidentified issue in share/chibi/*.img
circtools:
  - unidentified issue in bin/circtools
classpath:
  - timestamps in .zip files
  - ordering in .zip files
cl-containers:
  - includes test suite summary with date and timing information
clearsilver:
  - timestamps in manpages
cl-hdf5-cffi:
  - embedded temporary directory in .h5 files
clisp:
  - unidentified issue in lib/clisp-*/base/lispinit.mem
cl-metabang-bind:
  - summary of test suite results with timing information and date in filename
cl-metatilities-base:
  - summary of test suite results with timing information and date in filename
clojure:
  - timestamps in html documentation
  - ordering and/or nondeterminism in .class files
cloog:
  - unidentified issue in bin/cloog
  - ordering issues in libcloog-isl.a
clustal-omega:
  - unidentified issue in bin/clustalo
  - ordering issues in libclustalo.a
cl-yale-haskell:
  - differing number in bin/clisp-haskell
cl-yxorp-cli:
  - unidentified issue in bin/cl-yxorp
cuirass:
  - nondeterministic ordering embedded in guile .go files
ddcci-driver-linux:
  - unidentified differences in .ko files
dehydrated:
  - manpage compressed with gzip timestamp, pass --no-name to fix
deluge:
  - timestamps in python .egg files
didjvu:
  - unidentified issues in python .pyc
directfb:
  - timestamps in .so file
discrover:
  - .pdf produced with different text width
drip:
  - timestamps in .jar file
  - ordering in .jar file
ebusd:
  - embedded dates in bin/ebusd
ecl-*:
  - https://gitlab.com/embeddable-common-lisp/ecl/-/issues/551
edi:
  - uid/gid in tarball
  - sort order in tarball
efitools:
  - unidentified issue in share/efitools/efi/LockDown.efi
efl:
  - unidentified issue in share/elementary/themes/default.edj
emacs-ddskk:
  - timestamp in share/emacs/site-lisp/skk-autoloads.el and skksetup.el
emacs:
  - embeds kernel version in libexec/emacs/*/*/emacs.pdmp
  - unidentified issues in .elc files
emacs-howm:
  - unidentified issues in .elc files
emacs-minimal:
  - embeds kernel version in libexec/emacs/*/*/emacs.pdmp
  - unidentified issues in .elc files
emacs-next:
  - embeds kernel version in libexec/emacs/*/*/emacs.pdmp
emacs-next-pgtk:
  - embeds kernel version in libexec/emacs/*/*/emacs.pdmp
  - unidentified issues in .elc files
emacs-no-x:
  - embeds kernel version in libexec/emacs/*/*/emacs.pdmp
  - unidentified issues in .elc files
emacs-no-x-toolkit:
  - embeds kernel version in libexec/emacs/*/*/emacs.pdmp
  - unidentified issues in .elc files
emacs-sly-named-readtables:
  - differently formatted .el code
  - different numeric values in autoloads comment
emacs-subed:
  - nondeterministic numbers in subed-autoloads.el
emacs-treemacs:
  - date in .elc
emacs-wide-int:
  - embeds kernel version in libexec/emacs/*/*/emacs.pdmp
  - unidentified issues in .elc files
emacs-xwidgets:
  - embeds kernel version in libexec/emacs/*/*/emacs.pdmp
enblend-enfuse:
  - unidentified issue in bin/enfuse bin/enblend
erlang-bbmustache:
  - unidentified issues
fbreader:
  - unidentified issue in bin/FBReader
fenics-dolfin:
  - different precision and rounding differences in floating point numbers in *.h files
fennel:
  - ordering differences in bin/fennel and fennel.lua
fflas-ffpack:
  - bin/fflas-ffpack-config contains different cpu optimizations
filtlong:
  - unidentified issues in bin/filtlong
fldigi:
  - timestamps in bin/flarq
fpc:
  - dates embedded in bin/* and lib/fpc/*/units/*/pastojs/pas2jscompiler.o
freerct:
  - timestamps in .rcd files
fstrcmp:
  - timestamps in .pdf
fullswof-2d:
  - unidentified issue in bin/FullSWOF_2D
gap:
  - kernel version in config.log
  - ld warnings with random temporary filenames in config.log
  - timestamp in *.log
gavl:
  - unidentified issues in lib/libgavl.so.*
gcc-stripped-tarball:
  - unidentified issues in bin/* in tarball
gcl:
  - different addresses for functions in lib/gcl-2.7.0/unixport/libansi_gcl.a
  - ordering issues in lib/*/unixport/saved_ansi_gcl
gerbil:
  - ordering in .scm
  - ordering in .ssi
  - unidentified issues in lib
gf2x:
  - ordering issues in lib/libgf2x.a
  - unidentified issues in lib/libgf2x.so.*
givaro:
  - differing cpu optimizations in bin/givaro-makefile
  - unidentified issues in lib (possibly related to cpu optimizations?)
gnome-arcade:
  - unidentified issues
gnome-desktop:
  - date in share/gnome/gnome-version.xml
gnome-tweaks:
  - unidentified issues in .pyc
gnome-shell-extension-burn-my-windows:
  - ordering issues in
    share/gnome-shell/extensions/burn-my-windows@schneegans.github.com/resources/burn-my-windows.gresource.xml
gnome-vfs:
  - ordering issues in lib/gnome-vfs-2.0/modules/libhttp.a
gnucobol:
   - timestamp in lib/gnucobol/CBL_OC_DUMP.so
gnunet-scheme:
  - timestamp in .pdf (CreationDate via TeXmacs)
go-std:
  - timestamp (nanoseconds since epoch? e.g. 1657092720137458355) in var/cache/go/build/* files
gprolog:
  - date in .h and .a files, share/gprolog/bin/*
  - randomized temporary filenames in share/gprolog/lib/*
groff:
  - ordering issues in various files
gtkglext:
  - ordering in .a files
guile-chickadee:
  - nondeterministic ordering in guile .go files
guile:
  - unidentified issue in lib/guile/3.0/ccache/ice-9/ftw.go
guile-for-guile-emacs:
  - date in lib/libguile-2.2.so.0.0.0
  - unidentified issues in guile .go files
guile-g-golf:
  - nondeterministic ordering in guile .go files
guile-git:
  - nondeterministic ordering embedded in guile .go files
guile-gnome:
  - unidentified issues in .so files
guile-irc:
  - nondeterministic ordering in guile .go files
guile-lib:
  - nondeterministic ordering in guile .go files
guile-next:
  - unidentified issue in lib/guile/3.0/ccache/ice-9/ftw.go
guile-rdf:
  - ordering in guile .go files
guix-build-coordinator:
  - nondeterministic ordering embedded in guile .go files
guix-data-service:
  - randomized href strings in share/doc/guix-data-service/README.html
guix:
  - ordering in guile .go files
hashcat:
  - unidentified issue in bin/hashcat
haunt:
  - ordering in guile .go files
hevea:
  - temporary randomized filename built with ocaml
hh-suite:
  - unidentified issues in bin/, possibly ordering
i3status-rust:
  - unidentified issues in bin/.i3status-rs-real
icedtea-web:
  - timestamps in .jar
  - ordering in .jar
  - date in manpages
icu4c-build-root:
  - kernel version in config.log
  - randomized temporary file in config.log
insight-toolkit:
  - unidentified issues in lib
ipxe:
  - .iso file, possibly filesystem metadata
irods:
  - embeds random/arbitrary number in define include/irods/server_control_plane_command.hpp
isl:
  - unidentified issues in lib/libisl.so.*
java-cofoja:
  - dates embedded in filenames of .jar files (e.g. share/java/cofoja+asm-1.2-20220529.jar)
java-commons-daemon:
  - timestamp embedded in .html documentation made with javadoc
  - date embedded in .html (e.g. <meta name="date" content="2022-05-29">)
java-commons-httpclient:
  - timestamp embedded in .html documentation made with javadoc
  - date embedded in .html (e.g. <meta name="date" content="2022-05-29">)
  - ordering isues in documentation (parallelism?)
java-jblas:
  - timestamps in .jar
java-jdom:
  - timestamps embedded in filenames of .jar files (e.g. jdom-2.x-2022.08.10.22.18-junit.jar)
java-ngs:
  - timestamps in .jar
  - ordering in .jar
java-openmpi:
  - timestamp embedded in .html documentation made with javadoc
  - date embedded in .html (e.g. <meta name="date" content="2022-05-29">)
java-tomcat:
  - date in .html (e.g. <time datetime="2022-08-10">Aug 10 2022</time>)
java-xmlpull-api-v1:
  - timestamp embedded in .html documentation made with javadoc
  - date embedded in .html (e.g. <meta name="date" content="2022-05-29">)
julia:
  - unidentified issues
  - diffoscope takes ~forever
kawa:
  - timestamps in .jar
  - ordering in .jar
kdelibs4support:
  - unidentified issues in .so, possibly fixed in versions 5.93+
keepalived:
  - unidentified issue in .info
kicad:
  - uid/gid in tarball
  - sort order in tarball
kissat:
  - kernel version embedded in bin/ and .so files
  - timestamp embedded in bin/ and .so files
kodi:
  - timestamp embedded in lib/kodi/kodi-x11
kodi-wayland:
  - timestamp embedded in lib/kodi/kodi-x11
lagrange:
  - timestamp in VERSION file embedded in share/lagrange/resources.lgr
laminar:
  - unidentified issue in sbin/laminard
lean:
  - unidentified issues in .olean files
lepton-eda:
  - hashed identifiers in .go files
libadwaita:
  - date in share/metainfo/org.gnome.Adwaita1.Demo.metainfo.xml
libcamera:
  - unidentified issue (maybe embedded signatures?)
libccd:
  - differing characters in .html files (‘’ vs. '' and ’ vs. &#39;s)
libflame:
  - undentified issues in .so file
libgtop:
  - kernel version embedded in bin/libgtop_server2
libjcat:
  - timestamp and randomness in tls cert libexec/installed-tests/libjcat/colorhug/firmware.bin.p7c
liblinphone:
  - ordering issues in include/linphone++/linphone.hh
  - ordering issues in .so
libmpeg2:
  - ordering issues in lib/
libnet:
  - timestamps in manpage
libopensmtpd:
  - date in manpage
libosmo-dsp:
  - timestamps in share/doc/libosmodsp/html/_formulas.log
libpinyin:
  - unidentified issues
libquicktime:
  - unidentified issues in bin/ and .so files
librem-ec-acpi-linux-module:
  - unidentified differences in .ko files
libstdc++-doc:
  - date in .html
libwebsockets:
  - private key share/libwebsockets-test-server/libwebsockets-test-server.key.pem
linbox:
  - cpu specific compiler flags in bin/linbox-config
linux-libre:
  - differences in bzImage and System.map
  - unidentified differences in .ko files
linux-libre-bpf:
  - differences in bzImage and System.map
  - unidentified differences in .ko files
  - unidentified differences in bzimage
lirc:
  - uid/gid in tarball
lkrg:
  - unidentified differences in .ko files
lokke:
  - nondeterministic ordering embedded in guile .go files
looking-glass-client:
  - unidentified issues
lttng-modules:
  - unidentified differences in .ko files
m4ri:
  - cpu cache values in include/m4ri/m4ri_config.h
m4rie:
  - unidentified issues
maradns:
  - FIX PROPOSED timestamps embedded
  - FIX PROPOSED random number embedded
maven-compat:
  - ordering issues in META-INF/plexus/components.xml inside .jar
maven-model-builder:
  - ordering issues in META-INF/sisu/javax.inject.Named inside .jar
maven-resolver-provider:
  - ordering issues in META-INF/sisu/javax.inject.Named inside .jar
maven-settings-builder:
  - ordering issues in META-INF/sisu/javax.inject.Named inside .jar
maxima:
  - lib/maxima/5.45.1/binary-sbcl/maxima.core
  - ordering or other issues in .html
meep:
  - unidentified issues
mercurial:
  - ordering inside .pyc files
mia:
  - ordering issues in manpages
minced:
  - timestamps in .jar
mingw-w64-i686:
  - timestamps in .a files
mingw-w64-i686-winpthreads:
  - timestamps in .a files
mingw-w64-x86_64:
  - timestamps in .a files
mingw-w64-x86_64-winpthreads:
  - timestamps in .a files
miniupnpc:
  - embedded kernel version in User-Agent
mit-scheme:
  - unidentified issues
mkp224o:
  - unidentified issues in bin/mkp224o
mm-common:
  - uid/gid in share/doc/mm-common/skeletonmm.tar.xz,
    patch https://bugs.debian.org/977177
    fix submitted https://issues.guix.gnu.org/57304
moarvm:
  - unidentified issues in lib/libmoar.so
mono:
  - unidentified issues
mruby:
  - unidentified issues
mu:
  - unidentified issues in .elc file
musescore:
  - timestamp? randomness? in
    share/mscore-3.6/workspaces/Advanced.workspace in .zip format
musl-cross:
  - unidentified issues
myrddin:
  - unidentified issues
mysql:
  - kernel version share/mysql/docs/INFO_BIN
  - timestamps in share/mysql/docs/INFO_BIN
nanomsg:
  - unidentified issues
nauty:
  - unidentified issues
ncdu2:
  - unidentified issues
ne:
  - date in bin/ne
netcdf-fortran:
  - timestamp in lib/libnetcdff.settings
nng:
  - unidentified issues
node:
  - ordering issues in include/node/config.gypi
node-addon-api:
  - ordering issues in lib/node_modules/node-addon-api/test/build/Makefile
  - ordering issues in lib/node_modules/node-addon-api/test/build/config.gypi
node-openzwave-shared:
  - ordering issues in lib/node_modules/openzwave-shared/build/Makefile
  - ordering issues in lib/node_modules/openzwave-shared/build/config.gypi
node-segfault-handler:
  - ordering issues in lib/node_modules/segfault-handler/build/Makefile
  - ordering issues in lib/node_modules/segfault-handler/build/config.gypi
node-serialport-bindings:
  - ordering issues in lib/node_modules/@serialport/bindings/build/Makefile
  - ordering issues in lib/node_modules/@serialport/bindings/build/config.gypi
node-sqlite3:
  - ordering issues in lib/node_modules/sqlite3/build/Makefile
  - ordering issues in lib/node_modules/sqlite3/build/config.gypi
notmuch:
  - unidentified issues in share/info/notmuch-tag.info.gz
nqp:
  - unidentified issues in .moarvm files
nss:
  - unidentified issues in .chk files
nushell:
  - unidentified issues in bin/nu
nyacc:
  - nondeterministic ordering embedded in guile .go files
nyxt:
  - unidentified issues in bin/.nyxt-real
ocrodjvu:
  - unidentified issues in .pyc
octave:
  - unidentified issues in .qch and .qhc files
openblas:
  - unidentified issues
openblas-ilp64:
  - unidentified issues
openjdk:
  - timestamps in .jar
  - timestamps in .diz
  - ordering issues in .zip
  - timestamp in libjvm.so
openmolar:
  - timestamps in .pyc
  - randomness in resources_rc.py
opensmtpd-filter-dkimsign:
  - date in share/man/man8/filter-dkimsign.8.gz
  - kernel version in share/man/man8/filter-dkimsign.8.gz
pari-gp:
  - timestamps in .dvi (tex? texlive?)
patchwork:
  - ordering issue in share/patchwork/htdocs/staticfiles.json
perf:
  - ordering issues in bin/*
perl6-tap-harness:
  - unidentified issues in precompiled perl6 files
perl6-zef:
  - unidentified issues in precompiled perl6 files
perl-class-methodmaker:
  - significant differences in generated perl code possible patch
    https://salsa.debian.org/perl-team/modules/packages/libclass-methodmaker-perl/-/blob/master/debian/patches/reproducible_build
    https://rt.cpan.org/Public/Bug/Display.html?id=104163
    fix pushed f31e55d0819064557b9a2af687f05b131f5c4f26
perl-encode-hanextra:
  - unidentified issues in .so
petsc:
  - number of processors and system load embedded in
    lib/petsc/conf/petscvariables
  - kernel version in include/petscmachineinfo.h
petsc-complex:
  - number of processors and system load embedded in
    lib/petsc/conf/petscvariables
  - kernel version in include/petscmachineinfo.h
petsc-complex-openmpi:
  - number of processors and system load embedded in
    lib/petsc/conf/petscvariables
  - kernel version in include/petscmachineinfo.h
petsc-openmpi:
  - number of processors and system load embedded in
    lib/petsc/conf/petscvariables
  - kernel version in include/petscmachineinfo.h
pgloader:
  - unidentified issues in bin/
phockup:
  - timestamp in .pyc
plover:
  - timestamp in .pyc
  - ordering issues in .pyc
  - randomness in resources_rc.py
polyml:
  - unidentified issues
porechop:
  - unidentified issues
proplib:
  - timestamps in .a files
pure:
  - ordering issues in "extralibs" in lib/pkgconfig/pure.pc
pwsafe:
  - ordering issues in .zip files
pybind11:
  - unidentified issues in .pyc
python-blosc:
  - unidentified issues cpython*.so
python-gamera:
  - unidentified issues cpython*.so
python-numba:
  - unidentified issues in .nbi and .nbc files in tests/__pycache__ directories
python-numpy-next:
  - unidentified issues cpython*.so
python-pytest:
  - timestamps in .pyc
python-shiboken-2:
  - unidentified issues cpython*.so
python-xapian-bindings:
  - timestamps in .pyc
quickjs:
  - unidentified issues in lib/quickjs/libquickjs.lto.a
racket:
  - differing hashes(?) in various .dep files
rakudo:
  - unidentified issues in .moarvm files
rc:
  - date embedded in bin/rc
r-cli:
  - pid embedded in site-library/cli/R/cli.rdb
rct:
  - undentified issues
r-dimred:
  - unidentified issues in .rdb and .rdx files
readymedia:
  - kernel version in sbin/minidlnad
rebar3:
  - unidentified issues in
renpy:
  - unidentified issues in .rpyc files
restic:
  - differing GO BUILDID in bin/restic
r-glmmtmb:
  - unidentified issues in .RData files
  - differing hashes in site-library/glmmTMB/doc/troubleshooting_cache/html
r-laplacesdemon:
  - unidentified issues in .rdb and .rdx files
r-liger:
  - timestamps in .jar
r-mclust:
  - unidentified issues in .rdb files
r-minimal:
  - unidentified issues in .rdb and .rdx files
  - date in lib/R/library/stats/doc/reshape.pdf
r-misha:
  - unidentified issues in site-library/misha/trackdb/test/.db.cache
r-omnipathr:
  - unidentified issues in .rdb files
r-quantmod:
  - unidentified issues in .rdb and .rdx files
r-rbowtie2:
  - unidentified issues in site-library/Rbowtie2/bowtie2*
rrdtool:
  - unidentified issues
r-repr:
  - unidentified issues in .rdb and .rdx files
r-rgraphviz:
  - unidentified issues in site-library/Rgraphviz/libs/Rgraphviz.so
r-rhdf5filters:
  - unidentified issues in site-library/rhdf5filters/lib/libH5Zblosc.so
r-rjava:
  - timestamps in .jar file
  - ordering in .jar file
r-rsbml:
  - kernel version in site-library/rsbml/SBML_odeSolver-1.7.0beta/config.log
rtl8812au-aircrack-ng-linux-module:
  - unidentified differences in .ko files
rtl8821ce-linux-module:
  - unidentified differences in .ko files
r-tm:
  - unidentified issues in .rdb and .rdx files
r-topicmodels:
  - unidentified issues in .rdb and .rdx files
r-tractor-base:
  - unidentified issues in .rdb and .rdx files
ruby-ae:
  - ordering issues in .gemspec
ruby-ansi:
  - ordering issues in .gemspec
ruby-citrus:
  - date in .gemspec
ruby-concurrent:
  - date in .gemspec
ruby:
  - date in gem_make.out files
  - date in Makefile files
ruby-ffi:
  - ordering issues in Makefile
ruby-money-open-exchange-rates:
  - date in .gemspec
ruby-oj:
  - date in .gemspec
  - ordering issues in .gemspec
ruby-patron:
  - temporarily filename in mkmf.log
ruby-pg:
  - temporarily filename in mkmf.log
  - ordering issues in Makefile
ruby-rexml:
  - ordering issues in .gemspec
ruby-rjb:
  - temporarily filename in mkmf.log
  - extra content in RBridge.class
ruby-sys-filesystem:
  - date in .gemspec
ruby-sys-uname:
  - date in .gemspec
ruby-terminfo:
  - date in gem_make.out files
  - temporary filename in gem_make.out files
  - date in Makefile files
  - temporary filename in Makefile files
ruby-treetop:
  - date in .gemspec
ruby-wapiti:
  - date in .gemspec
  - ordering issues in Makefile
salmon:
  - unidentified issue in .a file
sbcl-bknr-datastore:
  - unidentified issue in .fasl
sbcl-burgled-batteries3:
  - unidentified issue in .fasl
sbcl-cffi:
  - unidentified issue in .fasl
sbcl-cl-ana:
  - unidentified issue in .fasl
sbcl-cl-charms:
  - unidentified issue in .fasl
sbcl-cl-containers:
  - date in test summary
  - timing in test summary
sbcl-cl-diskspace:
  - unidentified issue in .fasl
sbcl-cl-freetype2:
  - unidentified issue in .fasl
sbcl-clinenoise:
  - unidentified issue in .fasl
sbcl-cl-libuv:
  - unidentified issue in .fasl
sbcl-cl-rdkafka:
  - unidentified issue in .fasl
sbcl-cl-unicode:
  - unidentified issue in .fasl
sbcl-dexador:
  - unidentified issue in .fasl
sbcl:
  - unidentified issue in .fasl
sbcl-gsll:
  - unidentified issue in .fasl
sbcl-hdf5-cffi:
  - unidentified issue in .fasl
  - temporary filenames in .hd5
sbcl-iolib:
  - unidentified issue in .fasl
sbcl-magicffi:
  - unidentified issue in .fasl
sbcl-metabang-bind:
  - date in test summary
  - timing in test summary
sbcl-metatilities-base:
  - date in test summary
  - timing in test summary
sbcl-montezuma:
  - uniidentified isses in "segments" files
sbcl-osicat:
  - unidentified issue in .fasl
sbcl-overlord:
  - unidentified issue in .fasl
sbcl-png:
  - unidentified issue in .fasl
sbcl-prometheus:
  - unidentified issue in .fasl
sbcl-pzmq:
  - unidentified issue in .fasl
sbcl-supertrace:
  - unidentified issue in .fasl
sbcl-woo:
  - unidentified issue in .fasl
scanmem:
  - unidentified issues cpython*.so
scheme48:
  - unidentified issue in lib/scheme48-*/scheme48.image
scrollkeeper:
  - timestamps in var/log/scrollkeeper.log
scsh:
  - unidentified issue in lib/scsh-*/scsh.image
segemehl:
  - unidentified issue in bin/*
serveez:
  - timestamps in bin/serveez
silc-toolkit:
  - unidentified issue in lib/*.so.*
singularity:
  - timestamps in libexec/singularity/bootstrap-scripts/environment.tar
skribilo:
  - timestamps in .html files
  - timestamps in .pdf files
  - timestamps in .info files
slepc:
  - unidentified issues in lib/libslepc.so.*
slepc-complex:
  - unidentified issues in lib/libslepc.so.*
slepc-complex-openmpi:
  - unidentified issues in lib/libslepc.so.*
slepc-openmpi:
  - unidentified issues in lib/libslepc.so.*
smalltalk:
  - sort order in .star (embedded .zip)
  - timestamps in .star (embedded .zip)
smlnj:
  - unidentified issues in bin and lib
smplayer:
  - date in smplayer.appdata.xml
sonnet:
  - unidentified issues in lib/libKF5SonnetCore.so.*
srain:
  - ordering in share/doc/srain/html/.doctrees/environment.pickle
srecord:
  - timestamps in .pdf generated by ghostscript
star:
  - unidentified issues in bin/STAR
starlong:
  - unidentified issues in bin/STARlong
stumpwm:
  - unidentified issues in bin/stumpwm
stumpwm-with-slynk:
  - unidentified issues in bin/stumpwm
superstarfighter:
  - unidentified issues in share/superstarfighter/superstarfighter.pck
surge-synth:
  - ordering of and/or differing .svg files within Surge.so
swi-prolog:
  - timestamps in .prc
  - ordering issues in lib/swipl/doc/manindex.db
  - timestamps in .pl
  - unidentified issue in lib/swipl/library/pldoc/doc_html.qlf
swish-e:
  - maybe ordering issues in bin/swish-e and lib/libswish-e*.a, maybe locale related files
syslinux:
  - unidentified issues (maybe obscure timestamps?) in bin/syslinux, sbin/extlinux and share/syslinux/*
tao:
  - dates in tao_version in bin/tao-config
  - timestamps in DATE in share/tao/examples/Makefile
  - dates in TAO_VERSION and VERSION in share/tao/examples/Makefile
tensorflow:
  - ordering in .pyc files
teximpatient:
  - timestamps in .dvi
  - timestamps in .pdf
texlive-cm:
  - timestamps in .log and .600gf files
texlive-etex:
  - timestamps in .log and .600gf files
texlive-fontinst:
  - timestamps in .log files
texlive-fonts-ec:
  - timestamps in .log and .600gf files
texlive-fonts-latex:
  - timestamps in .log and .600gf files
texlive-fonts-rsfs:
  - timestamps in .log and .600gf files
texlive-jadetex:
  - timestamps in .fmt files
texlive-knuth-lib:
  - timestamps in .log and .600gf files
texlive-latex-base:
  - timestamps in .fmt files
  - timestamps in .log files
  - timestamps in .aux files
texlive-latex-changepage:
  - date in .sty files
texlive-latex-trimspaces:
  - date in .sty files
texlive-latex-xkeyval:
  - timestamps in .dvi
texlive-metafont:
  - timestamps in mf.base
texlive-mflogo:
  - timestamps in .600gf files
texlive-xindy:
  - case differences (e.g. "DH" vs. "dh") in .xdy files
texlive-xmltex:
  - timestamps in .fmt files
tinmop:
  - unidentified issues in bin/tinmop
  - sort order in embedded .lisp and .scm files
tla2tools:
  - date in .jar
tome4:
  - unidentified issues in share/tome4/t-engine
tsukundere:
  - timestamps in .mo files
ufoai:
  - timestamps in .pk3 (.zip)
  - ordering in .pk3 (.zip)
ugrep:
  - unidentified issues in bin/ugrep
uim:
  - ordering issues in share/uim/loader.scm and share/uim/installed-modules.scm
uim-gtk:
  - ordering issues in share/uim/loader.scm and share/uim/installed-modules.scm
ungoogled-chromium:
  - uidentified issues in resources.pak
  - unidentified issues in lib/chromium
unknown-horizons:
  - differences in .png files
  - ordering issues in .json
utox:
  - temporary filenames in bin/.utox-real
v4l2loopback-linux-module:
  - unidentified differences in .ko files
vala:
  - unidentified issues in bin and lib
vhba-module:
  - unidentified differences in .ko files
vice:
  - unidentified issues in bin
virtuoso-ose:
  - sort order or randomness in share/virtuoso/vad/isparql_dav.vad
vivid:
  - unidentified issues in bin/vivid
vlc:
  - uid in share/vlc/skins2/default.vlt
wine64:
  - timestamps in *.dll.so, can be (partly?) mitigated using
    WIDL_TIME_OVERRIDE environment variable or patching out in
    tools/widl/write_msft.c
wine64-staging:
  - timestamps in *.dll.so
xjackfreak:
  - unidentified issues in bin
xlispstat:
  - unidentified issue in lib/xlispstat/xlisp.wks
xpadneo:
  - unidentified differences in .ko files
xpra:
  - embedded cpu info in lib/python3.9/site-packages/xpra/build_info.py and .pyc
  - timestamp in .pyc
xsnow:
  - date in share/metainfo/xsnow.appdata.xml
yadifa:
  - unidentified issues bin/ sbin/ and lib/
zeitgeist:
  - ordering issues in embedded URLs in lib/libzeitgeist-2.0.so.*
zita-alsa-pcmi:
  - unidentified issues in lib/libzita-alsa-pcmi.so.0.3.2
zn-poly:
  - unidentified issues in lib/
zynaddsubfx:
  - random(?) number in lib/lv2/ZynAddSubFX.lv2/presets.ttl

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 227 bytes --]