[core-updates-frozen] Attempt julia@1.6.4 (upgrade)

[core-updates-frozen] Attempt julia@1.6.4 (upgrade)

[zimoun]

Hi,

First, I am not convinced that upgrade Julia from 1.6.3 to 1.6.4 is
something to do now; especially when the branch is “frozen”.  Using
patches #52117 [1], all failures are fixed for 1.6.3.

1: https://issues.guix.gnu.org/52117


Here a rough attempt which replaces the source of 1.6.3 by 1.6.4 and
many tests are deeply broken (broken precompile is not a good sign, at
all ;-)).  Well, it seems expected regarding the complexity of the Julia
stack. :-)

Therefore, the upgrade requires various other upgrades elsewhere and
probably some fixes with couple of patches.  As it had been for previous
Julia upgrades. :-)

Then, using this upgraded julia@1.6.4, there is a high probability that
many julia-* packages would be broken too and thus they would require
fixes.

IMHO, if we want a working Julia in the delay for the merge, the best
seems to just apply patch#52117 and let this Julia upgrade for another
round.  For what my opinion is here. :-)


Cheers,
simon



--8<---------------cut here---------------start------------->8---
Error in testset precompile:
Test Failed at /tmp/guix-build-julia-1.6.4.drv-0/jl_kkDGDX/Foo4b3a94a1a081a8cb.jl:109
  Expression: g() === 2.0
   Evaluated: 97.0 === 2.0
Error in testset precompile:
Test Failed at /tmp/guix-build-julia-1.6.4.drv-0/julia-1.6.4/test/precompile.jl:240
  Expression: Foo.ptr2 === Ptr{UInt8}(0)
   Evaluated: Ptr{UInt8} @0x0000000000000001 === Ptr{UInt8} @0x0000000000000000
Error in testset precompile:
Test Failed at /tmp/guix-build-julia-1.6.4.drv-0/julia-1.6.4/test/precompile.jl:242
  Expression: Foo.layout1::Vector{Ptr{Int8}} == Ptr{Int8}[Ptr{Int8}(0), Ptr{Int8}(0), Ptr{Int8}(-1)]
   Evaluated: Ptr{Int8}[Ptr{Int8} @0x0000000000000000, Ptr{Int8} @0x0000000000000001, Ptr{Int8} @0xffffffffffffffff] == Ptr{Int8}[Ptr{Int8} @0x0000000000000000, Ptr{Int8} @0x0000000000000000, Ptr{Int8} @0xffffffffffffffff]
Error in testset precompile:
Test Failed at /tmp/guix-build-julia-1.6.4.drv-0/julia-1.6.4/test/precompile.jl:243
  Expression: Foo.layout2 == Any[Ptr{Int8}(0), Ptr{Int16}(0), Ptr{Int32}(-1)]
   Evaluated: Any[Ptr{Int8} @0x0000000000000000, Ptr{Int16} @0x0000000000000001, Ptr{Int32} @0xffffffffffffffff] == Any[Ptr{Int8} @0x0000000000000000, Ptr{Int16} @0x0000000000000000, Ptr{Int32} @0xffffffffffffffff]
Error in testset precompile:
Test Failed at /tmp/guix-build-julia-1.6.4.drv-0/julia-1.6.4/test/precompile.jl:269
  Expression: ms isa Array{Any, 1}
   Evaluated: ErrorException("Required dependency FooBase4b3a94a1a081a8cb [top-level] failed to load from a cache file.") isa Vector{Any}
Error in testset precompile:
Test Failed at /tmp/guix-build-julia-1.6.4.drv-0/julia-1.6.4/test/precompile.jl:267
  Expression: begin
    ms = Base._require_from_serialized(cachefile)
    #= /tmp/guix-build-julia-1.6.4.drv-0/julia-1.6.4/test/precompile.jl:269 =# @test ms isa Array{Any, 1}
end
   Evaluated: Test.LogRecord[]
Error in testset precompile:
Test Failed at /tmp/guix-build-julia-1.6.4.drv-0/julia-1.6.4/usr/share/julia/stdlib/v1.6/Test/src/Test.jl:671
  Expression: contains_warn(read(fname, String), $(Expr(:escape, "@ccallable was already defined for this method name")))
Error in testset precompile:
Test Failed at /tmp/guix-build-julia-1.6.4.drv-0/julia-1.6.4/test/precompile.jl:291
  Expression: modules == [Base.PkgId(Foo) => Base.module_build_id(Foo)]
   Evaluated: Pair{Base.PkgId, UInt64}[Foo4b3a94a1a081a8cb [top-level] => 0x000714cda79c2f8a] == Pair{Base.PkgId, UInt64}[Foo4b3a94a1a081a8cb [top-level] => 0x000714cdcc92a9f5]
Error in testset precompile:
Test Failed at /tmp/guix-build-julia-1.6.4.drv-0/julia-1.6.4/test/precompile.jl:304
  Expression: Dict(modules) == merge(Dict((let m = Base.PkgId(s)
                m => Base.module_build_id(Base.root_module(m))
            end for s = ["Base", "Core", "Main", string(Foo2_module), string(FooBase_module)])), Dict((let m = Base.root_module(Base, s)
                Base.PkgId(m) => Base.module_build_id(m)
            end for s = [:ArgTools, :Artifacts, :Base64, :CRC32c, :Dates, :DelimitedFiles, :Distributed, :Downloads, :FileWatching, :Future, :InteractiveUtils, :LazyArtifacts, :LibCURL, :LibCURL_jll, :LibGit2, :Libdl, :LinearAlgebra, :Logging, :Markdown, :Mmap, :MozillaCACerts_jll, :NetworkOptions, :Pkg, :Printf, :Profile, :p7zip_jll, :REPL, :Random, :SHA, :Serialization, :SharedArrays, :Sockets, :SparseArrays, :Statistics, :SuiteSparse, :TOML, :Tar, :Test, :UUIDs, :Unicode, :nghttp2_jll])))
   Evaluated: Dict{Base.PkgId, UInt64}(Future [9fa8497b-333b-5362-9e8d-4d0656e87820] => 0x00071396ddcbf382, p7zip_jll [3f19e933-33d8-53b3-aaab-bd5110c3b7a0] => 0x00071399314d1416, FileWatching [7b1f6079-737a-58dc-b8bc-7a2ca5c1b5ee] => 0x000713941e0295e8, Profile [9abbd945-dff8-562f-b5e8-e1ebf5ef1b79] => 0x000713973b8b20ed, UUIDs [cf7118a7-6976-5b1a-9a39-7adc72f591a4] => 0x00071397dc9eef34, MozillaCACerts_jll [14a3606d-f60d-562e-9121-12d972cd8159] => 0x0007139902e9e715, Logging [56ddb016-857b-54e1-b83d-db4d58db5568] => 0x000713942216cc44, LazyArtifacts [4af54fe1-eca0-43a8-85a7-787d91b784e3] => 0x00071399fd30494b, Sockets [6462fe0b-24de-5631-8697-dd941f90decc] => 0x000713944365e25e, LinearAlgebra [37e2e46d-f89d-539d-b4ee-838fcccc9c8e] => 0x0007139455f70aa6…) == Dict{Base.PkgId, UInt64}(FileWatching [7b1f6079-737a-58dc-b8bc-7a2ca5c1b5ee] => 0x000713941e0295e8, MozillaCACerts_jll [14a3606d-f60d-562e-9121-12d972cd8159] => 0x0007139902e9e715, UUIDs [cf7118a7-6976-5b1a-9a39-7adc72f591a4] => 0x00071397dc9eef34, Logging [56ddb016-857b-54e1-b83d-db4d58db5568] => 0x000713942216cc44, Markdown [d6f4376e-aef5-505a-96c1-9c027394607a] => 0x00071395ecfc76c0, Unicode [4ec0a83e-493e-50e2-b9ac-8f72acf5a8f5] => 0x00071394501d1f19, FooBase4b3a94a1a081a8cb [top-level] => 0x000714cdd480d344, CRC32c [8bf52ea8-c179-5cab-976a-9e18b702a9bc] => 0x000713941c4e26b1, Main [top-level] => 0x0007137d8d13f4e8, Base64 [2a0f44e3-6c83-55bd-87e4-b1978d98bd5f] => 0x0007139416f91bb6…)
Error in testset precompile:
Test Failed at /tmp/guix-build-julia-1.6.4.drv-0/julia-1.6.4/test/precompile.jl:413
  Expression: (Base.pkgorigins[id1]).cachepath == cachefile
   Evaluated: nothing == "/tmp/guix-build-julia-1.6.4.drv-0/jl_kkDGDX/compiled/v1.6/UsesB4b3a94a1a081a8cb.ji"
Error in testset precompile:
Test Failed at /tmp/guix-build-julia-1.6.4.drv-0/julia-1.6.4/test/precompile.jl:449
  Expression: Base.stale_cachefile(FooBar_file, joinpath(cachedir, "FooBar.ji")) isa Vector
   Evaluated: true isa Vector{T} where T
Error in testset precompile:
Test Failed at /tmp/guix-build-julia-1.6.4.drv-0/julia-1.6.4/test/precompile.jl:456
  Expression: Base.stale_cachefile(relFooBar_file, joinpath(cachedir, "FooBar.ji")) isa Vector
   Evaluated: true isa Vector{T} where T
Error in testset precompile:
Test Failed at /tmp/guix-build-julia-1.6.4.drv-0/julia-1.6.4/test/precompile.jl:468
  Expression: Base.stale_cachefile(FooBar1_file, joinpath(cachedir2, "FooBar1.ji")) isa Vector
   Evaluated: true isa Vector{T} where T
Error in testset precompile:
Test Failed at /tmp/guix-build-julia-1.6.4.drv-0/julia-1.6.4/test/precompile.jl:561
  Expression: t1_yes == t2_yes
   Evaluated: "1.637953005216387e9" == "1.637953005549356e9"
Error in testset precompile:
Test Failed at /tmp/guix-build-julia-1.6.4.drv-0/julia-1.6.4/test/precompile.jl:595
  Expression: read(fname, String) == "Iterators\n"
   Evaluated: "┌ Warning: The call to compilecache failed to create a usable precompiled cache file for Test6c92f26 [top-level]\n│   exception = Required dependency Iterators [top-level] failed to load from a cache file.\n└ @ Base loading.jl:1058\nIterators\n" == "Iterators\n"
Error in testset precompile:
Test Failed at /tmp/guix-build-julia-1.6.4.drv-0/julia-1.6.4/test/precompile.jl:595
  Expression: read(fname, String) == "Iterators\n"
   Evaluated: "┌ Warning: The call to compilecache failed to create a usable precompiled cache file for Test6c92f26 [top-level]\n│   exception = Required dependency Iterators [top-level] failed to load from a cache file.\n└ @ Base loading.jl:1058\nIterators\n" == "Iterators\n"
Error in testset precompile:
Test Failed at /tmp/guix-build-julia-1.6.4.drv-0/julia-1.6.4/test/precompile.jl:684
  Expression: Distributed.remotecall_eval(Main, wid, quote
            Base.module_build_id(Base.root_module(Main, $(QuoteNode(ModuleB))))
        end) == uuid
   Evaluated: 0x000714d2da74164c == 0x000714d2b3f4a19c
--8<---------------cut here---------------end--------------->8---

Re: [core-updates-frozen] Attempt julia@1.6.4 (upgrade)

[Maxim Cournoyer]

Hi Simon,

zimoun <zimon.toutoune@gmail.com> writes:

> Hi,
>
> First, I am not convinced that upgrade Julia from 1.6.3 to 1.6.4 is
> something to do now; especially when the branch is “frozen”.  Using
> patches #52117 [1], all failures are fixed for 1.6.3.
>
> 1: https://issues.guix.gnu.org/52117
>
>
> Here a rough attempt which replaces the source of 1.6.3 by 1.6.4 and
> many tests are deeply broken (broken precompile is not a good sign, at
> all ;-)).  Well, it seems expected regarding the complexity of the Julia
> stack. :-)
>
> Therefore, the upgrade requires various other upgrades elsewhere and
> probably some fixes with couple of patches.  As it had been for previous
> Julia upgrades. :-)
>
> Then, using this upgraded julia@1.6.4, there is a high probability that
> many julia-* packages would be broken too and thus they would require
> fixes.
>
> IMHO, if we want a working Julia in the delay for the merge, the best
> seems to just apply patch#52117 and let this Julia upgrade for another
> round.  For what my opinion is here. :-)

Seems I had not answered here; thanks for attempting my suggestion!  It
seems you were right that Julia (even for a patch version bump) is
picky.

It'll have to be resolved on core-updates :-).

Thanks,

Maxim

Re: [core-updates-frozen] Attempt julia@1.6.4 (upgrade)

[zimoun]

Hi Maxim,

On Mon, 13 Dec 2021 at 22:20, Maxim Cournoyer <maxim.cournoyer@gmail.com> wrote:

> It'll have to be resolved on core-updates :-).

Well, Julia update can happen in master, IMHO.  Even, depending on the
release date, it appears to me doable for the next release. ;-)

Cheers,
simon

Re: [core-updates-frozen] Attempt julia@1.6.4 (upgrade)

[Maxim Cournoyer]

Hey Simon!

zimoun <zimon.toutoune@gmail.com> writes:

> Hi Maxim,
>
> On Mon, 13 Dec 2021 at 22:20, Maxim Cournoyer <maxim.cournoyer@gmail.com> wrote:
>
>> It'll have to be resolved on core-updates :-).
>
> Well, Julia update can happen in master, IMHO.  Even, depending on the
> release date, it appears to me doable for the next release. ;-)

Oh wow!  You sound confident, I like it!  :-).

When you have polished patches ready, we could have them built on the
version-1.4.0 branch.

Cheers,

Maxim