unofficial mirror of bug-guix@gnu.org 
 help / color / mirror / code / Atom feed
* bug#43721: Package 'dune' (ocaml) is not Reproducible
@ 2020-09-30 11:56 zimoun
  2020-09-30 12:41 ` Tobias Geerinckx-Rice via Bug reports for GNU Guix
  2020-09-30 12:42 ` Julien Lepiller
  0 siblings, 2 replies; 8+ messages in thread
From: zimoun @ 2020-09-30 11:56 UTC (permalink / raw)
  To: 43721

Dear,

Using Guix 04a459a, the classical:

   guix build dune
   guix build dune --no-grafts --check -K

return:

--8<---------------cut here---------------start------------->8---
guix build: error: derivation `/gnu/store/kg7mnb1b09n5zddgvc4hs8ira3i4jzz2-dune-1.11.3.drv' may not be deterministic: output `/gnu/store/1wwdmzcjhrpal92sz2zwzhyqmbc3w7ri-dune-1.11.3' differs from ‘/gnu/store/1wwdmzcjhrpal92sz2zwzhyqmbc3w7ri-dune-1.11.3-check’
--8<---------------cut here---------------end--------------->8---

then:

   diff -r --no-dereference /gnu/store/1wwdmzcjhrpal92sz2zwzhyqmbc3w7ri-dune-1.11.3{,-check}
   
returns a large output (truncated here):

--8<---------------cut here---------------start------------->8---
Binary files /gnu/store/1wwdmzcjhrpal92sz2zwzhyqmbc3w7ri-dune-1.11.3/lib/ocaml/site-lib/dune/configurator/configurator.cma and /gnu/store/1wwdmzcjhrpal92sz2zwzhyqmbc3w7ri-dune-1.11.3-check/lib/ocaml/site-lib/dune/configurator/configurator.cma differ
Binary files /gnu/store/1wwdmzcjhrpal92sz2zwzhyqmbc3w7ri-dune-1.11.3/lib/ocaml/site-lib/dune/configurator/configurator__Extract_obj.cmt and /gnu/store/1wwdmzcjhrpal92sz2zwzhyqmbc3w7ri-dune-1.11.3-check/lib/ocaml/site-lib/dune/configurator/configurator__Extract_obj.cmt differ
Binary files /gnu/store/1wwdmzcjhrpal92sz2zwzhyqmbc3w7ri-dune-1.11.3/lib/ocaml/site-lib/dune/configurator/configurator__V1.cmti and /gnu/store/1wwdmzcjhrpal92sz2zwzhyqmbc3w7ri-dune-1.11.3-check/lib/ocaml/site-lib/dune/configurator/configurator__V1.cmti differ

[...]

Binary files /gnu/store/1wwdmzcjhrpal92sz2zwzhyqmbc3w7ri-dune-1.11.3/lib/ocaml/site-lib/dune/_stdune/stdune__User_error.cmti and /gnu/store/1wwdmzcjhrpal92sz2zwzhyqmbc3w7ri-dune-1.11.3-check/lib/ocaml/site-lib/dune/_stdune/stdune__User_error.cmti differ
Binary files /gnu/store/1wwdmzcjhrpal92sz2zwzhyqmbc3w7ri-dune-1.11.3/lib/ocaml/site-lib/dune/_stdune/stdune__User_message.cmti and /gnu/store/1wwdmzcjhrpal92sz2zwzhyqmbc3w7ri-dune-1.11.3-check/lib/ocaml/site-lib/dune/_stdune/stdune__User_message.cmti differ
Binary files /gnu/store/1wwdmzcjhrpal92sz2zwzhyqmbc3w7ri-dune-1.11.3/lib/ocaml/site-lib/dune/_stdune/stdune__User_warning.cmti and /gnu/store/1wwdmzcjhrpal92sz2zwzhyqmbc3w7ri-dune-1.11.3-check/lib/ocaml/site-lib/dune/_stdune/stdune__User_warning.cmti differ
--8<---------------cut here---------------end--------------->8---


Is it expected?  Does it comes from timestamp?  Is it avoidable?


I have not tried (yet) with the patch [1] updating ’dune’.

[1] <http://issues.guix.gnu.org/issue/40091>

All the best,
simon




^ permalink raw reply	[flat|nested] 8+ messages in thread

* bug#43721: Package 'dune' (ocaml) is not Reproducible
  2020-09-30 11:56 bug#43721: Package 'dune' (ocaml) is not Reproducible zimoun
@ 2020-09-30 12:41 ` Tobias Geerinckx-Rice via Bug reports for GNU Guix
  2020-09-30 12:42 ` Julien Lepiller
  1 sibling, 0 replies; 8+ messages in thread
From: Tobias Geerinckx-Rice via Bug reports for GNU Guix @ 2020-09-30 12:41 UTC (permalink / raw)
  To: zimoun; +Cc: 43721

[-- Attachment #1: Type: text/plain, Size: 541 bytes --]

Zimoun,

Thanks for the report!

zimoun 写道:
> diff -r --no-dereference 
> /gnu/store/1wwdmzcjhrpal92sz2zwzhyqmbc3w7ri-dune-1.11.3{,-check}

Don't use ‘diff’ for this, use something like diffoscope:

  $ diffoscope --exclude-directory-metadata --html dune.html $old 
  $new
  -> https://www.tobias.gr/dune.html

I think the problem is confined to the first screenful: one header 
byte differs, and then $old has an extra byte that shifts 
everything to the right causing these huge diffs.

Kind regards,

T G-R

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 247 bytes --]

^ permalink raw reply	[flat|nested] 8+ messages in thread

* bug#43721: Package 'dune' (ocaml) is not Reproducible
  2020-09-30 11:56 bug#43721: Package 'dune' (ocaml) is not Reproducible zimoun
  2020-09-30 12:41 ` Tobias Geerinckx-Rice via Bug reports for GNU Guix
@ 2020-09-30 12:42 ` Julien Lepiller
  2020-10-13 12:17   ` zimoun
  1 sibling, 1 reply; 8+ messages in thread
From: Julien Lepiller @ 2020-09-30 12:42 UTC (permalink / raw)
  To: zimoun; +Cc: 43721

Le Wed, 30 Sep 2020 13:56:21 +0200,
zimoun <zimon.toutoune@gmail.com> a écrit :

> Dear,
> 
> Using Guix 04a459a, the classical:
> 
>    guix build dune
>    guix build dune --no-grafts --check -K
> 
> return:
> 
> --8<---------------cut here---------------start------------->8---
> guix build: error: derivation
> `/gnu/store/kg7mnb1b09n5zddgvc4hs8ira3i4jzz2-dune-1.11.3.drv' may not
> be deterministic: output
> `/gnu/store/1wwdmzcjhrpal92sz2zwzhyqmbc3w7ri-dune-1.11.3' differs
> from ‘/gnu/store/1wwdmzcjhrpal92sz2zwzhyqmbc3w7ri-dune-1.11.3-check’
> --8<---------------cut here---------------end--------------->8---
> 
> then:
> 
>    diff -r --no-dereference
> /gnu/store/1wwdmzcjhrpal92sz2zwzhyqmbc3w7ri-dune-1.11.3{,-check} 
> returns a large output (truncated here):
> 
> --8<---------------cut here---------------start------------->8---
> Binary files
> /gnu/store/1wwdmzcjhrpal92sz2zwzhyqmbc3w7ri-dune-1.11.3/lib/ocaml/site-lib/dune/configurator/configurator.cma
> and
> /gnu/store/1wwdmzcjhrpal92sz2zwzhyqmbc3w7ri-dune-1.11.3-check/lib/ocaml/site-lib/dune/configurator/configurator.cma
> differ Binary files
> /gnu/store/1wwdmzcjhrpal92sz2zwzhyqmbc3w7ri-dune-1.11.3/lib/ocaml/site-lib/dune/configurator/configurator__Extract_obj.cmt
> and
> /gnu/store/1wwdmzcjhrpal92sz2zwzhyqmbc3w7ri-dune-1.11.3-check/lib/ocaml/site-lib/dune/configurator/configurator__Extract_obj.cmt
> differ Binary files
> /gnu/store/1wwdmzcjhrpal92sz2zwzhyqmbc3w7ri-dune-1.11.3/lib/ocaml/site-lib/dune/configurator/configurator__V1.cmti
> and
> /gnu/store/1wwdmzcjhrpal92sz2zwzhyqmbc3w7ri-dune-1.11.3-check/lib/ocaml/site-lib/dune/configurator/configurator__V1.cmti
> differ
> 
> [...]
> 
> Binary files
> /gnu/store/1wwdmzcjhrpal92sz2zwzhyqmbc3w7ri-dune-1.11.3/lib/ocaml/site-lib/dune/_stdune/stdune__User_error.cmti
> and
> /gnu/store/1wwdmzcjhrpal92sz2zwzhyqmbc3w7ri-dune-1.11.3-check/lib/ocaml/site-lib/dune/_stdune/stdune__User_error.cmti
> differ Binary files
> /gnu/store/1wwdmzcjhrpal92sz2zwzhyqmbc3w7ri-dune-1.11.3/lib/ocaml/site-lib/dune/_stdune/stdune__User_message.cmti
> and
> /gnu/store/1wwdmzcjhrpal92sz2zwzhyqmbc3w7ri-dune-1.11.3-check/lib/ocaml/site-lib/dune/_stdune/stdune__User_message.cmti
> differ Binary files
> /gnu/store/1wwdmzcjhrpal92sz2zwzhyqmbc3w7ri-dune-1.11.3/lib/ocaml/site-lib/dune/_stdune/stdune__User_warning.cmti
> and
> /gnu/store/1wwdmzcjhrpal92sz2zwzhyqmbc3w7ri-dune-1.11.3-check/lib/ocaml/site-lib/dune/_stdune/stdune__User_warning.cmti
> differ --8<---------------cut
> here---------------end--------------->8---
> 
> 
> Is it expected?  Does it comes from timestamp?  Is it avoidable?
> 
> 
> I have not tried (yet) with the patch [1] updating ’dune’.
> 
> [1] <http://issues.guix.gnu.org/issue/40091>
> 
> All the best,
> simon
> 
> 
> 

The difference seems to be bigger than a simple timestamp, but it's all
on binary files, and diffoscope is not very useful for that. Maybe file
system ordering? I'm investigating.




^ permalink raw reply	[flat|nested] 8+ messages in thread

* bug#43721: Package 'dune' (ocaml) is not Reproducible
  2020-09-30 12:42 ` Julien Lepiller
@ 2020-10-13 12:17   ` zimoun
  2020-10-13 15:29     ` Julien Lepiller
  0 siblings, 1 reply; 8+ messages in thread
From: zimoun @ 2020-10-13 12:17 UTC (permalink / raw)
  To: Julien Lepiller; +Cc: 43721

Dear,

On Wed, 30 Sep 2020 at 14:42, Julien Lepiller <julien@lepiller.eu> wrote:

>> --8<---------------cut here---------------start------------->8---
>> Binary files
>> /gnu/store/1wwdmzcjhrpal92sz2zwzhyqmbc3w7ri-dune-1.11.3/lib/ocaml/site-lib/dune/configurator/configurator.cma
>> and
>> /gnu/store/1wwdmzcjhrpal92sz2zwzhyqmbc3w7ri-dune-1.11.3-check/lib/ocaml/site-lib/dune/configurator/configurator.cma
>> differ Binary files
>> /gnu/store/1wwdmzcjhrpal92sz2zwzhyqmbc3w7ri-dune-1.11.3/lib/ocaml/site-lib/dune/configurator/configurator__Extract_obj.cmt
>> and
>> /gnu/store/1wwdmzcjhrpal92sz2zwzhyqmbc3w7ri-dune-1.11.3-check/lib/ocaml/site-lib/dune/configurator/configurator__Extract_obj.cmt
>> differ Binary files
>> /gnu/store/1wwdmzcjhrpal92sz2zwzhyqmbc3w7ri-dune-1.11.3/lib/ocaml/site-lib/dune/configurator/configurator__V1.cmti
>> and
>> /gnu/store/1wwdmzcjhrpal92sz2zwzhyqmbc3w7ri-dune-1.11.3-check/lib/ocaml/site-lib/dune/configurator/configurator__V1.cmti
>> differ

[...]

> The difference seems to be bigger than a simple timestamp, but it's all
> on binary files, and diffoscope is not very useful for that. Maybe file
> system ordering? I'm investigating.

Is it not related to your detailed analysis:

   <http://issues.guix.gnu.org/43745#51>

BTW, the update of “dune“ #43745 seems fixing the issue.


All the best,
simon




^ permalink raw reply	[flat|nested] 8+ messages in thread

* bug#43721: Package 'dune' (ocaml) is not Reproducible
  2020-10-13 12:17   ` zimoun
@ 2020-10-13 15:29     ` Julien Lepiller
  2020-10-13 15:41       ` zimoun
  2020-10-28 18:54       ` zimoun
  0 siblings, 2 replies; 8+ messages in thread
From: Julien Lepiller @ 2020-10-13 15:29 UTC (permalink / raw)
  To: zimoun; +Cc: 43721



Le 13 octobre 2020 08:17:10 GMT-04:00, zimoun <zimon.toutoune@gmail.com> a écrit :
>Dear,
>
>On Wed, 30 Sep 2020 at 14:42, Julien Lepiller <julien@lepiller.eu>
>wrote:
>
>>> --8<---------------cut here---------------start------------->8---
>>> Binary files
>>>
>/gnu/store/1wwdmzcjhrpal92sz2zwzhyqmbc3w7ri-dune-1.11.3/lib/ocaml/site-lib/dune/configurator/configurator.cma
>>> and
>>>
>/gnu/store/1wwdmzcjhrpal92sz2zwzhyqmbc3w7ri-dune-1.11.3-check/lib/ocaml/site-lib/dune/configurator/configurator.cma
>>> differ Binary files
>>>
>/gnu/store/1wwdmzcjhrpal92sz2zwzhyqmbc3w7ri-dune-1.11.3/lib/ocaml/site-lib/dune/configurator/configurator__Extract_obj.cmt
>>> and
>>>
>/gnu/store/1wwdmzcjhrpal92sz2zwzhyqmbc3w7ri-dune-1.11.3-check/lib/ocaml/site-lib/dune/configurator/configurator__Extract_obj.cmt
>>> differ Binary files
>>>
>/gnu/store/1wwdmzcjhrpal92sz2zwzhyqmbc3w7ri-dune-1.11.3/lib/ocaml/site-lib/dune/configurator/configurator__V1.cmti
>>> and
>>>
>/gnu/store/1wwdmzcjhrpal92sz2zwzhyqmbc3w7ri-dune-1.11.3-check/lib/ocaml/site-lib/dune/configurator/configurator__V1.cmti
>>> differ
>
>[...]
>
>> The difference seems to be bigger than a simple timestamp, but it's
>all
>> on binary files, and diffoscope is not very useful for that. Maybe
>file
>> system ordering? I'm investigating.
>
>Is it not related to your detailed analysis:
>
>   <http://issues.guix.gnu.org/43745#51>

Yes, the differences look very similar between these two issues. I've posted a bug report at https://github.com/ocaml/dune/issues/3863. Hopefully this will result in a good fix. As a workaround, building with one thread seems to be effective, but we need to change the dune-build-system for that.

>
>BTW, the update of “dune“ #43745 seems fixing the issue.

Yes indeed :) nice side-effect.

>
>
>All the best,
>simon

-- 
Envoyé de mon appareil Android avec Courriel K-9 Mail. Veuillez excuser ma brièveté.




^ permalink raw reply	[flat|nested] 8+ messages in thread

* bug#43721: Package 'dune' (ocaml) is not Reproducible
  2020-10-13 15:29     ` Julien Lepiller
@ 2020-10-13 15:41       ` zimoun
  2020-10-13 15:54         ` Julien Lepiller
  2020-10-28 18:54       ` zimoun
  1 sibling, 1 reply; 8+ messages in thread
From: zimoun @ 2020-10-13 15:41 UTC (permalink / raw)
  To: Julien Lepiller; +Cc: 43721

On Tue, 13 Oct 2020 at 17:29, Julien Lepiller <julien@lepiller.eu> wrote:

> Yes, the differences look very similar between these two issues. I've posted a bug report at https://github.com/ocaml/dune/issues/3863. Hopefully this will result in a good fix. As a workaround, building with one thread seems to be effective, but we need to change the dune-build-system for that.

Which means core-updates, right?




^ permalink raw reply	[flat|nested] 8+ messages in thread

* bug#43721: Package 'dune' (ocaml) is not Reproducible
  2020-10-13 15:41       ` zimoun
@ 2020-10-13 15:54         ` Julien Lepiller
  0 siblings, 0 replies; 8+ messages in thread
From: Julien Lepiller @ 2020-10-13 15:54 UTC (permalink / raw)
  To: zimoun; +Cc: 43721



Le 13 octobre 2020 11:41:32 GMT-04:00, zimoun <zimon.toutoune@gmail.com> a écrit :
>On Tue, 13 Oct 2020 at 17:29, Julien Lepiller <julien@lepiller.eu>
>wrote:
>
>> Yes, the differences look very similar between these two issues. I've
>posted a bug report at https://github.com/ocaml/dune/issues/3863.
>Hopefully this will result in a good fix. As a workaround, building
>with one thread seems to be effective, but we need to change the
>dune-build-system for that.
>
>Which means core-updates, right?

We don't have more than 300 dependents, so I think it should be master.




^ permalink raw reply	[flat|nested] 8+ messages in thread

* bug#43721: Package 'dune' (ocaml) is not Reproducible
  2020-10-13 15:29     ` Julien Lepiller
  2020-10-13 15:41       ` zimoun
@ 2020-10-28 18:54       ` zimoun
  1 sibling, 0 replies; 8+ messages in thread
From: zimoun @ 2020-10-28 18:54 UTC (permalink / raw)
  To: Julien Lepiller; +Cc: 43721-done

Hi,

On Tue, 13 Oct 2020 at 11:29, Julien Lepiller <julien@lepiller.eu> wrote:

>>BTW, the update of “dune“ #43745 seems fixing the issue.
>
> Yes indeed :) nice side-effect.

So closing!

Cheers,
simon




^ permalink raw reply	[flat|nested] 8+ messages in thread

end of thread, other threads:[~2020-10-28 18:55 UTC | newest]

Thread overview: 8+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2020-09-30 11:56 bug#43721: Package 'dune' (ocaml) is not Reproducible zimoun
2020-09-30 12:41 ` Tobias Geerinckx-Rice via Bug reports for GNU Guix
2020-09-30 12:42 ` Julien Lepiller
2020-10-13 12:17   ` zimoun
2020-10-13 15:29     ` Julien Lepiller
2020-10-13 15:41       ` zimoun
2020-10-13 15:54         ` Julien Lepiller
2020-10-28 18:54       ` zimoun

Code repositories for project(s) associated with this public inbox

	https://git.savannah.gnu.org/cgit/guix.git

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).