Skip to content

haskellPackages: update stackage and hackage#142641

Merged
cdepillabout merged 41 commits intomasterfrom
haskell-updates
Nov 5, 2021
Merged

haskellPackages: update stackage and hackage#142641
cdepillabout merged 41 commits intomasterfrom
haskell-updates

Conversation

@expipiplus1
Copy link
Contributor

This Merge

This PR is the regular merge of the haskell-updates branch into master.

This branch is being continually built and tested by hydra at https://hydra.nixos.org/jobset/nixpkgs/haskell-updates. You may be able to find an up-to-date Hydra build report at cdepillabout/nix-haskell-updates-status.

We roughly aim to merge these haskell-updates PRs at least once every two weeks. See the @NixOS/haskell team calendar for who is currently in charge of this branch.

haskellPackages Workflow Summary

Our workflow is currently described in pkgs/development/haskell-modules/HACKING.md.

The short version is this:

  • We regularly update the Stackage and Hackage pins on haskell-updates (normally at the beginning of a merge window).
  • The community fixes builds of Haskell packages on that branch.
  • We aim at at least one merge of haskell-updates into master every two weeks.
  • We only do the merge if the mergeable job is succeeding on hydra.
  • If a maintained package is still broken at the time of merge, we will only merge if the maintainer has been pinged 7 days in advance. (If you care about a Haskell package, become a maintainer!)

This is the follow-up to #142094. Come to #haskell:nixos.org if you have any questions.

Nathan Ringo and others added 4 commits October 23, 2021 00:15
This commit has been generated by maintainers/scripts/haskell/update-hackage.sh
This commit has been generated by maintainers/scripts/haskell/regenerate-hackage-packages.sh
@github-actions github-actions bot added the 6.topic: haskell General-purpose, statically typed, purely functional programming language label Oct 23, 2021
@ofborg ofborg bot added 8.has: package (new) This PR adds a new package 10.rebuild-darwin: 501+ This PR causes many rebuilds on Darwin and should normally target the staging branches. 10.rebuild-darwin: 2501-5000 This PR causes many rebuilds on Darwin and should target the staging branches. 10.rebuild-linux: 501+ This PR causes many rebuilds on Linux and should normally target the staging branches. 10.rebuild-linux: 2501-5000 This PR causes many rebuilds on Linux and should target the staging branches. labels Oct 23, 2021
@expipiplus1
Copy link
Contributor Author

expipiplus1 commented Oct 24, 2021

haskell-updates build report from hydra

evaluation 1715724 of nixpkgs commit 1b71c0a as of 2021-10-24 12:18 UTC

🟡 Potential issues

  • maintained jobset failed.

Build summary

Platform Failed ❌ DependencyFailed ❗ TimedOut ⌛🚫 Success ✔️
aarch64-linux 📱 29 14 6 7051
x86_64-darwin 🍎 70 46 5 6934
x86_64-linux 🐧 13 9 2 7124

Maintained packages with build failure

Maintained packages with failed dependency

Unmaintained packages with build failure

88 job(s)

Unmaintained packages with failed dependency

55 job(s)

Top 50 broken packages, sorted by number of reverse dependencies

50 job(s)

haskell98 ⤴️ 153
enumerator ⤴️ 56
derive ⤴️ 48
contiguous ⤴️ 46
MonadCatchIO-transformers ⤴️ 41
parseargs ⤴️ 41
bytesmith ⤴️ 36
data-lens ⤴️ 34
distributed-process ⤴️ 30
iteratee ⤴️ 29
jmacro ⤴️ 29
ip ⤴️ 26
either-unwrap ⤴️ 25
HList ⤴️ 23
SciBaseTypes ⤴️ 22
haskelldb ⤴️ 22
hsc3 ⤴️ 22
wxdirect ⤴️ 22
BiobaseTypes ⤴️ 21
wxc ⤴️ 21
biocore ⤴️ 20
secp256k1-haskell ⤴️ 20
wxcore ⤴️ 20
attoparsec-enumerator ⤴️ 19
bytestring-show ⤴️ 19
numhask ⤴️ 19
polysemy-plugin ⤴️ 19
wx ⤴️ 19
BiobaseENA ⤴️ 18
asn1-data ⤴️ 18
dbus-core ⤴️ 18
gtksourceview2 ⤴️ 18
BiobaseXNA ⤴️ 17
HGamer3D-Data ⤴️ 17
certificate ⤴️ 17
clash-prelude ⤴️ 17
dbus-client ⤴️ 17
gconf ⤴️ 17
gtk-serialized-event ⤴️ 17
uuid-orphans ⤴️ 17
cuda ⤴️ 16
happstack-jmacro ⤴️ 16
manatee-core ⤴️ 16
monads-fd ⤴️ 16
murmur3 ⤴️ 16
tls-extra ⤴️ 16
ADPfusion ⤴️ 15
MaybeT ⤴️ 15
blaze-builder-enumerator ⤴️ 15
hetero-dict ⤴️ 15

⤴️: The number of packages that depend (directly or indirectly) on this package (if any). If two numbers are shown the first (lower) number considers only packages which currently have enabled hydra jobs, i.e. are not marked broken. The second (higher) number considers all packages.

Report generated with maintainers/scripts/haskell/hydra-report.hs

markus1189 and others added 2 commits October 24, 2021 19:42
Fails to compile with stackage's brick version and additionally depends
on packages depending on brick, so overrideScope is necessary. Should be
fine as this is a leaf package.
@sternenseemann
Copy link
Member

yices failure doesn't necessarily need to concern us, but would be neat to fix since it seems to fail a few things on darwin.

sternenseemann and others added 5 commits October 31, 2021 09:09
GHC 9.2.1 seemingly has trouble decoding the UTF-8 in tf-random's
haddock comments and cabal file, causing haddock and the build to
fail. Until there's a patch from upstream we can apply, we'll just
disable haddock.
@sternenseemann
Copy link
Member

@rvl Can we upgrade electron for hyper-haskell?

in job ‘hyper-haskell.x86_64-linux’:
error: Failed to evaluate electron-10.4.7: «insecure»: is marked as insecure

@cdepillabout
Copy link
Member

cdepillabout commented Nov 3, 2021

haskell-updates build report from hydra

evaluation 1718485 of nixpkgs commit cf8d672 as of 2021-11-03 00:37 UTC

🔴 Branch not mergeable

  • mergeable jobset failed.
  • maintained jobset failed.

Build summary

Platform Failed ❌ DependencyFailed ❗ TimedOut ⌛🚫 Unfinished ⏳ Success ✔️
aarch64-linux 📱 28 20 4 1 7054
x86_64-darwin 🍎 68 59 19 6924
x86_64-linux 🐧 11 7 1 5 7123

Maintained packages with failed dependency

Unmaintained packages with build failure

87 job(s)

Unmaintained packages with failed dependency

67 job(s)

Top 50 broken packages, sorted by number of reverse dependencies

50 job(s)

haskell98 ⤴️ 153
enumerator ⤴️ 56
derive ⤴️ 48
contiguous ⤴️ 46
MonadCatchIO-transformers ⤴️ 41
parseargs ⤴️ 41
bytesmith ⤴️ 36
data-lens ⤴️ 34
distributed-process ⤴️ 30
iteratee ⤴️ 29
jmacro ⤴️ 29
ip ⤴️ 26
either-unwrap ⤴️ 25
HList ⤴️ 23
SciBaseTypes ⤴️ 22
haskelldb ⤴️ 22
hsc3 ⤴️ 22
wxdirect ⤴️ 22
BiobaseTypes ⤴️ 21
wxc ⤴️ 21
biocore ⤴️ 20
secp256k1-haskell ⤴️ 20
wxcore ⤴️ 20
attoparsec-enumerator ⤴️ 19
bytestring-show ⤴️ 19
numhask ⤴️ 19
polysemy-plugin ⤴️ 19
wx ⤴️ 19
BiobaseENA ⤴️ 18
asn1-data ⤴️ 18
dbus-core ⤴️ 18
gtksourceview2 ⤴️ 18
BiobaseXNA ⤴️ 17
HGamer3D-Data ⤴️ 17
certificate ⤴️ 17
clash-prelude ⤴️ 17
dbus-client ⤴️ 17
gconf ⤴️ 17
gtk-serialized-event ⤴️ 17
uuid-orphans ⤴️ 17
cuda ⤴️ 16
happstack-jmacro ⤴️ 16
manatee-core ⤴️ 16
monads-fd ⤴️ 16
murmur3 ⤴️ 16
tls-extra ⤴️ 16
ADPfusion ⤴️ 15
MaybeT ⤴️ 15
blaze-builder-enumerator ⤴️ 15
hetero-dict ⤴️ 15

⤴️: The number of packages that depend (directly or indirectly) on this package (if any). If two numbers are shown the first (lower) number considers only packages which currently have enabled hydra jobs, i.e. are not marked broken. The second (higher) number considers all packages.

Report generated with maintainers/scripts/haskell/hydra-report.hs

@cdepillabout
Copy link
Member

cdepillabout commented Nov 3, 2021

Looks like there are some ghc921 problems on aarch64, as well as various problems on Darwin.

In talking to @sternenseemann, we decided it might be alright to ignore the ghc921 problems on aarch64 for now (since there isn't a fix upstream yet??), but if anyone wants to look into it, it would of course be appreciated.

@sternenseemann
Copy link
Member

In talking to @sternenseemann, we decided it might be alright to ignore the ghc921 problems on aarch64 for now (since there isn't a fix upstream yet??), but if anyone wants to look into it, it would of course be appreciated.

I don't think there's much we can do about it, except maybe bisecting GHC (ugh) between 9.2.1-rc1 and 9.2.1 proper. GHC upstream knows about the problem and is looking into it, as far as I can tell.

@sternenseemann
Copy link
Member

A lot of stuff has fixed itself either via restart or a regression being adressed in master. The remaining failures have either been introduced in master (nokogiri on darwin) or are beyond our power for now (GHC 9.2.1 on aarch64-linux).

For GHC 9.2.1, we could work around the issue, but I'm not sure if disabling test suites that fail because of a buggy hGetContents is a good idea…

@cdepillabout
Copy link
Member

cdepillabout commented Nov 5, 2021

I'm going to go ahead and merge this in. Like sternenseemann said, the 9.2.1 stuff doesn't appear to be fixed upstream yet, and the OSX errors appear to also be happening on master, so not really something we can fix.

@expipiplus1
Copy link
Contributor Author

Thanks, @cdepillabout!

This commit has been generated by maintainers/scripts/haskell/mark-broken.sh
@ofborg ofborg bot added the 8.has: clean-up This PR removes packages or removes other cruft label Nov 5, 2021
hyper-haskell depends on electron-10.4.7, which is marked insecure.
@cdepillabout
Copy link
Member

@rvl I've marked hyper-haskell as broken because it depends on an insecure version of electron in 316dee0. Sorry for not giving you the normal full 7 days to respond to #142641 (comment).

If this breaks your workflow, please feel free to ping me on a PR to master fixing hyper-haskell and I'll be happy to quickly merge it in.

@ofborg ofborg bot requested a review from rvl November 5, 2021 06:13
@cdepillabout cdepillabout merged commit 4269070 into master Nov 5, 2021
@sternenseemann
Copy link
Member

@rvl I've marked hyper-haskell as broken because it depends on an insecure version of electron in 316dee0. Sorry for not giving you the normal full 7 days to respond to #142641 (comment).

Don't quite agree with that: Marking it as broken changes the error message in an inaccurate way: The package builds fine, but uses an insecure dependency and that should be communicated to the user. To get rid of the eval error, adding it to dont-distribute-packages should suffice.

@cdepillabout
Copy link
Member

@sternenseemann That's a good point.

I'll put together a PR targeting master doing what you suggest.

@cdepillabout
Copy link
Member

cdepillabout commented Nov 7, 2021

@sternenseemann @rvl

To get rid of the eval error, adding it to dont-distribute-packages should suffice.

I took a look at this, and hyper-haskell isn't actually a Haskell package. It's a top-level package in Nixpkgs that uses both electron and the Haskell package hyper-haskell-server. hyper-haskell-server doesn't have a dependency on electron.

So adding the top-level hyper-haskell to our dont-distribute-packages won't do anything. I guess either way, the top-level hyper-haskell would need to be removed from being explicitly listed in the pkgs/top-level/release-haskell.nix file until it is fixed.

I guess the only thing that needs to happen now is to unmark it as broken, since it is not really broken, just relying on unsecure packages:
316dee0#diff-97aee2d8fbd78b3a92ad7b817d312385ab692410fde89db4900c6cee6ed20e18R54

@sternenseemann
Copy link
Member

IMO just having the slight noise in the eval output would be fine.

sternenseemann added a commit that referenced this pull request Nov 15, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

6.topic: haskell General-purpose, statically typed, purely functional programming language 8.has: clean-up This PR removes packages or removes other cruft 8.has: package (new) This PR adds a new package 10.rebuild-darwin: 501+ This PR causes many rebuilds on Darwin and should normally target the staging branches. 10.rebuild-darwin: 2501-5000 This PR causes many rebuilds on Darwin and should target the staging branches. 10.rebuild-linux: 501+ This PR causes many rebuilds on Linux and should normally target the staging branches. 10.rebuild-linux: 2501-5000 This PR causes many rebuilds on Linux and should target the staging branches. 11.by: package-maintainer This PR was created by a maintainer of all the package it changes.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants