Skip to content

[staging-next] python3Packages.protobuf: fix drv version#194111

Merged
vcunat merged 3 commits intoNixOS:staging-nextfrom
oxalica:fix/python-protobuf
Nov 8, 2022
Merged

[staging-next] python3Packages.protobuf: fix drv version#194111
vcunat merged 3 commits intoNixOS:staging-nextfrom
oxalica:fix/python-protobuf

Conversation

@oxalica
Copy link
Contributor

@oxalica oxalica commented Oct 2, 2022

TL;DR: Currently the python3Packages.protobuf.version is 3.21 but its output is actually 4.21, which cause suspicious breakages. This PR targets staging-next for the fix.

EDIT: I give up pinning it back to 3.20. Now I did the reverse: just correct version to 4.21 and fix build failure of dependent packages by unrestrict the protobuf requirement. This should be fine according to #194112 (comment)


OLD ATTEMPT:

protobuf 3.21 coresponds with its python library 4.21, which diverges and causes many breakages. protobuf 3.20 is also the last version having the same version as its python library.

See: https://developers.google.com/protocol-buffers/docs/news/2022-05-06#python-updates

Fixes #193997 and tested electrum.

Note that this will also break some packages requiring protobuf >= 4, like biliass. But using 4 breaks
touch (pytorch/pytorch#78362), electrum (spesmilo/electrum#7833), keepkey (keepkey/python-keepkey#146) and any packages containing a legacy generated _pb2.py.
I think pinning to 3.20 would cause less harm.

I'm still running nixpkgs-review to see how it goes.

Description of changes
Things done
  • Built on platform(s)
    • x86_64-linux
    • aarch64-linux
    • x86_64-darwin
    • aarch64-darwin
  • For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
  • Tested, as applicable:
  • Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
  • Tested basic functionality of all binary files (usually in ./result/bin/)
  • 22.11 Release Notes (or backporting 22.05 Release notes)
    • (Package updates) Added a release notes entry if the change is major or breaking
    • (Module updates) Added a release notes entry if the change is significant
    • (Module addition) Added a release notes entry if adding a new NixOS module
    • (Release notes changes) Ran nixos/doc/manual/md-to-db.sh to update generated release notes
  • Fits CONTRIBUTING.md.

@github-actions github-actions bot added the 6.topic: python Python is a high-level, general-purpose programming language. label Oct 2, 2022
@ofborg ofborg bot added 10.rebuild-darwin: 101-500 This PR causes between 101 and 500 packages to rebuild on Darwin. 10.rebuild-linux: 501+ This PR causes many rebuilds on Linux and should normally target the staging branches. 10.rebuild-linux: 501-1000 This PR causes many rebuilds on Linux and should normally target the staging branches. labels Oct 2, 2022
@oxalica oxalica changed the base branch from master to staging-next October 4, 2022 01:37
@oxalica oxalica force-pushed the fix/python-protobuf branch from 846ce88 to 582361a Compare October 4, 2022 01:37
@oxalica oxalica changed the title python3Packages.protobuf: pin to 3.20 [staging-next] python3Packages.protobuf: pin to 3.20 Oct 4, 2022
@bobby285271 bobby285271 added the 12.approvals: 1 This PR was reviewed and approved by one person. label Oct 4, 2022
@FRidh
Copy link
Member

FRidh commented Oct 6, 2022

I'm still running nixpkgs-review to see how it goes.

Any update?

@oxalica
Copy link
Contributor Author

oxalica commented Oct 6, 2022

I'm still running nixpkgs-review to see how it goes.

Any update?

My PC seems not capable of handling some large python packges. They require too much memory. 😢
Anyone could help?

@oxalica oxalica force-pushed the fix/python-protobuf branch from 582361a to 9e01549 Compare October 6, 2022 12:17
@erdnaxe
Copy link
Member

erdnaxe commented Oct 6, 2022

I tried running nixpkgs-review on this pull request, but I am also running out of memory (16GB seems not enough).
From what I was able to build before the OOM killer came:

  • y78f3hixj2banpcm0knq503qi6s7nll7-python3.10-marshmallow-dataclass-8.5.8.drv and 85irq998pzw4c5gq9x875c7kgkd052aa-python3.9-marshmallow-dataclass-8.5.8.drv failed to build with exit code 1:
Logs
[...]
Executing setuptoolsBuildPhase
running bdist_wheel
running build
running build_py
creating build
creating build/lib
creating build/lib/marshmallow_dataclass
copying marshmallow_dataclass/typing.py -> build/lib/marshmallow_dataclass
copying marshmallow_dataclass/union_field.py -> build/lib/marshmallow_dataclass
copying marshmallow_dataclass/lazy_class_attribute.py -> build/lib/marshmallow_dataclass
copying marshmallow_dataclass/__init__.py -> build/lib/marshmallow_dataclass
copying marshmallow_dataclass/mypy.py -> build/lib/marshmallow_dataclass
copying marshmallow_dataclass/collection_field.py -> build/lib/marshmallow_dataclass
copying marshmallow_dataclass/py.typed -> build/lib/marshmallow_dataclass
/nix/store/pvj5zdmjn9x150p9knf192k4jqzb9jcy-python3.10-setuptools-65.3.0/lib/python3.10/site-packages/setuptools/command/install.py:34:>
  warnings.warn(
installing to build/bdist.linux-x86_64/wheel
running install
running install_lib
creating build/bdist.linux-x86_64
creating build/bdist.linux-x86_64/wheel
creating build/bdist.linux-x86_64/wheel/marshmallow_dataclass
copying build/lib/marshmallow_dataclass/typing.py -> build/bdist.linux-x86_64/wheel/marshmallow_dataclass
copying build/lib/marshmallow_dataclass/union_field.py -> build/bdist.linux-x86_64/wheel/marshmallow_dataclass
copying build/lib/marshmallow_dataclass/py.typed -> build/bdist.linux-x86_64/wheel/marshmallow_dataclass
copying build/lib/marshmallow_dataclass/lazy_class_attribute.py -> build/bdist.linux-x86_64/wheel/marshmallow_dataclass
copying build/lib/marshmallow_dataclass/__init__.py -> build/bdist.linux-x86_64/wheel/marshmallow_dataclass
copying build/lib/marshmallow_dataclass/mypy.py -> build/bdist.linux-x86_64/wheel/marshmallow_dataclass
copying build/lib/marshmallow_dataclass/collection_field.py -> build/bdist.linux-x86_64/wheel/marshmallow_dataclass
running install_egg_info
running egg_info
creating marshmallow_dataclass.egg-info
writing marshmallow_dataclass.egg-info/PKG-INFO
writing dependency_links to marshmallow_dataclass.egg-info/dependency_links.txt
writing requirements to marshmallow_dataclass.egg-info/requires.txt
writing top-level names to marshmallow_dataclass.egg-info/top_level.txt
writing manifest file 'marshmallow_dataclass.egg-info/SOURCES.txt'
reading manifest file 'marshmallow_dataclass.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
adding license file 'LICENSE'
...skipping...
        validator_b = SimpleValidator()
        validator_c = SimpleValidator()
        validator_d = SimpleValidator()

        CustomTypeOneValidator = NewType(
            "CustomTypeOneValidator", str, validate=validator_a
        )
        CustomTypeNoneValidator = NewType("CustomTypeNoneValidator", str, validate=None)
        CustomTypeMultiValidator = NewType(
            "CustomTypeNoneValidator", str, validate=[validator_a, validator_b]
        )

        @dataclasses.dataclass
        class A:
            data: CustomTypeNoneValidator = dataclasses.field()

>       schema_a = class_schema(A)()

tests/test_class_schema.py:319:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
marshmallow_dataclass/__init__.py:356: in class_schema
    return _internal_class_schema(clazz, base_schema, clazz_frame)
marshmallow_dataclass/__init__.py:402: in _internal_class_schema
    attributes.update(
marshmallow_dataclass/__init__.py:405: in <genexpr>
    field_for_schema(
marshmallow_dataclass/__init__.py:729: in field_for_schema
    or _internal_class_schema(typ, base_schema, typ_frame)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _

clazz = <function NewType.<locals>.new_type at 0x7ffff6181c60>
base_schema = None
clazz_frame = <frame at 0x8e4260, file '/build/source/tests/test_class_schema.py', line 319, code test_validator_stacking>

    @lru_cache(maxsize=MAX_CLASS_SCHEMA_CACHE_SIZE)
    def _internal_class_schema(
        clazz: type,
        base_schema: Optional[Type[marshmallow.Schema]] = None,
        clazz_frame: types.FrameType = None,
    ) -> Type[marshmallow.Schema]:
        _RECURSION_GUARD.seen_classes[clazz] = clazz.__name__
        try:
            # noinspection PyDataclass
            fields: Tuple[dataclasses.Field, ...] = dataclasses.fields(clazz)
        except TypeError:  # Not a dataclass
            try:
                warnings.warn(
                    "****** WARNING ****** "
                    f"marshmallow_dataclass was called on the class {clazz}, which is not a dataclass. "
                    "It is going to try and convert the class into a dataclass, which may have "
                    "undesirable side effects. To avoid this message, make sure all your classes and "
                    "all the classes of their fields are either explicitly supported by "
                    "marshmallow_dataclass, or define the schema explicitly using "
                    "field(metadata=dict(marshmallow_field=...)). For more information, see "
                    "https://github.com/lovasoa/marshmallow_dataclass/issues/51 "
                    "****** WARNING ******"
                )
                created_dataclass: type = dataclasses.dataclass(clazz)
                return _internal_class_schema(created_dataclass, base_schema, clazz_frame)
            except Exception:
>               raise TypeError(
                    f"{getattr(clazz, '__name__', repr(clazz))} is not a dataclass and cannot be turned into one."
                )
E               TypeError: CustomTypeNoneValidator is not a dataclass and cannot be turned into one.

marshmallow_dataclass/__init__.py:387: TypeError
=========================== short test summary info ============================
FAILED tests/test_class_schema.py::TestClassSchema::test_validator_stacking
================== 1 failed, 89 passed, 1 deselected in 2.44s ==================
...skipping...
        validator_b = SimpleValidator()
        validator_c = SimpleValidator()
        validator_d = SimpleValidator()

        CustomTypeOneValidator = NewType(
            "CustomTypeOneValidator", str, validate=validator_a
        )
        CustomTypeNoneValidator = NewType("CustomTypeNoneValidator", str, validate=None)
        CustomTypeMultiValidator = NewType(
            "CustomTypeNoneValidator", str, validate=[validator_a, validator_b]
        )

        @dataclasses.dataclass
        class A:
            data: CustomTypeNoneValidator = dataclasses.field()

>       schema_a = class_schema(A)()

tests/test_class_schema.py:319:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
marshmallow_dataclass/__init__.py:356: in class_schema
    return _internal_class_schema(clazz, base_schema, clazz_frame)
marshmallow_dataclass/__init__.py:402: in _internal_class_schema
    attributes.update(
marshmallow_dataclass/__init__.py:405: in <genexpr>
    field_for_schema(
marshmallow_dataclass/__init__.py:729: in field_for_schema
    or _internal_class_schema(typ, base_schema, typ_frame)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _

clazz = <function NewType.<locals>.new_type at 0x7ffff6181c60>
base_schema = None
clazz_frame = <frame at 0x8e4260, file '/build/source/tests/test_class_schema.py', line 319, code test_validator_stacking>

    @lru_cache(maxsize=MAX_CLASS_SCHEMA_CACHE_SIZE)
    def _internal_class_schema(
        clazz: type,
        base_schema: Optional[Type[marshmallow.Schema]] = None,
        clazz_frame: types.FrameType = None,
    ) -> Type[marshmallow.Schema]:
        _RECURSION_GUARD.seen_classes[clazz] = clazz.__name__
        try:
            # noinspection PyDataclass
            fields: Tuple[dataclasses.Field, ...] = dataclasses.fields(clazz)
        except TypeError:  # Not a dataclass
            try:
                warnings.warn(
                    "****** WARNING ****** "
                    f"marshmallow_dataclass was called on the class {clazz}, which is not a dataclass. "
                    "It is going to try and convert the class into a dataclass, which may have "
                    "undesirable side effects. To avoid this message, make sure all your classes and "
                    "all the classes of their fields are either explicitly supported by "
                    "marshmallow_dataclass, or define the schema explicitly using "
                    "field(metadata=dict(marshmallow_field=...)). For more information, see "
                    "https://github.com/lovasoa/marshmallow_dataclass/issues/51 "
                    "****** WARNING ******"
                )
                created_dataclass: type = dataclasses.dataclass(clazz)
                return _internal_class_schema(created_dataclass, base_schema, clazz_frame)
            except Exception:
>               raise TypeError(
                    f"{getattr(clazz, '__name__', repr(clazz))} is not a dataclass and cannot be turned into one."
                )
E               TypeError: CustomTypeNoneValidator is not a dataclass and cannot be turned into one.

marshmallow_dataclass/__init__.py:387: TypeError
=========================== short test summary info ============================
FAILED tests/test_class_schema.py::TestClassSchema::test_validator_stacking
================== 1 failed, 89 passed, 1 deselected in 2.44s ==================
  • 29vg1dnvqfifr0irnsvnxriqjffdw31m-python3.10-biliass-1.3.5.drv failed with exit code 1:
Logs
[...]
adding 'tests/test_protobuf.py'
adding 'tests/test_xml.py'
adding 'biliass-1.3.5.dist-info/LICENSE'
adding 'biliass-1.3.5.dist-info/METADATA'
adding 'biliass-1.3.5.dist-info/WHEEL'
adding 'biliass-1.3.5.dist-info/entry_points.txt'
adding 'biliass-1.3.5.dist-info/top_level.txt'
adding 'biliass-1.3.5.dist-info/zip-safe'
adding 'biliass-1.3.5.dist-info/RECORD'
removing build/bdist.linux-x86_64/wheel
Finished executing setuptoolsBuildPhase
@nix { "action": "setPhase", "phase": "installPhase" }
installing
Executing pipInstallPhase
/build/biliass-1.3.5/dist /build/biliass-1.3.5
Processing ./biliass-1.3.5-py3-none-any.whl
ERROR: Could not find a version that satisfies the requirement protobuf>=4.21.0 (from biliass) (from versions: none)
ERROR: No matching distribution found for protobuf>=4.21.0

@oxalica
Copy link
Contributor Author

oxalica commented Oct 6, 2022

I met some other dependency requirement failure. 🤔 Maybe it's better to keep both python libs instead?

@NickCao
Copy link
Member

NickCao commented Oct 6, 2022

Result of nixpkgs-review pr 194111 run on x86_64-linux 1

214 packages marked as broken and skipped:
  • barman
  • baserow
  • beancount
  • dbx
  • dvc-with-remotes
  • fava
  • gam
  • git-annex-remote-googledrive
  • gphotos-sync
  • gpt2tc
  • gyb
  • home-assistant-component-tests.apple_tv
  • home-assistant-component-tests.cast
  • home-assistant-component-tests.comfoconnect
  • home-assistant-component-tests.devolo_home_network
  • home-assistant-component-tests.esphome
  • home-assistant-component-tests.google_pubsub
  • home-assistant-component-tests.google_sheets
  • home-assistant-component-tests.hangouts
  • home-assistant-component-tests.lovelace
  • home-assistant-component-tests.nest
  • kube-hunter
  • ledger2beancount
  • libtensorflow
  • mlflow-server
  • openai
  • openai-whisper
  • parsedmarc
  • privacyidea
  • python310Packages.arviz
  • python310Packages.baselines
  • python310Packages.beancount
  • python310Packages.beancount_docverif
  • python310Packages.boxx
  • python310Packages.bpycv
  • python310Packages.caffe
  • python310Packages.caffeWithCuda
  • python310Packages.cirq
  • python310Packages.cntk
  • python310Packages.coqui-trainer
  • python310Packages.dalle-mini
  • python310Packages.deepwave
  • python310Packages.distrax
  • python310Packages.django-storages
  • python310Packages.dm-sonnet
  • python310Packages.drivelib
  • python310Packages.edward
  • python310Packages.elegy
  • python310Packages.ezyrb
  • python310Packages.ffcv
  • python310Packages.flax
  • python310Packages.functorch
  • python310Packages.gcsfs
  • python310Packages.gensim
  • python310Packages.google-auth-oauthlib
  • python310Packages.google-nest-sdm
  • python310Packages.gpt-2-simple
  • python310Packages.gspread
  • python310Packages.ignite
  • python310Packages.kubernetes
  • python310Packages.mask-rcnn
  • python310Packages.mlflow
  • python310Packages.monai
  • python310Packages.oauthenticator
  • python310Packages.objax
  • python310Packages.openai
  • python310Packages.openai-whisper
  • python310Packages.openshift
  • python310Packages.optuna
  • python310Packages.parsedmarc
  • python310Packages.pathy
  • python310Packages.pot
  • python310Packages.pydmd
  • python310Packages.pymanopt
  • python310Packages.pymc
  • python310Packages.pyro-ppl
  • python310Packages.pytorch-lightning
  • python310Packages.pytorch-metric-learning
  • python310Packages.pytorch-pfn-extras
  • python310Packages.qiskit
  • python310Packages.qiskit-machine-learning
  • python310Packages.rising
  • python310Packages.rl-coach
  • python310Packages.rlax
  • python310Packages.scikit-tda
  • python310Packages.shap
  • python310Packages.skorch
  • python310Packages.slicer
  • python310Packages.smart-open
  • python310Packages.spacy
  • python310Packages.spacy-loggers
  • python310Packages.spacy-transformers
  • python310Packages.stanza
  • python310Packages.tensorboard
  • python310Packages.tensorboardx
  • python310Packages.tensorflow
  • python310Packages.tensorflow-bin
  • python310Packages.tensorflow-build
  • python310Packages.tensorflow-datasets
  • python310Packages.tensorflow-probability
  • python310Packages.tensorflowWithCuda
  • python310Packages.tensorflowWithoutCuda
  • python310Packages.test-tube
  • python310Packages.textacy
  • python310Packages.tflearn
  • python310Packages.torch
  • python310Packages.torch-tb-profiler
  • python310Packages.torchWithCuda
  • python310Packages.torchWithoutCuda
  • python310Packages.torchgpipe
  • python310Packages.torchinfo
  • python310Packages.torchmetrics
  • python310Packages.torchvision
  • python310Packages.treex
  • python310Packages.trfl
  • python310Packages.umap-learn
  • python310Packages.vqgan-jax
  • python310Packages.wandb
  • python310Packages.worldengine
  • python310Packages.zcs
  • python39Packages.arviz
  • python39Packages.baselines
  • python39Packages.beancount
  • python39Packages.beancount_docverif
  • python39Packages.boxx
  • python39Packages.bpycv
  • python39Packages.cirq
  • python39Packages.cntk
  • python39Packages.coqui-trainer
  • python39Packages.dalle-mini
  • python39Packages.deepwave
  • python39Packages.distrax
  • python39Packages.django-storages
  • python39Packages.dm-sonnet
  • python39Packages.drivelib
  • python39Packages.edward
  • python39Packages.elegy
  • python39Packages.ezyrb
  • python39Packages.ffcv
  • python39Packages.flax
  • python39Packages.functorch
  • python39Packages.gcsfs
  • python39Packages.gensim
  • python39Packages.google-auth-oauthlib
  • python39Packages.google-nest-sdm
  • python39Packages.gpt-2-simple
  • python39Packages.gspread
  • python39Packages.ignite
  • python39Packages.kubernetes
  • python39Packages.mask-rcnn
  • python39Packages.mlflow
  • python39Packages.monai
  • python39Packages.oauthenticator
  • python39Packages.objax
  • python39Packages.openai
  • python39Packages.openai-whisper
  • python39Packages.openshift
  • python39Packages.optuna
  • python39Packages.parsedmarc
  • python39Packages.pathy
  • python39Packages.pot
  • python39Packages.pydmd
  • python39Packages.pymanopt
  • python39Packages.pymc
  • python39Packages.pyro-ppl
  • python39Packages.pytorch-lightning
  • python39Packages.pytorch-metric-learning
  • python39Packages.pytorch-pfn-extras
  • python39Packages.qiskit
  • python39Packages.qiskit-machine-learning
  • python39Packages.rising
  • python39Packages.rl-coach
  • python39Packages.rlax
  • python39Packages.scikit-tda
  • python39Packages.shap
  • python39Packages.skorch
  • python39Packages.slicer
  • python39Packages.smart-open
  • python39Packages.spacy
  • python39Packages.spacy-loggers
  • python39Packages.spacy-transformers
  • python39Packages.stanza
  • python39Packages.tensorboard
  • python39Packages.tensorboardx
  • python39Packages.tensorflow
  • python39Packages.tensorflow-bin
  • python39Packages.tensorflow-build
  • python39Packages.tensorflow-datasets
  • python39Packages.tensorflow-probability
  • python39Packages.tensorflowWithCuda
  • python39Packages.tensorflowWithoutCuda
  • python39Packages.test-tube
  • python39Packages.textacy
  • python39Packages.tflearn
  • python39Packages.torch
  • python39Packages.torch-tb-profiler
  • python39Packages.torchWithCuda
  • python39Packages.torchWithoutCuda
  • python39Packages.torchgpipe
  • python39Packages.torchinfo
  • python39Packages.torchmetrics
  • python39Packages.torchvision
  • python39Packages.treex
  • python39Packages.trfl
  • python39Packages.umap-learn
  • python39Packages.vqgan-jax
  • python39Packages.wandb
  • python39Packages.worldengine
  • python39Packages.zcs
  • s3ql
  • snakemake
  • tandoor-recipes
  • tts
  • worldengine-cli
33 packages failed to build:
  • biliass (python310Packages.biliass)
  • electrum-grs
  • esphome
  • manim
  • nrfutil
  • or-tools
  • pynitrokey
  • python310Packages.cairo-lang
  • python310Packages.certbot-dns-google
  • python310Packages.google-cloud-error-reporting
  • python310Packages.google-cloud-logging
  • python310Packages.ibis-framework
  • python310Packages.onnx
  • python310Packages.onnxconverter-common
  • python310Packages.ortools
  • python310Packages.sagemaker
  • python310Packages.skl2onnx
  • yutto (python310Packages.yutto)
  • python39Packages.apache-beam
  • python39Packages.biliass
  • python39Packages.cairo-lang
  • python39Packages.certbot-dns-google
  • python39Packages.google-cloud-error-reporting
  • python39Packages.google-cloud-logging
  • python39Packages.ibis-framework
  • python39Packages.manticore
  • python39Packages.onnx
  • python39Packages.onnxconverter-common
  • python39Packages.ortools
  • python39Packages.sagemaker
  • python39Packages.skl2onnx
  • python39Packages.yutto
  • streamlit
281 packages built:
  • agi
  • android-tools
  • botamusique
  • buildah
  • catt
  • cdogs-sdl
  • charge-lnd
  • chiaki
  • cinnamon.warpinator
  • cri-o
  • criterion
  • criu
  • crun
  • datadog-agent
  • datadog-process-agent
  • deja-dup
  • duplicity
  • duply
  • electron-cash
  • electrum
  • electrum-ltc
  • gajim
  • gcalcli
  • gnomecast
  • goobook (python310Packages.goobook)
  • hwi (python310Packages.hwi)
  • keepkey_agent (python310Packages.keepkey_agent)
  • kmymoney
  • krunvm
  • lbdb
  • ledger_agent (python310Packages.ledger_agent)
  • lieer
  • lndmanage
  • lxd
  • mitmproxy (python310Packages.mitmproxy)
  • mitmproxy2swagger
  • mkchromecast
  • mloader
  • nanopb
  • nanopbMalloc
  • ola
  • opensnitch-ui
  • podman
  • pulseaudio-dlna
  • python310Packages.PyChromecast
  • python310Packages.aioesphomeapi
  • python310Packages.angr
  • python310Packages.angrcli
  • python310Packages.angrop
  • python310Packages.apache-beam
  • python310Packages.augmax
  • python310Packages.betterproto
  • python310Packages.bitbox02
  • python310Packages.chainer
  • python310Packages.chirpstack-api
  • python310Packages.cirq-google
  • python310Packages.consonance
  • python310Packages.dask-yarn
  • python310Packages.devolo-plc-api
  • python310Packages.duckdb
  • python310Packages.duckdb-engine
  • python310Packages.einops
  • python310Packages.google-api-core
  • python310Packages.google-api-python-client
  • python310Packages.google-auth
  • python310Packages.google-auth-httplib2
  • python310Packages.google-cloud-access-context-manager
  • python310Packages.google-cloud-appengine-logging
  • python310Packages.google-cloud-asset
  • python310Packages.google-cloud-audit-log
  • python310Packages.google-cloud-automl
  • python310Packages.google-cloud-bigquery
  • python310Packages.google-cloud-bigquery-datatransfer
  • python310Packages.google-cloud-bigquery-logging
  • python310Packages.google-cloud-bigquery-storage
  • python310Packages.google-cloud-bigtable
  • python310Packages.google-cloud-compute
  • python310Packages.google-cloud-container
  • python310Packages.google-cloud-core
  • python310Packages.google-cloud-datacatalog
  • python310Packages.google-cloud-dataproc
  • python310Packages.google-cloud-datastore
  • python310Packages.google-cloud-dlp
  • python310Packages.google-cloud-dns
  • python310Packages.google-cloud-firestore
  • python310Packages.google-cloud-iam
  • python310Packages.google-cloud-iam-logging
  • python310Packages.google-cloud-iot
  • python310Packages.google-cloud-kms
  • python310Packages.google-cloud-language
  • python310Packages.google-cloud-monitoring
  • python310Packages.google-cloud-org-policy
  • python310Packages.google-cloud-os-config
  • python310Packages.google-cloud-pubsub
  • python310Packages.google-cloud-redis
  • python310Packages.google-cloud-resource-manager
  • python310Packages.google-cloud-runtimeconfig
  • python310Packages.google-cloud-secret-manager
  • python310Packages.google-cloud-securitycenter
  • python310Packages.google-cloud-spanner
  • python310Packages.google-cloud-speech
  • python310Packages.google-cloud-storage
  • python310Packages.google-cloud-tasks
  • python310Packages.google-cloud-testutils
  • python310Packages.google-cloud-texttospeech
  • python310Packages.google-cloud-trace
  • python310Packages.google-cloud-translate
  • python310Packages.google-cloud-videointelligence
  • python310Packages.google-cloud-vision
  • python310Packages.google-cloud-websecurityscanner
  • python310Packages.google-resumable-media
  • python310Packages.googleapis-common-protos
  • python310Packages.gpapi
  • python310Packages.gplaycli
  • python310Packages.grpc-google-iam-v1
  • python310Packages.grpcio
  • python310Packages.grpcio-gcp
  • python310Packages.grpcio-status
  • python310Packages.grpcio-tools
  • python310Packages.grpclib
  • python310Packages.gtfs-realtime-bindings
  • python310Packages.hangups
  • python310Packages.keepkey
  • python310Packages.keyrings-google-artifactregistry-auth
  • python310Packages.ledgerblue
  • python310Packages.ledgerwallet
  • python310Packages.matlink-gpapi
  • python310Packages.meshtastic
  • python310Packages.mypy-protobuf
  • python310Packages.mysql-connector
  • python310Packages.paranoid-crypto
  • python310Packages.proto-plus
  • python310Packages.protobuf
  • python310Packages.protobuf3-to-dict
  • python310Packages.pulumi
  • python310Packages.pulumi-aws
  • python310Packages.push-receiver
  • python310Packages.pyatv
  • python310Packages.pycomfoconnect
  • python310Packages.pydrive2
  • python310Packages.pymumble
  • python310Packages.python-axolotl
  • python310Packages.pytransportnswv2
  • python310Packages.s2clientprotocol
  • python310Packages.skein
  • python310Packages.snakebite
  • python310Packages.sqlglot
  • python310Packages.tensorboard-plugin-profile
  • python310Packages.tensorflow-metadata
  • python310Packages.transformers
  • trezorctl (python310Packages.trezor)
  • trezor_agent (python310Packages.trezor_agent)
  • python310Packages.web3
  • python310Packages.weboob
  • python310Packages.woob
  • python310Packages.xarray-einstats
  • python310Packages.yowsup
  • python39Packages.PyChromecast
  • python39Packages.aioesphomeapi
  • python39Packages.angr
  • python39Packages.angrcli
  • python39Packages.angrop
  • python39Packages.augmax
  • python39Packages.betterproto
  • python39Packages.bitbox02
  • python39Packages.caffe
  • python39Packages.caffeWithCuda
  • python39Packages.chainer
  • python39Packages.chirpstack-api
  • python39Packages.cirq-google
  • python39Packages.consonance
  • python39Packages.dask-yarn
  • python39Packages.devolo-plc-api
  • python39Packages.duckdb
  • python39Packages.duckdb-engine
  • python39Packages.einops
  • python39Packages.goobook
  • python39Packages.google-api-core
  • python39Packages.google-api-python-client
  • python39Packages.google-auth
  • python39Packages.google-auth-httplib2
  • python39Packages.google-cloud-access-context-manager
  • python39Packages.google-cloud-appengine-logging
  • python39Packages.google-cloud-asset
  • python39Packages.google-cloud-audit-log
  • python39Packages.google-cloud-automl
  • python39Packages.google-cloud-bigquery
  • python39Packages.google-cloud-bigquery-datatransfer
  • python39Packages.google-cloud-bigquery-logging
  • python39Packages.google-cloud-bigquery-storage
  • python39Packages.google-cloud-bigtable
  • python39Packages.google-cloud-compute
  • python39Packages.google-cloud-container
  • python39Packages.google-cloud-core
  • python39Packages.google-cloud-datacatalog
  • python39Packages.google-cloud-dataproc
  • python39Packages.google-cloud-datastore
  • python39Packages.google-cloud-dlp
  • python39Packages.google-cloud-dns
  • python39Packages.google-cloud-firestore
  • python39Packages.google-cloud-iam
  • python39Packages.google-cloud-iam-logging
  • python39Packages.google-cloud-iot
  • python39Packages.google-cloud-kms
  • python39Packages.google-cloud-language
  • python39Packages.google-cloud-monitoring
  • python39Packages.google-cloud-org-policy
  • python39Packages.google-cloud-os-config
  • python39Packages.google-cloud-pubsub
  • python39Packages.google-cloud-redis
  • python39Packages.google-cloud-resource-manager
  • python39Packages.google-cloud-runtimeconfig
  • python39Packages.google-cloud-secret-manager
  • python39Packages.google-cloud-securitycenter
  • python39Packages.google-cloud-spanner
  • python39Packages.google-cloud-speech
  • python39Packages.google-cloud-storage
  • python39Packages.google-cloud-tasks
  • python39Packages.google-cloud-testutils
  • python39Packages.google-cloud-texttospeech
  • python39Packages.google-cloud-trace
  • python39Packages.google-cloud-translate
  • python39Packages.google-cloud-videointelligence
  • python39Packages.google-cloud-vision
  • python39Packages.google-cloud-websecurityscanner
  • python39Packages.google-resumable-media
  • python39Packages.googleapis-common-protos
  • python39Packages.gpapi
  • python39Packages.gplaycli
  • python39Packages.grpc-google-iam-v1
  • python39Packages.grpcio
  • python39Packages.grpcio-gcp
  • python39Packages.grpcio-status
  • python39Packages.grpcio-tools
  • python39Packages.grpclib
  • python39Packages.gtfs-realtime-bindings
  • python39Packages.hangups
  • python39Packages.hwi
  • python39Packages.keepkey
  • python39Packages.keepkey_agent
  • python39Packages.keyrings-google-artifactregistry-auth
  • python39Packages.ledger_agent
  • python39Packages.ledgerblue
  • python39Packages.ledgerwallet
  • python39Packages.matlink-gpapi
  • python39Packages.meshtastic
  • python39Packages.mitmproxy
  • python39Packages.mypy-protobuf
  • python39Packages.mysql-connector
  • python39Packages.paranoid-crypto
  • python39Packages.proto-plus
  • python39Packages.protobuf
  • python39Packages.protobuf3-to-dict
  • python39Packages.pulumi
  • python39Packages.pulumi-aws
  • python39Packages.push-receiver
  • python39Packages.pyatv
  • python39Packages.pycomfoconnect
  • python39Packages.pydrive2
  • python39Packages.pymumble
  • python39Packages.python-axolotl
  • python39Packages.pytransportnswv2
  • python39Packages.s2clientprotocol
  • python39Packages.skein
  • python39Packages.snakebite
  • python39Packages.sqlglot
  • python39Packages.tensorboard-plugin-profile
  • python39Packages.tensorflow-metadata
  • python39Packages.transformers
  • python39Packages.trezor
  • python39Packages.trezor_agent
  • python39Packages.web3
  • python39Packages.weboob
  • python39Packages.woob
  • python39Packages.xarray-einstats
  • python39Packages.yowsup
  • qlcplus
  • siril
  • sparrow
  • tauon
  • wapiti

@oxalica oxalica force-pushed the fix/python-protobuf branch from 9e01549 to 49cfef7 Compare October 8, 2022 18:33
@oxalica oxalica changed the title [staging-next] python3Packages.protobuf: pin to 3.20 [staging-next] python3Packages.protobuf: fix drv version and dependent build failures Oct 8, 2022
@oxalica
Copy link
Contributor Author

oxalica commented Oct 8, 2022

I give up pinning it back to 3.20. Now I did the reverse: just correct version to 4.21 and fix build failure of dependent packages by unrestrict the protobuf requirement. This should be fine according to #194112 (comment)

@oxalica
Copy link
Contributor Author

oxalica commented Oct 8, 2022

Most of failures left are either,

  • Hard to fix: protobuf so link failure. or-tools
  • Hard to fix: requirements are inside wheels. streamlit
  • Test failure after the requirement change. electrum-grs
  • Other unrelated failures.

Result of nixpkgs-review run on x86_64-linux 1

226 packages marked as broken and skipped:
  • barman
  • baserow
  • beancount
  • dbx
  • dvc-with-remotes
  • fava
  • gam
  • git-annex-remote-googledrive
  • gphotos-sync
  • gpt2tc
  • gyb
  • home-assistant-component-tests.apple_tv
  • home-assistant-component-tests.cast
  • home-assistant-component-tests.comfoconnect
  • home-assistant-component-tests.devolo_home_network
  • home-assistant-component-tests.esphome
  • home-assistant-component-tests.google_pubsub
  • home-assistant-component-tests.google_sheets
  • home-assistant-component-tests.hangouts
  • home-assistant-component-tests.lovelace
  • home-assistant-component-tests.nest
  • kube-hunter
  • ledger2beancount
  • libtensorflow
  • libtensorflow-bin
  • mlflow-server
  • ocamlPackages.torch
  • openai-whisper
  • parsedmarc
  • privacyidea
  • python310Packages.arviz
  • python310Packages.baselines
  • python310Packages.beancount
  • python310Packages.beancount_docverif
  • python310Packages.boxx
  • python310Packages.bpycv
  • python310Packages.caffe
  • python310Packages.caffeWithCuda
  • python310Packages.cirq
  • python310Packages.cntk
  • python310Packages.coqui-trainer
  • python310Packages.dalle-mini
  • python310Packages.deepwave
  • python310Packages.distrax
  • python310Packages.django-storages
  • python310Packages.dm-sonnet
  • python310Packages.drivelib
  • python310Packages.edward
  • python310Packages.elegy
  • python310Packages.ezyrb
  • python310Packages.ffcv
  • python310Packages.flax
  • python310Packages.functorch
  • python310Packages.gcsfs
  • python310Packages.gensim
  • python310Packages.google-auth-oauthlib
  • python310Packages.google-nest-sdm
  • python310Packages.gpt-2-simple
  • python310Packages.gspread
  • python310Packages.ignite
  • python310Packages.kubernetes
  • python310Packages.mask-rcnn
  • python310Packages.mlflow
  • python310Packages.monai
  • python310Packages.oauthenticator
  • python310Packages.objax
  • python310Packages.openai-whisper
  • python310Packages.openshift
  • python310Packages.optuna
  • python310Packages.parsedmarc
  • python310Packages.pathy
  • python310Packages.pot
  • python310Packages.pydmd
  • python310Packages.pymanopt
  • python310Packages.pymc
  • python310Packages.pymc3
  • python310Packages.pyro-ppl
  • python310Packages.pytorch
  • python310Packages.pytorch-lightning
  • python310Packages.pytorch-metric-learning
  • python310Packages.pytorch-pfn-extras
  • python310Packages.pytorchWithCuda
  • python310Packages.pytorchWithoutCuda
  • python310Packages.qiskit
  • python310Packages.qiskit-machine-learning
  • python310Packages.rising
  • python310Packages.rl-coach
  • python310Packages.rlax
  • python310Packages.scikit-tda
  • python310Packages.shap
  • python310Packages.skorch
  • python310Packages.slicer
  • python310Packages.smart-open
  • python310Packages.spacy
  • python310Packages.spacy-loggers
  • python310Packages.spacy-transformers
  • python310Packages.stanza
  • python310Packages.tensorboard
  • python310Packages.tensorboardx
  • python310Packages.tensorflow
  • python310Packages.tensorflow-bin
  • python310Packages.tensorflow-bin_2
  • python310Packages.tensorflow-build_2
  • python310Packages.tensorflow-datasets
  • python310Packages.tensorflow-probability
  • python310Packages.tensorflow-tensorboard
  • python310Packages.tensorflow-tensorboard_2
  • python310Packages.tensorflowWithCuda
  • python310Packages.tensorflowWithoutCuda
  • python310Packages.test-tube
  • python310Packages.textacy
  • python310Packages.tflearn
  • python310Packages.torch
  • python310Packages.torch-tb-profiler
  • python310Packages.torchWithCuda
  • python310Packages.torchWithoutCuda
  • python310Packages.torchgpipe
  • python310Packages.torchinfo
  • python310Packages.torchmetrics
  • python310Packages.torchvision
  • python310Packages.treex
  • python310Packages.trfl
  • python310Packages.umap-learn
  • python310Packages.vqgan-jax
  • python310Packages.wandb
  • python310Packages.worldengine
  • python310Packages.zcs
  • python39Packages.arviz
  • python39Packages.baselines
  • python39Packages.beancount
  • python39Packages.beancount_docverif
  • python39Packages.boxx
  • python39Packages.bpycv
  • python39Packages.cirq
  • python39Packages.cntk
  • python39Packages.coqui-trainer
  • python39Packages.dalle-mini
  • python39Packages.deepwave
  • python39Packages.distrax
  • python39Packages.django-storages
  • python39Packages.dm-sonnet
  • python39Packages.drivelib
  • python39Packages.edward
  • python39Packages.elegy
  • python39Packages.ezyrb
  • python39Packages.ffcv
  • python39Packages.flax
  • python39Packages.functorch
  • python39Packages.gcsfs
  • python39Packages.gensim
  • python39Packages.google-auth-oauthlib
  • python39Packages.google-nest-sdm
  • python39Packages.gpt-2-simple
  • python39Packages.gspread
  • python39Packages.ignite
  • python39Packages.kubernetes
  • python39Packages.mask-rcnn
  • python39Packages.mlflow
  • python39Packages.monai
  • python39Packages.oauthenticator
  • python39Packages.objax
  • python39Packages.openai-whisper
  • python39Packages.openshift
  • python39Packages.optuna
  • python39Packages.parsedmarc
  • python39Packages.pathy
  • python39Packages.pot
  • python39Packages.pydmd
  • python39Packages.pymanopt
  • python39Packages.pymc
  • python39Packages.pymc3
  • python39Packages.pyro-ppl
  • python39Packages.pytorch
  • python39Packages.pytorch-lightning
  • python39Packages.pytorch-metric-learning
  • python39Packages.pytorch-pfn-extras
  • python39Packages.pytorchWithCuda
  • python39Packages.pytorchWithoutCuda
  • python39Packages.qiskit
  • python39Packages.qiskit-machine-learning
  • python39Packages.rising
  • python39Packages.rl-coach
  • python39Packages.rlax
  • python39Packages.scikit-tda
  • python39Packages.shap
  • python39Packages.skorch
  • python39Packages.slicer
  • python39Packages.smart-open
  • python39Packages.spacy
  • python39Packages.spacy-loggers
  • python39Packages.spacy-transformers
  • python39Packages.stanza
  • python39Packages.tensorboard
  • python39Packages.tensorboardx
  • python39Packages.tensorflow
  • python39Packages.tensorflow-bin
  • python39Packages.tensorflow-bin_2
  • python39Packages.tensorflow-build_2
  • python39Packages.tensorflow-datasets
  • python39Packages.tensorflow-probability
  • python39Packages.tensorflow-tensorboard
  • python39Packages.tensorflow-tensorboard_2
  • python39Packages.tensorflowWithCuda
  • python39Packages.tensorflowWithoutCuda
  • python39Packages.test-tube
  • python39Packages.textacy
  • python39Packages.tflearn
  • python39Packages.torch
  • python39Packages.torch-tb-profiler
  • python39Packages.torchWithCuda
  • python39Packages.torchWithoutCuda
  • python39Packages.torchgpipe
  • python39Packages.torchinfo
  • python39Packages.torchmetrics
  • python39Packages.torchvision
  • python39Packages.treex
  • python39Packages.trfl
  • python39Packages.umap-learn
  • python39Packages.vqgan-jax
  • python39Packages.wandb
  • python39Packages.worldengine
  • python39Packages.zcs
  • s3ql
  • snakemake
  • tandoor-recipes
  • tts
12 packages failed to build:
  • electrum-grs
  • or-tools
  • pynitrokey
  • python310Packages.certbot-dns-google
  • python310Packages.ibis-framework
  • python310Packages.ortools
  • python310Packages.skl2onnx
  • python39Packages.certbot-dns-google
  • python39Packages.ibis-framework
  • python39Packages.ortools
  • python39Packages.skl2onnx
  • streamlit
302 packages built:
  • agi
  • android-tools
  • biliass (python310Packages.biliass)
  • botamusique
  • buildah
  • catt
  • cdogs-sdl
  • charge-lnd
  • chiaki
  • cinnamon.warpinator
  • cri-o
  • criterion
  • criu
  • crun
  • datadog-agent
  • datadog-process-agent
  • deja-dup
  • duplicity
  • duply
  • electron-cash
  • electrum
  • electrum-ltc
  • esphome
  • gajim
  • gcalcli
  • gnomecast
  • goobook (python310Packages.goobook)
  • hwi (python310Packages.hwi)
  • keepkey_agent (python310Packages.keepkey_agent)
  • kmymoney
  • krunvm
  • lbdb
  • ledger_agent (python310Packages.ledger_agent)
  • lieer
  • lndmanage
  • lxd
  • manim
  • mitmproxy (python310Packages.mitmproxy)
  • mitmproxy2swagger
  • mkchromecast
  • mloader
  • nanopb
  • nanopbMalloc
  • nrfutil
  • ola
  • opensnitch-ui
  • podman
  • pulseaudio-dlna
  • python310Packages.PyChromecast
  • python310Packages.aioesphomeapi
  • python310Packages.angr
  • python310Packages.angrcli
  • python310Packages.angrop
  • python310Packages.apache-beam
  • python310Packages.augmax
  • python310Packages.betterproto
  • python310Packages.bitbox02
  • python310Packages.cairo-lang
  • python310Packages.chainer
  • python310Packages.chirpstack-api
  • python310Packages.cirq-google
  • python310Packages.consonance
  • python310Packages.dask-yarn
  • python310Packages.devolo-plc-api
  • python310Packages.duckdb
  • python310Packages.duckdb-engine
  • python310Packages.einops
  • python310Packages.google-api-core
  • python310Packages.google-api-python-client
  • python310Packages.google-auth
  • python310Packages.google-auth-httplib2
  • python310Packages.google-cloud-access-context-manager
  • python310Packages.google-cloud-appengine-logging
  • python310Packages.google-cloud-asset
  • python310Packages.google-cloud-audit-log
  • python310Packages.google-cloud-automl
  • python310Packages.google-cloud-bigquery
  • python310Packages.google-cloud-bigquery-datatransfer
  • python310Packages.google-cloud-bigquery-logging
  • python310Packages.google-cloud-bigquery-storage
  • python310Packages.google-cloud-bigtable
  • python310Packages.google-cloud-compute
  • python310Packages.google-cloud-container
  • python310Packages.google-cloud-core
  • python310Packages.google-cloud-datacatalog
  • python310Packages.google-cloud-dataproc
  • python310Packages.google-cloud-datastore
  • python310Packages.google-cloud-dlp
  • python310Packages.google-cloud-dns
  • python310Packages.google-cloud-error-reporting
  • python310Packages.google-cloud-firestore
  • python310Packages.google-cloud-iam
  • python310Packages.google-cloud-iam-logging
  • python310Packages.google-cloud-iot
  • python310Packages.google-cloud-kms
  • python310Packages.google-cloud-language
  • python310Packages.google-cloud-logging
  • python310Packages.google-cloud-monitoring
  • python310Packages.google-cloud-org-policy
  • python310Packages.google-cloud-os-config
  • python310Packages.google-cloud-pubsub
  • python310Packages.google-cloud-redis
  • python310Packages.google-cloud-resource-manager
  • python310Packages.google-cloud-runtimeconfig
  • python310Packages.google-cloud-secret-manager
  • python310Packages.google-cloud-securitycenter
  • python310Packages.google-cloud-spanner
  • python310Packages.google-cloud-speech
  • python310Packages.google-cloud-storage
  • python310Packages.google-cloud-tasks
  • python310Packages.google-cloud-testutils
  • python310Packages.google-cloud-texttospeech
  • python310Packages.google-cloud-trace
  • python310Packages.google-cloud-translate
  • python310Packages.google-cloud-videointelligence
  • python310Packages.google-cloud-vision
  • python310Packages.google-cloud-websecurityscanner
  • python310Packages.google-resumable-media
  • python310Packages.googleapis-common-protos
  • python310Packages.gpapi
  • python310Packages.gplaycli
  • python310Packages.grpc-google-iam-v1
  • python310Packages.grpcio
  • python310Packages.grpcio-gcp
  • python310Packages.grpcio-status
  • python310Packages.grpcio-tools
  • python310Packages.grpclib
  • python310Packages.gtfs-realtime-bindings
  • python310Packages.hangups
  • python310Packages.keepkey
  • python310Packages.keyrings-google-artifactregistry-auth
  • python310Packages.ledgerblue
  • python310Packages.ledgerwallet
  • python310Packages.matlink-gpapi
  • python310Packages.meshtastic
  • python310Packages.mypy-protobuf
  • python310Packages.mysql-connector
  • python310Packages.onnx
  • python310Packages.onnxconverter-common
  • python310Packages.paranoid-crypto
  • python310Packages.proto-plus
  • python310Packages.protobuf
  • python310Packages.protobuf3-to-dict
  • python310Packages.pulumi
  • python310Packages.pulumi-aws
  • python310Packages.push-receiver
  • python310Packages.pyatv
  • python310Packages.pycomfoconnect
  • python310Packages.pydrive2
  • python310Packages.pymumble
  • python310Packages.python-axolotl
  • python310Packages.pytransportnswv2
  • python310Packages.s2clientprotocol
  • python310Packages.sagemaker
  • python310Packages.skein
  • python310Packages.snakebite
  • python310Packages.sqlglot
  • python310Packages.tensorboard-plugin-profile
  • python310Packages.tensorflow-metadata
  • python310Packages.transformers
  • trezorctl (python310Packages.trezor)
  • trezor_agent (python310Packages.trezor_agent)
  • python310Packages.web3
  • python310Packages.weboob
  • python310Packages.woob
  • python310Packages.xarray-einstats
  • python310Packages.yowsup
  • yutto (python310Packages.yutto)
  • python39Packages.PyChromecast
  • python39Packages.aioesphomeapi
  • python39Packages.angr
  • python39Packages.angrcli
  • python39Packages.angrop
  • python39Packages.apache-beam
  • python39Packages.augmax
  • python39Packages.betterproto
  • python39Packages.biliass
  • python39Packages.bitbox02
  • python39Packages.caffe
  • python39Packages.caffeWithCuda
  • python39Packages.cairo-lang
  • python39Packages.chainer
  • python39Packages.chirpstack-api
  • python39Packages.cirq-google
  • python39Packages.consonance
  • python39Packages.dask-yarn
  • python39Packages.devolo-plc-api
  • python39Packages.duckdb
  • python39Packages.duckdb-engine
  • python39Packages.einops
  • python39Packages.goobook
  • python39Packages.google-api-core
  • python39Packages.google-api-python-client
  • python39Packages.google-auth
  • python39Packages.google-auth-httplib2
  • python39Packages.google-cloud-access-context-manager
  • python39Packages.google-cloud-appengine-logging
  • python39Packages.google-cloud-asset
  • python39Packages.google-cloud-audit-log
  • python39Packages.google-cloud-automl
  • python39Packages.google-cloud-bigquery
  • python39Packages.google-cloud-bigquery-datatransfer
  • python39Packages.google-cloud-bigquery-logging
  • python39Packages.google-cloud-bigquery-storage
  • python39Packages.google-cloud-bigtable
  • python39Packages.google-cloud-compute
  • python39Packages.google-cloud-container
  • python39Packages.google-cloud-core
  • python39Packages.google-cloud-datacatalog
  • python39Packages.google-cloud-dataproc
  • python39Packages.google-cloud-datastore
  • python39Packages.google-cloud-dlp
  • python39Packages.google-cloud-dns
  • python39Packages.google-cloud-error-reporting
  • python39Packages.google-cloud-firestore
  • python39Packages.google-cloud-iam
  • python39Packages.google-cloud-iam-logging
  • python39Packages.google-cloud-iot
  • python39Packages.google-cloud-kms
  • python39Packages.google-cloud-language
  • python39Packages.google-cloud-logging
  • python39Packages.google-cloud-monitoring
  • python39Packages.google-cloud-org-policy
  • python39Packages.google-cloud-os-config
  • python39Packages.google-cloud-pubsub
  • python39Packages.google-cloud-redis
  • python39Packages.google-cloud-resource-manager
  • python39Packages.google-cloud-runtimeconfig
  • python39Packages.google-cloud-secret-manager
  • python39Packages.google-cloud-securitycenter
  • python39Packages.google-cloud-spanner
  • python39Packages.google-cloud-speech
  • python39Packages.google-cloud-storage
  • python39Packages.google-cloud-tasks
  • python39Packages.google-cloud-testutils
  • python39Packages.google-cloud-texttospeech
  • python39Packages.google-cloud-trace
  • python39Packages.google-cloud-translate
  • python39Packages.google-cloud-videointelligence
  • python39Packages.google-cloud-vision
  • python39Packages.google-cloud-websecurityscanner
  • python39Packages.google-resumable-media
  • python39Packages.googleapis-common-protos
  • python39Packages.gpapi
  • python39Packages.gplaycli
  • python39Packages.grpc-google-iam-v1
  • python39Packages.grpcio
  • python39Packages.grpcio-gcp
  • python39Packages.grpcio-status
  • python39Packages.grpcio-tools
  • python39Packages.grpclib
  • python39Packages.gtfs-realtime-bindings
  • python39Packages.hangups
  • python39Packages.hwi
  • python39Packages.keepkey
  • python39Packages.keepkey_agent
  • python39Packages.keyrings-google-artifactregistry-auth
  • python39Packages.ledger_agent
  • python39Packages.ledgerblue
  • python39Packages.ledgerwallet
  • python39Packages.manticore
  • python39Packages.matlink-gpapi
  • python39Packages.meshtastic
  • python39Packages.mitmproxy
  • python39Packages.mypy-protobuf
  • python39Packages.mysql-connector
  • python39Packages.onnx
  • python39Packages.onnxconverter-common
  • python39Packages.paranoid-crypto
  • python39Packages.proto-plus
  • python39Packages.protobuf
  • python39Packages.protobuf3-to-dict
  • python39Packages.pulumi
  • python39Packages.pulumi-aws
  • python39Packages.push-receiver
  • python39Packages.pyatv
  • python39Packages.pycomfoconnect
  • python39Packages.pydrive2
  • python39Packages.pymumble
  • python39Packages.python-axolotl
  • python39Packages.pytransportnswv2
  • python39Packages.s2clientprotocol
  • python39Packages.sagemaker
  • python39Packages.skein
  • python39Packages.snakebite
  • python39Packages.sqlglot
  • python39Packages.tensorboard-plugin-profile
  • python39Packages.tensorflow-metadata
  • python39Packages.transformers
  • python39Packages.trezor
  • python39Packages.trezor_agent
  • python39Packages.web3
  • python39Packages.weboob
  • python39Packages.woob
  • python39Packages.xarray-einstats
  • python39Packages.yowsup
  • python39Packages.yutto
  • qlcplus
  • siril
  • sparrow
  • tauon
  • wapiti

@ehllie ehllie mentioned this pull request Oct 10, 2022
13 tasks
@oxalica oxalica force-pushed the fix/python-protobuf branch from f121b1d to 8bd4d92 Compare November 5, 2022 11:50
@oxalica
Copy link
Contributor Author

oxalica commented Nov 5, 2022

Rebased and removed fixes that already included in master.

@oxalica oxalica requested a review from acairncross November 5, 2022 11:52
@erdnaxe
Copy link
Member

erdnaxe commented Nov 6, 2022

Result of nixpkgs-review pr 194111 run on aarch64-linux 1

/!\ I believe the OOM killer killed something in nixpkgs-review. I set NIXPKGS_ALLOW_UNSUPPORTED_SYSTEM=1. Please take this review as potentially wrong.

58 packages marked as broken and skipped:
  • python310Packages.angrcli
  • python310Packages.arviz
  • python310Packages.augmax
  • python310Packages.caffe
  • python310Packages.caffeWithCuda
  • python310Packages.cirq
  • python310Packages.cirq-google
  • python310Packages.dalle-mini
  • python310Packages.dask-yarn
  • python310Packages.distrax
  • python310Packages.dm-sonnet
  • python310Packages.elegy
  • python310Packages.flax
  • python310Packages.mask-rcnn
  • python310Packages.oauthenticator
  • python310Packages.objax
  • python310Packages.optuna
  • python310Packages.pydmd
  • python310Packages.pymc
  • python310Packages.qiskit
  • python310Packages.qiskit-machine-learning
  • python310Packages.rl-coach
  • python310Packages.rlax
  • python310Packages.skein
  • python310Packages.skorch
  • python310Packages.tensorflow-datasets
  • python310Packages.treex
  • python310Packages.vqgan-jax
  • python310Packages.worldengine
  • python39Packages.angrcli
  • python39Packages.arviz
  • python39Packages.augmax
  • python39Packages.cirq
  • python39Packages.cirq-google
  • python39Packages.dalle-mini
  • python39Packages.dask-yarn
  • python39Packages.distrax
  • python39Packages.dm-sonnet
  • python39Packages.elegy
  • python39Packages.flax
  • python39Packages.manticore
  • python39Packages.mask-rcnn
  • python39Packages.oauthenticator
  • python39Packages.objax
  • python39Packages.optuna
  • python39Packages.pydmd
  • python39Packages.pymc
  • python39Packages.qiskit
  • python39Packages.qiskit-machine-learning
  • python39Packages.rl-coach
  • python39Packages.rlax
  • python39Packages.skein
  • python39Packages.skorch
  • python39Packages.tensorflow-datasets
  • python39Packages.treex
  • python39Packages.vqgan-jax
  • python39Packages.worldengine
  • worldengine-cli
52 packages failed to build:
  • electrum-grs
  • manim
  • or-tools
  • pynitrokey
  • python310Packages.boxx
  • python310Packages.bpycv
  • python310Packages.ffcv
  • python310Packages.ortools
  • python310Packages.pytorch-lightning
  • python310Packages.pytorch-metric-learning
  • python310Packages.pytorch-pfn-extras
  • python310Packages.rising
  • python310Packages.shap
  • python310Packages.spacy
  • python310Packages.spacy-transformers
  • python310Packages.tensorflowWithCuda
  • python310Packages.test-tube
  • python310Packages.textacy
  • python310Packages.torchWithCuda
  • python310Packages.torchinfo
  • python310Packages.zcs
  • python39Packages.baselines
  • python39Packages.boxx
  • python39Packages.bpycv
  • python39Packages.caffe
  • python39Packages.caffeWithCuda
  • python39Packages.edward
  • python39Packages.ffcv
  • python39Packages.gpt-2-simple
  • python39Packages.ortools
  • python39Packages.potpython39Packages.pymanopt
  • python39Packages.pytorch-lightning
  • python39Packages.pytorch-metric-learning
  • python39Packages.pytorch-pfn-extras
  • python39Packages.rising
  • python39Packages.scikit-tda
  • python39Packages.shap
  • python39Packages.spacy
  • python39Packages.spacy-transformers
  • python39Packages.tensorflow
  • python39Packages.tensorflow-probability
  • python39Packages.tensorflowWithCuda
  • python39Packages.test-tube
  • python39Packages.textacy
  • python39Packages.tflearn
  • python39Packages.torchWithCuda
  • python39Packages.torchinfo
  • python39Packages.trfl
  • python39Packages.umap-learn
  • python39Packages.zcs
  • streamlit
396 packages built:
  • android-tools
  • barman
  • baserow
  • beancount
  • biliass
  • botamusique
  • buildah
  • catt
  • cdogs-sdl
  • charge-lnd
  • chiaki
  • cinnamon.warpinator
  • cri-o
  • criterion
  • criu
  • crun
  • datadog-agent
  • datadog-process-agent
  • dbx
  • deja-dupduplicity
  • duply
  • dvc-with-remotes
  • electron-cash
  • electrum
  • electrum-ltc
  • fava
  • gajim
  • gam
  • gcalcli
  • git-annex-remote-googledrive
  • gnomecast
  • goobook
  • gphotos-sync
  • gyb
  • home-assistant-component-tests.apple_tv
  • home-assistant-component-tests.cast
  • home-assistant-component-tests.comfoconnect
  • home-assistant-component-tests.devolo_home_network
  • home-assistant-component-tests.esphome
  • home-assistant-component-tests.google_pubsub
  • home-assistant-component-tests.google_sheets
  • home-assistant-component-tests.hangouts
  • home-assistant-component-tests.lovelace
  • home-assistant-component-tests.nest
  • hwi
  • keepkey_agent
  • kmymoney
  • kube-hunter
  • lbdb
  • ledger2beancount
  • ledger_agent
  • libtensorflow
  • lieer
  • lndmanage
  • lxd
  • mitmproxy
  • mitmproxy2swagger
  • mkchromecast
  • mlflow-server
  • mloader
  • mycli
  • mypy-protobuf
  • nanopb
  • nanopbMalloc
  • nrfutil
  • ola
  • openai-whisper
  • opensnitch-ui
  • parsedmarc
  • patroni
  • podman
  • privacyidea
  • pulseaudio-dlna
  • python310Packages.PyChromecast
  • python310Packages.aioesphomeapi
  • python310Packages.angr
  • python310Packages.angrop
  • python310Packages.apache-beam
  • python310Packages.baselines
  • python310Packages.beancount_docverif
  • python310Packages.betterproto
  • python310Packages.bitbox02
  • python310Packages.cairo-langpython310Packages.certbot-dns-google
  • python310Packages.chainer
  • python310Packages.chirpstack-api
  • python310Packages.consonance
  • python310Packages.devolo-plc-api
  • python310Packages.django-storages
  • python310Packages.drivelib
  • python310Packages.duckdb
  • python310Packages.duckdb-engine
  • python310Packages.edward
  • python310Packages.einops
  • python310Packages.ezyrb
  • python310Packages.gcsfs
  • python310Packages.gensim
  • python310Packages.google-api-core
  • python310Packages.google-api-python-client
  • python310Packages.google-auth
  • python310Packages.google-auth-httplib2
  • python310Packages.google-auth-oauthlib
  • python310Packages.google-cloud-access-context-manager
  • python310Packages.google-cloud-appengine-logging
  • python310Packages.google-cloud-asset
  • python310Packages.google-cloud-audit-log
  • python310Packages.google-cloud-automl
  • python310Packages.google-cloud-bigquery
  • python310Packages.google-cloud-bigquery-datatransfer
  • python310Packages.google-cloud-bigquery-logging
  • python310Packages.google-cloud-bigquery-storage
  • python310Packages.google-cloud-bigtable
  • python310Packages.google-cloud-compute
  • python310Packages.google-cloud-container
  • python310Packages.google-cloud-core
  • python310Packages.google-cloud-datacatalog
  • python310Packages.google-cloud-dataproc
  • python310Packages.google-cloud-datastore
  • python310Packages.google-cloud-dlp
  • python310Packages.google-cloud-dns
  • python310Packages.google-cloud-error-reporting
  • python310Packages.google-cloud-firestore
  • python310Packages.google-cloud-iam
  • python310Packages.google-cloud-iam-logging
  • python310Packages.google-cloud-iot
  • python310Packages.google-cloud-kms
  • python310Packages.google-cloud-language
  • python310Packages.google-cloud-logging
  • python310Packages.google-cloud-monitoring
  • python310Packages.google-cloud-org-policy
  • python310Packages.google-cloud-os-config
  • python310Packages.google-cloud-pubsub
  • python310Packages.google-cloud-redis
  • python310Packages.google-cloud-resource-manager
  • python310Packages.google-cloud-runtimeconfigpython310Packages.google-cloud-secret-manager
  • python310Packages.google-cloud-securitycenter
  • python310Packages.google-cloud-spanner
  • python310Packages.google-cloud-speech
  • python310Packages.google-cloud-storage
  • python310Packages.google-cloud-tasks
  • python310Packages.google-cloud-testutils
  • python310Packages.google-cloud-texttospeech
  • python310Packages.google-cloud-trace
  • python310Packages.google-cloud-translate
  • python310Packages.google-cloud-videointelligence
  • python310Packages.google-cloud-vision
  • python310Packages.google-cloud-websecurityscanner
  • python310Packages.google-nest-sdm
  • python310Packages.google-resumable-media
  • python310Packages.googleapis-common-protos
  • python310Packages.gpapi
  • python310Packages.gplaycli
  • python310Packages.gpt-2-simple
  • python310Packages.grpc-google-iam-v1
  • python310Packages.grpcio
  • python310Packages.grpcio-gcp
  • python310Packages.grpcio-status
  • python310Packages.grpcio-tools
  • python310Packages.grpclib
  • python310Packages.gspread
  • python310Packages.gtfs-realtime-bindings
  • python310Packages.hangups
  • python310Packages.ibis-framework
  • python310Packages.ignite
  • python310Packages.keepkey
  • python310Packages.keyrings-google-artifactregistry-auth
  • python310Packages.kubernetes
  • python310Packages.ledgerblue
  • python310Packages.ledgerwallet
  • python310Packages.matlink-gpapi
  • python310Packages.meshtastic
  • python310Packages.mlflow
  • python310Packages.monai
  • python310Packages.mysql-connector
  • python310Packages.onnx
  • python310Packages.onnxconverter-common
  • python310Packages.opencensus
  • python310Packages.openshift
  • python310Packages.paranoid-crypto
  • python310Packages.pathy
  • python310Packages.pot
  • python310Packages.proto-plus
  • python310Packages.protobuf
  • python310Packages.protobuf3-to-dict
  • python310Packages.pulumi
  • python310Packages.pulumi-aws
  • python310Packages.push-receiver
  • python310Packages.pyatv
  • python310Packages.pycomfoconnect
  • python310Packages.pydrive2
  • python310Packages.pymanopt
  • python310Packages.pymumble
  • python310Packages.pyro-ppl
  • python310Packages.python-axolotl
  • python310Packages.pytransportnswv2
  • python310Packages.s2clientprotocol
  • python310Packages.sagemaker
  • python310Packages.scikit-tda
  • python310Packages.skl2onnx
  • python310Packages.skrl
  • python310Packages.slicer
  • python310Packages.smart-open
  • python310Packages.snakebite
  • python310Packages.spacy-loggers
  • python310Packages.sqlglot
  • python310Packages.stanza
  • python310Packages.tensorboard
  • python310Packages.tensorboard-plugin-profile
  • python310Packages.tensorboardx
  • python310Packages.tensorflow
  • python310Packages.tensorflow-metadata
  • python310Packages.tensorflow-probability
  • python310Packages.tflearn
  • python310Packages.torch
  • python310Packages.torch-tb-profiler
  • python310Packages.torchgpipe
  • python310Packages.torchmetrics
  • python310Packages.torchvision
  • python310Packages.transformers
  • trezorctl
  • trezor_agent
  • python310Packages.trfl
  • python310Packages.umap-learn
  • python310Packages.wandb
  • python310Packages.web3
  • python310Packages.weboob
  • python310Packages.woob
  • python310Packages.xarray-einstats
  • python310Packages.yowsup
  • python39Packages.PyChromecast
  • python39Packages.aioesphomeapi
  • python39Packages.angr
  • python39Packages.angrop
  • python39Packages.apache-beam
  • python39Packages.beancount
  • python39Packages.beancount_docverif
  • python39Packages.betterproto
  • python39Packages.biliass
  • python39Packages.bitbox02
  • python39Packages.cairo-lang
  • python39Packages.certbot-dns-google
  • python39Packages.chainer
  • python39Packages.chirpstack-api
  • python39Packages.consonance
  • python39Packages.devolo-plc-api
  • python39Packages.django-storages
  • python39Packages.drivelib
  • python39Packages.duckdb
  • python39Packages.duckdb-engine
  • python39Packages.einops
  • python39Packages.ezyrb
  • python39Packages.gcsfs
  • python39Packages.gensim
  • python39Packages.goobook
  • python39Packages.google-api-core
  • python39Packages.google-api-python-client
  • python39Packages.google-auth
  • python39Packages.google-auth-httplib2
  • python39Packages.google-auth-oauthlib
  • python39Packages.google-cloud-access-context-manager
  • python39Packages.google-cloud-appengine-logging
  • python39Packages.google-cloud-asset
  • python39Packages.google-cloud-audit-log
  • python39Packages.google-cloud-automl
  • python39Packages.google-cloud-bigquery
  • python39Packages.google-cloud-bigquery-datatransfer
  • python39Packages.google-cloud-bigquery-logging
  • python39Packages.google-cloud-bigquery-storage
  • python39Packages.google-cloud-bigtable
  • python39Packages.google-cloud-compute
  • python39Packages.google-cloud-container
  • python39Packages.google-cloud-core
  • python39Packages.google-cloud-datacatalog
  • python39Packages.google-cloud-dataproc
  • python39Packages.google-cloud-datastore
  • python39Packages.google-cloud-dlp
  • python39Packages.google-cloud-dns
  • python39Packages.google-cloud-error-reporting
  • python39Packages.google-cloud-firestore
  • python39Packages.google-cloud-iam
  • python39Packages.google-cloud-iam-logging
  • python39Packages.google-cloud-iot
  • python39Packages.google-cloud-kms
  • python39Packages.google-cloud-language
  • python39Packages.google-cloud-logging
  • python39Packages.google-cloud-monitoring
  • python39Packages.google-cloud-org-policy
  • python39Packages.google-cloud-os-config
  • python39Packages.google-cloud-pubsub
  • python39Packages.google-cloud-redis
  • python39Packages.google-cloud-resource-manager
  • python39Packages.google-cloud-runtimeconfig
  • python39Packages.google-cloud-secret-manager
  • python39Packages.google-cloud-securitycenter
  • python39Packages.google-cloud-spanner
  • python39Packages.google-cloud-speech
  • python39Packages.google-cloud-storage
  • python39Packages.google-cloud-tasks
  • python39Packages.google-cloud-testutils
  • python39Packages.google-cloud-texttospeech
  • python39Packages.google-cloud-trace
  • python39Packages.google-cloud-translate
  • python39Packages.google-cloud-videointelligence
  • python39Packages.google-cloud-vision
  • python39Packages.google-cloud-websecurityscanner
  • python39Packages.google-nest-sdm
  • python39Packages.google-resumable-media
  • python39Packages.googleapis-common-protos
  • python39Packages.gpapi
  • python39Packages.gplaycli
  • python39Packages.grpc-google-iam-v1
  • python39Packages.grpcio
  • python39Packages.grpcio-gcp
  • python39Packages.grpcio-status
  • python39Packages.grpcio-tools
  • python39Packages.grpclib
  • python39Packages.gspread
  • python39Packages.gtfs-realtime-bindings
  • python39Packages.hangups
  • python39Packages.hwi
  • python39Packages.ibis-framework
  • python39Packages.ignite
  • python39Packages.keepkey
  • python39Packages.keepkey_agent
  • python39Packages.keyrings-google-artifactregistry-auth
  • python39Packages.kubernetes
  • python39Packages.ledger_agent
  • python39Packages.ledgerblue
  • python39Packages.ledgerwallet
  • python39Packages.matlink-gpapi
  • python39Packages.meshtastic
  • python39Packages.mitmproxy
  • python39Packages.mlflow
  • python39Packages.monai
  • python39Packages.mypy-protobuf
  • python39Packages.mysql-connector
  • python39Packages.onnx
  • python39Packages.onnxconverter-common
  • python39Packages.openai-whisper
  • python39Packages.opencensus
  • python39Packages.openshift
  • python39Packages.paranoid-crypto
  • python39Packages.parsedmarc
  • python39Packages.pathy
  • python39Packages.proto-plus
  • python39Packages.protobuf
  • python39Packages.protobuf3-to-dict
  • python39Packages.pulumi
  • python39Packages.pulumi-aws
  • python39Packages.push-receiver
  • python39Packages.pyatv
  • python39Packages.pycomfoconnect
  • python39Packages.pydrive2
  • python39Packages.pymumble
  • python39Packages.pyro-ppl
  • python39Packages.python-axolotl
  • python39Packages.pytransportnswv2
  • python39Packages.s2clientprotocol
  • python39Packages.sagemaker
  • python39Packages.skl2onnx
  • python39Packages.skrl
  • python39Packages.slicer
  • python39Packages.smart-open
  • python39Packages.snakebite
  • python39Packages.spacy-loggers
  • python39Packages.sqlglot
  • python39Packages.stanza
  • python39Packages.tensorboard
  • python39Packages.tensorboard-plugin-profile
  • python39Packages.tensorboardx
  • python39Packages.tensorflow-metadata
  • python39Packages.torch
  • python39Packages.torch-tb-profiler
  • python39Packages.torchgpipe
  • python39Packages.torchmetrics
  • python39Packages.torchvision
  • python39Packages.transformers
  • python39Packages.trezor
  • python39Packages.trezor_agent
  • python39Packages.wandb
  • python39Packages.web3
  • python39Packages.weboob
  • python39Packages.woob
  • python39Packages.xarray-einstats
  • python39Packages.yowsup
  • qlcplus
  • s3ql
  • siril
  • snakemake
  • tandoor-recipes
  • tauon
  • wal_e
  • wapiti
  • yutto

@oxalica
Copy link
Contributor Author

oxalica commented Nov 6, 2022

@erdnaxe Thanks for the test.
This PR should not cause MORE breakage. Those packages requiring protobuf < 4 are already failing because python check the package metadata, which is already correct, instead of the drv version.

I think we should fix them individually in master rather than here, to prevent further conflicts.

@oxalica oxalica changed the title [staging-next] python3Packages.protobuf: fix drv version and dependent build failures [staging-next] python3Packages.protobuf: fix drv version Nov 6, 2022
@vcunat vcunat merged commit 7e3e9bb into NixOS:staging-next Nov 8, 2022
@oxalica oxalica deleted the fix/python-protobuf branch November 8, 2022 06:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

6.topic: python Python is a high-level, general-purpose programming language. 10.rebuild-darwin: 101-500 This PR causes between 101 and 500 packages to rebuild on Darwin. 10.rebuild-linux: 501-1000 This PR causes many rebuilds on Linux and should normally target the staging branches. 10.rebuild-linux: 501+ This PR causes many rebuilds on Linux and should normally target the staging branches. 12.approvals: 1 This PR was reviewed and approved by one person.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

electrum: fails to build on x86_64

7 participants