Skip to content

Conversation

@potiuk
Copy link
Member

@potiuk potiuk commented Mar 4, 2023

Recent change in the new containerd causes memory exhaution as huge amount of memory were used by python-daemon when starting, thus running Airflow in Docker for multiple OS-es using the new containerd was impossible without implementing some workarounds.

Python daemon fix has been released in 3.0.0 version in response to https://pagure.io/python-daemon/issue/72 and we should add min version for the package to make sure the new version is used.

Fixes: #29841


^ Add meaningful description above

Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

Recent change in the new containerd causes memory exhaution as
huge amount of memory were used by python-daemon when starting,
thus running Airflow in Docker for multiple OS-es using the new
containerd was impossible without implementing some workarounds.

Python daemon fix has been released in 3.0.0 version in response to
https://pagure.io/python-daemon/issue/72 and we should add min
version for the package to make sure the new version is used.

Fixes: apache#29841
Copy link
Member

@hussein-awala hussein-awala left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

@potiuk
Copy link
Member Author

potiuk commented Mar 4, 2023

Flaky test. merging.

@potiuk potiuk merged commit c8cc49a into apache:main Mar 4, 2023
@potiuk potiuk deleted the bump-min-python-daemon branch March 4, 2023 15:27
@pierrejeambrun pierrejeambrun added the type:bug-fix Changelog: Bug Fixes label Mar 6, 2023
pierrejeambrun pushed a commit that referenced this pull request Mar 7, 2023
…9916)

Recent change in the new containerd causes memory exhaution as
huge amount of memory were used by python-daemon when starting,
thus running Airflow in Docker for multiple OS-es using the new
containerd was impossible without implementing some workarounds.

Python daemon fix has been released in 3.0.0 version in response to
https://pagure.io/python-daemon/issue/72 and we should add min
version for the package to make sure the new version is used.

Fixes: #29841
(cherry picked from commit c8cc49a)
pierrejeambrun pushed a commit that referenced this pull request Mar 8, 2023
…9916)

Recent change in the new containerd causes memory exhaution as
huge amount of memory were used by python-daemon when starting,
thus running Airflow in Docker for multiple OS-es using the new
containerd was impossible without implementing some workarounds.

Python daemon fix has been released in 3.0.0 version in response to
https://pagure.io/python-daemon/issue/72 and we should add min
version for the package to make sure the new version is used.

Fixes: #29841
(cherry picked from commit c8cc49a)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

type:bug-fix Changelog: Bug Fixes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

high memory leak, cannot start even webserver

4 participants