Skip to content

Conversation

@potiuk
Copy link
Member

@potiuk potiuk commented Nov 30, 2020

Verification of images with PIP is done in separate jobs and
they provide useful information to committers and contributors
when the pip check fails.


^ Add meaningful description above

Read the Pull Request Guidelines for more information.
In case of fundamental code change, Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in UPDATING.md.

@potiuk potiuk marked this pull request as draft November 30, 2020 12:47
@potiuk potiuk requested review from ashb, kaxil and turbaszek November 30, 2020 12:52
@potiuk
Copy link
Member Author

potiuk commented Nov 30, 2020

Still draft, buit it should make it easy to handle dep changes in the future

@potiuk potiuk force-pushed the better-pip-check-validation branch 3 times, most recently from 8551dae to 7d912bc Compare November 30, 2020 14:17
@potiuk potiuk marked this pull request as ready for review November 30, 2020 14:17
@potiuk potiuk added the full tests needed We need to run full set of tests for this PR to merge label Nov 30, 2020
@potiuk potiuk force-pushed the better-pip-check-validation branch from 7d912bc to 5630308 Compare November 30, 2020 14:17
@potiuk
Copy link
Member Author

potiuk commented Nov 30, 2020

It's ready for review. I thnk it's really nice change that allows to focus on dep changes and explains how to fix it in case it happens..

@potiuk potiuk requested a review from mik-laj November 30, 2020 14:31
@potiuk potiuk force-pushed the better-pip-check-validation branch from 5630308 to c903d9d Compare November 30, 2020 15:20
@potiuk
Copy link
Member Author

potiuk commented Nov 30, 2020

@turbaszek @kaxil @ashb @mik-laj [@mjpieters ?] -> The PR with improved PIP check is ready - and you can actually see how things will work when there is a problem with PIP check (we still have the azure problem to fix in the prod image that @ephraimbuddy is working on):

https://github.com/apache/airflow/pull/12718/checks?check_run_id=1475010204#step:4:562

I already have a couple of small improvements to add:

  • adding RED error message to indicate clearly that the pip check output is an error and GREEN when everything is fine
  • few typos

However, I would love to get some comments on the wording and instructions. I based it on my experiences with getting rid of the conflicts and how I was solving them. I think those instructions should be clear enough for the contributors and commiters on what they should do in case their change actually results in conflict so I am happy to hear any comments.

@potiuk
Copy link
Member Author

potiuk commented Nov 30, 2020

BTW. once I merge this change I will also add an automated "update to newer dependencies" behaviour whenever setup.py changes in the PR. With PIP check guarding it, we should be safe to do pip upgrade --upgrade-strategy eager for any PR that changes setup.py/setup.cfg

@potiuk
Copy link
Member Author

potiuk commented Nov 30, 2020

This is what you get now when there is a pip check error:

Screenshot from 2020-11-30 22-47-04

Verification of images with PIP is done in separate jobs and
they provide useful information to committers and contributors
when the pip check fails.
@potiuk potiuk force-pushed the better-pip-check-validation branch from 0c7c9b8 to 80fc9dc Compare November 30, 2020 22:23
@potiuk potiuk merged commit ebc8fcf into apache:master Dec 1, 2020
@potiuk potiuk deleted the better-pip-check-validation branch December 1, 2020 08:51
potiuk added a commit that referenced this pull request Dec 1, 2020
Verification of images with PIP is done in separate jobs and
they provide useful information to committers and contributors
when the pip check fails.

(cherry picked from commit ebc8fcf)
kaxil pushed a commit that referenced this pull request Dec 3, 2020
Verification of images with PIP is done in separate jobs and
they provide useful information to committers and contributors
when the pip check fails.

(cherry picked from commit ebc8fcf)
ashb pushed a commit that referenced this pull request Dec 3, 2020
Verification of images with PIP is done in separate jobs and
they provide useful information to committers and contributors
when the pip check fails.

(cherry picked from commit ebc8fcf)
cfei18 pushed a commit to cfei18/incubator-airflow that referenced this pull request Mar 5, 2021
Verification of images with PIP is done in separate jobs and
they provide useful information to committers and contributors
when the pip check fails.

(cherry picked from commit ebc8fcf)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:dev-tools full tests needed We need to run full set of tests for this PR to merge

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants