Skip to content

Move openlineage configuration to provider#33124

Merged
hussein-awala merged 1 commit into
apache:mainfrom
potiuk:move-configuration-for-openlineage-to-provider
Aug 4, 2023
Merged

Move openlineage configuration to provider#33124
hussein-awala merged 1 commit into
apache:mainfrom
potiuk:move-configuration-for-openlineage-to-provider

Conversation

@potiuk

@potiuk potiuk commented Aug 4, 2023

Copy link
Copy Markdown
Member

^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

@potiuk
potiuk force-pushed the move-configuration-for-openlineage-to-provider branch from 315a656 to c3ab246 Compare August 4, 2023 17:59
@potiuk

potiuk commented Aug 4, 2023

Copy link
Copy Markdown
Member Author
Screenshot 2023-08-04 at 20 00 58

@potiuk potiuk added this to the Airflow 2.7.0 milestone Aug 4, 2023
@potiuk
potiuk force-pushed the move-configuration-for-openlineage-to-provider branch from c3ab246 to e03cc59 Compare August 4, 2023 18:24

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@mobuchowski - I had to add explicit fallback here as our "import" check checks the case where the providers are imported directly - and Provider's Manager might not yet have been initialized with provider configurations. So all top-level imports of configuration have to have explicit fallback, despite it being also specified in the provider.yaml

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Our CI detected it BTW.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

OK - makes sense. Top level means here "before initialization of plugins", right?

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yeah

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Had to also add it for others.

@potiuk
potiuk force-pushed the move-configuration-for-openlineage-to-provider branch 2 times, most recently from dad4c93 to 51798ea Compare August 4, 2023 19:04
@potiuk
potiuk force-pushed the move-configuration-for-openlineage-to-provider branch from 51798ea to f074a98 Compare August 4, 2023 19:24
@hussein-awala
hussein-awala merged commit bdc10a5 into apache:main Aug 4, 2023
ephraimbuddy pushed a commit that referenced this pull request Aug 8, 2023
@ephraimbuddy ephraimbuddy added the type:misc/internal Changelog: Misc changes that should appear in change log label Aug 9, 2023
@potiuk
potiuk deleted the move-configuration-for-openlineage-to-provider branch November 17, 2023 16:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:providers kind:documentation provider:openlineage AIP-53 type:misc/internal Changelog: Misc changes that should appear in change log

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants