Skip to content

TST: Patch failing tests caused by mpl-dev - #11292

Merged
pllim merged 2 commits into
astropy:masterfrom
pllim:fix-mpldev-tests
Feb 2, 2021
Merged

pllim merged 2 commits into
astropy:masterfrom
pllim:fix-mpldev-tests

Conversation

@pllim

@pllim pllim commented Feb 1, 2021 •

Copy link
Copy Markdown
Member

Description

This pull request is to patch failing tests caused by dev version matplotlib. I have no idea why it is failing but I also don't want it to be causing failures in unrelated PRs. If there is a better way to fix this, please let me know.

Temporarily address #11267

Also see matplotlib/matplotlib#19419 for why my version check is so shady.

@mhvk

mhvk commented Feb 1, 2021

Copy link
Copy Markdown
Contributor

The fixes needed suggest very much that wcsaxis is broken with matplotlib-dev - if it cannot be fixed properly quickly, I think we should just have xfail for all those tests rather than change some outcomes.

But I'll admit to being out of my league here - hopefully, @astrofrog has a better idea of what is actually going on.

@astrofrog

Copy link
Copy Markdown
Member

I agree with @mhvk that xfailing the tests would be a better short term approach. But we really should just fix this properly - has anyone had a chance to bisect to figure out the MPL commit that broke things?

@astrofrog

Copy link
Copy Markdown
Member

Actually I think we should maybe not even xfail tests but rather just comment out the CI config temporarily if it becomes a problem. Is it really an issue since each job has its own status though?

@pllim

pllim commented Feb 2, 2021

Copy link
Copy Markdown
Member Author

since each job has its own status though?

Well, I wouldn't care if it is just mpldev job but it was failing remote data and numpy-dev job too.

@pllim

pllim commented Feb 2, 2021

Copy link
Copy Markdown
Member Author

Okay, I see the discussions at matplotlib/matplotlib#19432 , so perhaps we just xfail them for mpldev for now. When they pass again, xfailed test would fail because of xfail strict, and we can remove the xfail. 💭

@pllim pllim added Upstream Action Required Was: Upstream Fix Required and removed ¯\_(ツ)_/¯ labels Feb 2, 2021

@mhvk mhvk left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, I think this is the best way forward. I do think we should try to keep all the jobs pass - it helps to just see at a glance whether things can be merged. And we will now get warning if things improve on the matplotlib side!

@pllim

pllim commented Feb 2, 2021

Copy link
Copy Markdown
Member Author

Thanks! Merging then.

keep all the jobs pass

I agree! The coordinates and mysterious table failures are another story though... 😹

@pllim
pllim merged commit 6904efe into astropy:master Feb 2, 2021
@pllim
pllim deleted the fix-mpldev-tests branch February 2, 2021 18:12
@pllim pllim mentioned this pull request Feb 2, 2021
1 task done
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants