Skip to content

TST: image-tests-mpldev is failing #8678

Closed

Description

@pllim

Example log: https://circleci.com/gh/astropy/astropy/30970

  • TestBasic.test_axislabels_regression
  • TestBasic.test_patches_distortion

both failed with

matplotlib.testing.exceptions.ImageComparisonFailure: Image sizes do not match expected size

@astrofrog ?

UPDATE: Need to undo #8696 to see the failures.

Activity

  1. pllim commented on May 9, 2019

    @pllim
    MemberAuthor

    I also posted at matplotlib/matplotlib#14180 . Maybe disabling image size comparison in the test (if possible) is the best route to go.

  2. astrofrog commented on May 11, 2019

    @astrofrog
    Member

    We shouldn't disable the image size comparison, as this should definitely count as a failure. The current output is currently wrong, either due to a bug in Matplotlib or a change in API in Matplotlib, so we need to address the underlying cause either way.

    For example, test_patches_distortion has:

    Before:

    baseline-test_patches_distortion

    After:

    test_patches_distortion

    I'm currently bisecting Matplotlib to understand why this changed (and is now wrong)

  3. astrofrog commented on May 11, 2019

    @astrofrog
    Member

    Bisecting points to matplotlib/matplotlib#14134 as the culprit. I'll try and understand if this is an actual bug in MPL or whether we need to fix anything in WCSAxes.

  4. astrofrog commented on May 11, 2019

    @astrofrog
    Member

    A minimal example that demonstrates the issue is:

    from astropy.wcs import WCS
    import matplotlib.pyplot as plt
    
    wcs = WCS()
    fig = plt.figure(figsize=(3, 3))
    ax = fig.add_axes([0.25, 0.25, 0.5, 0.5], projection=wcs, aspect='equal')
    ax.set_xlim(0, 10000)
    ax.set_ylim(0, 10)
    fig.savefig('test.png', bbox_inches='tight')

    this seems to happen only when aspect='equal'. I'll investigate further.

  5. astrofrog commented on May 11, 2019

    @astrofrog
    Member

    I've posted a comment here in case there are any insights on the Matplotlib side.

  6. astrofrog commented on May 11, 2019

    @astrofrog
    Member

    And I've now narrowed this down to a minimal example in matplotlib/matplotlib#14134 (comment), so let's see what they say.

  7. pllim commented on May 15, 2019

    @pllim
    MemberAuthor

    mpldev job is failing now with a different error:

    ! LaTeX Error: File `type1ec.sty' not found.
    

    https://circleci.com/gh/astropy/astropy/31251

  8. astrofrog commented on May 15, 2019

    @astrofrog
    Member

    Whaaaaaat

  9. astrofrog commented on May 17, 2019

    @astrofrog
    Member

    See matplotlib/matplotlib#14151 - PR forthcoming

  10. pllim commented on May 17, 2019

    @pllim
    MemberAuthor

    Thanks, @astrofrog ! #8722 did indeed fix sty not found error, but we still have the xfail-ed ones to deal with whenever you can get to it (no rush currently unless they are released that version soon).

  11. astrofrog commented on May 17, 2019

    @astrofrog
    Member

    The xfailed ones will be fixed by matplotlib/matplotlib#14216 :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions