Skip to content

⚠️ Upstream CI failed ⚠️ #10089

Closed

Description

@github-actions

Workflow Run URL

Python 3.10 Test Summary
dask/dataframe/tests/test_dataframe.py::test_apply: Failed: DID NOT WARN. No warnings of type (<class 'FutureWarning'>,) were emitted.
The list of emitted warnings is: [].

Activity

  1. jrbourbeau commented on Mar 20, 2023

    @jrbourbeau
    Member

    Looks like some deprecations were added to pandas main over the weekend. cc @j-bennet for visibility

  2. jrbourbeau commented on Mar 20, 2023

    @jrbourbeau
    Member

    #10094 should take care of the axis=-related failures here. @j-bennet mentioned offline that she's working on the observed=-related failures

  3. j-bennet commented on Mar 20, 2023

    @j-bennet
    Contributor

    Draft PR for observed deprecations here: #10095.

  4. jrbourbeau commented on Mar 22, 2023

    @jrbourbeau
    Member

    A couple of new pandas-related deprecations have popped up

    FutureWarning: DataFrameGroupBy.dtypes is deprecated and will be removed in a future version. Check the dtypes on the base object instead
    
    FutureWarning: The 'axis' keyword in DataFrame.rolling is deprecated and will be removed in a future version. Call the method without the axis keyword instead.
    

    @charlesbluca @j-bennet do either of you have bandwidth to knock those out?

  5. j-bennet commented on Mar 22, 2023

    @j-bennet
    Contributor

    @jrbourbeau I'll take care of those.

  6. j-bennet commented on Mar 24, 2023

    @j-bennet
    Contributor

    Found the reason for these:

    dask/dataframe/tests/test_groupby.py::test_groupby_aggregate_categorical_observed[8 failing variants]: AssertionError: DataFrame.iloc[:, 0] (column name="cat_2") are different
    dask/dataframe/tests/test_groupby.py::test_groupby_aggregate_categorical_observed[4 failing variants]: AssertionError: DataFrame.iloc[:, 0] (column name="cat_2") are different
    

    The reason is this PR:

    I filed an issue in pandas to clarify the behavior:

    From the discussion, it looks like the change in behavior was not intentional.

  7. j-bennet commented on Mar 31, 2023

    @j-bennet
    Contributor

    pandas-dev/pandas#52151 was fixed in Pandas, I'll recheck if we're still seeing errors with nightly.

  8. j-bennet commented on Mar 31, 2023

    @j-bennet
    Contributor

    pandas-dev/pandas#52151 was fixed in Pandas, I'll recheck if we're still seeing errors with nightly.

    Update: we're seeing different errors now - looks like a new deprecation. The groupby/categorical issue is fixed.

    I'll look into the new failures.

    dask/dataframe/tests/test_dataframe.py::test_apply: FutureWarning: the convert_dtype parameter is deprecated and will be removed in a future version.  Do ``ser.astype(object).apply()`` instead if you want ``convert_dtype=False``.
    dask/dataframe/tests/test_dataframe.py::test_apply_infer_columns: FutureWarning: the convert_dtype parameter is deprecated and will be removed in a future version.  Do ``ser.astype(object).apply()`` instead if you want ``convert_dtype=False``.
    
  9. jrbourbeau commented on Mar 31, 2023

    @jrbourbeau
    Member

    Thanks for following up here @j-bennet 👍

  10. jrbourbeau commented on Apr 10, 2023

    @jrbourbeau
    Member

    Okay, @j-bennet's change for convert_dtype in Series.apply is is. We've now got a couple of new deprecations:

    dask/dataframe/tests/test_accessors.py::test_dt_accessor: FutureWarning: The behavior of DatetimeProperties.to_pydatetime is deprecated, in a future version this will return a Series containing python datetime objects instead of an ndarray. To retain the old behavior, call `np.array` on the result
    dask/dataframe/tests/test_dataframe.py::test_apply: FutureWarning: Returning a DataFrame from Series.apply when the supplied functionreturns a Series is deprecated and will be removed in a future version.
    dask/dataframe/tests/test_dataframe.py::test_apply_infer_columns: FutureWarning: Returning a DataFrame from Series.apply when the supplied functionreturns a Series is deprecated and will be removed in a future version.
    

    @phofl is this something you have bandwidth to fix?

  11. phofl commented on Apr 24, 2023

    @phofl
    Collaborator

    There is a new groupby deprecation in pandas. I want to engage upstream before we adjust, since it is very very noisy

  12. jrbourbeau commented on May 1, 2023

    @jrbourbeau
    Member

    Looks like there are some lingering upstream failures. Most (all?) are related to deprecations. @j-bennet @phofl is this something you have bandwidth for?

  13. phofl commented on May 1, 2023

    @phofl
    Collaborator

    Can take a look tomorrow. Most of them seem familiar

  14. jrbourbeau commented on May 1, 2023

    @jrbourbeau
    Member

    Sounds good -- thanks @phofl. FWIW I went ahead and pushed up dask/distributed#7813 for one of the tests

  15. j-bennet commented on May 1, 2023

    @j-bennet
    Contributor

    I can take a look at those.

  16. j-bennet commented on May 1, 2023

    @j-bennet
    Contributor
  17. j-bennet commented on May 5, 2023

    @j-bennet
    Contributor

    Closed via #10256.

    For now. :)

  18. jrbourbeau commented on May 5, 2023

    @jrbourbeau
    Member

    Thanks @j-bennet @phofl for your work here

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions