Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: ecmwf/anemoi-utils
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: 0.4.35
Choose a base ref
...
head repository: ecmwf/anemoi-utils
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: 0.4.36
Choose a head ref
  • 10 commits
  • 20 files changed
  • 7 contributors

Commits on Aug 15, 2025

  1. feat: debug imports (#182)

    ## Description
    
    Debug slow imports
    
    ## What problem does this change solve?
    <!-- Describe if it's a bugfix, new feature, doc update, or breaking
    change -->
    
    ## What issue or task does this change relate to?
    <!-- link to Issue Number -->
    
    ##  Additional notes ##
    <!-- Include any additional information, caveats, or considerations that
    the reviewer should be aware of. -->
    
    ***As a contributor to the Anemoi framework, please ensure that your
    changes include unit tests, updates to any affected dependencies and
    documentation, and have been tested in a parallel setting (i.e., with
    multiple GPUs). As a reviewer, you are also responsible for verifying
    these aspects and requesting changes if they are not adequately
    addressed. For guidelines about those please refer to
    https://anemoi.readthedocs.io/en/latest/***
    
    By opening this pull request, I affirm that all authors agree to the
    [Contributor License
    Agreement.](https://github.com/ecmwf/codex/blob/main/Legal/contributor_license_agreement.md)
    
    ---------
    
    Co-authored-by: Harrison Cook <[email protected]>
    b8raoult and HCookie authored Aug 15, 2025
    Configuration menu
    Copy the full SHA
    1eaa615 View commit details
    Browse the repository at this point in the history

Commits on Aug 19, 2025

  1. feat: NoAuth for AML mlflow Logging (#200)

    ## Description
    
    This is a support PR for ecmwf/anemoi-core#469. My basic understanding
    is that the authentication processes are applicable to AML mlflow
    logging, since lots of credentials are required to setup the workspace
    in the first place. So, this creates a PassiveAuth authenticator to
    allow the AnemoiAzureMlflowLogger to be a child class of the
    AnemoiMlflowLogger parent class, just silently ignoring all the
    TokenAuth steps.
    
    ## What problem does this change solve?
    
    New feature: supports AML mlflow logging.
    
    ## What issue or task does this change relate to?
    
    None open but happy to open one if necessary.
    
    ##  Additional notes ##
    
    See ecmwf/anemoi-core#469 discussion
    
    ---
    
    ***As a contributor to the Anemoi framework, please ensure that your
    changes include unit tests, updates to any affected dependencies and
    documentation, and have been tested in a parallel setting (i.e., with
    multiple GPUs). As a reviewer, you are also responsible for verifying
    these aspects and requesting changes if they are not adequately
    addressed. For guidelines about those please refer to
    https://anemoi.readthedocs.io/en/latest/***
    
    By opening this pull request, I affirm that all authors agree to the
    [Contributor License
    Agreement.](https://github.com/ecmwf/codex/blob/main/Legal/contributor_license_agreement.md)
    timothyas authored Aug 19, 2025
    Configuration menu
    Copy the full SHA
    732182e View commit details
    Browse the repository at this point in the history

Commits on Aug 21, 2025

  1. feat: rich logging (#209)

    ## Description
    
    Allow rich logging, useful for debugging 
    
    ## What problem does this change solve?
    <!-- Describe if it's a bugfix, new feature, doc update, or breaking
    change -->
    
    ## What issue or task does this change relate to?
    <!-- link to Issue Number -->
    
    ##  Additional notes ##
    <!-- Include any additional information, caveats, or considerations that
    the reviewer should be aware of. -->
    
    ***As a contributor to the Anemoi framework, please ensure that your
    changes include unit tests, updates to any affected dependencies and
    documentation, and have been tested in a parallel setting (i.e., with
    multiple GPUs). As a reviewer, you are also responsible for verifying
    these aspects and requesting changes if they are not adequately
    addressed. For guidelines about those please refer to
    https://anemoi.readthedocs.io/en/latest/***
    
    By opening this pull request, I affirm that all authors agree to the
    [Contributor License
    Agreement.](https://github.com/ecmwf/codex/blob/main/Legal/contributor_license_agreement.md)
    b8raoult authored Aug 21, 2025
    Configuration menu
    Copy the full SHA
    3c762a5 View commit details
    Browse the repository at this point in the history

Commits on Aug 25, 2025

  1. feat: use obstore to access s3 buckets (#210)

    ## Description
    
    
    Use `obstore` instead of `boto3` for s3 access. This simplifies the
    code, solve some compatibility issues with other packages, and prepare
    the ground for `zarr3`
    
    ## What problem does this change solve?
    <!-- Describe if it's a bugfix, new feature, doc update, or breaking
    change -->
    
    ## What issue or task does this change relate to?
    <!-- link to Issue Number -->
    
    ##  Additional notes ##
    <!-- Include any additional information, caveats, or considerations that
    the reviewer should be aware of. -->
    
    ***As a contributor to the Anemoi framework, please ensure that your
    changes include unit tests, updates to any affected dependencies and
    documentation, and have been tested in a parallel setting (i.e., with
    multiple GPUs). As a reviewer, you are also responsible for verifying
    these aspects and requesting changes if they are not adequately
    addressed. For guidelines about those please refer to
    https://anemoi.readthedocs.io/en/latest/***
    
    By opening this pull request, I affirm that all authors agree to the
    [Contributor License
    Agreement.](https://github.com/ecmwf/codex/blob/main/Legal/contributor_license_agreement.md)
    
    ---------
    
    Co-authored-by: Florian Pinault <[email protected]>
    b8raoult and floriankrb authored Aug 25, 2025
    Configuration menu
    Copy the full SHA
    da380be View commit details
    Browse the repository at this point in the history

Commits on Sep 3, 2025

  1. chore(deps): pre-commit.ci autoupdate (#211)

    <!--pre-commit.ci start-->
    updates:
    - [github.com/pre-commit/pre-commit-hooks: v5.0.0 →
    v6.0.0](pre-commit/pre-commit-hooks@v5.0.0...v6.0.0)
    - [github.com/astral-sh/ruff-pre-commit: v0.12.7 →
    v0.12.11](astral-sh/ruff-pre-commit@v0.12.7...v0.12.11)
    <!--pre-commit.ci end-->
    
    Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
    pre-commit-ci[bot] authored Sep 3, 2025
    Configuration menu
    Copy the full SHA
    5f7f315 View commit details
    Browse the repository at this point in the history

Commits on Sep 8, 2025

  1. fix: add missing s3 function used by datasets (#212)

    ## Description
    
    Add missing`get_object` function used by datasets
    
    ## What problem does this change solve?
    <!-- Describe if it's a bugfix, new feature, doc update, or breaking
    change -->
    
    ## What issue or task does this change relate to?
    <!-- link to Issue Number -->
    
    ##  Additional notes ##
    <!-- Include any additional information, caveats, or considerations that
    the reviewer should be aware of. -->
    
    ***As a contributor to the Anemoi framework, please ensure that your
    changes include unit tests, updates to any affected dependencies and
    documentation, and have been tested in a parallel setting (i.e., with
    multiple GPUs). As a reviewer, you are also responsible for verifying
    these aspects and requesting changes if they are not adequately
    addressed. For guidelines about those please refer to
    https://anemoi.readthedocs.io/en/latest/***
    
    By opening this pull request, I affirm that all authors agree to the
    [Contributor License
    Agreement.](https://github.com/ecmwf/codex/blob/main/Legal/contributor_license_agreement.md)
    b8raoult authored Sep 8, 2025
    Configuration menu
    Copy the full SHA
    30589e8 View commit details
    Browse the repository at this point in the history

Commits on Sep 15, 2025

  1. chore: synced file(s) with ecmwf/reusable-workflows (#213)

    synced local file(s) with
    [ecmwf/reusable-workflows](https://github.com/ecmwf/reusable-workflows).
    
    
    
    <details>
    <summary>Changed files</summary>
    <ul>
    <li>synced local directory <code>./</code> with remote directory
    <code>sync-files/anemoi/all/</code></li>
    </ul>
    </details>
    
    ---
    
    This PR was created automatically by the
    [repo-file-sync-action](https://github.com/BetaHuhn/repo-file-sync-action)
    workflow run
    [#17737613242](https://github.com/ecmwf/reusable-workflows/actions/runs/17737613242)
    DeployDuck authored Sep 15, 2025
    Configuration menu
    Copy the full SHA
    175b08a View commit details
    Browse the repository at this point in the history

Commits on Sep 22, 2025

  1. feat: Speedup checkpoint editing - remove compression (#218)

    ## Description
    Checkpoint rebuilding can be quite slow for large models, as
    `ZIP_DEFLATED` was being used
    Switching to `ZIP_STORED` for no compression results in a large speed
    up, and since torch checkpoints contain already-compressed tensor data,
    `ZIP_STORED` gives speed gains with minimal size penalty.
    
    ```
    === BENCHMARK RESULTS ===
    Edit time: 3.52 seconds
    Original size: 1262.4 MB
    Output file size: 1262.4 MB
    Throughput: 358.9 MB/s
    ```
    Used to take 117 secs, now 3.52, so 33x
    
    - Also adds tests for the checkpoint code to ensure compatability
    - Reworked the code for clarity
    
    > [!NOTE]
    > New checkpoints have been run with inference and appear fine
    
    
    ***As a contributor to the Anemoi framework, please ensure that your
    changes include unit tests, updates to any affected dependencies and
    documentation, and have been tested in a parallel setting (i.e., with
    multiple GPUs). As a reviewer, you are also responsible for verifying
    these aspects and requesting changes if they are not adequately
    addressed. For guidelines about those please refer to
    https://anemoi.readthedocs.io/en/latest/***
    
    By opening this pull request, I affirm that all authors agree to the
    [Contributor License
    Agreement.](https://github.com/ecmwf/codex/blob/main/Legal/contributor_license_agreement.md)
    HCookie authored Sep 22, 2025
    Configuration menu
    Copy the full SHA
    b49120f View commit details
    Browse the repository at this point in the history
  2. feat: add aliases to registry (#219)

    ## Description
    
    Add aliases to the registry. The same filter, input, etc can be
    registered with a canonical name and some aliases.
    
    ## What problem does this change solve?
    
    This will allow migration of filter names to something more consistent
    while keeping backwards compatibility.
    
    ## What issue or task does this change relate to?
    <!-- link to Issue Number -->
    
    ##  Additional notes ##
    <!-- Include any additional information, caveats, or considerations that
    the reviewer should be aware of. -->
    
    ***As a contributor to the Anemoi framework, please ensure that your
    changes include unit tests, updates to any affected dependencies and
    documentation, and have been tested in a parallel setting (i.e., with
    multiple GPUs). As a reviewer, you are also responsible for verifying
    these aspects and requesting changes if they are not adequately
    addressed. For guidelines about those please refer to
    https://anemoi.readthedocs.io/en/latest/***
    
    By opening this pull request, I affirm that all authors agree to the
    [Contributor License
    Agreement.](https://github.com/ecmwf/codex/blob/main/Legal/contributor_license_agreement.md)
    b8raoult authored Sep 22, 2025
    Configuration menu
    Copy the full SHA
    37267b5 View commit details
    Browse the repository at this point in the history
  3. chore(main): Release 0.4.36 (#207)

    🤖 Automated Release PR
    
    This PR was created by `release-please` to prepare the next release.
    Once merged:
    
    1. A new version tag will be created
    2. A GitHub release will be published
    3. The changelog will be updated
    
    Changes to be included in the next release:
    ---
    
    
    ##
    [0.4.36](0.4.35...0.4.36)
    (2025-09-22)
    
    
    ### Features
    
    * Add aliases to registry
    ([#219](#219))
    ([37267b5](37267b5))
    * Debug imports
    ([#182](#182))
    ([1eaa615](1eaa615))
    * NoAuth for AML mlflow Logging
    ([#200](#200))
    ([732182e](732182e))
    * Rich logging
    ([#209](#209))
    ([3c762a5](3c762a5))
    * Speedup checkpoint editing - remove compression
    ([#218](#218))
    ([b49120f](b49120f))
    * Use obstore to access s3 buckets
    ([#210](#210))
    ([da380be](da380be))
    
    
    ### Bug Fixes
    
    * Add missing s3 function used by datasets
    ([#212](#212))
    ([30589e8](30589e8))
    
    ---
    > [!IMPORTANT]
    > Please do not change the PR title, manifest file, or any other
    automatically generated content in this PR unless you understand the
    implications. Changes here can break the release process.
    > ⚠️ Merging this PR will:
    > - Create a new release
    > - Trigger deployment pipelines
    > - Update package versions
    
     **Before merging:**
     - Ensure all tests pass
     - Review the changelog carefully
     - Get required approvals
    
    [Release-please
    documentation](https://github.com/googleapis/release-please)
    DeployDuck authored Sep 22, 2025
    Configuration menu
    Copy the full SHA
    67b40f9 View commit details
    Browse the repository at this point in the history
Loading