-
Notifications
You must be signed in to change notification settings - Fork 17
Comparing changes
Open a pull request
base repository: ecmwf/anemoi-utils
base: 0.4.35
head repository: ecmwf/anemoi-utils
compare: 0.4.36
- 10 commits
- 20 files changed
- 7 contributors
Commits on Aug 15, 2025
-
## Description Debug slow imports ## What problem does this change solve? <!-- Describe if it's a bugfix, new feature, doc update, or breaking change --> ## What issue or task does this change relate to? <!-- link to Issue Number --> ## Additional notes ## <!-- Include any additional information, caveats, or considerations that the reviewer should be aware of. --> ***As a contributor to the Anemoi framework, please ensure that your changes include unit tests, updates to any affected dependencies and documentation, and have been tested in a parallel setting (i.e., with multiple GPUs). As a reviewer, you are also responsible for verifying these aspects and requesting changes if they are not adequately addressed. For guidelines about those please refer to https://anemoi.readthedocs.io/en/latest/*** By opening this pull request, I affirm that all authors agree to the [Contributor License Agreement.](https://github.com/ecmwf/codex/blob/main/Legal/contributor_license_agreement.md) --------- Co-authored-by: Harrison Cook <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 1eaa615 - Browse repository at this point
Copy the full SHA 1eaa615View commit details
Commits on Aug 19, 2025
-
feat: NoAuth for AML mlflow Logging (#200)
## Description This is a support PR for ecmwf/anemoi-core#469. My basic understanding is that the authentication processes are applicable to AML mlflow logging, since lots of credentials are required to setup the workspace in the first place. So, this creates a PassiveAuth authenticator to allow the AnemoiAzureMlflowLogger to be a child class of the AnemoiMlflowLogger parent class, just silently ignoring all the TokenAuth steps. ## What problem does this change solve? New feature: supports AML mlflow logging. ## What issue or task does this change relate to? None open but happy to open one if necessary. ## Additional notes ## See ecmwf/anemoi-core#469 discussion --- ***As a contributor to the Anemoi framework, please ensure that your changes include unit tests, updates to any affected dependencies and documentation, and have been tested in a parallel setting (i.e., with multiple GPUs). As a reviewer, you are also responsible for verifying these aspects and requesting changes if they are not adequately addressed. For guidelines about those please refer to https://anemoi.readthedocs.io/en/latest/*** By opening this pull request, I affirm that all authors agree to the [Contributor License Agreement.](https://github.com/ecmwf/codex/blob/main/Legal/contributor_license_agreement.md)
Configuration menu - View commit details
-
Copy full SHA for 732182e - Browse repository at this point
Copy the full SHA 732182eView commit details
Commits on Aug 21, 2025
-
## Description Allow rich logging, useful for debugging ## What problem does this change solve? <!-- Describe if it's a bugfix, new feature, doc update, or breaking change --> ## What issue or task does this change relate to? <!-- link to Issue Number --> ## Additional notes ## <!-- Include any additional information, caveats, or considerations that the reviewer should be aware of. --> ***As a contributor to the Anemoi framework, please ensure that your changes include unit tests, updates to any affected dependencies and documentation, and have been tested in a parallel setting (i.e., with multiple GPUs). As a reviewer, you are also responsible for verifying these aspects and requesting changes if they are not adequately addressed. For guidelines about those please refer to https://anemoi.readthedocs.io/en/latest/*** By opening this pull request, I affirm that all authors agree to the [Contributor License Agreement.](https://github.com/ecmwf/codex/blob/main/Legal/contributor_license_agreement.md)
Configuration menu - View commit details
-
Copy full SHA for 3c762a5 - Browse repository at this point
Copy the full SHA 3c762a5View commit details
Commits on Aug 25, 2025
-
feat: use obstore to access s3 buckets (#210)
## Description Use `obstore` instead of `boto3` for s3 access. This simplifies the code, solve some compatibility issues with other packages, and prepare the ground for `zarr3` ## What problem does this change solve? <!-- Describe if it's a bugfix, new feature, doc update, or breaking change --> ## What issue or task does this change relate to? <!-- link to Issue Number --> ## Additional notes ## <!-- Include any additional information, caveats, or considerations that the reviewer should be aware of. --> ***As a contributor to the Anemoi framework, please ensure that your changes include unit tests, updates to any affected dependencies and documentation, and have been tested in a parallel setting (i.e., with multiple GPUs). As a reviewer, you are also responsible for verifying these aspects and requesting changes if they are not adequately addressed. For guidelines about those please refer to https://anemoi.readthedocs.io/en/latest/*** By opening this pull request, I affirm that all authors agree to the [Contributor License Agreement.](https://github.com/ecmwf/codex/blob/main/Legal/contributor_license_agreement.md) --------- Co-authored-by: Florian Pinault <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for da380be - Browse repository at this point
Copy the full SHA da380beView commit details
Commits on Sep 3, 2025
-
chore(deps): pre-commit.ci autoupdate (#211)
<!--pre-commit.ci start--> updates: - [github.com/pre-commit/pre-commit-hooks: v5.0.0 → v6.0.0](pre-commit/pre-commit-hooks@v5.0.0...v6.0.0) - [github.com/astral-sh/ruff-pre-commit: v0.12.7 → v0.12.11](astral-sh/ruff-pre-commit@v0.12.7...v0.12.11) <!--pre-commit.ci end--> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 5f7f315 - Browse repository at this point
Copy the full SHA 5f7f315View commit details
Commits on Sep 8, 2025
-
fix: add missing s3 function used by datasets (#212)
## Description Add missing`get_object` function used by datasets ## What problem does this change solve? <!-- Describe if it's a bugfix, new feature, doc update, or breaking change --> ## What issue or task does this change relate to? <!-- link to Issue Number --> ## Additional notes ## <!-- Include any additional information, caveats, or considerations that the reviewer should be aware of. --> ***As a contributor to the Anemoi framework, please ensure that your changes include unit tests, updates to any affected dependencies and documentation, and have been tested in a parallel setting (i.e., with multiple GPUs). As a reviewer, you are also responsible for verifying these aspects and requesting changes if they are not adequately addressed. For guidelines about those please refer to https://anemoi.readthedocs.io/en/latest/*** By opening this pull request, I affirm that all authors agree to the [Contributor License Agreement.](https://github.com/ecmwf/codex/blob/main/Legal/contributor_license_agreement.md)
Configuration menu - View commit details
-
Copy full SHA for 30589e8 - Browse repository at this point
Copy the full SHA 30589e8View commit details
Commits on Sep 15, 2025
-
chore: synced file(s) with ecmwf/reusable-workflows (#213)
synced local file(s) with [ecmwf/reusable-workflows](https://github.com/ecmwf/reusable-workflows). <details> <summary>Changed files</summary> <ul> <li>synced local directory <code>./</code> with remote directory <code>sync-files/anemoi/all/</code></li> </ul> </details> --- This PR was created automatically by the [repo-file-sync-action](https://github.com/BetaHuhn/repo-file-sync-action) workflow run [#17737613242](https://github.com/ecmwf/reusable-workflows/actions/runs/17737613242)
Configuration menu - View commit details
-
Copy full SHA for 175b08a - Browse repository at this point
Copy the full SHA 175b08aView commit details
Commits on Sep 22, 2025
-
feat: Speedup checkpoint editing - remove compression (#218)
## Description Checkpoint rebuilding can be quite slow for large models, as `ZIP_DEFLATED` was being used Switching to `ZIP_STORED` for no compression results in a large speed up, and since torch checkpoints contain already-compressed tensor data, `ZIP_STORED` gives speed gains with minimal size penalty. ``` === BENCHMARK RESULTS === Edit time: 3.52 seconds Original size: 1262.4 MB Output file size: 1262.4 MB Throughput: 358.9 MB/s ``` Used to take 117 secs, now 3.52, so 33x - Also adds tests for the checkpoint code to ensure compatability - Reworked the code for clarity > [!NOTE] > New checkpoints have been run with inference and appear fine ***As a contributor to the Anemoi framework, please ensure that your changes include unit tests, updates to any affected dependencies and documentation, and have been tested in a parallel setting (i.e., with multiple GPUs). As a reviewer, you are also responsible for verifying these aspects and requesting changes if they are not adequately addressed. For guidelines about those please refer to https://anemoi.readthedocs.io/en/latest/*** By opening this pull request, I affirm that all authors agree to the [Contributor License Agreement.](https://github.com/ecmwf/codex/blob/main/Legal/contributor_license_agreement.md)
Configuration menu - View commit details
-
Copy full SHA for b49120f - Browse repository at this point
Copy the full SHA b49120fView commit details -
feat: add aliases to registry (#219)
## Description Add aliases to the registry. The same filter, input, etc can be registered with a canonical name and some aliases. ## What problem does this change solve? This will allow migration of filter names to something more consistent while keeping backwards compatibility. ## What issue or task does this change relate to? <!-- link to Issue Number --> ## Additional notes ## <!-- Include any additional information, caveats, or considerations that the reviewer should be aware of. --> ***As a contributor to the Anemoi framework, please ensure that your changes include unit tests, updates to any affected dependencies and documentation, and have been tested in a parallel setting (i.e., with multiple GPUs). As a reviewer, you are also responsible for verifying these aspects and requesting changes if they are not adequately addressed. For guidelines about those please refer to https://anemoi.readthedocs.io/en/latest/*** By opening this pull request, I affirm that all authors agree to the [Contributor License Agreement.](https://github.com/ecmwf/codex/blob/main/Legal/contributor_license_agreement.md)
Configuration menu - View commit details
-
Copy full SHA for 37267b5 - Browse repository at this point
Copy the full SHA 37267b5View commit details -
chore(main): Release 0.4.36 (#207)
🤖 Automated Release PR This PR was created by `release-please` to prepare the next release. Once merged: 1. A new version tag will be created 2. A GitHub release will be published 3. The changelog will be updated Changes to be included in the next release: --- ## [0.4.36](0.4.35...0.4.36) (2025-09-22) ### Features * Add aliases to registry ([#219](#219)) ([37267b5](37267b5)) * Debug imports ([#182](#182)) ([1eaa615](1eaa615)) * NoAuth for AML mlflow Logging ([#200](#200)) ([732182e](732182e)) * Rich logging ([#209](#209)) ([3c762a5](3c762a5)) * Speedup checkpoint editing - remove compression ([#218](#218)) ([b49120f](b49120f)) * Use obstore to access s3 buckets ([#210](#210)) ([da380be](da380be)) ### Bug Fixes * Add missing s3 function used by datasets ([#212](#212)) ([30589e8](30589e8)) --- > [!IMPORTANT] > Please do not change the PR title, manifest file, or any other automatically generated content in this PR unless you understand the implications. Changes here can break the release process. >
⚠️ Merging this PR will: > - Create a new release > - Trigger deployment pipelines > - Update package versions **Before merging:** - Ensure all tests pass - Review the changelog carefully - Get required approvals [Release-please documentation](https://github.com/googleapis/release-please)Configuration menu - View commit details
-
Copy full SHA for 67b40f9 - Browse repository at this point
Copy the full SHA 67b40f9View commit details
This comparison is taking too long to generate.
Unfortunately it looks like we can’t render this comparison for you right now. It might be too big, or there might be something weird with your repository.
You can try running this command locally to see the comparison on your machine:
git diff 0.4.35...0.4.36