Refresh models, add a filter to only include the GH catalog#40
Merged
tonybaloney merged 2 commits intotonybaloney:mainfrom Jun 10, 2025
Merged
Refresh models, add a filter to only include the GH catalog#40tonybaloney merged 2 commits intotonybaloney:mainfrom
tonybaloney merged 2 commits intotonybaloney:mainfrom
Conversation
tonybaloney
reviewed
Jun 6, 2025
| | Cohere-command-r-plus-08-2024 | ❌ | ✅ | text | text | | ||
| | DeepSeek-R1 | ❌ | ❌ | text | text | | ||
| | DeepSeek-V3 | ❌ | ❌ | text | text | | ||
| | DeepSeek-R1-0528 | ❌ | ❌ | text | text | |
Owner
There was a problem hiding this comment.
Contributor
Author
There was a problem hiding this comment.
I removed the catalog filter and changed this PR to just be a model refresh which brough V3 back. It's still available in azureml, but is currently deprecated and set to retire in August
Contributor
Author
|
@tonybaloney - I reverted the change to add the GH catalog filter, this is just a model refresh now with existing logic. I'll file an issue so we can talk about this more, as I was debugging I found out that it's more complicated than I originally thought 😅 |
Owner
yeah, I'm learning that too |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Refreshing models and was digging into #19 at the same time. Turns out that
mistral-largeisRetiredas of April 15, which explains the error (see here).I can't find any way to add a deprecation filter to our
https://api.catalog.azureml.ms/asset-gallery/v1.0/modelsAPI call when fetching models, so instead I opted to also fetch the GH Models catalog and intersect the lists (the Azure catalog has much richer data so wanted to keep that around still).Annoyingly, this filter actually causes us to drop models that technically are supported (e.g.
Cohere Embed 4), but are not in the catalog. As an alternative approach we could add a filter against Azure's deprecation page, but it seems like we should be in parity with the GH Models catalog anyways.