Add get_simulation_artifact #3555
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Innixma
added
enhancement
shchur
reviewed
Oct 12, 2023
| "label", # The label column name | ||
| """ | ||
| aggregated_pred_proba = {} | ||
| aggregated_ground_truth = {} |
Collaborator
There was a problem hiding this comment.
Maybe with defaultdict we could get rid of the extra checks below?
from collections import defaultdict
def recursive_dd():
return defaultdict(recursive_dd)
aggregated_pred_proba = recursive_dd()
# we can now assign aggregated_pred_proba[task_name][fold][key][model] = value
Collaborator
There was a problem hiding this comment.
You can also optionally convert the output back to regular dicts with
def dd_to_dict(dd):
dd = dict(dd)
for k, v in dd.items():
if isinstance(v, defaultdict):
dd[k] = dd_to_dict(v)
return dd
Contributor
Author
There was a problem hiding this comment.
Good point! Updated to use defaultdict
Innixma
force-pushed
the
add_zeroshot_hpo_simulation_fetcher
branch
2 times, most recently
from
ff47f8b to
30d0820
Compare
Innixma
force-pushed
the
add_zeroshot_hpo_simulation_fetcher
branch
2 times, most recently
from
c816933 to
7099ac1
Compare
Innixma
force-pushed
the
add_zeroshot_hpo_simulation_fetcher
branch
2 times, most recently
from
9a82ca2 to
882b200
Compare
Innixma
force-pushed
the
add_zeroshot_hpo_simulation_fetcher
branch
from
cf7fd21 to
70e4d4c
Compare
LennartPurucker
pushed a commit
to LennartPurucker/autogluon
that referenced
this pull request
Jun 1, 2024
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Issue #, if available:
Description of changes:
save_jsonandload_jsonextra_info=True.score_formatargument to leaderboard to add the option to return the error instead of the score.By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.