Skip to content

Dataset Config Refine #1#1937

Merged
MaiziXiao merged 24 commits intoopen-compass:mainfrom
Myhs-phz:datasetrefine_week1
Mar 25, 2025
Merged

Dataset Config Refine #1#1937
MaiziXiao merged 24 commits intoopen-compass:mainfrom
Myhs-phz:datasetrefine_week1

Conversation

@Myhs-phz
Copy link
Copy Markdown
Collaborator

@Myhs-phz Myhs-phz commented Mar 12, 2025

Ready for Review

@MaiziXiao
Copy link
Copy Markdown
Contributor

Remove all the max_out_len settings from the dataset configs

@MaiziXiao
Copy link
Copy Markdown
Contributor

Resolve conflicts

@Myhs-phz Myhs-phz force-pushed the datasetrefine_week1 branch from 7c41604 to 199052e Compare March 24, 2025 10:20
from opencompass.openicl.icl_prompt_template import PromptTemplate
from opencompass.openicl.icl_retriever import ZeroRetriever
from opencompass.openicl.icl_inferencer import GenInferencer
from opencompass.datasets import Aime2024Dataset, MATHEvaluator, math_postprocess_v2
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Change to standard MATHEvaluator

from opencompass.openicl.icl_prompt_template import PromptTemplate
from opencompass.openicl.icl_retriever import ZeroRetriever
from opencompass.openicl.icl_inferencer import GenInferencer
from opencompass.datasets import MATHDataset, MATHEvaluator, math_postprocess_v2, normalize_final_answer
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Change to standard MATHEvaluator

Copy link
Copy Markdown
Contributor

@MaiziXiao MaiziXiao left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@MaiziXiao MaiziXiao merged commit 6118596 into open-compass:main Mar 25, 2025
8 checks passed
stephen-nju pushed a commit to stephen-nju/opencompass that referenced this pull request May 14, 2025
* feat datasetrefine drop

* fix datasets in fullbench_int3

* fix

* fix

* back

* fix

* fix and doc

* feat

* fix hook

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* doc

* fix

* fix

* Update dataset-index.yml
zyc140345 pushed a commit to zyc140345/opencompass that referenced this pull request Oct 23, 2025
* feat datasetrefine drop

* fix datasets in fullbench_int3

* fix

* fix

* back

* fix

* fix and doc

* feat

* fix hook

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* doc

* fix

* fix

* Update dataset-index.yml
iamkaia pushed a commit to iamkaia/opencompass that referenced this pull request Feb 4, 2026
* feat datasetrefine drop

* fix datasets in fullbench_int3

* fix

* fix

* back

* fix

* fix and doc

* feat

* fix hook

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* doc

* fix

* fix

* Update dataset-index.yml
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants