Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: SakanaAI/ALE-Bench
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: v1.3.0
Choose a base ref
...
head repository: SakanaAI/ALE-Bench
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: v1.4.0
Choose a head ref
  • 7 commits
  • 214 files changed
  • 2 contributors

Commits on Oct 27, 2025

  1. update MCP server

    @Yuki-Imajuku
    Yuki-Imajuku committed Oct 27, 2025
    Configuration menu
    Copy the full SHA
    a04cd8f View commit details
    Browse the repository at this point in the history

Commits on Dec 11, 2025

  1. Add new models (#24)

    @Yuki-Imajuku
    Yuki-Imajuku authored Dec 11, 2025
    Configuration menu
    Copy the full SHA
    174e464 View commit details
    Browse the repository at this point in the history

  2. Add shard async loop (#25)

    @Yuki-Imajuku
    Yuki-Imajuku authored Dec 11, 2025
    Configuration menu
    Copy the full SHA
    1f9e174 View commit details
    Browse the repository at this point in the history

Commits on Feb 6, 2026

  1. Add new models and drop Python 3.9 support (#26) 

    * add gpt-5.2

* add gpt-5.2-high

* add gemini 3 flash preview

* add glm-4.7, mimo-v2-flash, mimimax-m2.1

* add gpt-5.2-codex-xhigh and kimi-k2.5

* add claude-4.6-opus

* update dependencies, drop Python3.9 support

* add claude 4.6 opus

* Fix GitHub Actions

* update github actions

* drop windows check

* fix macos flow

* update pyproject.toml

* update dependencies
    @Yuki-Imajuku
    Yuki-Imajuku authored Feb 6, 2026
    Configuration menu
    Copy the full SHA
    0edd92d View commit details
    Browse the repository at this point in the history

Commits on Feb 20, 2026

  1. Change coding style (#27) 

    * change coding style

* add test and document

* update contributing.md

* update test and bug fix
    @Yuki-Imajuku
    Yuki-Imajuku authored Feb 20, 2026
    Configuration menu
    Copy the full SHA
    e698721 View commit details
    Browse the repository at this point in the history

  2. Add evaluation models (#28) 

    * add glm-5 minimax-m2.5 qwen-3.5

* add claude-4.6-sonnet

* add gemini-3.1-pro-preview

* apply ruff
    @Yuki-Imajuku
    Yuki-Imajuku authored Feb 20, 2026
    Configuration menu
    Copy the full SHA
    a15d207 View commit details
    Browse the repository at this point in the history

Commits on Feb 22, 2026

  1. Add judge version 202510 (#29) 

    * add dockerfiles

* update dockerfiles

* update dockerfile

* update dockerfile

* update dockerfiles

* update dockerfiles

* update dockerfiles and test script

* update dockerfiles

* update ruff ty exclude

* update dockerfiles

* update dockerfiles and test scripts

* update dockerfiles

* update dockerfiles

* update test scripts

* update test scripts

* update test scripts

* update test scripts

* update dockerfiles and test scripts

* update dockerfiles

* update dockerfiles

* update test scripts

* update docker files

* update dockerfiles

* update test scripts

* add judge v202501

* add docker related scripts

* update test

* update docker execution commands

* update dockerfiles

* update dockerfile

* update execution command

* update dockerfiles and test scripts

* update dockerfiles, execution command and test codes

* update TLE logic and test scripts

* update test code

* apply ruff and update compilation error logic

* update execution command

* update document
    @Yuki-Imajuku
    Yuki-Imajuku authored Feb 22, 2026
    Configuration menu
    Copy the full SHA
    f8cd502 View commit details
    Browse the repository at this point in the history
Loading