Skip to content

ci: one-line test-results comment built from the reporters' outputs

Sign in for the full log view
GitHub Actions / Test Results (aggregate) failed Sep 30, 2026 in 0s

1 errors, 7 fail, 252 skipped, 6 418 pass in 21m 58s

    12 files      12 suites   21m 58s ⏱️
 6 678 tests  6 418 ✅   252 💤  7 ❌ 1 🔥
20 164 runs  18 616 ✅ 1 524 💤 21 ❌ 3 🔥

Results for commit c03c93a.

Annotations

Check warning on line 0 in tests.test_zz_injected_failures

See this annotation in the file changed.

@github-actions github-actions / Test Results (aggregate)

All 3 runs failed: test_injected_plain_assert (tests.test_zz_injected_failures)

test-results/test-results-standard-linux-64-py3.12-cu13.4.2-wheels-l4-x1-latest/junit-core.xml [took 0s]
test-results/test-results-standard-linux-aarch64-py3.12-cu13.4.2-wheels-a100-x1-latest/junit-core.xml [took 0s]
test-results/test-results-standard-win-64-py3.12-cu13.4.2-local-a100-x1-latest-TCC/junit-core.xml [took 0s]
Raw output
assert (1 + 1) == 3
@pytest.mark.agent_authored(model="claude-fable-5-1")
    def test_injected_plain_assert():
>       assert 1 + 1 == 3
E       assert (1 + 1) == 3


tests/test_zz_injected_failures.py:27: AssertionError

Check warning on line 0 in tests.test_zz_injected_failures

See this annotation in the file changed.

@github-actions github-actions / Test Results (aggregate)

All 3 runs failed: test_injected_parametrized[1] (tests.test_zz_injected_failures)

test-results/test-results-standard-linux-64-py3.12-cu13.4.2-wheels-l4-x1-latest/junit-core.xml [took 0s]
test-results/test-results-standard-linux-aarch64-py3.12-cu13.4.2-wheels-a100-x1-latest/junit-core.xml [took 0s]
test-results/test-results-standard-win-64-py3.12-cu13.4.2-local-a100-x1-latest-TCC/junit-core.xml [took 0s]
Raw output
AssertionError: value 1 is odd
assert (1 % 2) == 0
value = 1

    @pytest.mark.agent_authored(model="claude-fable-5-1")
    @pytest.mark.parametrize("value", [1, 2, 3])
    def test_injected_parametrized(value):
>       assert value % 2 == 0, f"value {value} is odd"
E       AssertionError: value 1 is odd
E       assert (1 % 2) == 0

value      = 1

tests/test_zz_injected_failures.py:33: AssertionError

Check warning on line 0 in tests.test_zz_injected_failures

See this annotation in the file changed.

@github-actions github-actions / Test Results (aggregate)

All 3 runs failed: test_injected_parametrized[3] (tests.test_zz_injected_failures)

test-results/test-results-standard-linux-64-py3.12-cu13.4.2-wheels-l4-x1-latest/junit-core.xml [took 0s]
test-results/test-results-standard-linux-aarch64-py3.12-cu13.4.2-wheels-a100-x1-latest/junit-core.xml [took 0s]
test-results/test-results-standard-win-64-py3.12-cu13.4.2-local-a100-x1-latest-TCC/junit-core.xml [took 0s]
Raw output
AssertionError: value 3 is odd
assert (3 % 2) == 0
value = 3

    @pytest.mark.agent_authored(model="claude-fable-5-1")
    @pytest.mark.parametrize("value", [1, 2, 3])
    def test_injected_parametrized(value):
>       assert value % 2 == 0, f"value {value} is odd"
E       AssertionError: value 3 is odd
E       assert (3 % 2) == 0

value      = 3

tests/test_zz_injected_failures.py:33: AssertionError

Check warning on line 0 in tests.test_zz_injected_failures

See this annotation in the file changed.

@github-actions github-actions / Test Results (aggregate)

All 3 runs failed: test_injected_thread_unsafe (tests.test_zz_injected_failures)

test-results/test-results-standard-linux-64-py3.12-cu13.4.2-wheels-l4-x1-latest/junit-core.xml [took 0s]
test-results/test-results-standard-linux-aarch64-py3.12-cu13.4.2-wheels-a100-x1-latest/junit-core.xml [took 0s]
test-results/test-results-standard-win-64-py3.12-cu13.4.2-local-a100-x1-latest-TCC/junit-core.xml [took 0s]
Raw output
RuntimeError: injected failure outside the parallel runner
@pytest.mark.agent_authored(model="claude-fable-5-1")
    @pytest.mark.thread_unsafe(reason="injected: exercises the non-parallel FAILED path")
    def test_injected_thread_unsafe():
>       raise RuntimeError("injected failure outside the parallel runner")
E       RuntimeError: injected failure outside the parallel runner


tests/test_zz_injected_failures.py:39: RuntimeError

Check warning on line 0 in tests.test_zz_injected_failures

See this annotation in the file changed.

@github-actions github-actions / Test Results (aggregate)

All 3 runs failed: test_injected_dict_diff (tests.test_zz_injected_failures)

test-results/test-results-standard-linux-64-py3.12-cu13.4.2-wheels-l4-x1-latest/junit-core.xml [took 0s]
test-results/test-results-standard-linux-aarch64-py3.12-cu13.4.2-wheels-a100-x1-latest/junit-core.xml [took 0s]
test-results/test-results-standard-win-64-py3.12-cu13.4.2-local-a100-x1-latest-TCC/junit-core.xml [took 0s]
Raw output
AssertionError: assert {'a': 1, 'b': 20, 'd': 4} == {'a': 1, 'b': 2, 'c': 3}
  
  Omitting 1 identical items, use -vv to show
  Differing items:
  {'b': 20} != {'b': 2}
  Left contains 1 more item:
  {'d': 4}
  Right contains 1 more item:
  {'c': 3}
  
  Full diff:
    {
        'a': 1,
  -     'b': 2,
  +     'b': 20,
  ?           +
  -     'c': 3,
  ?      ^   ^
  +     'd': 4,
  ?      ^   ^
    }
@pytest.mark.agent_authored(model="claude-fable-5-1")
    def test_injected_dict_diff():
        expected = {"a": 1, "b": 2, "c": 3}
        actual = {"a": 1, "b": 20, "d": 4}
>       assert actual == expected
E       AssertionError: assert {'a': 1, 'b': 20, 'd': 4} == {'a': 1, 'b': 2, 'c': 3}
E         
E         Omitting 1 identical items, use -vv to show
E         Differing items:
E         {'b': 20} != {'b': 2}
E         Left contains 1 more item:
E         {'d': 4}
E         Right contains 1 more item:
E         {'c': 3}
E         
E         Full diff:
E           {
E               'a': 1,
E         -     'b': 2,
E         +     'b': 20,
E         ?           +
E         -     'c': 3,
E         ?      ^   ^
E         +     'd': 4,
E         ?      ^   ^
E           }

actual     = {'a': 1, 'b': 20, 'd': 4}
expected   = {'a': 1, 'b': 2, 'c': 3}

tests/test_zz_injected_failures.py:46: AssertionError

Check failure on line 0 in tests.test_zz_injected_failures

See this annotation in the file changed.

@github-actions github-actions / Test Results (aggregate)

All 3 runs with error: test_injected_setup_error (tests.test_zz_injected_failures)

test-results/test-results-standard-linux-64-py3.12-cu13.4.2-wheels-l4-x1-latest/junit-core.xml [took 0s]
test-results/test-results-standard-linux-aarch64-py3.12-cu13.4.2-wheels-a100-x1-latest/junit-core.xml [took 0s]
test-results/test-results-standard-win-64-py3.12-cu13.4.2-local-a100-x1-latest-TCC/junit-core.xml [took 0s]
Raw output
failed on setup with "ValueError: injected fixture error"
@pytest.fixture
    def broken_fixture():
>       raise ValueError("injected fixture error")
E       ValueError: injected fixture error


tests/test_zz_injected_failures.py:51: ValueError

Check warning on line 0 in tests.test_zz_injected_failures

See this annotation in the file changed.

@github-actions github-actions / Test Results (aggregate)

All 3 runs failed: test_injected_warning_then_fail (tests.test_zz_injected_failures)

test-results/test-results-standard-linux-64-py3.12-cu13.4.2-wheels-l4-x1-latest/junit-core.xml [took 0s]
test-results/test-results-standard-linux-aarch64-py3.12-cu13.4.2-wheels-a100-x1-latest/junit-core.xml [took 0s]
test-results/test-results-standard-win-64-py3.12-cu13.4.2-local-a100-x1-latest-TCC/junit-core.xml [took 0s]
Raw output
AssertionError: injected failure after a warning
@pytest.mark.agent_authored(model="claude-fable-5-1")
    @pytest.mark.thread_unsafe(reason="records process-global warnings")
    def test_injected_warning_then_fail():
        warnings.warn("injected warning: must not become an annotation", UserWarning, stacklevel=1)
>       raise AssertionError("injected failure after a warning")
E       AssertionError: injected failure after a warning


tests/test_zz_injected_failures.py:63: AssertionError

Check warning on line 0 in tests.test_zz_injected_failures

See this annotation in the file changed.

@github-actions github-actions / Test Results (aggregate)

All 3 runs failed: test_injected_exception_in_helper (tests.test_zz_injected_failures)

test-results/test-results-standard-linux-64-py3.12-cu13.4.2-wheels-l4-x1-latest/junit-core.xml [took 0s]
test-results/test-results-standard-linux-aarch64-py3.12-cu13.4.2-wheels-a100-x1-latest/junit-core.xml [took 0s]
test-results/test-results-standard-win-64-py3.12-cu13.4.2-local-a100-x1-latest-TCC/junit-core.xml [took 0s]
Raw output
ZeroDivisionError: integer division or modulo by zero
@pytest.mark.agent_authored(model="claude-fable-5-1")
    def test_injected_exception_in_helper():
        def helper(n):
            return 10 // n
    
>       assert helper(0) == 1
               ^^^^^^^^^

helper     = <function test_injected_exception_in_helper.<locals>.helper at 0x7adadc1653a0>

tests/test_zz_injected_failures.py:71: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

n = 0

    def helper(n):
>       return 10 // n
               ^^^^^^^
E       ZeroDivisionError: integer division or modulo by zero

n          = 0

tests/test_zz_injected_failures.py:69: ZeroDivisionError