Skip to content

Commit db8b005

Browse files
test(bedrock): use pytest.xfail for known-failing opus-4-7 cells
Replace pytest.fail with pytest.xfail when a model has a fail_reason, so known-broken cells stay visible as XFAIL without keeping CI red. Co-authored-by: Yassin Kortam <[email protected]>
1 parent 15b8f95 commit db8b005

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

tests/llm_translation/reasoning_effort_grid/test_reasoning_effort_grid.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -168,7 +168,7 @@ async def test_reasoning_effort_grid(
168168
pytest.skip(skip_reason)
169169

170170
if model.fail_reason:
171-
pytest.fail(model.fail_reason)
171+
pytest.xfail(model.fail_reason)
172172

173173
if route_name == "bedrock_invoke_messages":
174174
status, exc = await _call_messages(model, effort)

0 commit comments

Comments
 (0)