Skip to content

Commit 50eb20a

Browse files
Fix dsv4 dequant + tp/ep (#46378)
* fix dequant + tp/rp * Update src/transformers/core_model_loading.py Co-authored-by: Arthur <[email protected]> --------- Co-authored-by: Arthur <[email protected]>
1 parent 74464e8 commit 50eb20a

1 file changed

Lines changed: 2 additions & 1 deletion

File tree

‎src/transformers/core_model_loading.py‎

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1431,7 +1431,8 @@ def convert_and_load_state_dict_in_model(
14311431
)
14321432
shard_index = (
14331433
len(mapping.collected_tensors.get(source_pattern, []))
1434-
if isinstance(mapping, WeightConverter) and isinstance(mapping.operations[0], MergeModulelist)
1434+
if isinstance(mapping, WeightConverter)
1435+
and any(isinstance(op, MergeModulelist) for op in mapping.operations)
14351436
else None
14361437
)
14371438
future_or_tensor = spawn_tp_materialize(

0 commit comments

Comments
 (0)