Timeline

Released Date: Dec. 16th, 2023

Work Items

Major Improvement

1. • MSCCL++: integrated with MSCCL++ and removed dependency on gpudma (Integrate with MSCCL++ #179)

Platforms Support

1. • ROCm: add ROCm multi-GPU support (ROCm multi-GPU support #181)

Operators

1. • reduce: keepdims support for reduction (keepdims support for reduction #173)

Optimization

1. • OpGraph: optimize OpGraph scheduling (Optimize OpGraph scheduling #182)

Examples

1. • Example: add Llama2 multi-GPU examples (Support multi-GPU inference for llama2 #170)

CI

1. • [ ] Unit Tests: revise Python unit tests & add to the Azure pipeline (moved to the next version release plan)
2. • [ ] Unit Tests: add ROCm Azure pipelines (moved to the next version release plan)
3. • [ ] Code Coverage: add code coverage for Python code (moved to the next version release plan)