Skip to content

Comments

Add support for MIGraphX Exhaustive tune flag in MIGraphX EP#46

Merged
TedThemistokleous merged 4 commits intorocm6.2_internal_testingfrom
migx_enable_exhaustive_tune
Aug 2, 2024
Merged

Add support for MIGraphX Exhaustive tune flag in MIGraphX EP#46
TedThemistokleous merged 4 commits intorocm6.2_internal_testingfrom
migx_enable_exhaustive_tune

Conversation

@TedThemistokleous
Copy link
Collaborator

Description

Enable migraphx compile to toggle exhaustive tuning with linux environment env or through the python API

Motivation and Context

Allows for better performance at the trade off of a larger compile time be enabling MIGraphX's exhaustive tuning of kernels

Enable exhaustive tune by either python interface of environment env in bash
@TedThemistokleous TedThemistokleous added the enhancement New feature or request label Jul 11, 2024
@TedThemistokleous TedThemistokleous self-assigned this Jul 11, 2024
@TedThemistokleous TedThemistokleous merged commit 2562f2d into rocm6.2_internal_testing Aug 2, 2024
TedThemistokleous added a commit that referenced this pull request Aug 2, 2024
* Add support for MIGraphX Exhaustive tune flag in MIGraphX EP

Enable exhaustive tune by either python interface of environment env in bash

* Apply lintrunner pass

* Fix compile errors.

* Lintrunner pass
TedThemistokleous added a commit that referenced this pull request Aug 9, 2024
* Add support for MIGraphX Exhaustive tune flag in MIGraphX EP (#46)

* Add support for MIGraphX Exhaustive tune flag in MIGraphX EP

Enable exhaustive tune by either python interface of environment env in bash

* Apply lintrunner pass

* Fix compile errors.

* Lintrunner pass

* handle review comments

---------

Co-authored-by: Ted Themistokleous <[email protected]>
jagadish-amd pushed a commit to jagadish-amd/onnxruntime that referenced this pull request Sep 10, 2024
…microsoft#21599)

### Description
<!-- Describe your changes. -->
Set the exhaustive tune flag through the MIGraphX API and make this a
Session option in Onnxruntime

### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
Allow users to use MIGraphX Exhaustive tuning with Onnxruntime
inferences
This goers hand in hand with save/load after a model and been compiled
and tuning has found.

---------

Co-authored-by: Ted Themistokleous <[email protected]>
Co-authored-by: Tianlei Wu <[email protected]>
TedThemistokleous added a commit that referenced this pull request Jan 3, 2025
* Add support for MIGraphX Exhaustive tune flag in MIGraphX EP (#46)

* Add support for MIGraphX Exhaustive tune flag in MIGraphX EP

Enable exhaustive tune by either python interface of environment env in bash

* Apply lintrunner pass

* Fix compile errors.

* Lintrunner pass

* handle review comments

---------

Co-authored-by: Ted Themistokleous <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants