[Code Simplification] remove cum_offsets #3410
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
Thanks for your contribution! |
freeliuzc
previously approved these changes
Aug 18, 2025
zhoutianzi666
approved these changes
Aug 18, 2025
littledgg
pushed a commit
to littledgg/FastDeploy
that referenced
this pull request
Sep 8, 2025
This reverts commit 32b3962.
Jiang-Jia-Jun
pushed a commit
that referenced
this pull request
Oct 9, 2025
* success run ngram * Revert "[Code Simplification] remove cum_offsets (#3410)" This reverts commit 32b3962. * success run ngram5 tp4 42bs * success run ngram5 tp4 42bs * mtp draft commit * add decorator for target model * enable draft model in cudagraph v0.5 * revert revrt cum_offset * enable target model in cudagraph v0.9 And clean debug code * Revert "success run ngram" This reverts commit 8351e83. * add reverted code * enable target model in cudagraph v0.9 * solve comment * fix bid < 0 * Enable Target Model Padding And Draft Model in cudagraph * solve problem * delete rebuild padding debug note * fast compile * Add capture list for mtp * success run 256 tp1 mtp * Enable Lite TP2 Bsz256 * realy enable tp2 bsz 256 * fix problem * Solve problem for Draft model in cudagraph * Solve comment * replace emptytensor as zeros * Solve comments * Revert "fast compile" This reverts commit 834639a. * fix bug * fix merge bug * fix typo * fix bug --------- Co-authored-by: lizexu <[email protected]> Co-authored-by: littledgg <[email protected]> Co-authored-by: zeroRains <[email protected]> Co-authored-by: gongshaotian <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
将rebuild_padding输入cum_offsets替换成cu_seqlens_q，减少了计算量