Skip to content

TF-TRT Slice op converters explicit batch mode - #40736

Merged
copybara-service[bot] merged 1 commit into
tensorflow:masterfrom
tfeher:trt_slice_dynamic_shape
Mar 16, 2021
Merged

copybara-service[bot] merged 1 commit into
tensorflow:masterfrom
tfeher:trt_slice_dynamic_shape

Conversation

@tfeher

@tfeher tfeher commented Jun 23, 2020 •

Copy link
Copy Markdown
Contributor

This PR enables Slice and StridedSlice op conversion in explicit batch mode.

We currently enable the conversion only for the cases where the slice parameters (begin, size) can be calculated at conversion time. For other cases, we would need to use shape layers to calculate the slice parameters at runtime. We will implement this in a follow up PR.

The StridedSlice converter was improved to accept negative stride, and corresponding tests were added.

Tagging @bixia1 for review.

@google-ml-butler google-ml-butler Bot added the size:XL CL Change Size:Extra Large label Jun 23, 2020
@google-ml-butler
google-ml-butler Bot requested a review from joker-eph June 23, 2020 22:28
@gbaned gbaned self-assigned this Jun 24, 2020
@gbaned gbaned added the comp:gpu:tensorrt Issues specific to TensorRT label Jun 24, 2020
@gbaned
gbaned requested a review from bixia1 June 24, 2020 03:50
@gbaned gbaned added the awaiting review Pull request awaiting review label Jun 30, 2020
@gbaned

gbaned commented Jul 6, 2020

Copy link
Copy Markdown
Contributor

@tfeher Can you please resolve conflicts? Thanks!

@gbaned gbaned added stat:awaiting response Status - Awaiting response from author and removed awaiting review Pull request awaiting review labels Jul 6, 2020
@gbaned

gbaned commented Jul 14, 2020

Copy link
Copy Markdown
Contributor

@tfeher Any update on this PR? Please. Thanks!

@tfeher

tfeher commented Jul 20, 2020

Copy link
Copy Markdown
Contributor Author

This PR depends on #40545, I will resolve the conflicts once #40545 is merged.

@tensorflowbutler tensorflowbutler removed the stat:awaiting response Status - Awaiting response from author label Jul 22, 2020
@gbaned

gbaned commented Dec 23, 2020

Copy link
Copy Markdown
Contributor

@tfeher Can you please check @DEKHTIARJonathan's comments and keep us posted ? Thanks!

@gbaned gbaned added the stat:awaiting response Status - Awaiting response from author label Dec 23, 2020
@gbaned

gbaned commented Jan 5, 2021

Copy link
Copy Markdown
Contributor

@tfeher Any update on this PR? Please. Thanks!

@tensorflowbutler tensorflowbutler added the stale This label marks the issue/pr stale - to be closed automatically if no activity label Jan 22, 2021
@tfeher

tfeher commented Jan 22, 2021

Copy link
Copy Markdown
Contributor Author

This PR depends on #40545, I will resolve the conflicts once #40545 is merged.

@google-ml-butler google-ml-butler Bot removed the stale This label marks the issue/pr stale - to be closed automatically if no activity label Jan 22, 2021
@tensorflowbutler tensorflowbutler removed the stat:awaiting response Status - Awaiting response from author label Jan 24, 2021
@tfeher
tfeher force-pushed the trt_slice_dynamic_shape branch from 74a3138 to c3bf5c6 Compare February 24, 2021 14:57
@tfeher

tfeher commented Feb 24, 2021

Copy link
Copy Markdown
Contributor Author

PR rebased to contain the latest changes fro #40545 and #47215. Marking it as draft, because the dynamic shape input handling needs some improvement.

@tfeher
tfeher marked this pull request as draft February 24, 2021 14:59
@tfeher
tfeher force-pushed the trt_slice_dynamic_shape branch 2 times, most recently from 6e1f2a8 to cfaf348 Compare March 11, 2021 18:47
@tfeher tfeher changed the title TF-TRT slice op converter dynamic shape TF-TRT Slice op converters explicit batch mode Mar 12, 2021
@tfeher
tfeher marked this pull request as ready for review March 12, 2021 00:22

@bixia1 bixia1 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Still working on the reviewing, but would like to send out the comment I have so far. I also modified the PR description. Would you please check?

@tfeher tfeher left a comment

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @bixia1 for the comments! I have addressed the issues.

@tfeher
tfeher force-pushed the trt_slice_dynamic_shape branch from 806d1ec to ff1ff91 Compare March 14, 2021 23:06
… mode

Additionally, allow negative stride values.
@tfeher
tfeher force-pushed the trt_slice_dynamic_shape branch from ff1ff91 to 2b1d2b0 Compare March 16, 2021 00:10

@tfeher tfeher left a comment

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @bixia1 for the review, I have fixed the issues.

@google-ml-butler google-ml-butler Bot added kokoro:force-run Tests on submitted change ready to pull PR ready for merge process labels Mar 16, 2021
@kokoro-team kokoro-team removed the kokoro:force-run Tests on submitted change label Mar 16, 2021
@copybara-service
copybara-service Bot merged commit 4920f6a into tensorflow:master Mar 16, 2021
@tfeher
tfeher deleted the trt_slice_dynamic_shape branch May 16, 2022 08:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cla: yes comp:gpu:tensorrt Issues specific to TensorRT ready to pull PR ready for merge process size:XL CL Change Size:Extra Large

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants