Skip to content

Revert "Fixes #2943 - implements shared grpc connection per multiple …#5272

Merged
mattklein123 merged 1 commit intoenvoyproxy:masterfrom
adilhafeez:revert_a08597467917c3d982755ea45075e05106b92dd7
Dec 14, 2018
Merged

Revert "Fixes #2943 - implements shared grpc connection per multiple …#5272
mattklein123 merged 1 commit intoenvoyproxy:masterfrom
adilhafeez:revert_a08597467917c3d982755ea45075e05106b92dd7

Conversation

@adilhafeez
Copy link
Copy Markdown
Contributor

@adilhafeez adilhafeez commented Dec 11, 2018

Description:

While rolling out envoy/master at Lyft we found out that xDS was having issues making outbound grpc calls to fetch cluster information. We are still investigating the root case. This commit seems to be the suspect.

This reverts commit a085974.

Risk Level: Low
Testing: tested on lyft staging environment
Docs Changes: n/a
Release Notes: n/a

Signed-off-by: Adil Hafeez [email protected]

@zuercher
Copy link
Copy Markdown
Member

Please fill out the PR as described in https://github.com/envoyproxy/envoy/pull/PULL_REQUESTS.md -- I'm not sure why you want to revert this commit.

@adilhafeez adilhafeez changed the title Revert "Fixes #2943 - implements shared grpc connection per multiple … WIP - Revert "Fixes #2943 - implements shared grpc connection per multiple … Dec 12, 2018
@adilhafeez
Copy link
Copy Markdown
Contributor Author

@zuercher updated description

@zuercher
Copy link
Copy Markdown
Member

@adilhafeez please amend your commit to have the DCO signoff. Adding text in the form Signed-off-by: your name <[email protected]> is sufficient.

@mattklein123
Copy link
Copy Markdown
Member

@adilhafeez @lita @junr03 @tonya11en has this commit been verified to be faulty via bisecting/revert? Has any basic debugging been done? If we know this commit is faulty we can revert but it would we should 100% confirm this commit is at fault.

@mattklein123 mattklein123 self-assigned this Dec 13, 2018
@adilhafeez
Copy link
Copy Markdown
Contributor Author

adilhafeez commented Dec 13, 2018 via email

@narehayrapetyan
Copy link
Copy Markdown

@mattklein123 this commit caused a stream of 503 no healthy upstream hosts which stopped when we reverted this commit.

@mattklein123
Copy link
Copy Markdown
Member

@adilhafeez per previous comment please fix DCO. Thanks!

@mattklein123
Copy link
Copy Markdown
Member

cc @dmitri-d that we are reverting #5026 which appears to break EDS fetches at Lyft. @junr03 should be able to help debug next week if you want to contact him on Slack. cc @htuch

@mattklein123 mattklein123 changed the title WIP - Revert "Fixes #2943 - implements shared grpc connection per multiple … Revert "Fixes #2943 - implements shared grpc connection per multiple … Dec 13, 2018
@adilhafeez
Copy link
Copy Markdown
Contributor Author

I added text that @zuercher recommended. Isnt that enough?

@mattklein123
Copy link
Copy Markdown
Member

I added text that @zuercher recommended. Isnt that enough?

No, as the DCO bot is still failing. Please see the bot failure and the contributing guide to see how to work with DCO.

@adilhafeez
Copy link
Copy Markdown
Contributor Author

Will fix the DCO. Thanks

@dmitri-d
Copy link
Copy Markdown
Contributor

Is there a failing test case for this?

… multiple EDS subscriptions. (envoyproxy#5026)"

This reverts commit a085974.

Signed-off-by: Adil Hafeez <[email protected]>
@adilhafeez adilhafeez force-pushed the revert_a08597467917c3d982755ea45075e05106b92dd7 branch from 44206cf to d3cc24f Compare December 13, 2018 23:55
@adilhafeez
Copy link
Copy Markdown
Contributor Author

adilhafeez commented Dec 13, 2018

Is there a failing test case for this?

@dmitri-d no, but we should have test case to ensure that we don't break EDS fetch next time

@adilhafeez
Copy link
Copy Markdown
Contributor Author

@mattklein123 DCO bot is happy now

@dmitri-d
Copy link
Copy Markdown
Contributor

@adilhafeez: I'm happy to help with a testcase(s), but would need more details re: how EDS fetch fails.

@adilhafeez
Copy link
Copy Markdown
Contributor Author

@dmitri-d can we revert this PR as it is and work on writing test case in a separate PR? I'm not sure how and what came in play that broke the EDS and would require more investigation. @junr03 and I can work together to dig more details about the failure.

@dmitri-d
Copy link
Copy Markdown
Contributor

@adilhafeez: yes, I think reverting the commit is the way to go. Let me know if I can help with the investigation.

@mattklein123
Copy link
Copy Markdown
Member

@dmitri-d, @junr03 will be able to help to help debug and describe to you the problem next week so that you can fix it. @adilhafeez Yes, we will obviously have a test case for whatever is broken when it is fixed.

@adilhafeez
Copy link
Copy Markdown
Contributor Author

@mattklein123 can you please merge? all tests passed.

@mattklein123 mattklein123 merged commit 298dbf9 into envoyproxy:master Dec 14, 2018
@htuch
Copy link
Copy Markdown
Member

htuch commented Dec 14, 2018

OK, we should definitely have a dedicated EDS gRPC xDS integration test; today we have a combined gRPC ADS integration test and an EDS xDS from filesystem. We could build on the work done in #5228 to add a dedicated EDS gRPC test here.

@dmitri-d
Copy link
Copy Markdown
Contributor

I'll add EDS integration test while I'm at it.

@mattklein123
Copy link
Copy Markdown
Member

@dmitri-d yeah I would go ahead and just do that as a change on top of current master. It's possible that test will fail when you un-revert the change and then we don't need to debug at Lyft.

fredlas pushed a commit to fredlas/envoy that referenced this pull request Mar 5, 2019
… multiple EDS subscriptions. (envoyproxy#5026)" (envoyproxy#5272)

This reverts commit a085974.

Signed-off-by: Adil Hafeez <[email protected]>
Signed-off-by: Fred Douglas <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants