[fix](arrow-flight-sql) Fix FE not found arrow flight schema by xinyiZzz · Pull Request #43960 · apache/doris

xinyiZzz · 2024-11-14T08:18:33Z

What problem does this PR solve?

Problem Summary:

After query first phase exec_plan_fragment, FE will fetches arrow schema to BE, but BE will generate arrow schema when query second stage ResultSinkLocalState::open.

Therefore, this pr is changed to generate arrow schema in the first phase ResultSinkLocalState::init.

Fix:

rrmsg: Status [errorCode=NOT_FOUND, errorMsg=(172.16.212.191)[NOT_FOUND]FE not found arrow flight schema, maybe query has been canceled], error code: null, error msg:
java.lang.RuntimeException: fetch arrow flight schema failed, finstId: 3573efbeb10c44a7-956531d8e15d1630, errmsg: Status [errorCode=NOT_FOUND, errorMsg=(172.16.212.191)[NOT_FOUND]FE not found arrow flight schema, maybe query has been canceled]
        at org.apache.doris.service.arrowflight.FlightSqlConnectProcessor.fetchArrowFlightSchema(FlightSqlConnectProcessor.java:126) ~[doris-fe.jar:1.2-SNAPSHOT]
        at org.apache.doris.service.arrowflight.DorisFlightSqlProducer.executeQueryStatement(DorisFlightSqlProducer.java:229) ~[doris-fe.jar:1.2-SNAPSHOT]
        at org.apache.doris.service.arrowflight.DorisFlightSqlProducer.getFlightInfoStatement(DorisFlightSqlProducer.java:260) ~[doris-fe.jar:1.2-SNAPSHOT]

Check List (For Author)

Test
- Regression test
- Unit Test
- Manual test (add detailed scripts or steps below)
- No need to test or manual test. Explain why:
  - This is a refactor/code format and no logic has been changed.
  - Previous test can cover this change.
  - No code files have been changed.
  - Other reason
Behavior changed:
- No.
- Yes.
Does this need documentation?
- No.
- Yes.

Check List (For Reviewer who merge this PR)

Confirm the release note
Confirm test cases
Confirm document
Add branch pick label

doris-robot · 2024-11-14T08:18:38Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

What problem was fixed (it's best to include specific error reporting information). How it was fixed.
Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
What features were added. Why was this function added?
Which code was refactored and why was this part of the code refactored?
Which functions were optimized and what is the difference before and after the optimization?

xinyiZzz · 2024-11-14T08:18:59Z

run buildall

github-actions · 2024-11-14T08:23:30Z

clang-tidy review says "All clean, LGTM! 👍"

doris-robot · 2024-11-14T08:53:06Z

TeamCity be ut coverage result:
Function Coverage: 37.94% (9888/26060)
Line Coverage: 29.13% (82618/283580)
Region Coverage: 28.27% (42475/150240)
Branch Coverage: 24.85% (21541/86684)
Coverage Report: http://coverage.selectdb-in.cc/coverage/57834a4dab71129dac599055ef876e41b68bf5f6_57834a4dab71129dac599055ef876e41b68bf5f6/report/index.html

github-actions · 2024-11-17T08:09:14Z

PR approved by at least one committer and no changes requested.

github-actions · 2024-11-17T08:09:17Z

PR approved by anyone and no changes requested.

wangbo

LGTM

…43960) ### What problem does this PR solve? Problem Summary: After query first phase `exec_plan_fragment`, FE will fetches arrow schema to BE, but BE will generate arrow schema when query second stage `ResultSinkLocalState::open`. Therefore, this pr is changed to generate arrow schema in the first phase `ResultSinkLocalState::init`. Fix: ``` rrmsg: Status [errorCode=NOT_FOUND, errorMsg=(172.16.212.191)[NOT_FOUND]FE not found arrow flight schema, maybe query has been canceled], error code: null, error msg: java.lang.RuntimeException: fetch arrow flight schema failed, finstId: 3573efbeb10c44a7-956531d8e15d1630, errmsg: Status [errorCode=NOT_FOUND, errorMsg=(172.16.212.191)[NOT_FOUND]FE not found arrow flight schema, maybe query has been canceled] at org.apache.doris.service.arrowflight.FlightSqlConnectProcessor.fetchArrowFlightSchema(FlightSqlConnectProcessor.java:126) ~[doris-fe.jar:1.2-SNAPSHOT] at org.apache.doris.service.arrowflight.DorisFlightSqlProducer.executeQueryStatement(DorisFlightSqlProducer.java:229) ~[doris-fe.jar:1.2-SNAPSHOT] at org.apache.doris.service.arrowflight.DorisFlightSqlProducer.getFlightInfoStatement(DorisFlightSqlProducer.java:260) ~[doris-fe.jar:1.2-SNAPSHOT] ```

…43960) Problem Summary: After query first phase `exec_plan_fragment`, FE will fetches arrow schema to BE, but BE will generate arrow schema when query second stage `ResultSinkLocalState::open`. Therefore, this pr is changed to generate arrow schema in the first phase `ResultSinkLocalState::init`. Fix: ``` rrmsg: Status [errorCode=NOT_FOUND, errorMsg=(172.16.212.191)[NOT_FOUND]FE not found arrow flight schema, maybe query has been canceled], error code: null, error msg: java.lang.RuntimeException: fetch arrow flight schema failed, finstId: 3573efbeb10c44a7-956531d8e15d1630, errmsg: Status [errorCode=NOT_FOUND, errorMsg=(172.16.212.191)[NOT_FOUND]FE not found arrow flight schema, maybe query has been canceled] at org.apache.doris.service.arrowflight.FlightSqlConnectProcessor.fetchArrowFlightSchema(FlightSqlConnectProcessor.java:126) ~[doris-fe.jar:1.2-SNAPSHOT] at org.apache.doris.service.arrowflight.DorisFlightSqlProducer.executeQueryStatement(DorisFlightSqlProducer.java:229) ~[doris-fe.jar:1.2-SNAPSHOT] at org.apache.doris.service.arrowflight.DorisFlightSqlProducer.getFlightInfoStatement(DorisFlightSqlProducer.java:260) ~[doris-fe.jar:1.2-SNAPSHOT] ```

…43960) ### What problem does this PR solve? Problem Summary: After query first phase `exec_plan_fragment`, FE will fetches arrow schema to BE, but BE will generate arrow schema when query second stage `ResultSinkLocalState::open`. Therefore, this pr is changed to generate arrow schema in the first phase `ResultSinkLocalState::init`. Fix: ``` rrmsg: Status [errorCode=NOT_FOUND, errorMsg=(172.16.212.191)[NOT_FOUND]FE not found arrow flight schema, maybe query has been canceled], error code: null, error msg: java.lang.RuntimeException: fetch arrow flight schema failed, finstId: 3573efbeb10c44a7-956531d8e15d1630, errmsg: Status [errorCode=NOT_FOUND, errorMsg=(172.16.212.191)[NOT_FOUND]FE not found arrow flight schema, maybe query has been canceled] at org.apache.doris.service.arrowflight.FlightSqlConnectProcessor.fetchArrowFlightSchema(FlightSqlConnectProcessor.java:126) ~[doris-fe.jar:1.2-SNAPSHOT] at org.apache.doris.service.arrowflight.DorisFlightSqlProducer.executeQueryStatement(DorisFlightSqlProducer.java:229) ~[doris-fe.jar:1.2-SNAPSHOT] at org.apache.doris.service.arrowflight.DorisFlightSqlProducer.getFlightInfoStatement(DorisFlightSqlProducer.java:260) ~[doris-fe.jar:1.2-SNAPSHOT] ```

pick #43960 #43929 #44177

…43960) Problem Summary: After query first phase `exec_plan_fragment`, FE will fetches arrow schema to BE, but BE will generate arrow schema when query second stage `ResultSinkLocalState::open`. Therefore, this pr is changed to generate arrow schema in the first phase `ResultSinkLocalState::init`. Fix: ``` rrmsg: Status [errorCode=NOT_FOUND, errorMsg=(172.16.212.191)[NOT_FOUND]FE not found arrow flight schema, maybe query has been canceled], error code: null, error msg: java.lang.RuntimeException: fetch arrow flight schema failed, finstId: 3573efbeb10c44a7-956531d8e15d1630, errmsg: Status [errorCode=NOT_FOUND, errorMsg=(172.16.212.191)[NOT_FOUND]FE not found arrow flight schema, maybe query has been canceled] at org.apache.doris.service.arrowflight.FlightSqlConnectProcessor.fetchArrowFlightSchema(FlightSqlConnectProcessor.java:126) ~[doris-fe.jar:1.2-SNAPSHOT] at org.apache.doris.service.arrowflight.DorisFlightSqlProducer.executeQueryStatement(DorisFlightSqlProducer.java:229) ~[doris-fe.jar:1.2-SNAPSHOT] at org.apache.doris.service.arrowflight.DorisFlightSqlProducer.getFlightInfoStatement(DorisFlightSqlProducer.java:260) ~[doris-fe.jar:1.2-SNAPSHOT] ```

[pick](branch-3.0) #38215 #43281 #43960 --------- Co-authored-by: Guangdong Liu <[email protected]>

* [pick](branch-2.1) pick apache#38215 (apache#43386) pick apache#38215 --------- Co-authored-by: Zou Xinyi <[email protected]> * pick apache#43929 * pick apache#43960

…43960) ### What problem does this PR solve? Problem Summary: After query first phase `exec_plan_fragment`, FE will fetches arrow schema to BE, but BE will generate arrow schema when query second stage `ResultSinkLocalState::open`. Therefore, this pr is changed to generate arrow schema in the first phase `ResultSinkLocalState::init`. Fix: ``` rrmsg: Status [errorCode=NOT_FOUND, errorMsg=(172.16.212.191)[NOT_FOUND]FE not found arrow flight schema, maybe query has been canceled], error code: null, error msg: java.lang.RuntimeException: fetch arrow flight schema failed, finstId: 3573efbeb10c44a7-956531d8e15d1630, errmsg: Status [errorCode=NOT_FOUND, errorMsg=(172.16.212.191)[NOT_FOUND]FE not found arrow flight schema, maybe query has been canceled] at org.apache.doris.service.arrowflight.FlightSqlConnectProcessor.fetchArrowFlightSchema(FlightSqlConnectProcessor.java:126) ~[doris-fe.jar:1.2-SNAPSHOT] at org.apache.doris.service.arrowflight.DorisFlightSqlProducer.executeQueryStatement(DorisFlightSqlProducer.java:229) ~[doris-fe.jar:1.2-SNAPSHOT] at org.apache.doris.service.arrowflight.DorisFlightSqlProducer.getFlightInfoStatement(DorisFlightSqlProducer.java:260) ~[doris-fe.jar:1.2-SNAPSHOT] ```

1

57834a4

xinyiZzz added dev/2.1.x dev/3.0.x labels Nov 14, 2024

yiguolei added the usercase Important user case type label label Nov 16, 2024

yiguolei approved these changes Nov 17, 2024

View reviewed changes

github-actions Bot added approved Indicates a PR has been approved by one committer. reviewed labels Nov 17, 2024

wangbo approved these changes Nov 18, 2024

View reviewed changes

xinyiZzz merged commit f7bc15f into apache:master Nov 18, 2024

github-actions Bot added cherry-pick-conflict-in-3.0 cherry-pick-conflict-in-2.1.x labels Nov 18, 2024

xinyiZzz mentioned this pull request Nov 18, 2024

[pick](branch-3.0) #38215 #43281 #43960 #44136

Closed

xinyiZzz mentioned this pull request Nov 19, 2024

[pick](branch-2.1) pick #43960 #43929 #44177 #44240

Merged

xinyiZzz mentioned this pull request Nov 19, 2024

[pick](branch-3.0) #38215 #43281 #43960 #44244

Merged

yiguolei pushed a commit that referenced this pull request Nov 19, 2024

[pick](branch-2.1) pick #43960 #43929 #44177 (#44240)

83208ee

pick #43960 #43929 #44177

yiguolei added dev/2.1.8-merged and removed dev/2.1.x cherry-pick-conflict-in-2.1.x labels Nov 19, 2024

yiguolei pushed a commit that referenced this pull request Nov 26, 2024

[pick](branch-3.0) #38215 #43281 #43960 (#44244)

b64ae78

[pick](branch-3.0) #38215 #43281 #43960 --------- Co-authored-by: Guangdong Liu <[email protected]>

yiguolei added dev/3.0.3-merged and removed dev/3.0.x cherry-pick-conflict-in-3.0 labels Nov 26, 2024

yiguolei mentioned this pull request Jan 19, 2025

Release Note 2.1.8 #47198

Closed

Navigation Menu

Repository navigation

[fix](arrow-flight-sql) Fix FE not found arrow flight schema - #43960

[fix](arrow-flight-sql) Fix FE not found arrow flight schema#43960
xinyiZzz merged 1 commit into
apache:masterfrom
xinyiZzz:20241107_fix_arrowflight

xinyiZzz commented Nov 14, 2024 •

edited

Loading

Uh oh!

doris-robot commented Nov 14, 2024

Uh oh!

xinyiZzz commented Nov 14, 2024

Uh oh!

github-actions Bot commented Nov 14, 2024

Uh oh!

doris-robot commented Nov 14, 2024

Uh oh!

github-actions Bot commented Nov 17, 2024

Uh oh!

github-actions Bot commented Nov 17, 2024

Uh oh!

wangbo left a comment

Uh oh!

Reviewers

Uh oh!

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

Conversation

xinyiZzz commented Nov 14, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What problem does this PR solve?

Check List (For Author)

Check List (For Reviewer who merge this PR)

Uh oh!

doris-robot commented Nov 14, 2024

Uh oh!

xinyiZzz commented Nov 14, 2024

Uh oh!

github-actions Bot commented Nov 14, 2024

Uh oh!

doris-robot commented Nov 14, 2024

Uh oh!

github-actions Bot commented Nov 17, 2024

Uh oh!

github-actions Bot commented Nov 17, 2024

Uh oh!

wangbo left a comment

Choose a reason for hiding this comment

Uh oh!

Reviewers

Uh oh!

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

xinyiZzz commented Nov 14, 2024 •

edited

Loading