Skip to content

Conversation

@happyboy1024
Copy link
Contributor

Purpose of this pull request

Support Doris multi read and close #5731

Does this PR introduce any user-facing change?

How was this patch tested?

Check list

- [x] [schema projection](../../concept/connector-v2-features.md)
- [x] [parallelism](../../concept/connector-v2-features.md)
- [x] [support user-defined split](../../concept/connector-v2-features.md)
- [x] [support multiple table read](../../concept/connector-v2-features.md)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

update cn docs

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

update cn docs

done.

Copy link
Member

@Hisoka-X Hisoka-X left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM except one minior problem. Thanks @happyboy1024 !

DorisSourceTable dorisSourceTable =
tables.get(TablePath.of(partition.getDatabase(), partition.getTable()));
if (dorisSourceTable == null) {
return;
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we should throw exception.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we should throw exception.
Do we need to terminate directly here? Or do we add the warn log output, what do you think?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

An exception should be thrown because if there is no bug with the connector, it should never be null

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

An exception should be thrown because if there is no bug with the connector, it should never be null

Ok, I see what you mean. I'll adjust. thx

Copy link
Member

@Hisoka-X Hisoka-X left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM if ci passes. Thanks @happyboy1024 !

@hailin0
Copy link
Member

hailin0 commented Oct 25, 2024

waiting for ci passed

@hailin0 hailin0 merged commit 10c37ac into apache:dev Oct 25, 2024
@happyboy1024 happyboy1024 deleted the doris_multi_read branch November 14, 2024 06:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Feature][Doris] Support multi-table source read

3 participants