Skip to content

Conversation

@xiaochen-zhou
Copy link
Contributor

Purpose of this pull request

Support multi starrocks source

Does this PR introduce any user-facing change?

Yes

How was this patch tested?

Add new tests

Check list

@xiaochen-zhou xiaochen-zhou changed the title [Feature][Connector-v2] support multi starrocks source [Feature][Connector-v2] Support multi starrocks source Feb 22, 2025

@DisabledOnContainer(
value = {},
type = {EngineType.SPARK, EngineType.FLINK},
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
type = {EngineType.SPARK, EngineType.FLINK},

Currently supported

if (null == host) {
throw new StarRocksConnectorException(
CommonErrorCodeDeprecated.ILLEGAL_ARGUMENT,
CommonErrorCode.ILLEGAL_ARGUMENT,
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please do not directly use common error code, we should create it in

sink {
Assert {
rules {
table-names = ["e2e_table_source", "e2e_table_source_3"]
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@xiaochen-zhou
Copy link
Contributor Author

Done. could you please take a look and let me know if there's anything else that needs to be modified @Hisoka-X @hailin0

public class StarRocksQueryPlanReadClient {
private RetryUtils.RetryMaterial retryMaterial;
private SourceConfig sourceConfig;
private SeaTunnelRowType seaTunnelRowType;
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
private SeaTunnelRowType seaTunnelRowType;

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done.

QUEST_QUERY_PLAN_FAILED("STARROCKS-06", "Request query Plan failed"),
READER_ARROW_DATA_FAILED("STARROCKS-07", "Read Arrow data failed");
READER_ARROW_DATA_FAILED("STARROCKS-07", "Read Arrow data failed"),
HOST_IS_NULL("STARROCKS-07", "Read Arrow data failed");
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
HOST_IS_NULL("STARROCKS-07", "Read Arrow data failed");
HOST_IS_NULL("STARROCKS-08", "Read Arrow data failed");

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done.

Copy link
Member

@Hisoka-X Hisoka-X left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM if ci passes. Thanks @xiaochen-zhou

@hailin0 hailin0 merged commit 26b5529 into apache:dev Mar 4, 2025
8 checks passed
@xiaochen-zhou xiaochen-zhou deleted the support_sr_multi_source branch March 5, 2025 00:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants