Skip to content

Conversation

@dybyte
Copy link
Contributor

@dybyte dybyte commented Jul 28, 2025

Fixes #9509

Purpose of this pull request

This pull request fixes a Netty version conflict between the version used internally by the MaxCompute connector and the version bundled with Spark 3.3.0. This conflict previously caused a NoSuchMethodError at runtime. For more context and discussion, please refer to issue#9509

Does this PR introduce any user-facing change?

no

How was this patch tested?

Covered by existing tests.

if (container instanceof Spark3Container) {
    log.info("Skip on Spark 3.3.0 due to Netty conflict.");
    return;
}

Since the underlying Netty conflict has been resolved in this patch, this workaround has been removed, and the MaxCompute e2e test now runs and passes successfully on Spark 3.3.0.

Check list

Copy link
Member

@Hisoka-X Hisoka-X left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @dybyte !

Copy link
Member

@Carl-Zhou-CN Carl-Zhou-CN left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

good pr

@Carl-Zhou-CN Carl-Zhou-CN merged commit 4d2b55c into apache:dev Jul 29, 2025
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Bug] [Connector-V2] NoSuchMethodError caused by Netty version conflict on Spark 3.3.0

3 participants