Skip to content

Conversation

@SbloodyS
Copy link
Member

Purpose of the pull request

close #17370
close #17488

Brief change log

Verify this pull request

This pull request is code cleanup without any test coverage.

(or)

This pull request is already covered by existing tests, such as (please describe tests).

(or)

This change added tests and can be verified as follows:

(or)

Pull Request Notice

Pull Request Notice

If your pull request contains incompatible change, you should also add it to docs/docs/en/guide/upgrade/incompatible.md

@sonarqubecloud
Copy link

Copy link
Member

@ruanwenjun ruanwenjun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@Gallardot Gallardot merged commit 1bd41c1 into apache:dev Sep 10, 2025
74 of 94 checks passed
@Kinsonx
Copy link

Kinsonx commented Sep 19, 2025

After adding '-Dclassifier=shade' based on 3.3.1-release version, still got the 'java.lang.ClassNotFoundException: org.apache.htrace.core.Tracer$Builder' when start worker-server. It seems that jar file 'dolphinscheduler-storage-hdfs-3.3.1-shade.jar' dose not hive classes related to htrace. Did I miss any configurations ?

@Mrhs121
Copy link
Contributor

Mrhs121 commented Sep 19, 2025

After adding '-Dclassifier=shade' based on 3.3.1-release version, still got the 'java.lang.ClassNotFoundException: org.apache.htrace.core.Tracer$Builder' when start worker-server. It seems that jar file 'dolphinscheduler-storage-hdfs-3.3.1-shade.jar' dose not hive classes related to htrace. Did I miss any configurations ?

You haven't missed any configuration. The current workaround solution is to copy hbase-noop-htrace-4.1.1.jar to worker-server/libs.

@ruanwenjun
Copy link
Member

@Kinsonx Is your plugin dir exit dolphinscheduler-datasource-hive-3.3.1-shade.jar? hbase-noop-htrace should be shaded in this jar

@Mrhs121
Copy link
Contributor

Mrhs121 commented Sep 19, 2025

@Kinsonx Is your plugin dir exit dolphinscheduler-datasource-hive-3.3.1-shade.jar? hbase-noop-htrace should be shaded in this jar

I've created FOLLOWUP PR #17524 to fix it.

@Kinsonx
Copy link

Kinsonx commented Sep 20, 2025

@Kinsonx Is your plugin dir exit dolphinscheduler-datasource-hive-3.3.1-shade.jar? hbase-noop-htrace should be shaded in this jar

No datasource-plugins, only storage-plugins which contains 'storage-hdfs'

@Kinsonx
Copy link

Kinsonx commented Sep 20, 2025

After adding '-Dclassifier=shade' based on 3.3.1-release version, still got the 'java.lang.ClassNotFoundException: org.apache.htrace.core.Tracer$Builder' when start worker-server. It seems that jar file 'dolphinscheduler-storage-hdfs-3.3.1-shade.jar' dose not hive classes related to htrace. Did I miss any configurations ?

You haven't missed any configuration. The current workaround solution is to copy hbase-noop-htrace-4.1.1.jar to worker-server/libs.

Before I saw this PR, I made a soft link (cd worker-server/libs; ln -s ../../libs/hbase-noop-htrace-4.1.1.jar hbase-noop-htrace-4.1.1.jar), it did work.

davidzollo pushed a commit to davidzollo/dolphinscheduler that referenced this pull request Oct 27, 2025
…pe (apache#17496)

* fix worker server start failed when using hdfs storage type

* fix worker server start failed when using hdfs storage type
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backend bug Something isn't working priority:high

Projects

None yet

5 participants