[ZEPPELIN-4950]. Support for manually specifying the Java version of Spark Interpreter Scala REPL#3852
Closed
xiejiajun wants to merge 10 commits intoapache:branch-0.9from
Closed
[ZEPPELIN-4950]. Support for manually specifying the Java version of Spark Interpreter Scala REPL#3852xiejiajun wants to merge 10 commits intoapache:branch-0.9from
xiejiajun wants to merge 10 commits intoapache:branch-0.9from
Conversation
… interpreter may not be restarted when the interpreter process exits unexpectedly
Branch 0.9
…d to connect due to it abnormal stop , which eventually caused the remove paragraph operation to fail to complete.
Branch 0.9
Branch 0.9 update
Contributor
|
@xiejiajun What is the default value of |
Contributor
Author
@zjffdu 1. The default value of |
Contributor
|
@xiejiajun I don't see spark scala shell specifying |
Contributor
Author
|
Contributor
|
Thanks @xiejiajun, LGTM |
asfgit
pushed a commit
that referenced
this pull request
Jul 16, 2020
…Spark Interpreter Scala REPL ### What is this PR for? - Support for manually specifying the Java version of Spark Interpreter Scala REPL. - This feature can be used to resolve runtime errors caused by reference to third-party libraries that use high-version Java in Spark Interpreter. ### What type of PR is it? [Feature] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/projects/ZEPPELIN/issues/ZEPPELIN-4950 ### How should this be tested? * manually tested * Specify spark.repl.target through %spark.conf or when configuring Spark Interpreter * Reference and call a Java method in a third-party library developed using Java 8 and using Java 8 features such as interface static methods through the Spark interpreter. If the call is successful, it means the test passed ### Screenshots (if appropriate) - A runtime error will be triggered when we reference a third-party library that uses the new features of Java8 if we using the default value `jvm-1.6` of `settings.target.value` :  ### Questions: * Does the licenses files need update? NO * Is there breaking changes for older versions? NO * Does this needs documentation? Yes Author: xiejiajun <[email protected]> Author: JakeXie <[email protected]> Author: xie-jia-jun <[email protected]> Closes #3852 from xiejiajun/spark_repl_target and squashes the following commits: d131f19 [xiejiajun] spark.md docs fix 6872054 [xiejiajun] add spark.repl.target to spark.md docs 6a05b4f [xiejiajun] Support for manually specifying the Java version of Spark Interpreter Scala REPL 6a2cf04 [xiejiajun] Merge branch 'branch-0.9' of https://github.com/apache/zeppelin into branch-0.9 076668a [JakeXie] Merge pull request #7 from apache/branch-0.9 00e14dd [JakeXie] Merge pull request #5 from apache/branch-0.9 9bb7341 [xiejiajun] Merge remote-tracking branch 'origin/branch-0.9' into branch-0.9 9bc5605 [xiejiajun] bug fix: when we removing a paragraph , an interpreter process refused to connect due to it abnormal stop , which eventually caused the remove paragraph operation to fail to complete. 97d2714 [xie-jia-jun] Merge pull request #2 from apache/branch-0.9 9b3c744 [xiejiajun] added timeout for getting Thrift client to avoid situations where the interpreter may not be restarted when the interpreter process exits unexpectedly
1 task
prabhjyotsingh
pushed a commit
to prabhjyotsingh/zeppelin
that referenced
this pull request
Aug 14, 2020
…Spark Interpreter Scala REPL ### What is this PR for? - Support for manually specifying the Java version of Spark Interpreter Scala REPL. - This feature can be used to resolve runtime errors caused by reference to third-party libraries that use high-version Java in Spark Interpreter. ### What type of PR is it? [Feature] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/projects/ZEPPELIN/issues/ZEPPELIN-4950 ### How should this be tested? * manually tested * Specify spark.repl.target through %spark.conf or when configuring Spark Interpreter * Reference and call a Java method in a third-party library developed using Java 8 and using Java 8 features such as interface static methods through the Spark interpreter. If the call is successful, it means the test passed ### Screenshots (if appropriate) - A runtime error will be triggered when we reference a third-party library that uses the new features of Java8 if we using the default value `jvm-1.6` of `settings.target.value` :  ### Questions: * Does the licenses files need update? NO * Is there breaking changes for older versions? NO * Does this needs documentation? Yes Author: xiejiajun <[email protected]> Author: JakeXie <[email protected]> Author: xie-jia-jun <[email protected]> Closes apache#3852 from xiejiajun/spark_repl_target and squashes the following commits: d131f19 [xiejiajun] spark.md docs fix 6872054 [xiejiajun] add spark.repl.target to spark.md docs 6a05b4f [xiejiajun] Support for manually specifying the Java version of Spark Interpreter Scala REPL 6a2cf04 [xiejiajun] Merge branch 'branch-0.9' of https://github.com/apache/zeppelin into branch-0.9 076668a [JakeXie] Merge pull request apache#7 from apache/branch-0.9 00e14dd [JakeXie] Merge pull request apache#5 from apache/branch-0.9 9bb7341 [xiejiajun] Merge remote-tracking branch 'origin/branch-0.9' into branch-0.9 9bc5605 [xiejiajun] bug fix: when we removing a paragraph , an interpreter process refused to connect due to it abnormal stop , which eventually caused the remove paragraph operation to fail to complete. 97d2714 [xie-jia-jun] Merge pull request #2 from apache/branch-0.9 9b3c744 [xiejiajun] added timeout for getting Thrift client to avoid situations where the interpreter may not be restarted when the interpreter process exits unexpectedly (cherry picked from commit 054651f) Signed-off-by: Jeff Zhang <[email protected]>
asfgit
pushed a commit
that referenced
this pull request
Oct 13, 2020
…Spark Interpreter Scala REPL and fix the CI failure due to low Scala version ### What is this PR for? - fix the [CI failure](https://travis-ci.org/github/apache/zeppelin/builds/709913046) due to [PR-3852](#3852) ### What type of PR is it? [Bug Fix] ### Todos * [ ] - Task ### What is the Jira issue? * [ZEPPELIN-4962](https://issues.apache.org/jira/projects/ZEPPELIN/issues/ZEPPELIN-4962) ### How should this be tested? * CI test ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? NO * Is there breaking changes for older versions? NO * Does this needs documentation? Yes Author: xiejiajun <[email protected]> Author: xie-jia-jun <[email protected]> Author: JakeXie <[email protected]> Closes #3860 from xiejiajun/ZEPPELIN-4962 and squashes the following commits: 9128c9b [JakeXie] spark.repl.target docs update ad4c0e3 [xiejiajun] Clear irrelevant code a12d3a9 [xiejiajun] Support for manually specifying the Java version of Spark Interpreter Scala REPL and fix the CI failure due to low Scala version ab2b191 [xiejiajun] Merge branch 'master' of https://github.com/apache/zeppelin into apache-master 5569788 [xiejiajun] Merge branch 'master' of https://github.com/apache/zeppelin into apache-master 0a9af6c [xiejiajun] Merge branch 'master' of https://github.com/apache/zeppelin into apache-master be36b37 [xiejiajun] 合并Apache Master分支冲突解决 1335d55 [xiejiajun] Merge remote-tracking branch 'origin/master' fc59f57 [JakeXie] Merge pull request #4 from apache/master 9cc70fe [xiejiajun] Merge remote-tracking branch 'origin/master' 6ef9b23 [xie-jia-jun] Merge pull request #3 from apache/master 45af87a [xiejiajun] added timeout for getting Thrift client to avoid situations where the interpreter may not be restarted when the interpreter process exits unexpectedly f149c3b [xie-jia-jun] Merge pull request #1 from apache/master 5d4b645 [xie-jia-jun] Support OSSConfigStorage of Aliyun dbb6639 [xie-jia-jun] Add Aliyun OSS SDK bb47849 [xie-jia-jun] Support S3ConfigStorage of AWS
asfgit
pushed a commit
that referenced
this pull request
Oct 13, 2020
…Spark Interpreter Scala REPL and fix the CI failure due to low Scala version ### What is this PR for? - fix the [CI failure](https://travis-ci.org/github/apache/zeppelin/builds/709913046) due to [PR-3852](#3852) ### What type of PR is it? [Bug Fix] ### Todos * [ ] - Task ### What is the Jira issue? * [ZEPPELIN-4962](https://issues.apache.org/jira/projects/ZEPPELIN/issues/ZEPPELIN-4962) ### How should this be tested? * CI test ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? NO * Is there breaking changes for older versions? NO * Does this needs documentation? Yes Author: xiejiajun <[email protected]> Author: xie-jia-jun <[email protected]> Author: JakeXie <[email protected]> Closes #3860 from xiejiajun/ZEPPELIN-4962 and squashes the following commits: 9128c9b [JakeXie] spark.repl.target docs update ad4c0e3 [xiejiajun] Clear irrelevant code a12d3a9 [xiejiajun] Support for manually specifying the Java version of Spark Interpreter Scala REPL and fix the CI failure due to low Scala version ab2b191 [xiejiajun] Merge branch 'master' of https://github.com/apache/zeppelin into apache-master 5569788 [xiejiajun] Merge branch 'master' of https://github.com/apache/zeppelin into apache-master 0a9af6c [xiejiajun] Merge branch 'master' of https://github.com/apache/zeppelin into apache-master be36b37 [xiejiajun] 合并Apache Master分支冲突解决 1335d55 [xiejiajun] Merge remote-tracking branch 'origin/master' fc59f57 [JakeXie] Merge pull request #4 from apache/master 9cc70fe [xiejiajun] Merge remote-tracking branch 'origin/master' 6ef9b23 [xie-jia-jun] Merge pull request #3 from apache/master 45af87a [xiejiajun] added timeout for getting Thrift client to avoid situations where the interpreter may not be restarted when the interpreter process exits unexpectedly f149c3b [xie-jia-jun] Merge pull request #1 from apache/master 5d4b645 [xie-jia-jun] Support OSSConfigStorage of Aliyun dbb6639 [xie-jia-jun] Add Aliyun OSS SDK bb47849 [xie-jia-jun] Support S3ConfigStorage of AWS (cherry picked from commit 185ffd4) Signed-off-by: Jeff Zhang <[email protected]>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What is this PR for?
What type of PR is it?
[Feature]
Todos
What is the Jira issue?
How should this be tested?
Screenshots (if appropriate)
jvm-1.6ofsettings.target.value:Questions: