Merged
Conversation
### What is this PR for? This PR removes individual developer tags from project pom. ### What type of PR is it? [Bug Fix] ### What is the Jira issue? [ZEPPELIN-896](https://issues.apache.org/jira/browse/ZEPPELIN-896) Author: Luciano Resende <[email protected]> Closes #925 from lresende/pom-cleanup and squashes the following commits: 74c844f [Luciano Resende] [ZEPPELIN-896] Remove individual developer tags from pom
### What is this PR for? Remove obsolete incubator disclaimer file ### What type of PR is it? [Bug Fix] ### What is the Jira issue? [ZEPPELIN-897](https://issues.apache.org/jira/browse/ZEPPELIN-897) Author: Luciano Resende <[email protected]> Closes #926 from lresende/incubator-disclaimer and squashes the following commits: ea3a95c [Luciano Resende] [ZEPPELIN-897] Remove incubator disclaimer
### What is this PR for? Update resources to use Zeppelin TLP links ### What type of PR is it? [Bug Fix] ### What is the Jira issue? [ZEPPELIN-898](https://issues.apache.org/jira/browse/ZEPPELIN-898) Author: Luciano Resende <[email protected]> Closes #927 from lresende/incubator-links and squashes the following commits: 8fca07c [Luciano Resende] [ZEPPELIN-898] Update resources to use Zeppelin TLP links
### What is this PR for? Apache Ignite 1.6 contains JDBC driver improvements that affect Zeppelin Ignite interpreter user experience. ### What type of PR is it? [Improvement] ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-881 Author: agura <[email protected]> Closes #916 from agura/ZEPPELIN-881 and squashes the following commits: e215b00 [agura] ZEPPELIN-881 Apache Ignite version updated to 1.6
### What is this PR for?
This PR enable Zeppelin server register Interpreters without any dependencies of their own. For instance, we should build `spark` with `spark-dependencies` even we use our own Spark cluster because current initialisation mechanism needs to all of its dependencies.
### What type of PR is it?
[Improvement]
### Todos
* [x] - Add RegisteredInterpreter from interpreter-setting.json in a jar or interpreter/{interpreter}/interpreter-setting.json
* [x] - Adjust it to Spark*Interpreter
### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-804
### How should this be tested?
1. Prepare your own spark cluster - e.g. standalone, Yarn, Mesos -
1. rm -rf interpreter
1. mvn clean package -DskipTests -pl 'zeppelin-display,zeppelin-interpreter,zeppelin-server,zeppelin-web,zeppelin-zengine,angular,jdbc,spark'
1. bin/zeppelin-daemon.sh start
1. Check error in log
1. apply patch
1. mvn clean package -DskipTests -pl 'zeppelin-display,zeppelin-interpreter,zeppelin-server,zeppelin-web,zeppelin-zengine,angular,jdbc,spark'
1. bin/zeppelin-daemon.sh start
1. run some paragraph with simple command like `sc.version`
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No
### Description
#### This PR introduce three initialisation mechanism including current one.
* {interpreter_dir}/{interpreter_group}/interpreter-setting.json
* interpreter-settings.json in your interpreter jar
* Current static initialization
#### Initialization step
1. Get {interpreter_dir} from Configuration
1. Get the list of {interpreter_dir}/[{interpreter_group1},{interpreter_group2}...]
1. Find {interpreter_dir}/{interpreter_group1}/interpreter-setting.json
1. Find interpreter-setting.json in the resources of {interpreter_dir}/{interpreter_group1}/**/*.jar
1. Adopt static init
1. Repeat them from the second step with {interpreter_group2}
Author: Jongyoul Lee <[email protected]>
Closes #835 from jongyoul/ZEPPELIN-804 and squashes the following commits:
823321e [Jongyoul Lee] ZEPPELIN-804 Refactoring registration mechanism on Interpreters - Added documentation
25bc501 [Jongyoul Lee] ZEPPELIN-804 Refactoring registration mechanism on Interpreters - Ignored while registering a new interpreter with existing interpreter key
312dd77 [Jongyoul Lee] ZEPPELIN-804 Refactoring registration mechanism on Interpreters - Reverted log4j setting
81ab361 [Jongyoul Lee] ZEPPELIN-804 Refactoring registration mechanism on Interpreters - Changed logger setting only for test. This will be reverted after test
e8f990f [Jongyoul Lee] ZEPPELIN-804 Refactoring registration mechanism on Interpreters - Fixed some unicode characters in interpreter-setting.json
3ad41bb [Jongyoul Lee] ZEPPELIN-804 Refactoring registration mechanism on Interpreters - Checked if path exists or not
1b3cd0c [Jongyoul Lee] ZEPPELIN-804 Refactoring registration mechanism on Interpreters - Checked if path exists or not
844dccb [Jongyoul Lee] ZEPPELIN-804 Refactoring registration mechanism on Interpreters - Fixed logic to check for supporting legacy mechanism
c5b7d54 [Jongyoul Lee] ZEPPELIN-804 Refactoring registration mechanism on Interpreters - Extracted new initialization logic into another methods
5d63d91 [Jongyoul Lee] ZEPPELIN-804 Refactoring registration mechanism on Interpreters - Removed static initialisation of Spark*Interpreter
0d720c0 [Jongyoul Lee] ZEPPELIN-804 Refactoring registration mechanism on Interpreters - Removed a interpreter which fails to initialize
d343636 [Jongyoul Lee] ZEPPELIN-804 Refactoring registration mechanism on Interpreters - Excluded SparkRInterpreter from interpreter-setting.json
519f057 [Jongyoul Lee] ZEPPELIN-804 Refactoring registration mechanism on Interpreters - Excluded interpreter-setting.json from rat check
00f55a8 [Jongyoul Lee] ZEPPELIN-804 Refactoring registration mechanism on Interpreters - Excluded interpreter-setting.json from rat check
1fa2e52 [Jongyoul Lee] ZEPPELIN-804 Refactoring registration mechanism on Interpreters - Fixed test environments
8a90fe4 [Jongyoul Lee] ZEPPELIN-804 Refactoring registration mechanism on Interpreters - Fixed test environments
d54f98e [Jongyoul Lee] ZEPPELIN-804 Refactoring registration mechanism on Interpreters - Changed Spark*Interpreter to use interpreter-setting.json
48ac41d [Jongyoul Lee] ZEPPELIN-804 Refactoring registration mechanism on Interpreters - Fixed the style
ca7b96c [Jongyoul Lee] ZEPPELIN-804 Refactoring registration mechanism on Interpreters - Added a new initialization mechanism to use interpreter-setting.json - Adjusted new mechanism to SparkInterpreter for verification
### What is this PR for? Added documentation for new contributors ### What type of PR is it? [Documentation] ### Todos * [x] - Upadated docs ### What is the Jira issue? N/A ### How should this be tested? N/A ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jongyoul Lee <[email protected]> Closes #934 from jongyoul/doc-added-link-for-beginner and squashes the following commits: e9d1aee [Jongyoul Lee] [DOC] Added the link of Apache's Jira for beginner
### What is this PR for? To increase initial notebook name. ### What type of PR is it? Bug Fix ### How should this be tested? execute create new note. ### Screenshots (if appropriate) - before  - after  ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: astroshim <[email protected]> Closes #929 from astroshim/hotfix/notename and squashes the following commits: eb0defd [astroshim] list name has changed.
### What is this PR for? Adding a python 2 &3 interpreter. It's a basic implementation (no py4j for example), with a java ProcessBuilder object used to instantiate a python REPL. The interpreter doesn't bring it own python binary but uses the python specified by python.path configutation. Thus, you can still use your specific installed python modules (scikit-learn, matplotlib...) and the interpreter is able to work with python 2 & 3 without change. I had a python helper function (zeppelin_show() ) to easily display matplotlib graph as SVG. ### What type of PR is it? [Feature] ### Todos * [x] - Code review * [x] - Improve bootstrap.py : choose available helper functions and their names * [x] - Unit / IT tests ? * [x] documentation updates needed, that AhyoungRyu pointed out * [X] LICENSE needs to be updated to include all non-apache licensed dependencies (i.e AFAIK Py4j is BSD ) in bin-license * [x] double-check that code formatting conforms project style guide * [x] the branch need to be rebased on latest master. ### What is the Jira issue? [ZEPPELIN-502](https://issues.apache.org/jira/browse/ZEPPELIN-502?jql=project%20%3D%20ZEPPELIN%20AND%20text%20~%20%22python%22) ### How should this be tested? 1. In interpreter screen, in Python section, specify in python.path the python binary you want to use 2. In a paragraph, you can use the interpreter with **_%python_**. Calling help() will describe you the interpreter functionnalities. 3. Install py4j (pip install py4j) if you want to use input form ### Screenshots     ### Questions: * Does the licenses files need update? Yes, only bin-license (py4j) * Is there breaking changes for older versions? No * Does this needs documentation? Yes Author: Hervé RIVIERE <[email protected]> Closes #869 from hriviere/PR_interpreter_python and squashes the following commits: 80b6e75 [Hervé RIVIERE] [ZEPPELIN-502] move BSD py4j license to zeppelin-distribution/src/bin_license/license a4b82a5 [Hervé RIVIERE] [ZEPPELIN-502]Improving doc following @AhyoungRyu review 3252353 [Hervé RIVIERE] [ZEPPELIN-502] Formatting code to respect project convention 54ec4f1 [Hervé RIVIERE] [ZEPPELIN-502]Improving doc following @AhyoungRyu review 6a831bc [Hervé RIVIERE] [ZEPPELIN-502] Add BSD py4j license 11e1b9c [Hervé RIVIERE] [ZEPPELIN-502] minor changes in python.md e5d0bdb [Hervé RIVIERE] [ZEPPELIN-502] change PYTHON_PATH to ZEPPELIN_PYTHON c62ac98 [Hervé RIVIERE] [ZEPPELIN-502] Improve python.md 5008125 [Hervé RIVIERE] [ZEPPELIN-502] Improve python.md with features not yet supported and technical description 7d533e1 [Hervé RIVIERE] [ZEPPELIN-502] Add tests and reformating code to help tests writing fecaf25 [Hervé RIVIERE] [ZEPPELIN-502] Rename python.path to python and default from /usr/bin/python to python 02d1320 [Hervé RIVIERE] [ZEPPELIN-502] Input form, change from simple input form to native (pyspark syntax) 60d2956 [Hervé RIVIERE] [ZEPPELIN-502] Indent as pep8 convention 9bdb192 [Hervé RIVIERE] [ZEPPELIN-502] Add python.md to _navigation.html 7142aa5 [Hervé RIVIERE] [ZEPPELIN-502] Catch exception in logger.error 1a86ad7 [Hervé RIVIERE] [ZEPPELIN-502] Python interpreter group
### What is this PR for? Fix flaky Integration Test by adding new id to HTML (as of HTML5 it can be [any non-empty string](https://html.spec.whatwg.org/multipage/dom.html#the-id-attribute)) and liverage it in tests for simpler XPath statements that pick only 1 candidate. ### TODO - [x] fix test - [x] update New Interpreter form validation and error message ### What type of PR is it? Bug Fix ### What is the Jira issue? [ZEPPELIN-928](https://issues.apache.org/jira/browse/ZEPPELIN-928) ### How should this be tested? CI should pass ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Alexander Bezzubov <[email protected]> Closes #939 from bzz/fix/ZEPPELIN-928 and squashes the following commits: 9bcba08 [Alexander Bezzubov] Interpreter creation: add ID to the HTML and update Integration tests to use simple xpath 8744834 [Alexander Bezzubov] New Interpreter validation: prohibit whitespace names and correct error msg
### What is this PR for?
Changed the regex to find a issue number from title. This doesn't change any code about Zeppelin, but this will effect helper script for committers
### What type of PR is it?
[Bug Fix]
### Todos
* [x] - Fixed the bug
### What is the Jira issue?
N/A
### How should this be tested?
```
>>> import re
>>> re.findall("ZEPPELIN-[0-9]{3,4}", "ZEPPELIN-123")
['ZEPPELIN-123']
>>> re.findall("ZEPPELIN-[0-9]{4,5}", "ZEPPELIN-123")
[]
>>> re.findall("ZEPPELIN-[0-9]{3,4,5}", "ZEPPELIN-123")
[]
>>> re.findall("ZEPPELIN-[0-9]{3}", "ZEPPELIN-123")
['ZEPPELIN-123']
>>> re.findall("ZEPPELIN-[0-9]{3,5}", "ZEPPELIN-123")
['ZEPPELIN-123']
>>> re.findall("ZEPPELIN-[0-9]{4,5}", "ZEPPELIN-123")
[]
>>> re.findall("ZEPPELIN-[0-9]{3,5}", "ZEPPELIN-123")
['ZEPPELIN-123']
```
### Screenshots (if appropriate)
N/A
### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No
Author: Jongyoul Lee <[email protected]>
Closes #936 from jongyoul/minor-find-issue-number-from-title and squashes the following commits:
63f37af [Jongyoul Lee] [MINOR] fixed logic to find issue number from title
c16117b [Jongyoul Lee] [MINOR] fixed logic to find issue number from title
…button ### What is this PR for? I just changed the `Repository Information` icon placement with `+Create` button in Interpreter setting page, since the tooltip is not shown properly. ### What type of PR is it? Improvement ### Todos * [x] - Change the icon placement ### What is the Jira issue? No ### How should this be tested? After applying this PR and go to interpreter setting page. Then hover the mouse on the gear icon. That's it :) ### Screenshots (if appropriate) - **Before**  - **After**  ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: AhyoungRyu <[email protected]> Closes #901 from AhyoungRyu/fix/tooltipPlacement and squashes the following commits: f352a78 [AhyoungRyu] Change the placement of 'Repository Information' icon
### What is this PR for? Currently available interpreter list is not shown in `Creating New Interpreter` section. It seems this bug was generated after #835 was merged. So I temporally deactivated [3 SerializedName code lines](6d7f1bc). ### What type of PR is it? Bug Fix ### Todos * [x] - Fix interpreter listing bug when creating new interpreter ### What is the Jira issue? [ZEPPELIN-931](https://issues.apache.org/jira/browse/ZEPPELIN-931) ### How should this be tested? 1. Build latest master branch and browse Zeppelin home 2. Create new interpreter -> You can not see the available interpreter list in this step like below attached screenshot 3. Apply this patch 4. Build again and browse -> You can see the available interpreter list as normal ### Screenshots (if appropriate) - **Before** <img width="1273" alt="screen shot 2016-06-01 at 12 36 42 pm" src="https://cloud.githubusercontent.com/assets/10060731/15723066/9082435e-27f5-11e6-9783-df44638dbbec.png"> - **After** <img width="1273" alt="screen shot 2016-06-01 at 12 33 06 pm" src="https://cloud.githubusercontent.com/assets/10060731/15723067/92bcc8ce-27f5-11e6-82f5-6c0db7b4342c.png"> ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: AhyoungRyu <[email protected]> Author: Jongyoul Lee <[email protected]> Author: Ah young <[email protected]> Closes #945 from AhyoungRyu/ZEPPELIN-931 and squashes the following commits: 711eb54 [Ah young] Merge pull request #2 from jongyoul/ZEPPELIN-931 6121f9b [Jongyoul Lee] - Fixed documentation 6e7dac9 [Ah young] Merge pull request #1 from jongyoul/ZEPPELIN-931 fed1b40 [Jongyoul Lee] - Fixed fieldName in interpreter-setting.json 6d7f1bc [AhyoungRyu] ZEPPELIN-931: fix interpreter listing bug
### What is this PR for? Remove incubating from doc ### What type of PR is it? Documentation ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Mina Lee <[email protected]> Closes #941 from minahlee/doc/removeIncubating and squashes the following commits: dbf37ef [Mina Lee] Remove redundant doap.rdf bcb6b54 [Mina Lee] Remove incubating from doc c7e34e7 [Mina Lee] Remove incubating from doc accec53 [Mina Lee] Remove incubating from doc
### What is this PR for? Remove `incubating` term from pom files ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Mina Lee <[email protected]> Closes #942 from minahlee/tlp/removeIncubating and squashes the following commits: e605b54 [Mina Lee] Remove incubating from pom files
### What is this PR for? spark-dependencies module pom: 1. add spark-2.0 profile 2. add hadoop-2.7 profile 3. profile spark-1.6 activeByDefault 4. replace scala version 2.10 with property `scala.binary.version` Author: shijinkui <[email protected]> This patch had conflicts when merged, resolved by Committer: Lee moon soo <[email protected]> Closes #923 from shijinkui/add_spark1.6_hdfs2.7 and squashes the following commits: e2e5da7 [shijinkui] remove spark 2.0 profile before really support that version 6952b0b [shijinkui] [ZEPPELIN 894] add new hadoop/spark profile and default spark 1.6 active 1. add spark-2.0 profile 2. add hadoop-2.7 profile 3. profile spark-1.6 activeByDefault 4. replace scala version 2.10 with property `scala.binary.version`
…tication ### What is this PR for? The purpose of this pull request is to allow users to use their own credentials to authenticate with data sources. It contains the following: - web UI and rest API to let users input their credentials - changes to AuthenticationInfo to add data source credentials - changes to Paragraph to set data source credentials in AuthenticationInfo - changes to HiveInterpreter to use the user credentials and simplification to use a new connection for every query. We made this change since we found an issue with closed vertica connections. Since we are using HiveInterpreter for analytics, the cost of creating a new connection is small compared to query execution. We don't have to merge this change into master. ### What type of PR is it? Feature ### Todos * [x] - Save user credentials in a file * [x] - Do not persist AuthenticationInfo in paragraph since it contains sensitive information * [ ] - Add tests * [ ] - Add documentation ### What is the Jira issue? [ZEPPELIN-828] (https://issues.apache.org/jira/browse/ZEPPELIN-828) ### How should this be tested? 1. In conf/shiro.ini, use /** = authc 1. Login to Zeppelin 2. Enter credentials for a data source 3. Check if the interpreter is using the correct credentials ### Screenshots (if appropriate) https://gfycat.com/LiquidGentleKatydid ### Questions: * Does this needs documentation? Yes. Author: Prasad Wagle <[email protected]> Closes #860 from prasadwagle/ZEPPELIN-828 and squashes the following commits: f6d8de3 [Prasad Wagle] Use LOG.error(msg, e) 62b64a0 [Prasad Wagle] Use LOG.error(msg, e) c628099 [Prasad Wagle] Use a more general term 'entity' instead of 'datasource' cbbb591 [Prasad Wagle] Added conf/credentials.json to .gitignore 623d42a [Prasad Wagle] Revert changes to HiveInterpreter, Update tests f2628e3 [Prasad Wagle] Remove vertica dependency from hive/pom.xml d4e3cd1 [Prasad Wagle] Fix checkstyle error, Update Data Source Authorization section in docs 8b70f08 [Prasad Wagle] Persist credentials depending on conf setting d9dae04 [Prasad Wagle] Persist user info instead of authentication info in paragraph cfe4c86 [Prasad Wagle] Pass all user credentials to the interpreter 90d546f [Prasad Wagle] Use individual user credentials for data source authentication
### What is this PR for? set scala Settings.numClassFileSetting to 128 to prevent "Getting 'File name too long'" error. See https://issues.apache.org/jira/browse/SPARK-4820 ### What type of PR is it? Bug Fix ### Todos * [x] - Programatically set numClassFileSetting to 128 ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-926 https://issues.apache.org/jira/browse/SPARK-4820 ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: Lee moon soo <[email protected]> Closes #935 from Leemoonsoo/maxClassfileName and squashes the following commits: 596a33a [Lee moon soo] Set maxClassfileName to 128
### What is this PR for? closed li tag. and Add a tooltip, and reduced the size of the horizontal search bar. ### What type of PR is it? Bug Fix and Improvement ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-930 ### How should this be tested? It changes the browser horizontal size. Use the search feature. ### Screenshots (if appropriate) #### before  #### after  ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: CloverHearts <[email protected]> Closes #938 from cloverhearts/fix/ZEPPELIN-930 and squashes the following commits: bd0fca2 [CloverHearts] change placeholder text on search box. 17573c0 [CloverHearts] reverting placeholder in search box on navbar. d2fbba7 [CloverHearts] Merge branch 'master' into fix/ZEPPELIN-930 0bd1785 [CloverHearts] fix width and not close li tag in searchbar
### What is this PR for? zeppelin-server should simply rely on transitive commons-exec from zeppelin-interpreter. ### What type of PR is it? [Improvement] ### Todos ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN/ZEPPELIN-533 ### How should this be tested? Simply build ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? N * Is there breaking changes for older versions? N * Does this needs documentation? N Author: Eric Charles <[email protected]> Closes #931 from echarles/commons-exec-compile-scope and squashes the following commits: b791ba7 [Eric Charles] remove unnedeed commons-exec declaration in scope test
### What is this PR for? Since version 1.8.2 of jsoup, org.jsoup.select.Elements class no longer has "get(int index)" method. It contradicts to <jsoup.version>1.8.2</jsoup.version> written in scala/pom.xml. Currently %r scripts fail with "java.lang.NoSuchMethodError: org.jsoup.select.Elements.get(I)Lorg/jsoup/nodes/Element;" This PR changes obsolete get(0) method to more universal and logically equivalent first() method, removing error message and removing 1.8.1 restriction to jsoup library (at least in ZeppelinRDisplay part of zeppelin). ### What type of PR is it? Bug Fix ### Todos * [ ] - Task ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-941 ### How should this be tested? Execute R-Tutorial Notebook in default installation of zeppelin and confirm that you can see output. ### Questions: It shouldn't break older versions. Author: Andrey Oskin <[email protected]> Closes #949 from Arkoniak/rdisplay_jsoup_fix and squashes the following commits: 3d05400 [Andrey Oskin] jsoup get(0) to first()
### What is this PR for? Most of the builds are failing for ZeppelinIT at testSparkInterpreterDependencyLoading:243, as the previous line's `testDepRemoveBtn.click()` is taking it to a different page. ### What type of PR is it? [Hot Fix] ### Todos * [x] - Change all add/remove dependencies/property's div to button * [x] - make relevant change in selenium test case. ### What is the Jira issue? [ZEPPELIN-950](https://issues.apache.org/jira/browse/ZEPPELIN-950) ### How should this be tested? CI should pass ### Questions: * Does the licenses files need update? N/A * Is there breaking changes for older versions? N/A * Does this needs documentation? N/A Author: Prabhjyot Singh <[email protected]> Closes #958 from prabhjyotsingh/ZEPPELIN-950 and squashes the following commits: 23369e9 [Prabhjyot Singh] Fix flaky ZeppelinIT build
### What is this PR for? Implement ZeppelinApi Experimental annotations and apply them in the public api. Also mark deprecated global scope angular object methods ### What type of PR is it? Feature ### Todos * [x] - Implement ZeppelinApi, Experimental annotations * [x] - Apply annotation to public Api * [x] - Mark deprecated global scope angular object related methods ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-809 ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: Lee moon soo <[email protected]> Closes #940 from Leemoonsoo/ZEPPELIN-809 and squashes the following commits: 0927f55 [Lee moon soo] Add @ZeppelinApi to restapi endpoint 96734a6 [Lee moon soo] Correction 6a1e4d8 [Lee moon soo] Remove unnecessary annotation 989dd86 [Lee moon soo] Add annotation impl 50cfed8 [Lee moon soo] Add @ZeppelinApi @experimental annotation and apply. Mark @deprecated for global scope angular displaysystem method
…ner style ### What is this PR for? Update cron expression link and fix broken cron container style ### What type of PR is it? Bug Fix ### What is the Jira issue? ZEPPELIN-951 ### Screenshots (if appropriate) **Before** <img width="429" alt="screen shot 2016-06-03 at 7 01 00 pm" src="https://cloud.githubusercontent.com/assets/8503346/15796973/e19a492a-29bd-11e6-89dd-cd69310e077d.png"> **After** <img width="304" alt="screen shot 2016-06-03 at 7 00 39 pm" src="https://cloud.githubusercontent.com/assets/8503346/15796974/e73c4ac2-29bd-11e6-8f9a-0e95ab69d2a6.png"> ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Mina Lee <[email protected]> Closes #959 from minahlee/ZEPPELIN-951 and squashes the following commits: 5a867d0 [Mina Lee] Update cron expression link and fix broken cron container style
…nse file. ### What is this PR for? <Jquery.floatThead> is no longer used. But the license document contains the appropriate information. Due to the following PR <jquery.floatThead> was removed. Resulting in a using < HandsonTable >. #858 ### What type of PR is it? Documentation ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-953 ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: CloverHearts <[email protected]> Closes #960 from cloverhearts/ZEPPELIN-953 and squashes the following commits: d9ac1f1 [CloverHearts] Merge branch 'master' into ZEPPELIN-953 5cddba6 [CloverHearts] deleted jquery.floatThead at license file
…er.md ### What is this PR for? Currently some code blocks in [docs/development/writingzeppelininterpreter.html](https://zeppelin.apache.org/docs/0.6.0-SNAPSHOT/development/writingzeppelininterpreter.html) & [docs/storage/storage.html#S3](https://zeppelin.apache.org/docs/0.6.0-SNAPSHOT/storage/storage.html) are broken. But it seems the broken code block in `docs/storage/storage.html` is already handled in #962. So I just updated in `docs/development/writingzeppelininterpreter.html` ### What type of PR is it? Hot Fix ### Todos ### What is the Jira issue? [ZEPPELIN-959](https://issues.apache.org/jira/browse/ZEPPELIN-959) ### How should this be tested? See the attached images :) ### Screenshots (if appropriate) - Before  - After <img width="1077" alt="screen shot 2016-06-05 at 7 38 50 pm" src="https://cloud.githubusercontent.com/assets/10060731/15812563/4b36e696-2b6b-11e6-8f14-f4572331eec6.png"> ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: AhyoungRyu <[email protected]> Closes #969 from AhyoungRyu/ZEPPELIN-959 and squashes the following commits: 8f8cc70 [AhyoungRyu] ZEPPELIN-959: Fix odd code block in writingzeppelininterpreter.md 879b8f9 [AhyoungRyu] Revert "ZEPPELIN-959: Fix odd code blocks in some documentations" 967b2fa [AhyoungRyu] ZEPPELIN-959: Fix odd code blocks in some documentations
### What is this PR for? Older Apache Spark releases seems to have been removed from mirrors, and thus the build scripts needs to be updated to download older releases from the archives. ### What type of PR is it? [Bug Fix] ### What is the Jira issue? [ZEPPELIN-956](https://issues.apache.org/jira/browse/ZEPPELIN-956) ### How should this be tested? Existing build tests Author: Luciano Resende <[email protected]> Closes #967 from lresende/download and squashes the following commits: 4fcbf7b [Luciano Resende] [ZEPPELIN-956] Download old spark versions direct from archive
### What is this PR for? Update external links to project code style guides in CONTRIBUTING.md as old ones give 404 now ### What type of PR is it? Bug Fix ### How should this be tested? Lins should be clickable and return 200 ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Alexander Bezzubov <[email protected]> Closes #968 from bzz/fix/update-styleguid-links and squashes the following commits: f5f8155 [Alexander Bezzubov] Update external links to project code styleguides
### What is this PR for? Move zeppelin version that is shown home page to new about section. ### What type of PR is it? [Improvement] ### Todos N/A ### What is the Jira issue? [ZEPPELIN-943](https://issues.apache.org/jira/browse/ZEPPELIN-943) ### How should this be tested? Please refer the gif below. ### Screenshots (if appropriate) Before:  After: Without authentication  With authentication  ### Questions: * Does the licenses files need update? N/A * Is there breaking changes for older versions? N/A * Does this needs documentation? N/A Author: Prabhjyot Singh <[email protected]> Closes #951 from prabhjyotsingh/ZEPPELIN-943 and squashes the following commits: 70aaff4 [Prabhjyot Singh] Merge remote-tracking branch 'origin/master' into ZEPPELIN-943 e714e66 [Prabhjyot Singh] implemeting feedback 5ed77c9 [Prabhjyot Singh] Move zeppelin version from home page to about section
### What is this PR for? This PR applies the new interpreter registration mechanism to Shell interpreter. ### What type of PR is it? Improvement ### Todos * [x] - Remove static property definition code lines in `shellInterpreter.java` and add `interpreter-setting.json` under the `shell/src/main/resources` ### What is the Jira issue? [ZEPPELIN-923](https://issues.apache.org/jira/browse/ZEPPELIN-923) ### How should this be tested? 1. apply patch 2. rm -r `interpreter/sh` and `conf/interpreter.json` 3. build source 4. bin/zeppelin-daemon.sh start 5. Run some shell command ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: AhyoungRyu <[email protected]> Closes #956 from AhyoungRyu/ZEPPELIN-923 and squashes the following commits: 3df8c7d [AhyoungRyu] ZEPPELIN-923: exclude interpreter-setting.json be3e22e [AhyoungRyu] ZEPPELIN-923: Change defaultValue 5000 -> 60000 b70d650 [AhyoungRyu] ZEPPELIN-923: Apply new interpreter mechanism to Shell interpreter
### What is this PR for? This PR will provide user-friendly way to give notebook permissions. It will show suggestions on the basis of usernames matching the input characters. It will communicate with Shiro to fetch usernames from the configured realms and select usernames matching the input character and shows it to the user as suggestions. Currently, it works with shiro.ini file, LDAP, JDBC. In future we can extend it to work with other realms too. ### What type of PR is it? Improvement ### Todos ### What is the Jira issue? [ZEPPELIN-933](https://issues.apache.org/jira/browse/ZEPPELIN-933) ### How should this be tested? 1. Authenticate Zeppelin with any of the realms mention above(LDAP, JDBC,ini). 2. In notebook permission section, try giving permissions to some notebook and press some initial characters . It should show matching users as suggestions and you should be able to select users from the suggestions. 3. You should be able to give usernames separated by comma and finally save it. ### Screenshots (if appropriate)  ### Questions: * Does the licenses files need update?no * Is there breaking changes for older versions?no * Does this needs documentation?maybe Author: Ravi Ranjan <[email protected]> Author: Prabhjyot Singh <[email protected]> Closes #937 from ravicodder/auto-suggestion and squashes the following commits: 4b4c826 [Ravi Ranjan] Merge branch 'master' of https://github.com/apache/incubator-zeppelin into auto-suggestion b4ef169 [Ravi Ranjan] use width in palce of margin-right 30bdae4 [Ravi Ranjan] Add log and make UI look better b7333d6 [Ravi Ranjan] reduce the size of autosugesstion and add sepreator 95a420e [Ravi Ranjan] change codeing style 140af69 [Ravi Ranjan] Merge branch 'master' of https://github.com/apache/incubator-zeppelin into auto-suggestion 6627019 [Ravi Ranjan] Merge branch 'master' of https://github.com/apache/incubator-zeppelin into auto-suggestion cdc50b3 [Ravi Ranjan] Modified notbook.html , include alert on save, modify condition to identify the realm 80ace5f [Prabhjyot Singh] aa ef3658c [Ravi Ranjan] add GetUserList.java file 060f27a [Ravi Ranjan] add auto-suggest option
### What is this PR for? After #1087 merged, a new docs `shell.md` was added. But in the docs website, still Shell interpreter link points to `pleasecontribute.html`. So I changed this link, applied TOC and added more descriptions. ### What type of PR is it? Documentation ### Todos * [x] - Change `pleasecontribute.html` -> `shell.html` * [x] - Apply TOC(table of contents) * [x] - Add more description to `shell.md` ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: AhyoungRyu <[email protected]> Closes #1138 from AhyoungRyu/improve/shell-docs and squashes the following commits: 69d567d [AhyoungRyu] Address @felixcheung feedback fca76a6 [AhyoungRyu] Apply TOC to rest-credential.md c8e988b [AhyoungRyu] Change docs group manual -> interpreter a0bf1d5 [AhyoungRyu] Add shell.html to _navigation.html
### What is this PR for?
When user isn't logged while the auth is activated, we are hiding the notebooks and most of the menus.
However you can still access them using the url routes.
This PR is blocking the url routes except the home route ('/') in that case.
### What type of PR is it?
Improvement
### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1123
### How should this be tested?
* Activate the auth in shiro.ini
* Launch Zeppelin, and try to visit `localhost:8080/#/interpreter` by typing it in your browser
* You should be redirected to '/'
### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No
Author: Damien CORNEAU <[email protected]>
Closes #1153 from corneadoug/ZEPPELIN-1123 and squashes the following commits:
58c5a6e [Damien CORNEAU] Remove preventDefault
ebb9136 [Damien CORNEAU] Block all routes except Home when user isn't logged
### What is this PR for? Fix for [ZEPPELIN-1150](https://issues.apache.org/jira/browse/ZEPPELIN-1150). ### What type of PR is it? Bug Fix ### Todos * [x] - Recreate table on data refresh * [x] - Better solution for [ZEPPELIN-1078](https://issues.apache.org/jira/browse/ZEPPELIN-1078) without performance degrade ### What is the Jira issue? [ZEPPELIN-1150](https://issues.apache.org/jira/browse/ZEPPELIN-1150) ### How should this be tested? Reproduce procedure described in the issue ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: Lee moon soo <[email protected]> Closes #1171 from Leemoonsoo/ZEPPELIN-1150 and squashes the following commits: 7978f47 [Lee moon soo] remove multiple newlines b3406b7 [Lee moon soo] Recreate table when (data) is refreshed
### What is this PR for? This PR prevent to show the ace editor's showSettingMenu screen. ### What type of PR is it? Bug Fix ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1091 ### How should this be tested? Type "Ctrl+." on your paragraph. ### Screenshots (if appropriate) - before  ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: astroshim <[email protected]> Closes #1110 from astroshim/ZEPPELIN-1091 and squashes the following commits: 9ff2886 [astroshim] rebase c736db0 [astroshim] disable showSettingsMenu
… and configurations info ### What is this PR for? For some user cases, people might want to hide **Interpreter Setting**, **Credentials** and **Configurations** information to other users (who are defined in `conf/shiro.ini`). So I added ``` #/api/interpreter/** = authc, roles[admin] #/api/configurations/** = authc, roles[admin] #/api/credential/** = authc, roles[admin] ``` below the [ [urls] ](https://github.com/apache/zeppelin/blob/master/conf/shiro.ini#L38) section. This issue was originally suggested at [Zeppelin user mailing list](https://mail-archives.apache.org/mod_mbox/zeppelin-users/201606.mbox/%3CCAPgU7Y%3DBJrXQ_P0ond4PTukoya0FEjwoPuUb31iN3qwo8iyM1Q%40mail.gmail.com%3E) by TomNorden ### What type of PR is it? Improvement | Documentation ### Todos * [x] - Add `interpreter`, `credential` and `configuration` url to `conf/shiro.ini` * [x] - Update `shiroauthentication.md` for this change * [x] - Redirect to home with ngToast error message when status is `401` * [x] - Rebase after #1100 merged and add error message to `Credential` menu as well ### What is the Jira issue? [ZEPPELIN-987](https://issues.apache.org/jira/browse/ZEPPELIN-987) ### How should this be tested? 1. Apply this patch and restart Zeppelin 2. Login with `admin` and `password1` 3. Go to interpreter, credential and configuration tab -> You can see all of the information in each tabs 4. Logout -> Login again with `user1` and `password2` 5. Go to interpreter, credential and configuration tab -> In this time, you can't see all of the information in each tabs ### Screenshots (if appropriate) - When you login with `user1` (doesn't have permission to see the interpreter, credential and cofiguration info) - interpreter menu  - configuration menu  - credential menu  - `shiroauthentication.md` <img width="807" alt="screen shot 2016-06-10 at 12 25 02 pm" src="https://cloud.githubusercontent.com/assets/10060731/15976949/a49bc542-2f0a-11e6-8869-8575ba8f1875.png"> ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? Yes, so I updated. Author: AhyoungRyu <[email protected]> Closes #993 from AhyoungRyu/ZEPPELIN-987 and squashes the following commits: 1d291ac [AhyoungRyu] Redirect to home when unauthorized user click 'credentials' 5896c12 [AhyoungRyu] Revert shiro setting 4411188 [AhyoungRyu] Address @prabhjyotsingh feedback 5c9242c [AhyoungRyu] Redirect to home with error message when status is 401 2a054d4 [AhyoungRyu] Add interpreter, credential and configuration urls to shiro.ini d3a81d5 [AhyoungRyu] Update shiro authentication docs 8be7970 [AhyoungRyu] Change authcBasic -> authc
…nvironment ### What is this PR for? Zeppelin JDBC interpreter should work in a Kerberos environment ### What type of PR is it? [Bug Fix] ### Todos * [x] - Update doc ### What is the Jira issue? * [ZEPPELIN-1146](https://issues.apache.org/jira/browse/ZEPPELIN-1146) ### How should this be tested? In JDBC interpreter setting add following properties - zeppelin.jdbc.auth.type = KERBEROS - zeppelin.jdbc.principal = principal value - zeppelin.jdbc.keytab.location = keytab location Now try and run any of hive's query (say `show tables`) it should return with valid results. ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? yes Author: Prabhjyot Singh <[email protected]> Closes #1157 from prabhjyotsingh/ZEPPELIN-1146 and squashes the following commits: c4add61 [Prabhjyot Singh] make hadoop-common scope as provided f5fe7db [Prabhjyot Singh] correctin logger name class b11eef4 [Prabhjyot Singh] add doc for kerberos c36cd67 [Prabhjyot Singh] ZEPPELIN-1146 Zeppelin JDBC interpreter should work in a Kerberos environment
### What is this PR for? The Jquery-ui css file name changed between version and is now missing  ### What type of PR is it? Bug Fix ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1166 ### How should this be tested? You can run in a paragraph and click inside the input: ``` %angular <script> $( function() { $( "#datepicker" ).datepicker(); } ); </script> <p>Date: <input type="text" id="datepicker"></p> ``` ### Screenshots (if appropriate) Before:  After:  ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Damien CORNEAU <[email protected]> Closes #1177 from corneadoug/ZEPPELIN-1166 and squashes the following commits: c1291be [Damien CORNEAU] change the jquery-ui css file name
Enable Zeppelin to be built with both Scala 2.10 and Scala 2.11, mostly to start supporting interpreters that are moving to Scala 2.11 only such as Spark. Before testing this PR, one would need to [build Spark 1.6.1 for example with Scala 2.11](http://spark.apache.org/docs/latest/building-spark.html#building-for-scala-211) and [build Flink 1.0 with Scala 2.11](https://ci.apache.org/projects/flink/flink-docs-master/setup/building.html#scala-versions) Author: Luciano Resende <[email protected]> Author: Lee moon soo <[email protected]> Closes #747 from lresende/scala-210-211 and squashes the following commits: b9bdf86 [Luciano Resende] Properly invoke createTempDir from spark utils c208e69 [Luciano Resende] Fix class reference 87f46de [Luciano Resende] Force build 6e5e5ad [Luciano Resende] Refactor utility methods to helper class 4e2237a [Luciano Resende] Update readme to use profile to build scala 2.11 and match CI dd79443 [Luciano Resende] Minor formatting change to force build de4fc10 [Luciano Resende] Minor change to force build 9194218 [Lee moon soo] initialize imain cbf84c7 [Luciano Resende] Force Scala 2.11 profile to be called 98790a6 [Luciano Resende] Remove obsolete/commented config 6e4f7b0 [Luciano Resende] Force scala-library dependency version based on scala a3d0525 [Luciano Resende] Fix new code to support both scala versions e068593 [Luciano Resende] Fix pom.xml merge conflict 736d055 [Lee moon soo] make binary built with scala 2.11 work with spark_2.10 binary 74d8a62 [Luciano Resende] Force close 9f5d2a2 [Lee moon soo] Remove unused methods fc9e8a0 [Lee moon soo] Update ignite interpreter 6d3e7e2 [Lee moon soo] Update FlinkInterpreter 6b9ff1d [Lee moon soo] SparkContext sharing seems not working in scala 2.11, disable the test 9424769 [Lee moon soo] style 2ec51a3 [Lee moon soo] Fix reflection c999a2d [Lee moon soo] fix style dfe6e83 [Lee moon soo] Fix reflection around HttpServer and createTempDir 222e4e7 [Lee moon soo] Fix reflection on creating SparkCommandLine 112ae7d [Lee moon soo] Fix some reflections b9e0e1e [Lee moon soo] scala 2.11 support for spark interpreter c88348d [Lee moon soo] Initial scala-210, 211 support in the single binary 5c47d9a [Luciano Resende] [ZEPPELIN-605] Rewrite Spark interpreter based on Scala 2.11 support a73b68d [Luciano Resende] [ZEPPELIN-605] Enable Scala 2.11 REPL support for Spark Interpreter 175be7a [Luciano Resende] [ZEPPELIN-605] Add Scala 2.11 build profile 82eaefa [Luciano Resende] [ZEPPELIN-605] Add support for Scala 2.11
### What is this PR for? This PR applies the [new interpreter registration mechanism](https://issues.apache.org/jira/browse/ZEPPELIN-804) to Elasticsearch interpreter. ### What type of PR is it? Improvement ### Todos * [x] - Remove static property definition code lines in `ElasticsearchInterpreter.java` and create `interpreter-setting.json` under `elasticsearch/src/main/resources` * [ ] - fix CI build error ### What is the Jira issue? [ZEPPELIN-909](https://issues.apache.org/jira/browse/ZEPPELIN-909) ### How should this be tested? 1. apply this patch 2. rm -r `interpreter/elasticsearch` and rm `conf/interpreter.json` 3. build source 4. bin/zeppelin-daemon.sh start 5. Run a paragraph with elasticsearch commands ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: AhyoungRyu <[email protected]> Closes #1162 from AhyoungRyu/ZEPPELIN-909 and squashes the following commits: ca393f3 [AhyoungRyu] Address @bzz comment 331eae6 [AhyoungRyu] Fix CI build failure 76ac45d [AhyoungRyu] Remove static block f1c1156 [AhyoungRyu] Apply new mechanism to Elasticsearch interpreter
### What is this PR for? Add new interpreter to Python group: `%python.sql` for SQL over DataFrame support ### What type of PR is it? Improvement ### TODOs * [x] add new interpreter `%python.sql` * [x] add test * [x] make Python-dependant tests, excluded from CI * PythonInterpreterWithPythonInstalledTest * PythonPandasSqlInterpreterTest * run manually by `mvn -Dpython.test.exclude='' test -pl python -am` * [x] add docs `%python.sql` * [x] make `%python.sql` fail gracefully in case there is no Pandas or PandaSQL installed * [x] after #747 is merged - rebase and remove `-Dpython.test.exclude=''` from both profiles ### What is the Jira issue? [ZEPPELIN-1115](https://issues.apache.org/jira/browse/ZEPPELIN-1115) ### How should this be tested? `mvn -Dpython.test.exclude='' test -pl python -am` should pass or manually run - Given the DataFrame i.e ``` %python import pandas as pd rates = pd.read_csv("bank.csv", sep=";") ``` - SQL query it like ``` %python.sql SELECT * FROM rates LIMIT 10 ``` ### Screenshots (if appropriate)  ### Questions: * Does the licenses files need update? No, no dependencies were included in source or binary release * Is there breaking changes for older versions? No * Does this needs documentation? Yes Author: Alexander Bezzubov <[email protected]> Closes #1164 from bzz/ZEPPELIN-1115/python/add-sql-for-dataframes and squashes the following commits: 0f2f852 [Alexander Bezzubov] Fail SQL gracefully if no python dependencies installed aca2bdf [Alexander Bezzubov] Fix typos in docs ⚡ 158ba6a [Alexander Bezzubov] Remove third-party dependant test from CI 5fe46fc [Alexander Bezzubov] Update Python Matplotlib notebook example 72884c8 [Alexander Bezzubov] Add docs for %python.sql feature e931dc4 [Alexander Bezzubov] Make test for PythonPandasSqlInterpreter usable 76bbb44 [Alexander Bezzubov] Complete implementation of the PythonPandasSqlInterpreter f6ca1eb [Alexander Bezzubov] Add %python.sql to interpreter menue 11ba490 [Alexander Bezzubov] Add draft implementation of %python.sql for DataFrames
### What is this PR for? Supporting aliases for same interpreter group and enabling running two interpreters in same group. ### What type of PR is it? [Feature] ### Todos * [x] - Add InterpreterSettingRef * [x] - Add aliases feature ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-1012 ### How should this be tested? 1. Create spark2 interpreter in a interpreter tab 1. Add that interpreter in a notebook 1. run `%spark` and `%spark2` ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jongyoul Lee <[email protected]> Closes #1145 from jongyoul/ZEPPELIN-1012 and squashes the following commits: 4d38462 [Jongyoul Lee] Reverted modifier of CronJob back to public 2fab2f2 [Jongyoul Lee] Reverted default constructor 7f9f72d [Jongyoul Lee] Fixed the style 4dd8f6e [Jongyoul Lee] Reverted style into original to avoid checkstyle 5eff48f [Jongyoul Lee] Reverted style into original to avoid checkstyle 5e50864 [Jongyoul Lee] Reverted refName to group fac0b86 [Jongyoul Lee] Reformatted files related to this PR without test classes 5bb15a0 [Jongyoul Lee] Removed some console.log added for debugging 334634a [Jongyoul Lee] Fixed the description of parameter of add method ca20889 [Jongyoul Lee] Changed setting.group to setting.name Removed meaningless super constructor dde2232 [Jongyoul Lee] Added catching IOE from caller of createNewSetting cb7dde5 [Jongyoul Lee] Fixed wrong test to save to file after Zeppelin calls createNewSetting d59029b [Jongyoul Lee] Removed unused code Fixed the type of variables Adjusted diamond operator 9b05ca2 [Jongyoul Lee] Fixed some style e585791 [Jongyoul Lee] Fixed some style 634cc21 [Jongyoul Lee] Fixed usage of getGroup c100f76 [Jongyoul Lee] Removed deprecated method 240c8af [Jongyoul Lee] Removed debugging message 4ff493b [Jongyoul Lee] Fixed test case d5a4c44 [Jongyoul Lee] Refactored InterpreterSetting Changed menu for creating new InterpreterSetting 16b56c3 [Jongyoul Lee] Fixed broken tests for InterpreterRestApiTest fccdd9b [Jongyoul Lee] Fixed the style 5159a84 [Jongyoul Lee] Added feature for Interpreter aliases Extracted InterpreterInfo from InterpreterSetting c4b016e [Jongyoul Lee] Refactored getInterpreter method not to use RegisteredInterpreter
### What is this PR for? This is to cleanup some unused print methods from repository layer ### What type of PR is it? Maintenance | Cleanup ### Todos * [x] - remove unused methods ### What is the Jira issue? [#1174](https://issues.apache.org/jira/browse/ZEPPELIN-1174) ### How should this be tested? CI pass ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: Khalid Huseynov <[email protected]> Closes #1183 from khalidhuseynov/repo/clean-unused-methods and squashes the following commits: 0a4e615 [Khalid Huseynov] remove unused functions
### What is this PR for? Final version of the proxy setup paragraph on main README. Removed Bower note beacuse it works with the last checkout from master. See also #1069 and #876. ### What type of PR is it? Documentation ### Todos * [ ] - Task ### What is the Jira issue? * Open an issue on Jira https://issues.apache.org/jira/browse/ZEPPELIN/ * Put link here, and add [ZEPPELIN-*Jira number*] in PR title, eg. [ZEPPELIN-533] ### How should this be tested? Outline the steps to test the PR here. ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Final setup for building behind a proxy. Author: fvaleri <[email protected]> Closes #1114 from fvaleri/proxy-build and squashes the following commits: 53e299d [fvaleri] Removed Bower note. Final setup for building behind a proxy.
### What is this PR for? While investigating the original issue, I discovered that the `printMode.css` file was never used before. I changed it so it is taken into account when printing, and added some CSS to remove unnecessary components in the printing page. ### What type of PR is it? Bug Fix ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1059 ### How should this be tested? Try to print a Note with your web-browser and look at the preview. There shouldn't be the Zeppelin Navbar or a weird Title hiding the content. ### Screenshots (if appropriate) After this PR:  ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Damien CORNEAU <[email protected]> Closes #1180 from corneadoug/ZEPPELIN-1059 and squashes the following commits: 9f14a13 [Damien CORNEAU] modify a test name to fit better 9e81cb3 [Damien CORNEAU] fix the Selenium tests errors cbbbc26 [Damien CORNEAU] Apply print CSS file in production 39182b5 [Damien CORNEAU] remove a ng-if that wasnt necessary bb3542d [Damien CORNEAU] fix the print css
### What is this PR for? This PR fixes auto competion of HDFSFileInterpreter. ### What type of PR is it? Bug Fix ### How should this be tested? Please refer to test case. ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: astroshim <[email protected]> Closes #1141 from astroshim/bugfix/HDFSFileInterpreterCompletion and squashes the following commits: 81d4dee [astroshim] add space after , 9831e0b [astroshim] add testcase 7cc30c3 [astroshim] bugfix HDFSFileInterpreter completion
### What is this PR for? Unbinding interpreter from note throws NPE when paragraph repl is not set. ### What type of PR is it? Bug Fix ### What is the Jira issue? [ZEPPELIN-1186](https://issues.apache.org/jira/browse/ZEPPELIN-1186) ### How should this be tested? 1. Create notebook 2. type '%fake ' including space at the end 3. Unbind spark interpreter from note binding and hit save 4. Unbind all interpreter and hit save 5. See if you can save the interpreter bind without error ### Screenshots (if appropriate) **Before**  **After**  ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: Mina Lee <[email protected]> Closes #1191 from minahlee/ZEPPELIN-1186 and squashes the following commits: d65cd83 [Mina Lee] Prevent NPE when unbind interpreter
…`./grunt serve` is used ### What is this PR for? Creating this issue from [this](#1071 (comment)) comment, Application does not logout user when authcBasic is used and process was running with `grunt serve` ### What type of PR is it? [Bug Fix] ### What is the Jira issue? * [ZEPPELIN-1125](https://issues.apache.org/jira/browse/ZEPPELIN-1125) ### How should this be tested? Run web-app as `grunt serve` and configure shiro auth to use `authcBasic`, and then try to logout. ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: Prabhjyot Singh <[email protected]> Closes #1140 from prabhjyotsingh/ZEPPELIN-1125 and squashes the following commits: 04a2aff [Prabhjyot Singh] remove unrequired params from response, revert to post 986d549 [Prabhjyot Singh] Application does not logout user when authcBasic and running on a different host/port
…for CSRF protection ### What is this PR for? Add http header X-Requested-By in post request to Livy for CSRF protection ### What type of PR is it? Improvement ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1168 ### How should this be tested? enable csrf_protection on livy and check for "CSRF protection is enabled" message in the Livy logs. If this header is missing Livy server will send the following error message "Missing Required Header for CSRF protection." ### Questions: * Does the licenses files need update? n/a * Is there breaking changes for older versions? n/a * Does this needs documentation? n/a Author: Renjith Kamath <[email protected]> Closes #1181 from r-kamath/ZEPPELIN-1168 and squashes the following commits: 3bae7a5 [Renjith Kamath] ZEPPELIN-1168 Add http header X-Requested-By in post request to Livy Interpreter
### What is this PR for? Create static field logger in Paragraph instead of function to make the code style consistent. This is a trivial and straightforward change, so I didn't create jira for it. ### What type of PR is it? [Refactoring] Author: Jeff Zhang <[email protected]> Closes #1175 from zjffdu/logger and squashes the following commits: 21240ce [Jeff Zhang] remove unnecessary code b965253 [Jeff Zhang] use static field logger instead of function
### What is this PR for? This PR for redirecting to zeppelin home when requested wrong path. ### What type of PR is it? Improvement ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1176 ### How should this be tested? put wrong path to your browser like screenshot. ### Screenshots (if appropriate) - before  - after  ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: astroshim <[email protected]> Closes #1185 from astroshim/feat/redirectHome and squashes the following commits: d29519c [astroshim] remove # eae453f [astroshim] fix path c937b90 [astroshim] fix location.path 8db7017 [astroshim] redirect home when wrong path
### What is this PR for? Handsontable fails to display data on second run if first run did not render table due to an error in the query. Fix for a render issue caused by #1059 ### What type of PR is it? Bug Fix ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1170 ### How should this be tested? Please ref the screenshots ### Screenshots (if appropriate) **Before**  **After**  ### Questions: * Does the licenses files need update? n/a * Is there breaking changes for older versions? n/a * Does this needs documentation? n/a Author: Renjith Kamath <[email protected]> Closes #1182 from r-kamath/ZEPPELIN-1170 and squashes the following commits: 6f0f591 [Renjith Kamath] Merge remote-tracking branch 'upstream/master' into ZEPPELIN-1170 d63d517 [Renjith Kamath] ZEPPELIN-1170 Handsontable fails to display data on second run
### What is this PR for? There is a native service used across the app to take care of re-routing to different page: `$location`, however there has been a few times where `$window.location` is used instead, and people tend to do it in new PR too. This convert the `$window.location` from the code to use `$location`. Only one was kept in `app.controller.js` for Iframe, so it doesn't flicker. ### What type of PR is it? Refactoring ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1183 ### How should this be tested? You can try to reproduce the couple of cases that redirection is needed, but overall there shouldn't be any issue from that change. ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Damien CORNEAU <[email protected]> Closes #1188 from corneadoug/ZEPPELIN-1183 and squashes the following commits: 1bc5f3b [Damien CORNEAU] unify the paths 469f221 [Damien CORNEAU] Remove unused controller function parameters 60cd327 [Damien CORNEAU] Remove the window.location from the code, for
### What is this PR for? It had been pointed out in the mailing list that after #862, the execution time was changed to humanized fashion, while we would want to keep something more precise in that case. This PR is rolling back to the old precise time for execution time. ### What type of PR is it? Improvement ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1161 ### How should this be tested? Run a paragraph, after it is finished, it should show: `Took x seconds.` instead of `Took a few seconds` (or Hours, Minutes, Sec) ### Screenshot  ### Questions: * Does the licenses files need update? Yes * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Damien CORNEAU <[email protected]> Closes #1172 from corneadoug/ZEPPELIN-1161 and squashes the following commits: df752bd [Damien CORNEAU] Add licence of new dependency 2c21894 [Damien CORNEAU] Fix jscs errors 9f756e3 [Damien CORNEAU] add moment plugin for duration 935f348 [Damien CORNEAU] Fix jxcs e4f7625 [Damien CORNEAU] Revert seconds ago for execution time
### What is this PR for? This is a small refactoring PR for zeppelin-web. This is moving all the code's `$scope.$on` functions together at the end of each controller file. ### What type of PR is it? Refactoring ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1167 ### How should this be tested? No test is needed, the code was just moved around ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Damien CORNEAU <[email protected]> Closes #1178 from corneadoug/ZEPPELIN-1167 and squashes the following commits: a282dc5 [Damien CORNEAU] Fix indentation in result-list controller 7cd9146 [Damien CORNEAU] group .on functions at the end of the controllers
### What is this PR for? To correct typo found in documentation ### What type of PR is it? Documentation ### Todos * [x] - Replace sentence with incorrect english docs with correction. ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-1202 ### How should this be tested? Build docs and see correct docs on `https://zeppelin.apache.org/docs/latest/development/writingzeppelininterpreter.html` ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: Zak Hassan <[email protected]> Closes #1198 from zmhassan/ZEPPELIN-1202 and squashes the following commits: 5b3d708 [Zak Hassan] Making correction to Json snippet inside docs. f3e2150 [Zak Hassan] Corrected typo of interpreter-setting.json file should not be interpareter-setting.json 8d6e068 [Zak Hassan] Documentation typo creation.
### What is this PR for? This PR will fix [ZEPPELIN-1109](https://issues.apache.org/jira/browse/ZEPPELIN-1109). I'm not sure this approach can be the best way for fixing this issue since I would prefer to have the fade-in/out animation for bootstrap dialog. So if anyone has better idea for this, please let me know. ### What type of PR is it? Bug Fix ### What is the Jira issue? [ZEPPELIN-1109](https://issues.apache.org/jira/browse/ZEPPELIN-1109) ### How should this be tested? 1. Press `Enter` button right after clicking any bootstrap dialog (i.e. trash can icon in the notebook) -> Bootstrap dialog will be shown up multiple times 2. Apply this patch and [build `zeppelin-web`](https://github.com/apache/zeppelin/tree/master/zeppelin-web#configured-environment) 3. Try number 1 again -> you can see there is no fade animation so you don't have time interval to generate multi dialogs ### Screenshots (if appropriate) - Before  - After  ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: AhyoungRyu <[email protected]> Closes #1179 from AhyoungRyu/ZEPPELIN-1109 and squashes the following commits: 668fde0 [AhyoungRyu] Fix jscs checkstyle error 77c94ee [AhyoungRyu] Remove bootstrap dialog animation by default
### What is this PR for? RestTemplate throws HttpClientErrorException, exception thrown when an HTTP 4xx is received. http://docs.spring.io/spring/docs/current/javadoc-api/org/springframework/web/client/HttpClientErrorException.html ### What type of PR is it? [Bug Fix] ### What is the Jira issue? * [ZEPPELIN-1159](https://issues.apache.org/jira/browse/ZEPPELIN-1159) ### How should this be tested? Run a paragraph using livy interpreter (say sc.version), now let this session expire (or just restart livy server), then try running the same paragraph, this should result in proper error message. ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: Prabhjyot Singh <[email protected]> Closes #1184 from prabhjyotsingh/ZEPPELIN-1159 and squashes the following commits: 7c58e42 [Prabhjyot Singh] ZEPPELIN-1159 - catch RestTemplate exception
mfelgamal
pushed a commit
that referenced
this pull request
Aug 16, 2016
### What is this PR for? This is a small refactoring to keep this Controller following the [ControllerAs with vm](https://github.com/johnpapa/angular-styleguide/tree/master/a1#controlleras-with-vm) rules, that it was based on. Here is a list of things that were changed and why: * Most of the controller's $scope values & fct (except from the search q) where moved to the vm.The controller is using vm, so storing in $scope to share with the view is not needed. * Functions or Vars that are not used in the view were removed from the vm. (kept private to the controller) * $rootscope functions was moved to `app.js`. I think the need for that function might need to be changed, but for the scope of this PR, we are just moving it to where the $rootScope values are declared. * Gathering vm declaration before the functions and ordered alphabetically * Re-order functions alphabetically * Create `initController ` to regroup all the controller setup. ### What type of PR is it? Refactoring ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1290 ### How should this be tested? You can Just verify that the below Navbar related features are still good: * Search Form * Connected Status * Login button * User Name and its dropdown menu * Notebook list drop-down menu (and filer, folder inside of it) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Damien CORNEAU <[email protected]> Author: CORNEAU Damien <[email protected]> Author: Prabhjyot Singh <[email protected]> Closes apache#1281 from corneadoug/Refactor/navbarCtrl and squashes the following commits: 31f9110 [CORNEAU Damien] Merge pull request #4 from prabhjyotsingh/logoutUserFix 4686a18 [Prabhjyot Singh] CI failure for testGroupPermission 2fde749 [Damien CORNEAU] finish cleaning the controller be18547 [Damien CORNEAU] Remove functions from navbar controller
mfelgamal
added a commit
that referenced
this pull request
Aug 16, 2016
### What is this PR for? Adding extra libraries to livy interpreter which isn't exist by default. ### What type of PR is it? [ Improvement ] ### Todos * [Test case ] - Task ### What is the Jira issue? * [ZEPPELIN-1258] ### How should this be tested? - Create new livy interpreter or modify the default. - Set `livy.spark.jars.packages` to list of maven coordinates of jars. The format for the coordinates should be groupId:artifactId:version. ### Screenshots (if appropriate)   ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? yes Author: mahmoudelgamal <[email protected]> Author: mfelgamal <[email protected]> Author: Fouad <[email protected]> Closes apache#1255 from mfelgamal/feature/modifying-livy-doc and squashes the following commits: 5411a2f [mahmoudelgamal] changeing default to example d7f6818 [mahmoudelgamal] Adding livy.spark.jars.packages property 98090ab [mahmoudelgamal] Adding external libraries to livy 03a1e80 [mfelgamal] Merge pull request #4 from apache/master 2586651 [Fouad] Merge pull request #2 from apache/master
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
20 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What is this PR for?
A few sentences describing the overall goals of the pull request's commits.
First time? Check out the contributing guide - https://github.com/apache/incubator-zeppelin/blob/master/CONTRIBUTING.md
What type of PR is it?
[Bug Fix | Improvement | Feature | Documentation | Hot Fix | Refactoring]
Todos
What is the Jira issue?
How should this be tested?
Outline the steps to test the PR here.
Screenshots (if appropriate)
Questions: