You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/interpreter/livy.md
+23Lines changed: 23 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -44,6 +44,26 @@ Additional requirements for the Livy interpreter are:
44
44
<td>1000</td>
45
45
<td>Max number of SparkSQL result to display.</td>
46
46
</tr>
47
+
<tr>
48
+
<td>spark.driver.cores</td>
49
+
<td>1</td>
50
+
<td>Driver cores. ex) 1, 2.</td>
51
+
</tr>
52
+
<tr>
53
+
<td>spark.driver.memory</td>
54
+
<td>512m</td>
55
+
<td>Driver memory. ex) 512m, 32g.</td>
56
+
</tr>
57
+
<tr>
58
+
<td>spark.executor.instances</td>
59
+
<td>3</td>
60
+
<td>Executor instances. ex) 1, 4.</td>
61
+
</tr>
62
+
<tr>
63
+
<td>spark.executor.cores</td>
64
+
<td>1</td>
65
+
<td>Max number of SparkSQL result to display.</td>
66
+
</tr>
47
67
</table>
48
68
49
69
@@ -105,3 +125,6 @@ The session would have timed out, you may need to restart the interpreter.
105
125
> Blacklisted configuration values in session config: spark.master
106
126
107
127
edit `conf/spark-blacklist.conf` file in livy server and comment out `#spark.master` line.
128
+
129
+
if you choose to work on livy https://github.com/cloudera/hue/tree/master/apps/spark/java,
130
+
copy `spark-user-configurable-options.template` to `spark-user-configurable-options.conf` file in livy server and comment out `#spark.master`
0 commit comments