How to specify Spark properties when starting Spark History Server? -
does know how set values in sparkconf
when starting spark history server?
if using <spark_home>/sbin/start-history-server.sh
cannot specify command line argument can specify spark_history_opts
environment variable , specify various environment variables like: -
export spark_history_opts="$spark_history_opts -dspark.history.ui.port=9000
but if using <spark_home>/sbin/start-daemon.sh
script can specify multiple command line options. this: -
<spark_home>/sbin/spark-daemon.sh start org.apache.spark.deploy.history.historyserver -dspark.history.ui.port=9000
Comments
Post a Comment