大数据 IMF 传奇 spark -history在分布式 集群 的安装部署 及问题解决

配置Spark History Server   1. 在Spark的conf目录下/usr/local/spark-1.6.0-bin-hadoop2.6/conf，将spark-defaults.conf.template改名为spark-defaults.conf  mv spark-defaults.conf.template spark-defaults.conf      root@master:/usr/local/spark-1.6.0-bin-hadoop2.6/sbin# cd /usr/local/spark-1.6.0-bin-hadoop2.6/conf root@master:/usr/local/spark-1.6.0-bin-hadoop2.6/conf# mv spark-defaults.conf.template spark-defaults.conf  2. 对spark-defaults.conf 配置 spark.eventLog.enabled           true spark.eventLog.dir hdfs://master:9000/historyserverforSpark spark.history.ui.port            18080 spark.history.fs.logDirectory    hdfs://master:9000/historyserverforSpark 8.分发配置/usr/local/spark-1.6.0-bin-hadoop2.6/conf/spark-defaults.conf root@master:/usr/local/setup_scripts# vi sparkhistory_