配置Spark History Server 1. 在Spark的conf目录下/usr/local/spark-1.6.0-bin-hadoop2.6/conf,将spark-defaults.conf.template改名为spark-defaults.conf mv spark-defaults.conf.template spark-defaults.conf 2. 对spark-defaults.conf 配置 spark.eventLog.enabled true spark.eventLog.dir hdfs://Master:9000/historyserverforSpark spark.history.ui.port 18080 spark.history.fs.logDirectory hdfs://Master:9000/historyserverforSpark
3.启动history-server [root@master sbin]# ./start-history-server.sh
4.成功 [root@master sbin]# jps 2691 DataNode 3459 Master 5444 HistoryServer 2836 SecondaryNameNode 2600 NameNode 3512 Worker 5641 Jps [root@master sbin]#
5.在web浏览器中查看http://192.168.2.100:18080/ 显示页面
1.6.0 History Server
Event log direct