您当前的位置: 首页 > 

宝哥大数据

暂无认证

  • 1浏览

    0关注

    1029博文

    0收益

  • 0浏览

    0点赞

    0打赏

    0留言

私信
关注
热门博文

ExecutorAllocationManager

宝哥大数据 发布时间:2019-04-13 15:29:16 ,浏览量:1

1.1、和启动Executor分配管理器ExecutorAllocationManager
		//声明
		private var _executorAllocationManager: Option[ExecutorAllocationManager] = None

		
		//初始化
        // Optionally scale number of executors dynamically based on workload. Exposed for testing.
        val dynamicAllocationEnabled = Utils.isDynamicAllocationEnabled(_conf)
        _executorAllocationManager =
                if (dynamicAllocationEnabled) {
                    schedulerBackend match {
                        case b: ExecutorAllocationClient =>
                            Some(new ExecutorAllocationManager(
                                schedulerBackend.asInstanceOf[ExecutorAllocationClient], listenerBus, _conf))
                        case _ =>
                            None
                    }
                } else {
                    None
                }
		//启动
        _executorAllocationManager.foreach(_.start())
关注
打赏
1587549273
查看更多评论
立即登录/注册

微信扫码登录

0.0387s