一、RDD转换及DAG构建
1.1、以textFile为例
- 广播hadoop configuration, 通过BroadcastManager
- 定义偏函数(jobConf: JobConf) => FileInputFormat.setInputPaths(jobConf, path), 用于以后构件输入路径
- 构建hadoopRDD
- 调用map(), 将hadoopRDD映射为MappedRDD