基于以下的失败过程,我们修改了数据文件再测试了一次,将tab分割改成了逗号“,”,相应的程序里面也进行了修改String[] splited = data.split(",");,再次运行,测试ok
数据文件
[root@master IMFdatatest]#hadoop dfs -cat /library/dataForMutipleSorting.txt DEPRECATED: Use of this script to execute hdfs command is deprecated. Instead use the hdfs command for it.
16/02/27 04:01:55 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Spark,100 Hadoop,60 Kafka,95 Spark,99 Hadoop,65 Kafka,98 Spark,99 Hadoop,63 Kafka,97
[root@master IMFdatatest]#hadoop dfs -cat /library/outputdataForMutipleSorting8/part-r-00000 DEPRECATED: Use of this script to execute hdfs command is deprecated. Instead use the hdfs command for it.
16/02/27 04:04:11 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your pla