您当前的位置: 首页 >  ar

宝哥大数据

暂无认证

  • 1浏览

    0关注

    1029博文

    0收益

  • 0浏览

    0点赞

    0打赏

    0留言

私信
关注
热门博文

spark入hbase版本问题(未解决)

宝哥大数据 发布时间:2019-03-23 00:45:59 ,浏览量:1

集群 spark-2.3.2, hbase-2.0.2

Exception in thread "main" java.lang.NullPointerException
	at org.apache.hadoop.hbase.security.UserProvider.instantiate(UserProvider.java:122)
	at org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:214)
	at org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:119)
	at org.apache.hadoop.hbase.mapreduce.TableOutputFormat.checkOutputSpecs(TableOutputFormat.java:177)
	at org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1.apply$mcV$sp(PairRDDFunctions.scala:1099)
	at org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1.apply(PairRDDFunctions.scala:1085)
	at org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1.apply(PairRDDFunctions.scala:1085)
	at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
	at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:112)
	at org.apache.spark.rdd.RDD.withScope(RDD.scala:362)
	at org.apache.spark.rdd.PairRDDFunctions.saveAsNewAPIHadoopDataset(PairRDDFunctions.scala:1085)
	at com.niu.utils.SparkUtil$.write2Hbase(SparkUtil.scala:88)
	at com.niu.spark.mileage.info.CommonStats.dealInfoMessager(CommonStats.scala:132)
	at com.niu.spark.mileage.info.V12.run(V12.scala:38)
	at com.niu.spark.mileage.info.V12$.main(V12.scala:46)
	at com.niu.spark.mileage.info.V12.main(V12.scala)
暂时 pom.xml中将hbase 降低为1.1.2, 还未找到问题
关注
打赏
1587549273
查看更多评论
立即登录/注册

微信扫码登录

0.0391s