gpt4 book ai didi

java - Hbase批量加载异常(HFile版)

转载 作者:行者123 更新时间:2023-11-30 11:14:29 24 4
gpt4 key购买 nike

我正在将数据从 HDFS 加载到 HBase。

 FileOutputFormat.setOutputPath(job, output);

HTable table = new HTable(conf, tableName);
HFileOutputFormat.configureIncrementalLoad(job, table);
.......
LoadIncrementalHFiles loader = new LoadIncrementalHFiles(config);
loader.doBulkLoad(new Path(inPath), hTable);

异常(exception)情况:

Caused by: java.lang.IllegalArgumentException: Invalid HFile version: 2099722 (expected to be between 2 and 3)
at org.apache.hadoop.hbase.io.hfile.HFile.checkFormatVersion(HFile.java:888)
at org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.readFromStream(FixedFileTrailer.java:402)
at org.apache.hadoop.hbase.io.hfile.HFile.pickReaderVersion(HFile.java:537)

Exception in thread "main" org.apache.hadoop.hbase.io.hfile.CorruptHFileException: Problem reading HFile Trailer from file hdfs:...
at org.apache.hadoop.hbase.io.hfile.HFile.pickReaderVersion(HFile.java:552)
at org.apache.hadoop.hbase.io.hfile.HFile.createReader(HFile.java:595)

你能给些建议吗?

提前致谢!

最佳答案

你试过运行吗:

hbase org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles pathToHFiles tableName

关于java - Hbase批量加载异常(HFile版),我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/25892531/

24 4 0
Copyright 2021 - 2024 cfsdn All Rights Reserved 蜀ICP备2022000587号
广告合作:1813099741@qq.com 6ren.com