hadoop - HBase shell "OutOfOrderScannerNextException"扫描器和计数调用错误

Question

无论是我运行扫描命令还是计数，都会弹出此错误并且错误消息对我来说没有意义。它说什么以及如何解决它？

org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException: Expected nextCallSeq: 1 But the nextCallSeq got from client: 0; request=scanner_id: 788 number_of_rows: 100 close_scanner: false next_call_seq: 0

命令:

计数'表'，5000扫描 'table', {COLUMN => ['cf:cq'], FILTER => "ValueFilter( =, 'binaryprefix:somevalue')"}

编辑:

我在hbase-site.xml中添加了以下设置

<property>
    <name>hbase.rpc.timeout</name>
    <value>1200000</value>
  </property>
  <property>
    <name>hbase.client.scanner.caching</name>
    <value>100</value>
 </property>

没有影响

EDIT2:增加 sleep

                Result[] results = scanner.next(100);

                for (int i = 0; i < results.length; i++) {
                    result = results[i];
                    try {
                        ...
                        count++;
                        ...
                        Thread.sleep(10); // ADDED SLEEP
                    } catch (Throwable exception) {
                        System.out.println(exception.getMessage());

                        System.out.println("sleeping");
                    }
                }

Edit2 后的新错误:

org.apache.hadoop.hbase.client.ScannerTimeoutException: 101761ms passed since the last invocation, timeout is currently set to 60000
...


Caused by: org.apache.hadoop.hbase.UnknownScannerException: org.apache.hadoop.hbase.UnknownScannerException: Name: 31, already closed?
    ...

Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.UnknownScannerException): org.apache.hadoop.hbase.UnknownScannerException: Name: 31, already closed?
    ...

FINALLY BLOCK: 9900
Exception in thread "main" java.lang.RuntimeException: org.apache.hadoop.hbase.client.ScannerTimeoutException: 101766ms passed since the last invocation, timeout is currently set to 60000
    ...


Caused by: org.apache.hadoop.hbase.client.ScannerTimeoutException: 101766ms passed since the last invocation, timeout is currently set to 60000
    ...

Caused by: org.apache.hadoop.hbase.UnknownScannerException: org.apache.hadoop.hbase.UnknownScannerException: Name: 31, already closed?
    ...

Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.UnknownScannerException): org.apache.hadoop.hbase.UnknownScannerException: Name: 31, already closed?
    ...

Answer 1

编辑:通过使用与下载的 hbase 一起提供的相同客户端版本(不是 maven 0.99)，我能够解决这个问题。服务器版本是0.98.6.1在 ./lib 文件夹中包含客户端 jar

不要忘记附加 zookeeper 库

---

旧:

现在我做了两件事，更改了表连接 API (0.99)

                    Configuration conf = HBaseConfiguration.create();
                    TableName name = TableName.valueOf("TABLENAME"); 
                    Connection conn = ConnectionFactory.createConnection(conf);
                    Table table = conn.getTable(name);

然后当错误弹出时，我尝试重新创建连接

                    scanner.close();
                    conn.close();
                    conf.clear();
                    conf = HBaseConfiguration.create();
                    conn = ConnectionFactory.createConnection(conf);
                    table = conn.getTable(name);
                    table = ConnectionFactory.createConnection(conf).getTable(name);
                    scanner = table.getScanner(scan);

这可行，但在收到第一个错误后可能会变慢。扫描所有行非常慢