hadoop - HBase MasterProcWAL问题

Question

我注意到由于某些持续的错误，Hbase MasterProcWALs文件夹已填满我的Hdfs。我想知道是否删除MasterProcWALs文件夹下的文件会删除Hbase中的任何数据？

Answer 1

主节点使用MasterProcWAL，这是Apache HBase ™ Reference Guide给出的描述

HMaster records administrative operations and their running states, such as the handling of a crashed server, table creation, and other DDLs, into a Procedure Store. The Procedure Store WALs are stored under the MasterProcWALs directory. The Master WALs are not like RegionServer WALs. Keeping up the Master WAL allows us run a state machine that is resilient across Master failures. For example, if a HMaster was in the middle of creating a table encounters an issue and fails, the next active HMaster can take up where the previous left off and carry the operation to completion. Since hbase-2.0.0, a new AssignmentManager (A.K.A AMv2) was introduced and the HMaster handles region assignment operations, server crash processing, balancing, etc., all via AMv2 persisting all state and transitions into MasterProcWALs rather than up into ZooKeeper, as we do in hbase-1.x. This section pertains to hbase-2.0.0 through hbase-2.2.x.

因此，MasterProcWAL包含Active HBase Master在永久性存储上未应用的DDL过程。如果删除它们，然后重新启动HBase Master或切换到另一HBase Master，它将无法读取存储在这些WAL中的过程，并且它们将丢失。主机将以WAL之前的最后一个已知状态启动。数据在RegionServers级别进行管理，除非其结构受到WAL中存储的某些过程的影响而丢失，否则不应受到影响。
在那之前，我会

检查HBase UI的“Procedures”选项卡中发生的情况，它显示过程和WAL文件。尝试找出问题的根本原因，WAL文件的数量不应随时间增加。

尝试重新启动主服务器，检查其日志，因为它将在启动过程中读取MasterProcWAL文件。

仅在HBase Master启动过程中出现阻塞问题时才删除它们。如果您决定删除它们，请执行备份，请谨慎操作，后果自负。

另请参见 HBase Master won't start。