Offline Emergency Restoration Upon a Service Exception Caused by Metadata File Abnormalities

Fault handling

Rebuild the meta table using the HDFS data that maps to HBase in offline mode.

Solution

• Stop the HBase service.

http://10.88.69.41:7088/idp-edit-service/editor/image/11108756775/A-1_1_en-us_image_0180784983.jpg

• Enter the correct password as prompted.
• 
  

[root@10-10-10-11 client]# source bigdata_env  #Configure environment variables.  
[root@10-10-10-11 client]# kinit hbase         #Set kinit authentication.

  
Password for hbase@HADOOP.COM.

Example:

[root@10-10-10-11 client]# zkCli.sh -server 10.149.0.90:24002 #Enter  

Connecting to 10.149.0.90:24002
Welcome to ZooKeeper!
JLine support is enabled
[zk: 10.149.0.90:24002(CONNECTING) 0]
WATCHER::

WatchedEvent state:SyncConnected type:None path:null

WATCHER::

WatchedEvent state:SaslAuthenticated type:None path:null

[zk: 10.149.0.90:24002(CONNECTED) 0] ls /hbase
[acl, backup-masters, balancer, draining, flush-table-proc, hbaseid, master, meta-region-server, namespace, online-snapshot, recovering-regions, region-in-transition, replication, rs, running, splitWAL, table, table-lock, tokenauth]
[zk: 10.149.0.90:24002(CONNECTED) 1] deleteall /hbase/acl        #Delete

......
[zk: 10.149.0.90:24002(CONNECTED) 20] quit

http://10.88.194.32:7088/idp-edit-service/editor/image/11108756775/A-1_1_en-us_image_0180784984.png

• Start the HBase service.

http://10.88.194.32:7088/idp-edit-service/editor/image/11108756775/A-1_1_en-us_image_0180784986.jpg