Got it

[FI Components] HMaster HA feature

Latest reply: Mar 11, 2022 09:34:04 1230 10 3 0 0

Hello all,

I want to talk about HMaster HA and the relationship HBase with other components. The HMaster in the HBase allocates regions; migrates corresponding meta from a failed regionserver to another regionserver. The HMaster HA feature is brought in to prevent HBase functions from being affected by the HMaster SPOF.

Implementation

Figure 1 HMaster HA architecture

HMaster HA architecture

The HMaster HA architecture is implemented by creating ephemeral zookeeper node in the ZooKeeper cluster.
Upon startup, two HMaster nodes try to create a master znode in the ZooKeeper cluster. The HMaster node that creates the master znode becomes the Active HMaster, and the other is the Standby HMaster which will add watch events to the master node.
If the active node fails, it disconnects from the ZooKeeper cluster. After the session expires, the master node disappears. The standby node detects the disappearance of the node through watch events and creates a master node to make itself be the Active Master. Then, the Active/Standby switchover completes. If the subsequently failed node detects existence of the master node after being restarted, it enters the Standby state and adds watch events to the master znode.
When the client accesses the HBase, it first obtains the HMaster's address based on the master node information on the Zookeeper and then establishes a connection to the active HMaster.

Relationship with Other Components

Relationship Between HDFS and HBase:

HDFS is the subproject of Apache Hadoop. HBase uses the Hadoop Distributed File System (HDFS) as the file storage system. HBase is located in structured storage layer. The HDFS provides highly reliable support for lower-layer storage of HBase. All the data files of HBase can be stored in the HDFS, except for some log files generated by HBase.


Relationship Between ZooKeeper and HBase:

Figure 2 describes the relationship between ZooKeeper and HBase.
Figure 2 Relationship between ZooKeeper and HBase

Relationship between ZooKeeper and HBase

1. HRegionServer registers itself to ZooKeeper in Ephemeral node. ZooKeeper stores the HBase information, including the HBase metadata and HBase address.
2. HMaster detects the health status of each HRegionServer using ZooKeeper and monitors them.
3. HBase can deploy multiple HMasters (like HDFS NameNode). When the active HMatser node is faulty, the standby HMaster node obtains the state information of the entire cluster using ZooKeeper, which means that HBase single point faults can be avoided using ZooKeeper.
This is what I want to share with you today, thank you!

The post is synchronized to: FusionInsight Components

  • x
  • convention:

olive.zhao
Admin Created Mar 11, 2022 09:34:04

Do you know how to solve the failed to active/standby switchover the HMasters issue?

Don't worry, the post will share with you.

Active/Standby Switchover of the HMasters Fails


View more
  • x
  • convention:

little_fish
little_fish Created Mar 11, 2022 09:57:32 (0) (0)
 
Geek69
Created Feb 6, 2020 02:10:44

Hi, thanks for sharing!
View more
  • x
  • convention:

GADS
Created Mar 4, 2020 18:37:46

Great, thanks.
View more
  • x
  • convention:

Angel1802
Created Mar 6, 2020 17:38:51

Pretty Nice.
View more
  • x
  • convention:

little_fish
Admin Created Mar 9, 2020 06:10:32

Posted by Geek69 at 2020-02-06 02:10 Hi, thanks for sharing!
Thanks
View more
  • x
  • convention:

little_fish
Admin Created Mar 9, 2020 06:10:41

Thanks
View more
  • x
  • convention:

little_fish
Admin Created Mar 9, 2020 06:10:54

Thanks
View more
  • x
  • convention:

Lucas_Zhao
Created Apr 17, 2020 00:40:31

good sharing
View more
  • x
  • convention:

little_fish
little_fish Created Aug 10, 2020 09:28:28 (0) (0)
good  
olive.zhao
Admin Created Mar 11, 2022 09:34:04

Do you know how to solve the failed to active/standby switchover the HMasters issue?

Don't worry, the post will share with you.

Active/Standby Switchover of the HMasters Fails


View more
  • x
  • convention:

little_fish
little_fish Created Mar 11, 2022 09:57:32 (0) (0)
 

Comment

You need to log in to comment to the post Login | Register
Comment

Notice: To protect the legitimate rights and interests of you, the community, and third parties, do not release content that may bring legal risks to all parties, including but are not limited to the following:
  • Politically sensitive content
  • Content concerning pornography, gambling, and drug abuse
  • Content that may disclose or infringe upon others ' commercial secrets, intellectual properties, including trade marks, copyrights, and patents, and personal privacy
Do not share your account and password with others. All operations performed using your account will be regarded as your own actions and all consequences arising therefrom will be borne by you. For details, see " User Agreement."

My Followers

Login and enjoy all the member benefits

Login

Block
Are you sure to block this user?
Users on your blacklist cannot comment on your post,cannot mention you, cannot send you private messages.
Reminder
Please bind your phone number to obtain invitation bonus.
Information Protection Guide
Thanks for using Huawei Enterprise Support Community! We will help you learn how we collect, use, store and share your personal information and the rights you have in accordance with Privacy Policy and User Agreement.