Got it

[FI Components] Relationship of SmallFS with other components

Latest reply: Nov 24, 2021 05:21:49 2466 12 12 0 1

Hello all,

In this post, I will tell you about the relationship between HDFS/YARN/ZooKeeper.


Relationship between SmallFS and HDFS

As a file system constructed at the upper layer of HDFS, SmallFS can merge small files on HDFS to reduce the impact of excessive small files on HDFS and provide customers with a transparent small file operation interface.


Numerous small files on HDFS are merged as input of SmallFS into large files, which are then output to HDFS.


Relationship between SmallFS and YARN

SmallFS will periodically run merge, delete, and cleanup tasks. Suck tasks are MapReduce tasks running on YARN to merge, delete, and clean up data in the HDFS.


Relationship between SmallFS and ZooKeeper

FGCService is deployed in high availability (HA) mode. The HA mode is used to ensure service availability when a single-node fault occurs. FGCService depends on ZooKeeper to support the HA mode.


Figure 1 Relationship between ZooKeeper and ZooKeeper

Relationship between ZooKeeper and ZooKeeper

That is all for today, thanks.



The post is synchronized to: FusionInsight Components

  • x
  • convention:

Unicef
MVE Created Aug 24, 2020 14:39:47

Nice one
View more
  • x
  • convention:

little_fish
little_fish Created Aug 25, 2020 01:14:39 (0) (0)
 
JOSEFRR
Created Aug 25, 2020 02:27:46

Awesome
View more
  • x
  • convention:

wissal
MVE Created Aug 25, 2020 04:26:14

Very important knowledge, learned
View more
  • x
  • convention:

VinceD
Moderator Created Oct 1, 2020 16:40:25

interesting
View more
  • x
  • convention:

VinceD
Moderator Created Jun 26, 2021 16:14:36

interesting content.
View more
  • x
  • convention:

manpham
Created Nov 1, 2021 09:18:34

Thanks for sharing
View more
  • x
  • convention:

kita
Created Nov 5, 2021 02:44:27

Nice one
View more
  • x
  • convention:

bobi
Created Nov 6, 2021 13:24:40

Thanks for sharing
View more
  • x
  • convention:

user_4001805
Created Nov 7, 2021 04:20:42

Thanks for sharing
View more
  • x
  • convention:

12
Back to list

Comment

You need to log in to comment to the post Login | Register
Comment

Notice: To protect the legitimate rights and interests of you, the community, and third parties, do not release content that may bring legal risks to all parties, including but are not limited to the following:
  • Politically sensitive content
  • Content concerning pornography, gambling, and drug abuse
  • Content that may disclose or infringe upon others ' commercial secrets, intellectual properties, including trade marks, copyrights, and patents, and personal privacy
Do not share your account and password with others. All operations performed using your account will be regarded as your own actions and all consequences arising therefrom will be borne by you. For details, see " User Agreement."

My Followers

Login and enjoy all the member benefits

Login

Block
Are you sure to block this user?
Users on your blacklist cannot comment on your post,cannot mention you, cannot send you private messages.
Reminder
Please bind your phone number to obtain invitation bonus.
Information Protection Guide
Thanks for using Huawei Enterprise Support Community! We will help you learn how we collect, use, store and share your personal information and the rights you have in accordance with Privacy Policy and User Agreement.