Got it

Huawei Enterprise Support Community

[FI Components] Relationship of SmallFS with other components

Created: Aug 24, 2020 13:00:12Latest reply: Nov 24, 2021 05:21:49 2330 12 12 0 1

Hello all,

In this post, I will tell you about the relationship between HDFS/YARN/ZooKeeper.

Relationship between SmallFS and HDFS

As a file system constructed at the upper layer of HDFS, SmallFS can merge small files on HDFS to reduce the impact of excessive small files on HDFS and provide customers with a transparent small file operation interface.

Numerous small files on HDFS are merged as input of SmallFS into large files, which are then output to HDFS.

Relationship between SmallFS and YARN

SmallFS will periodically run merge, delete, and cleanup tasks. Suck tasks are MapReduce tasks running on YARN to merge, delete, and clean up data in the HDFS.

Relationship between SmallFS and ZooKeeper

FGCService is deployed in high availability (HA) mode. The HA mode is used to ensure service availability when a single-node fault occurs. FGCService depends on ZooKeeper to support the HA mode.

Figure 1 Relationship between ZooKeeper and ZooKeeper

Relationship between ZooKeeper and ZooKeeper

That is all for today, thanks.

The post is synchronized to: FusionInsight Components

x
convention：
Emotion(0)

Like (12) Dislike (0) Favorite(1) Report

 Previous: This section describes the FusionInsight components

Next: Cloud Computing



(1) (0)

^2#

Unicef

MVE Created Aug 24, 2020 14:39:47

Nice one

x
convention：

little_fish Created Aug 25, 2020 01:14:39 (0) (0)

(1) (0)

^3#

JOSEFRR

Created Aug 25, 2020 02:27:46

Awesome

x
convention：

(1) (0)

^4#

wissal

MVE Created Aug 25, 2020 04:26:14

Very important knowledge, learned

x
convention：

(1) (0)

^5#

VinceD

Created Oct 1, 2020 16:40:25

interesting

x
convention：

(1) (0)

^6#

VinceD

Created Jun 26, 2021 16:14:36

interesting content.

x
convention：

(1) (0)

^7#

manpham

Created Nov 1, 2021 09:18:34

Thanks for sharing

x
convention：

(1) (0)

^8#

kita

Created Nov 5, 2021 02:44:27

Nice one

x
convention：

(1) (0)

^9#

bobi

Created Nov 6, 2021 13:24:40

Thanks for sharing

x
convention：

(1) (0)

^10#

user_4001805

Created Nov 7, 2021 04:20:42

Thanks for sharing

x
convention：

Comment

Notice: To protect the legitimate rights and interests of you, the community, and third parties, do not release content that may bring legal risks to all parties, including but are not limited to the following:

Politically sensitive content
Content concerning pornography, gambling, and drug abuse
Content that may disclose or infringe upon others ' commercial secrets, intellectual properties, including trade marks, copyrights, and patents, and personal privacy

Do not share your account and password with others. All operations performed using your account will be regarded as your own actions and all consequences arising therefrom will be borne by you. For details, see " User Agreement."

My Followers

Are you sure to block this user?
Users on your blacklist cannot comment on your post,cannot mention you, cannot send you private messages.

Please bind your phone number to obtain invitation bonus.

Enterprise

Consumer

Corporate

Carriers

[FI Components] Relationship of SmallFS with other components

Relationship between SmallFS and HDFS

Relationship between SmallFS and YARN

Relationship between SmallFS and ZooKeeper

Third Party’s Trade Secret

My Followers

FusionInsight Components