Got it

What is HDFS?

Created: Aug 27, 2019 13:40:49Latest reply: Feb 6, 2022 05:14:14 991 8 0 0 0
  Rewarded HiCoins: 0 (problem resolved)

Hello, team


What is HDFS?


I want get some information about it , can you help me ?

  • x
  • convention:

Featured Answers
stephen.xu
Admin Created Aug 27, 2019 13:56:27

Hello, Freaks!

HDFS means the Hadoop Distributed File System.

HDFS is mainly used to provide high throughput data access and is suitable for large-scale dataset.

HDFS consists of the active and standby NameNodes and multiple DataNodes.

The HDFS is a Master/Slave structure. The NameNode runs on the master, and the DataNode runs on each slave.
The communication between NameNode and DataNode is based on TCP/IP. Both NameNodes and DataNodes are designed to be deployed on servers running Linux.

What is HDFS?-3046517-1

The HDFS main working principles are as follows:

1. In the HDFS, a file is divided into one or more data blocks. The data blocks are stored in the DataNode collection. The NameNode is responsible for storing and managing all HDFS metadata.

2. The client connects to the NameNode and executes the namespace operation of the file system, for example, opening, closing, and renaming files and directories, and determines the mapping between data blocks and specific DataNodes.

3. The DataNode creates, deletes, and replicates data blocks under the command of the NameNode.

4. The client connects to the DataNode and reads and writes user data.

What is HDFS?-3046517-2

For details, you can refer here.

Have a nice day!
View more

This article contains more resources

You need to log in to download or view. No account? Register

x
  • x
  • convention:

user_4237671
user_4237671 Created Dec 20, 2021 22:40:57 (0) (0)
Great  
chantha
chantha Created Feb 15, 2022 01:37:31 (0) (0)
 
All Answers
stephen.xu
stephen.xu Admin Created Aug 27, 2019 13:56:27

Hello, Freaks!

HDFS means the Hadoop Distributed File System.

HDFS is mainly used to provide high throughput data access and is suitable for large-scale dataset.

HDFS consists of the active and standby NameNodes and multiple DataNodes.

The HDFS is a Master/Slave structure. The NameNode runs on the master, and the DataNode runs on each slave.
The communication between NameNode and DataNode is based on TCP/IP. Both NameNodes and DataNodes are designed to be deployed on servers running Linux.

What is HDFS?-3046517-1

The HDFS main working principles are as follows:

1. In the HDFS, a file is divided into one or more data blocks. The data blocks are stored in the DataNode collection. The NameNode is responsible for storing and managing all HDFS metadata.

2. The client connects to the NameNode and executes the namespace operation of the file system, for example, opening, closing, and renaming files and directories, and determines the mapping between data blocks and specific DataNodes.

3. The DataNode creates, deletes, and replicates data blocks under the command of the NameNode.

4. The client connects to the DataNode and reads and writes user data.

What is HDFS?-3046517-2

For details, you can refer here.

Have a nice day!
View more

This article contains more resources

You need to log in to download or view. No account? Register

x
  • x
  • convention:

user_4237671
user_4237671 Created Dec 20, 2021 22:40:57 (0) (0)
Great  
chantha
chantha Created Feb 15, 2022 01:37:31 (0) (0)
 
Werido
Werido Created Aug 30, 2019 12:13:23

It is useful to lear about HDFS.
View more
  • x
  • convention:

Navin_kay
Navin_kay Created Feb 15, 2022 01:38:32 (0) (0)
 
futurework
futurework Created Oct 10, 2021 19:24:11

good
View more
  • x
  • convention:

Sothea_nh
Sothea_nh Created Feb 15, 2022 01:39:09 (0) (0)
 
Saqibaz
Saqibaz Created Feb 6, 2022 05:14:14

Great share.
View more
  • x
  • convention:

Comment

You need to log in to comment to the post Login | Register
Comment

Notice: To protect the legitimate rights and interests of you, the community, and third parties, do not release content that may bring legal risks to all parties, including but are not limited to the following:
  • Politically sensitive content
  • Content concerning pornography, gambling, and drug abuse
  • Content that may disclose or infringe upon others ' commercial secrets, intellectual properties, including trade marks, copyrights, and patents, and personal privacy
Do not share your account and password with others. All operations performed using your account will be regarded as your own actions and all consequences arising therefrom will be borne by you. For details, see " User Agreement."

My Followers

Login and enjoy all the member benefits

Login

Block
Are you sure to block this user?
Users on your blacklist cannot comment on your post,cannot mention you, cannot send you private messages.
Reminder
Please bind your phone number to obtain invitation bonus.
Information Protection Guide
Thanks for using Huawei Enterprise Support Community! We will help you learn how we collect, use, store and share your personal information and the rights you have in accordance with Privacy Policy and User Agreement.