Got it

Data redundancy protection Huawei FusionStorage HDFS Big Data Storage

Created: Dec 2, 2021 13:35:48Latest reply: Dec 10, 2021 12:18:48 429 6 4 0 0
  Rewarded HiCoins: 0 (problem resolved)

What data redundancy protection is being supported by Huawei FusionStorage HDFS Big Data Storage?


@feifei_xin


  • x
  • convention:

Featured Answers
faysalji
Author Created Dec 2, 2021 15:28:50

Yes, its Erasure Coding (EC). It is a method of data protection in which data is broken into fragments, expanded and encoded with redundant data pieces and stored across a set of different locations or storage media.

Erasure coding works by splitting a unit of data, such as a file or object, into multiple fragments (data blocks) and then creating additional fragments (parity blocks) that can be used for data recovery. For each parity fragment, the EC algorithm calculates the parity's value based on the original data fragments. The data and parity fragments are stored across multiple drives to protect against data loss in case a drive fails or data becomes corrupted on one of the drives. If such an event occurs, the parity fragments can be used to rebuild the data unit without experiencing data loss.

EC Supports N + M redundancy protection.

For example, a storage system might use a 5+2 encoding configuration to distribute data across multiple physical drives. In this configuration, the EC algorithm breaks each data unit into five data fragments and then adds two parity fragments, which are calculated from the original data. Each fragment is stored on a different physical drive. As a result, the storage system must include at least seven drives.
View more
  • x
  • convention:

SamB
SamB Created Dec 3, 2021 16:41:24 (0) (0)
Thanks for detailed input  
All Answers
little_fish
little_fish Admin Created Dec 2, 2021 13:36:54

Dear, he is working on this.
View more
  • x
  • convention:

feifei_xin
feifei_xin Created Dec 2, 2021 13:43:23

hi, it's using EC algorithm, for more detail can check with the product document. thanks
View more
  • x
  • convention:

SamB
SamB Created Dec 3, 2021 16:40:58 (0) (0)
Thanks  
faysalji
faysalji Author Created Dec 2, 2021 15:28:50

Yes, its Erasure Coding (EC). It is a method of data protection in which data is broken into fragments, expanded and encoded with redundant data pieces and stored across a set of different locations or storage media.

Erasure coding works by splitting a unit of data, such as a file or object, into multiple fragments (data blocks) and then creating additional fragments (parity blocks) that can be used for data recovery. For each parity fragment, the EC algorithm calculates the parity's value based on the original data fragments. The data and parity fragments are stored across multiple drives to protect against data loss in case a drive fails or data becomes corrupted on one of the drives. If such an event occurs, the parity fragments can be used to rebuild the data unit without experiencing data loss.

EC Supports N + M redundancy protection.

For example, a storage system might use a 5+2 encoding configuration to distribute data across multiple physical drives. In this configuration, the EC algorithm breaks each data unit into five data fragments and then adds two parity fragments, which are calculated from the original data. Each fragment is stored on a different physical drive. As a result, the storage system must include at least seven drives.
View more
  • x
  • convention:

SamB
SamB Created Dec 3, 2021 16:41:24 (0) (0)
Thanks for detailed input  
Unicef
Unicef MVE Created Dec 10, 2021 12:18:48

Cool answer
View more
  • x
  • convention:

Comment

You need to log in to comment to the post Login | Register
Comment

Notice: To protect the legitimate rights and interests of you, the community, and third parties, do not release content that may bring legal risks to all parties, including but are not limited to the following:
  • Politically sensitive content
  • Content concerning pornography, gambling, and drug abuse
  • Content that may disclose or infringe upon others ' commercial secrets, intellectual properties, including trade marks, copyrights, and patents, and personal privacy
Do not share your account and password with others. All operations performed using your account will be regarded as your own actions and all consequences arising therefrom will be borne by you. For details, see " User Agreement."

My Followers

Login and enjoy all the member benefits

Login

Block
Are you sure to block this user?
Users on your blacklist cannot comment on your post,cannot mention you, cannot send you private messages.
Reminder
Please bind your phone number to obtain invitation bonus.
Information Protection Guide
Thanks for using Huawei Enterprise Support Community! We will help you learn how we collect, use, store and share your personal information and the rights you have in accordance with Privacy Policy and User Agreement.