Got it

Why Does deduplication and Compression Affect Performance?

Created: Aug 31, 2019 08:59:54Latest reply: Aug 31, 2019 10:03:24 564 2 0 0 0
  Rewarded HiCoins: 0 (problem resolved)

Why does deduplication and Compression have impact on Performance of storage?

Featured Answers
QiangSun
Created Aug 31, 2019 10:03:24

The impact of deduplication on performance is reflected in the I/O process. Compared with the non-deduplication process, the deduplication process has one more forwarding and metadata operations. Second, deduplication effectively reduces the number of disks (deduplication ratio is greater than 1:1). However, for deduplication data, the system compares the data word by byte to ensure that the data is duplicate, which brings extra KV core computing resource consumption. In addition, deduplication affects the volume of disks, which affects the garbage volume. Therefore, the impact on the recycling performance needs to be considered.
View more
  • x
  • convention:

All Answers
Hi!
The deduplication and compression feature (SmartDedupe&SmartCompression) consumes CPU resources during the process of deduplication and data compression. It is used to calculate fingerprint information, compression and decompression processing. Therefore, the more LUNs that are simultaneously deduplicated and compressed, the greater the impact on system performance.

It is recommended to enable the deduplication and compression function according to the actual service. For details OceanStor 5300 V3, 5500 V3, 5600 V3, 5800 V3, and 6800 V3 Storage System V300R003 SmartDedupe&SmartCompression Feature Guide for Block 10, see the chapter "Application Scenarios".
View more
  • x
  • convention:

The impact of deduplication on performance is reflected in the I/O process. Compared with the non-deduplication process, the deduplication process has one more forwarding and metadata operations. Second, deduplication effectively reduces the number of disks (deduplication ratio is greater than 1:1). However, for deduplication data, the system compares the data word by byte to ensure that the data is duplicate, which brings extra KV core computing resource consumption. In addition, deduplication affects the volume of disks, which affects the garbage volume. Therefore, the impact on the recycling performance needs to be considered.
View more
  • x
  • convention:

Comment

You need to log in to comment to the post Login | Register
Comment

Notice: To protect the legitimate rights and interests of you, the community, and third parties, do not release content that may bring legal risks to all parties, including but are not limited to the following:
  • Politically sensitive content
  • Content concerning pornography, gambling, and drug abuse
  • Content that may disclose or infringe upon others ' commercial secrets, intellectual properties, including trade marks, copyrights, and patents, and personal privacy
Do not share your account and password with others. All operations performed using your account will be regarded as your own actions and all consequences arising therefrom will be borne by you. For details, see " User Agreement."

My Followers

Login and enjoy all the member benefits

Login

Block
Are you sure to block this user?
Users on your blacklist cannot comment on your post,cannot mention you, cannot send you private messages.
Reminder
Please bind your phone number to obtain invitation bonus.