Hello, everyone!
Following is the share about SmartDedupe and SmartCompression of Dorado V6.
SmartDedupe is data deduplication from Huawei. Deduplication deletes duplicate data in storage systems to save space. It searches for duplicate data blocks that usually exceed 4 KB and saves only one copy of these blocks in the storage system. Deduplication is widely used in network disks, emails, and backup media devices.
Type of Compression
• Inline compression: Data is compressed when being written to storage media.
• Post-process compression: Data is first written to storage media and then read for compression.
• Software compression: Uses the system CPU to perform a compression algorithm.
• Hardware compression: The compression algorithm logic is fixed to a hardware device, for example, the acceleration engine, FPGA, or ASIC of the Arm CPU. The compression API provided by the hardware device is invoked when the compression algorithm logic is used.
• Lossy compression: A compression mode in which original data cannot be completely restored after decompression. This mode is commonly used for audio, video, and image processing.
• Lossless compression: A compression mode in which original data can be completely restored after decompression.
Implementation of the Inline Deduplication
Implementation of Post-Process Similarity-based Deduplication
That's all, thanks!
