Got it

Discussion on mass data storage [Prize-awarding interaction Phase Ⅳ] Activity

Latest reply: Jul 7, 2020 22:50:17 2248 117 26 2

Discussion on mass data storage [Prize-awarding interaction Phase Ⅳ]

1

12

3

4

56

7

24

  • x
  • convention:

Admin Created Jun 17, 2020 06:15:51 Helpful(1) Helpful(1)

come in!
View more
  • x
  • convention:

MVE Created Jun 17, 2020 06:18:32 Helpful(0) Helpful(0)

Thanks for hosting this amazing activity!
View more
  • x
  • convention:

I%20would%20like%20to%20share%20with%20you%20my%20experience%2C%20I'm%20telecommunications%20engineer%2C%20currently%20senior%20project%20manager%20at%20an%20operator%2C%20partner%20of%20Huawei%2C%20in%20the%20radio%20access%20network%20department%2C%20for%2020%20years%20I%20managed%20several%20types%20of%20projects%2C%20for%20the%20different%20nodes%20of%20the%20network.%3Cbr%2F%3EAt%20the%20same%20time%2C%20I%20give%20courses%20in%20universities%20as%20a%20temporary%2C%20to%20bring%20the%20operational%20side%20of%20telecommunication%20technologies%20to%20students%2C%20for%20network%20supervision%20systems%2C%20mobile%20radio%20networks%20and%20access%20networks%20etc.
Admin Created Jun 17, 2020 06:43:56 Helpful(5) Helpful(5)

  • x
  • convention:

Unicef Created Jun 17, 2020 06:46:31
Thanks q!  
wissal Created Jun 17, 2020 08:30:17
Thanks for invitation my friend  
gabo.lr Created Jun 17, 2020 12:42:23
Thanks for the invite!  
BAZ
BAZ Created Jun 18, 2020 16:14:25
Thanks for sharing.. Sure. I will.  
Ddkompik Created Jun 22, 2020 15:20:32
Great Thanks for This!  
Created Jun 17, 2020 13:20:25 Helpful(0) Helpful(0)

Great
View more
  • x
  • convention:

Created Jun 17, 2020 15:07:12 Helpful(1) Helpful(1)

Good activity
View more
  • x
  • convention:

Created Jun 17, 2020 16:49:13 Helpful(0) Helpful(0)

Thanks
View more
  • x
  • convention:

Created Jun 17, 2020 16:50:16 Helpful(0) Helpful(0)

Thanks
View more
  • x
  • convention:

Created Jun 17, 2020 19:11:36 Helpful(5) Helpful(5)

Hi,

The amount of data generated daily by industries, large organizations and research institute is increasing at a very fast rate. These huge volumes of data need to be kept not just for analytic purposes, but also in compliance with laws and service level agreements to protect and preserve data. Storage and management are major concern in this era of big data. The ability for storage devices to scale to meet the rate of data growth, enhance access time and data transfer rate is equally challenging. These factors, to a considerable extent, determine the overall performance of data storage and management. Mass data storage requirements are complex and thus needs a holistic approach to mitigate its challenges.

Challenges of big data storage and management
1. Characteristics of Mass Data:
- Volume - Large data set from business, scientific research, government, and online social networking are
generated daily.
- Variety - All data generated are totally different.
- Velocity - Big data is characterized with velocity, which deals with the speed at which data is received and transmitted from various devices.
- Complexity - Data is complex and diverse in types and representation.

2. Data Backup and Archiving
Data backup plays an indispensable role in the computing system. Backup is one way to ensure data protection. By keeping copies of production data, backup protects data from potential loss such as hardware and software loss, human errors, and natural disasters. The deployment of backup systems can affect performance and availability of a system. Backup processes can compete with system processes for resources, such as disk input/output. The huge amount of data needing backup and archiving may consume much storage as well as making data backup inefficient.

3. Data Replication
A replica set is a group of instances that host the same data set. Replica sets provide redundancy and high availability, and are the basis for all production deployments. In mass data environment, because of the huge volumes of data, the aggressive copy coherence won’t be able to handle the load pressure.

4. Data Deduplication
Deduplication is being adopted almost everywhere to reduce cost and free storage space in data centres. This technology identifies data blocks with identical content and eliminates redundancy, and thus dramatically reduces the need to store or transfer data in the overall capacity. In attempt to achieve a high accuracy and high -precision matching, byte-level deduplication is introduced. It compares stream of data with stored data byte by byte which is not very scalable.

Big data era has brought about an explosive growth of data. The increase of mobile applications, social media, and big data analytic initiatives has caused big data storage challenges to become even greater. Choosing the right storage devices, management tool, and efficient techniques is relevant and determines the rate of growth. The approach to big data storage and management can significantly, affect an entire organization. Organizations and businesses are now more concerned about how to efficiently keep and retain all their data. Variables such as capacity, scalability, data transfer rate, access time, and cost of storage devices, are crucial for planning the best architecture that will meet current and future requirements.

More information could be found at:
https://www.researchgate.net/publication/298433319
View more
  • x
  • convention:

Created Jun 17, 2020 21:14:02 Helpful(5) Helpful(5)

Mass Data Storage 


  1. Introduction:

    Since the last decade, there has been a rapid growth in the use of the Internet, especially thanks to the development of terminals, daughter and wireless networks. More and more data is produced every day, but unfortunately, the growth in the production of these data is not in line with traditional storage techniques. It will be a question for us to be able to present the cloud mass data storage concept, more particularly the Cloud Oceanstor solution from Huawei, to share our experience with this solution and then highlight the challenges of the cloud in a general way and also in an African context.

    Cloud computing simply refers to the delivery of on-demand resources and services over the internet. It refers to the storage and access to data via the Internet rather than via the hard drive of a computer or any other means of storage. But with the large amount of data, simple Cloud services cannot work

this way, the biggest companies in the world today are investing in the mass data storage such as HUawei


   2. Huawei cloud mass storage solutions


    Huawei has announced the global launch of the next generation OceanStor Pacific mass storage system. This product line provides efficient, cost-effective and reliable services for AI, high performance computing (CHP), video and other big data scenarios by breaking the boundaries of architecture, services and performance , and taking advantage of uncompromising multiprotocol interworking, a new generation elastic EC algorithm and a range of dedicated hardware. This series marks a new standard for future-oriented mass data storage, helping businesses unleash the power of data in the age of intelligence.


   3. Why Huawei OceanStor pacific for mass storage?


    3 reasons to choose this solution: 

  • Efficiency:

    This series of products crosses the service frontier to implement uncompromising interworking of object, file and HDFS protocols, by addressing performance problems and semantic loss caused by traditional gateways. As part of autonomous driving R&D, a Huawei storage system streamlines data processing in different phases. Data does not need to be transferred between multiple storage systems, which improves service processing efficiency by 25 percent and reduces space by 20 percent. By pushing the boundaries of performance, the next generation file system supports bandwidth intensive and operations intensive applications, adapting to increasingly complex CHP loads.


  • Economic:

    This range of products crosses the architectural border with the innovative and very reliable vNode mode, as well as the new generation of elastic EC technology. It allows disk usage of up to 93 percent, more than 40 percent above the industry average, without compromising performance and reliability. Its all-new high-density, high-capacity node supports 120 disks in a space of just 5 U, with a density of 2.67 times that of versatile storage servers and a reduction in space of 62.5 percent.


  • Sustainability:

    This product range provides a four-level mechanism for data, devices, systems and solutions to ensure high reliability. Its comprehensive system for early detection and preprocessing of data makes it possible to identify the risks of error before it occurs. The OceanStor Pacific series uses inter-group and multi-asset three-site active-active data recording mechanisms for inter-regional data recording, providing 24/7 online banking image services , online videos and other production apps.


   4. Our experience with OceanStor Pacific 


    Regarding the African context, the amount of data produced is not yet very large compared to other countries this because of the instability of the internet connection and electrical energy. But nevertheless, our continent is starting to introduce cloud computing, even if it is not yet really the last series, Oceanstor Pacific.

    HUAWEI CLOUD now offers commercial services in South Africa and thus becomes the world's leading cloud service provider, with an operational data center in Africa, which currently supports twelve African countries.

Over the past six months, HUAWEI CLOUD users and partners have grown rapidly in Africa. Their clients include the main African companies, such as:

Kilimall, the local African electronic commerce platform that uses HUAWEI CLOUD to quickly adapt resources and easily add new services according to rapidly changing customer demands. One of the leading internet finance companies, Weshare, which benefits from a two-week service rollout that reduces latency to head office to less than 100 ms, allowing faster financial services to Kenya.

    We hope that over time, seminars can be organized in our countries to train us on this series and why not get training grants to facilitate the integration of these technologies in Africa.


    5. Challenges of mass storage


  • The first challenge is data security, our data is stored in different places and can be attacked

  • The cost, how can companies make this solution accessible so that everyone can access it, knowing the low capital of African companies. this cost also includes the amount of money to spend for these firms to deploy data centers

  • How are these companies going to manage energy deficits?



You can find more infos at: https://www.smartdatacollective.com/7-biggest-problems-data-storage-overcome/,

https://www.tuitec.com/huawei-cloud-se-devoile-afrique-sud-permettant-de-construire-afrique-entierement-connectee-dotee-de-produits-intelligents/

View more
  • x
  • convention:

Comment

Comment
You need to log in to comment to the post Login | Register

Notice Notice: To protect the legitimate rights and interests of you, the community, and third parties, do not release content that may bring legal risks to all parties, including but are not limited to the following:
  • Politically sensitive content
  • Content concerning pornography, gambling, and drug abuse
  • Content that may disclose or infringe upon others ' commercial secrets, intellectual properties, including trade marks, copyrights, and patents, and personal privacy
Do not share your account and password with others. All operations performed using your account will be regarded as your own actions and all consequences arising therefrom will be borne by you. For details, see " Privacy."
If the attachment button is not available, update the Adobe Flash Player to the latest version!

My Followers

Login and enjoy all the member benefits

Login

Huawei Enterprise Support Community
Huawei Enterprise Support Community
Block
Are you sure to block this user?
Users on your blacklist cannot comment on your post,cannot mention you, cannot send you private messages.