Got it

Exploring The Frontiers of Cloud Native

Latest reply: Aug 6, 2022 03:23:42 303 42 18 0 15

Exploring The Frontiers of Cloud Native

Towards “Distributed Cloud Native”

I remember in the early days of Cloud Native.

There were a number of big debates over schedulers and distributed computing versus cloud native computing for managing cloud workloads.

On the one hand, there were many schedulers from the distributed computing and batch scheduling realm, such as Yarn, HTCondor, and Grid Engine, that were increasingly managing cloud workloads. On the other hand, there were the new “cloud native” schedulers such as Kubernetes, Docker Swarm, and Marathon, that claimed to be better for orchestrating cloud-native technologies like containers.

Of course, we know that over time, Cloud Native scheduling — and in particular, Kubernetes — became the dominant approach for scheduling cloud workloads. However, just because Kubernetes and Cloud Native “won,” that doesn’t mean that distributed computing requirements went away. It just fragmented the market so that many distributed computing workloads could not run as cloud native workloads because they depended on features that Kubernetes couldn’t readily address such as complex scheduling, extreme scale, and batch processing.

For many years, this was not a major issue. However, the relatively recent rise of large-scale, intensive workloads, such as machine learning in the cloud, requires a coming together of the previously distinct realms of distributed processing and cloud-native processing.

At Huawei, we have been working on this problem for a number of years now, all with the aim towards providing a merged set of capabilities we call Distributed Cloud Native. Distributed Cloud Native brings the advanced scheduling capabilities from distributed computing into the realm of Kubernetes and cloud native computing.

cloud native

As a result, we have been able to push cloud native computing into new frontiers, spanning physically extreme industries to extreme scale to multiple clouds to new communities.

New boundaries: Physically extreme industries to Cloud Native

We contributed the open source project, KubeEdge, to the Cloud Native Computing Foundation (CNCF). KubeEdge has since grown into a tremendously successful project, enabling Kubernetes to deploy into many physically extreme environments at the edge, away from cloud data centers.

For example, with KubeEdge and Kubernetes, we have:

  • Deployed Kubernetes in space satellites, managing the open source MindSpore AI framework to perform orbit-earth coordinated image inference, incremental deep learning, and federated learning in space.

  • Brought distributed cloud native scheduling into offshore oilfields. Oil drilling requires tremendous distributed data analysis to find the right drilling sites in extreme environments, like oceans, that are far from cloud data centers and reliable network connectivity.

  • Created cloud-native Internet of Vehicle (IoV) deployments by deploying Kubernetes in automobiles. These vehicles have to deal with unreliable connections and constantly changing environments at high speeds while communicating with each other as well as managing containerized services within the cars, such as smart-cabin or autonomous driving features. Today, more than 200,000 vehicles a year ship with Kubernetes and KubeEdge inside of them. And, we are able to manage clusters of 100,000 vehicles at a time.

Cloud Native

Distributed Cloud Native Computing at extreme edge environments with Kubernetes and KubeEdge has been one of the major developments that Huawei has contributed to open source.

New Breadth: Scalability breakthroughs for Cloud Native

Data-intensive workloads such as machine learning require bringing distributed computing features, like advanced scheduling, extreme scale, and batch processing, into cloud-native computing. To facilitate this, Huawei has contributed the Volcano open source project to CNCF.

Volcano provides Kubernetes with many advanced distributed computing features. As a result, Kubernetes with Volcano can handle both cloud-native workloads and AI or big data workloads at large scale. For example, with Volcano, we have enabled Kubernetes to scale to 1 million pods, increased throughput by 1,000%, and improved utilization by 60%. These massive improvements enable Kubernetes to scale to the needs of large distributed computing workloads such as machine learning.

Cloud Native

Ubiquitous: 1st CNCF project for multi-cloud Kubernetes

Most enterprise companies have a strategy to become multi-cloud, and Kubernetes is typically key to this strategy because it provides a common platform for building cloud-native applications. However, Kubernetes has a limitation in that it cannot really handle scheduling applications that span more than one cloud or cluster. There are a variety of solutions in the market to address this limitation, but they are mainly single-vendor solutions that lock you into a proprietary approach.

To enable open, multi-cloud Kubernetes, Huawei has contributed Karmada to CNCF. Karmada is the first CNCF project to facilitate cross-cloud, cross-cluster Kubernetes scheduling. Because Karmada is hosted at CNCF, it is a truly open solution, not tying you to a particular vendor for multi-cloud. Furthermore, Karmada greatly simplifies becoming multi-cloud by keeping the same APIs as Kubernetes, providing unified network management, and including many advanced scheduling capabilities that are immediately ready to use.

Cloud Native

With Karmada, Kubernetes takes a giant step forwards towards enabling multi-cloud applications in a completely open way.

New and expanding community

Perhaps even more important than pushing the technology boundaries of cloud-native computing, Huawei has been focused on expanding the frontiers of the cloud native community. For example:

  • The growing end-user member community within CNCF is one of the strengths of the overall cloud-native ecosystem. However, cloud-native adoption in China lags behind many other parts of the world, and there are far fewer end-user members in CNCF from China than from other countries. To help grow the number of cloud-native end users in China, we have partnered with CNCF and CAICT to create a Cloud Native Elite Club. This provides a forum where many executives across different companies can come together to learn and share from each other best practices and benefits for moving towards cloud native. We now have more than 100 CXOs participating in the Cloud Native Elite Club.

In addition to the Cloud Native Elite Club, Huawei has helped to organize over 30 KCD days and Cloud Native Days events in China, reaching over 100,000 developers

  • We have been working to grow the number of women in the CNCF community, supporting not only CNCF’s goals around diversity but also the overall health of the CNCF community and new opportunities for women in technology. We are pleased that we have been able to support 120 women to join the cloud native community.

Cloud Native

Cloud native computing has come a long way since the early debates about schedulers and is now one of the most important technologies for building services and applications. We are excited to continue to push the boundaries of cloud native technologies and the community to see where they take us next!


Thanks for reading this post


Reference:

Exploring The Frontiers of Cloud Native – Huawei BLOG

  • x
  • convention:

Murtaza520
Created 3 days ago

Great post
View more
  • x
  • convention:

Usama0310
Usama0310 Created 2 days 03:58 (0) (0)
 
Murtaza520
Created 3 days ago

helpful
View more
  • x
  • convention:

Usama0310
Usama0310 Created 2 days 03:58 (0) (0)
 
Shaheer7777
Created 3 days ago

helpful
View more
  • x
  • convention:

Usama0310
Usama0310 Created 2 days 03:58 (0) (0)
 
UsmanJokhio520
Created 3 days ago

helpful
View more
  • x
  • convention:

Usama0310
Usama0310 Created 2 days 03:58 (0) (0)
 
Thor23
Created 3 days ago

helpful
View more
  • x
  • convention:

Usama0310
Usama0310 Created 2 days 03:59 (0) (0)
 
user_4801571
Created 3 days ago

helpful
View more
  • x
  • convention:

Usama0310
Usama0310 Created 2 days 03:59 (0) (0)
 
user_4801581
Created 3 days ago

helpful
View more
  • x
  • convention:

Usama0310
Usama0310 Created 2 days 03:59 (0) (0)
 
user_4801581
Created 3 days ago

good share
View more
  • x
  • convention:

Usama0310
Usama0310 Created 2 days 03:59 (0) (0)
 
user_4803089
Created 3 days ago

good to read it
View more
  • x
  • convention:

Usama0310
Usama0310 Created 2 days 03:59 (0) (0)
 
123
Back to list

Comment

You need to log in to comment to the post Login | Register
Comment

Notice: To protect the legitimate rights and interests of you, the community, and third parties, do not release content that may bring legal risks to all parties, including but are not limited to the following:
  • Politically sensitive content
  • Content concerning pornography, gambling, and drug abuse
  • Content that may disclose or infringe upon others ' commercial secrets, intellectual properties, including trade marks, copyrights, and patents, and personal privacy
Do not share your account and password with others. All operations performed using your account will be regarded as your own actions and all consequences arising therefrom will be borne by you. For details, see " User Agreement."

My Followers

Login and enjoy all the member benefits

Login

Block
Are you sure to block this user?
Users on your blacklist cannot comment on your post,cannot mention you, cannot send you private messages.
Reminder
Please bind your phone number to obtain invitation bonus.
Information Protection Guide
Thanks for using Huawei Enterprise Support Community! We will help you learn how we collect, use, store and share your personal information and the rights you have in accordance with Privacy Policy and User Agreement.