CERN Case Study
Hello, guys in this blog you get to know that how Kubernetes solving industries issues.
History
Kubernetes was founded by Joe Beda, Brendan Burns, and Craig McLuckie, who was joined by other Google engineers including Brian Grant and Tim Hockin, and was first announced by Google in mid-2014. Its development and design are heavily influenced by Google’s Borg system and many of the top contributors to the project previously worked on Borg.
Whats is Kubernetes?
Kubernetes (commonly known as k8s) is an open-source container orchestration system for automating computer application deployment, scaling, and management.
It was originally designed by Google and is now maintained by the Cloud Native Computing Foundation.
“it is a platform for automating deployment, scaling, and operations of application containers across clusters of hosts”.
It works with a range of container tools and runs containers in a cluster, often with images built using Docker. Kubernetes originally interfaced with the Docker runtime through a “Dockershim”; however, the shim has since been deprecated in favor of directly interfacing with containers or another CRI-compliant runtime.
Many cloud services offer a Kubernetes-based platform or infrastructure as a service (PaaS or IaaS) on which Kubernetes can be deployed as a platform-providing service. Many vendors also provide their own branded Kubernetes distributions.
Kubernetes architecture?
Kubernetes allows you to deploy cloud-native applications anywhere and manage them exactly as you like everywhere.it helps you to avoid vendor lock issues as it can use any vendor-specific APIs or services except where Kubernetes provides an abstraction, e.g., load balancer and storage. Kubernetes allows you to assure those containerized applications run where and when you want and helps you to find resources and tools in which you want to work. this is the main reason developers moving towards Kubernetes and it getting more and more popular day by day because of its features.
Features of Kubernetes
Here are the essential features of Kubernetes:
- Automated Scheduling
- Self-Healing Capabilities
- Automated rollouts & rollback
- Horizontal Scaling & Load Balancing
- Offers environment consistency for development, testing, and production
- Infrastructure is loosely coupled to each component can act as a separate unit
- Provides a higher density of resource utilization
- Offers enterprise-ready features
- Application-centric management
- Auto-scalable infrastructure
- You can create predictable infrastructure
CASE STUDY: CERN
The European Organization for Nuclear Research, known as CERN, is a European research organization that operates the largest particle physics laboratory in the world. Established in 1954, the organization is based in a northwest suburb of Geneva on the Franco-Swiss border and has 23 member states.
“At CERN, we probe the fundamental structure of the particles that make up everything around us. We do so using the world's largest and most complex scientific instruments.”
Challenge
At CERN, the European Organization for Nuclear Research, physicists conduct experiments to learn about fundamental science. In its particle accelerators, “we accelerate protons to very high energy, close to the speed of light, and we make the two beams of protons collide,” says CERN Software Engineer Ricardo Rocha. “The end result is a lot of data that we have to process.” CERN currently stores 330 petabytes of data in its data centers, and an upgrade of its accelerators expected in the next few years will drive that number up by 10x. Additionally, the organization experiences extreme peaks in its workloads during periods prior to big conferences and needs its infrastructure to scale to those peaks. “We want to have a more hybrid infrastructure, where we have our on-premise infrastructure but can make use of public clouds temporarily when these peaks come up,” says Rocha. “We’ve been looking at new technologies that can help improve our efficiency in our infrastructure so that we can dedicate more of our resources to the actual processing of the data.”
CERN currently stores and processes 330 petabytes of data gathered from 4,300 projects and 3,300 users using 10,000 hypervisors and 320,000 cores in its data centers.
“Before, the tendency was always: ‘I need this, I get a couple of developers, and I implement it.’ Right now it’s ‘I need this, I’m sure other people also need this, so I’ll go and ask around.’ The CNCF is a good source because there’s a very large catalog of applications available. It’s very hard right now to justify developing a new product in-house. There is really no real reason to keep doing that. It’s much easier for us to try it out, and if we see it’s a good solution, we try to reach out to the community and start working with that community.”
— RICARDO ROCHA, SOFTWARE ENGINEER, CERN
Solution
CERN’s technology team embraced containerization and cloud-native practices, choosing Kubernetes for orchestration, Helm for deployment, Prometheus for monitoring, and CoreDNS for DNS resolution inside the clusters. Kubernetes federation has allowed the organization to run some production workloads both on-premise and in public clouds.
Impact of Kubernetes
“Kubernetes gives them the full automation of the application,” “It comes with built-in monitoring and logging for all the applications and the workloads that deploy in Kubernetes. This is a massive simplification of our current deployments.” The time to deploy a new cluster for a complex distributed storage system has gone from more than 3 hours to less than 15 minutes. Adding new nodes to a cluster used to take more than an hour; now it takes less than 2 minutes. The time it takes to autoscale replicas for system components has decreased from more than an hour to less than 2 minutes. Initially, virtualization gave 20% overhead, but with Kubernetes tuning, this was reduced to ~5%. Moving to Kubernetes on bare metal would get this to 0%. Not having to host virtual machines is expected to also get 10% of memory capacity back.
“With Kubernetes, there’s a well-established technology and a big community that we can contribute to. It allows us to do our physics analysis without having to focus so much on the lower-level software. This is just exciting. We are looking forward to keep contributing to the community and collaborating with everyone.”
— RICARDO ROCHA, SOFTWARE ENGINEER, CERN
Conclusion :
so using Kubernetes CERN engineers able to focus on research without thinking of infrastructure management and other things.
Hope this blog is helpful to you!!!!
No comments