Kubernetes
Open-source system for automating deployment, scaling, and management of containerized applications.
Think of it like
A conductor managing an orchestra—assigns instruments to musicians, replaces broken ones, scales up for large halls.
Example
Declare desired replicas of an inference container; K8s ensures the count is maintained and routes traffic across healthy pods.
How it actually works
Abstracts underlying hardware. Handles pod placement, resource allocation, rolling updates, self-healing, and networking. Learning curve is steep; day-2 operations (monitoring, upgrades, storage) demand expertise. Not needed for small, static deployments.
For product teams
Enables reliable, multi-cloud deployment and auto-scaling but adds operational complexity.
For engineers
Declarative system; etcd stores cluster state; controllers watch and reconcile; kubelet on nodes enforces spec.
Related
- Containerization — Orchestrates.
- MLOps — Sits below.
Read anything AI without the jargon
Look up any term in plain English, or save terms as you read with the free Chrome extension.
Open DecoderAdd to Chrome