Kubernetes, the open source orchestration system for Docker containers, is a fast-moving project that can be somewhat complicated to install and configure, especially if you’re just getting started with it.
Fortunately, the project maintains some really well-done getting started guides, the simplest of which steps you through running Kubernetes, in Docker containers, on a single host.
The up-and-running part of the walkthrough amounts to issuing just three docker run commands:
# docker run --net=host -d gcr.io/google_containers/etcd:2.0.9 /usr/local/bin/etcd --addr=127.0.0.1:4001 --bind-addr=0.0.0.0:4001 --data-dir=/var/etcd/data # docker run --net=host -d -v /var/run/docker.sock:/var/run/docker.sock gcr.io/google_containers/hyperkube:v0.21.2 /hyperkube kubelet --api_servers=http://localhost:8080 --v=2 --address=0.0.0.0 --enable_server --hostname_override=127.0.0.1 --config=/etc/kubernetes/manifests # docker run -d --net=host --privileged gcr.io/google_containers/hyperkube:v0.21.2 /hyperkube proxy --master=http://127.0.0.1:8080 --v=2
Now, this isn’t as simple as rattling off a single command from memory, but we can’t have everything…
…or can we?
Through the magic of a couple tools we’ve been working on here at Project Atomic, we can get up and running with the upstream kubernetes project’s containerized install method using a single command like this:
# atomic run jasonbrooks/kubernetes-atomicapp
The first part of the command,
atomic, refers to the containerized application and system management tool that ships with all Atomic Hosts and that allows an image provider to specify how a container image expects to be run. This tool takes advantage of the support for adding custom metadata, through labels, that debuted in docker 1.6.0.
If you aren’t using an Atomic Host, the
atomic tool is available in the CentOS 7 and Fedora repositories. Issue a
yum install atomic or
dnf install atomic to get one of your own. For other platforms, check out Brian Exelbierd’s recent blog post about testing nulecule (and atomic) on Debian.
You can read all about atomic in this post from Dan Walsh, but the short version is that labels allow image developers to fold their big hairy docker run commands into their Dockerfiles, and the atomic tool allows users to access these labels.
At the end of the command, we have
atomicapp, which is a tool for packaging complex multi-container applications and services, along with their orchestration metadata, into a deployable container image. Atomicapp is a reference implementation of the Nulecule specification.
Atomicapps are pretty easy to build. The process consists of gathering up orchestration metadata from whichever providers you intend to support (atomicapp currently works with kubernetes, docker, and openshift), placing this metadata in the right directory structure, and filling out a Nulecule file with information about the images, parameters and metadata you wish to use.
The nulecule repository contains a project template that we can use for reference:
$ git clone https://github.com/projectatomic/nulecule.git $ tree nulecule/spec/examples/ nulecule/spec/examples/ └── template ├── artifacts │ ├── provider1 │ │ ├── pod.json │ │ └── service.json │ └── provider2 │ └── file.json ├── Dockerfile └── Nulecule
For our kubernetes app, we’ll be using the docker provider, with one metadata file for each of the three docker run commands we mentioned above:
$ mkdir -p nulecule/examples/kubernetes-atomicapp/artifacts/docker $ echo "docker run --net=host -d gcr.io/google_containers/etcd:2.0.9 /usr/local/bin/etcd --addr=127.0.0.1:4001 --bind-addr=0.0.0.0:4001 --data-dir=/var/etcd/data" > nulecule/examples/kubernetes-atomicapp/artifacts/docker/kube-etcd_run $ echo "docker run --net=host -d -v /var/run/docker.sock:/var/run/docker.sock gcr.io/google_containers/hyperkube:v0.21.2 /hyperkube kubelet --api_servers=http://localhost:8080 --v=2 --address=0.0.0.0 --enable_server --hostname_override=127.0.0.1 --config=/etc/kubernetes/manifests" > nulecule/examples/kubernetes-atomicapp/artifacts/docker/kube-master_run $ echo "docker run -d --net=host --privileged gcr.io/google_containers/hyperkube:v0.21.2 /hyperkube proxy --master=http://127.0.0.1:8080 --v=2" > nulecule/examples/kubernetes-atomicapp/artifacts/docker/kube-svcproxy_run
Next, we need to customize our Nulecule file:
$ vi nulecule/examples/kubernetes-atomicapp/Nulecule --- specversion: 0.0.2 id: kubernetes-atomicapp metadata: name: Kubernetes Atomic App appversion: 0.0.1 description: Atomic app for deploying a local, dockerized kubernetes graph: - name: kubernetes-atomicapp artifacts: docker: - file://artifacts/docker/kube-etcd_run - file://artifacts/docker/kube-master_run - file://artifacts/docker/kube-svcproxy_run
Next, we’ll create an
answers.conf file to ensure that docker is picked up as our default provider – otherwise, atomicapp will default to kubernetes.
$ vi nulecule/examples/kubernetes-atomicapp/answers.conf [general] namespace = default provider = docker
Finally we need a Dockerfile, which we can copy, mostly unchanged, from the nulecule template. We need to modify the nulecule providers label to list docker as our provider, and add in the answer file we created above:
$ cp nulecule/spec/examples/template/Dockerfile nulecule/examples/kubernetes-atomicapp/ $ vi nulecule/examples/kubernetes-atomicapp/Dockerfile FROM projectatomic/atomicapp:0.1.3 MAINTAINER Your Name <firstname.lastname@example.org> LABEL io.projectatomic.nulecule.specversion 0.0.2 LABEL io.projectatomic.nulecule.providers = "docker" ADD /Nulecule /Dockerfile /answers.conf /application-entity/ ADD /artifacts /application-entity/artifacts
Now we can pack up our metadata, nulecule file and Dockerfile into an image:
# docker build -t YOURNAME/kubernetes-atomicapp nulecule/examples/kubernetes-atomicapp/.
You can now run your image, push it to a docker registry to pull and run somewhere else, or you can just run the image I already pushed to the docker hub:
# atomic run jasonbrooks/kubernetes-atomicapp
NOTE: Running kubernetes in this way involves providing a container with access to the docker daemon on the host machine, which SELinux prevents, so you’ll need to put SELinux into permissive mode (
sudo setenforce 0) for this experiment.
From here, you can pick up with the original kubernetes-on-docker walkthrough, at the Test it out step.
Till Next Time
That’s enough for now. Next time, we’ll take our shiny new single-command kubernetes install, and use atomicapp to deploy an application on it. We’ll also talk about how you can use atomicapp parameters to deploy newer and older versions of kubernetes (or any other app) by adjusting the images we specify in our
If you have questions or suggestions regarding this post, I’d love to hear them. Leave a comment below, ping me at jbrooks in #atomic on freenode irc or @jasonbrooks on Twitter, or send a message to the Project Atomic mailing list. Also, be sure to check out the Project Atomic Q&A site.