vbatts/quay
Archived
1
0
Fork 0
Code Issues Pull requests Releases Wiki Activity
This repository has been archived on 2020-03-24. You can view files and clone it, but cannot push or open issues or pull requests.
quay/config_app/docs/kube_setup.md
Sam Chow 9ecf5c1c27 Add all kube templates
2018-08-31 15:39:56 -04:00

6.4 KiB
Raw Blame History

Quay Enterprise Installation on Kubernetes

This guide walks through the deployment of Quay Enterprise onto a Kubernetes cluster. After completing the steps in this guide, a deployer will have a functioning instance of Quay Enterprise orchestrated as a Kubernetes service on a cluster, and will be able to access the Quay Enterprise Setup tool with a browser to complete configuration of image repositories, builders, and users.

Prerequisites

A PostgreSQL database must be available for Quay Enterprise metadata storage. We currently recommend running this database server outside of the cluster.

Download Kubernetes Configuration Files

Visit the RedHat Documentation and download the pre-formatted pull secret, under "Account Assets". There are several formats of the secret, be sure to download the "dockercfg" format resulting in a config.json file. This pull secret is used to download the Quay Enterprise containers.

This will be used later in the guide.

Next, download each of the following files to your workstation, placing them alongside your pull secret:

Role Based Access Control

Quay Enterprise has native Kubernetes integrations. These integrations require Service Account to have access to Kubernetes API. When Kubernetes RBAC is enabled, Role Based Access Control policy manifests also have to be deployed.

Kubernetes API has minor changes between versions 1.4 and 1.5, Download appropiate versions of Role Based Access Control (RBAC) Policies.

Kubernetes v1.6.x and later RBAC Policies

Deploy to Kubernetes

All Kubernetes objects will be deployed under the "quay-enterprise" namespace. The first step is to create this namespace:

kubectl create -f quay-enterprise-namespace.yml

Next, add your pull secret to Kubernetes (make sure you specify the correct path to config.json):

kubectl create secret generic coreos-pull-secret --from-file=".dockerconfigjson=config.json" --type='kubernetes.io/dockerconfigjson' --namespace=quay-enterprise

Kubernetes v1.6.x and later : Deploy RBAC Policies

kubectl create -f quay-servicetoken-role-k8s1-6.yaml
kubectl create -f quay-servicetoken-role-binding-k8s1-6.yaml

Deploy Quay Enterprise objects

Finally, the remaining Kubernetes objects can be deployed onto Kubernetes:

kubectl create -f quay-enterprise-config-secret.yml -f quay-enterprise-redis.yml -f quay-enterprise-app-rc.yml

Expose via Kubernetes Service

In order to access Quay Enterprise, a user must route to it through a Kubernetes Service. It is up to the deployer to decide which Service type is appropriate for their use case: a LoadBalancer or a NodePort.

A LoadBalancer is recommended if the Kubernetes cluster is integrated with a cloud provider, otherwise a NodePort will suffice. Along with this guide are examples of this service.

LoadBalancer

Using the sample provided, a LoadBalancer Kubernetes Service can be created like so:

kubectl create -f quay-enterprise-service-loadbalancer.yml

kubectl can be used to find the externally-accessible URL of the quay-enterprise service:

kubectl describe services quay-enterprise --namespace=quay-enterprise

NodePort

Using the sample provided, a NodePort Kubernetes Service can be created like so:

kubectl create -f quay-enterprise-service-nodeport.yml

By default, the quay-enterprise service will be available on port 30080 on every node in the Kubernetes cluster. If this port conflicts with an existing Kubernetes Service, simply modify the sample configuration file and change the value of NodePort.

Continue with Quay Enterprise Setup

All that remains is to configure Quay Enterprise itself through the configuration tool.

Download the following files to your workstation:

Configuring RBAC for the configuration tool

Apply the following policies to allow the config tool to make changes to the Q.E. deployment:

kubectl apply -f config-tool-serviceaccount.yaml

kubectl apply -f config-tool-servicetoken-role.yaml

kubectl apply -f config-tool-servicetoken-role-binding.yaml

Deploy Config Tool

Deploy the configuration tool and route a service to it:

kubectl apply -f qe-config-tool.yml -f config-tool-service-nodeport.yml

By default, the config-tool service will be available on port 30090 on every node in the Kubernetes cluster. Similar to the Quay application service, if this port conflicts with an existing Kubernetes Service, simply modify the sample configuration file and change the value of NodePort. Once at the Quay Enterprise setup UI, follow the setup instructions to finalize your installation.

Using the Configuration Tool

Click on "Start New Configuration for this Cluster", and follow the instructions to create your configuration, downloading and saving it (to load as a backup or if you ever wish to change your settings). You will also be able to deploy the configuration to all instances by hitting "Deploy". Allow for a minute for the Quay instances to cycle the pods, and your configuration will be enacted once the pods have started.