pangeo-eosc

How to deploy Pangeo using a baremetal kubernetes cluster

These are the steps to deploy Jupyterhub connected to Dask and MinIO using the baremetal k8s cluster at CESNET.

Assumptions for deployment

This guide assumes that you have:

  1. Access to a kubernetes cluster with kubectl.
  2. Helm is installed (i.e. the helm command works).
  3. Access to configure DNS hostnames (e.g. the EGI Dynamic DNS).
  4. Credentials for an OIDC (e.g. the EGI Check-in).
  5. The kubernetes administrator has deployed the Dask Kubernetes Operator.

Get a copy of this repository

For example, using git clone, and make sure you are in the correct workding directory:

cd working/dir/
git clone git@github.com:pangeo-data/pangeo-eosc.git
cd providers/kubernetes/

JupyterHub connected to Dask

To deploy Jupyterhub we use the official documentation from Zero to JupyterHub with Kubernetes.

Before going ahead

Please configure the values below accordingly:

Deployment

Deploy JupyterHub with the helm command below:

helm upgrade jupyterhub jupyterhub/jupyterhub \
   --cleanup-on-fail \
   --wait --install \
   --create-namespace \
   --namespace c-scale-pangeo-dask \
   --values jupyterhub/jupyterhub.yaml \
   --values jupyterhub/jupyterhub-secrets.yaml

Note: c-scale-pangeo-dask must be replaced with your own namespace.

Then configure RBACs for Dask:

kubectl apply -f dask/dask-user-role.yaml
kubectl apply -f dask/dask-user-rolebinding.yaml

All going well JupyterHub will be available at https://pangeo-eosc.vm.fedcloud.eu.

See an example notebook to get started.

MinIO

Before going ahead

Please configure the values below accordingly:

Steps

Use helm to install MinIO with the command below:

helm upgrade minio bitnami/minio \
  --install --wait \
  --cleanup-on-fail \
  --create-namespace \
  --namespace c-scale-pangeo-dask \
  --version 16.0.10 \
  --values minio/minio.yaml \
  --values minio/minio-secrets.yaml

All going well the MinIO Console will be available at https://pangeo-eosc-minio.vm.fedcloud.eu and the MinIO API endpoint will be available at https://pangeo-eosc-minioapi.vm.fedcloud.eu.

See an example notebook to get started.