Provision gitlab-runner metrics collection using prometheus
Create a new monitoring
namespace for the prometheus stack.
Install kube-prometheus-stack which includes a number of resources for monitoring applications and includes CRDs such as ServiceMonitor which the gitlab-runner chart supports.
Enable the gitlab-runner metrics prometheus endpoint and pprof listener, and a prometheus based service monitor.
After this is provisioned, we should be able to access prometheus and grafana dashboards via the following.
kubectl port-forward svc/kube-prometheus-stack-prometheus 9090:9090 -n monitoring
kubectl port-forward svc/kube-prometheus-stack-grafana 3000:80 -n monitoring
See https://marketplace.digitalocean.com/apps/kubernetes-monitoring-stack