Explore projects
-
repos / cloud / toolforge / toolforge lima kilo
GNU General Public License v3.0 or laterToolforge Local Kubernetes setup for development
See also: https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/lima-kilo
Topics: toolforgeUpdated -
-
Updated
-
This is an environment for developing WMF weekly deployment ("train") tooling and processes.
Updated -
repos / releng / Scap
GNU General Public License v3.0 onlyUpdated -
Creates an artifact, a packed conda environment, to be deployed across the data engineering cluster. Currently contains Pyspark3 and JupyterHub.
Updated -
repos / cloud / cicd / gitlab-ci
GNU General Public License v3.0 or laterWMCS repository for Gitlab CI/CD related stuff.
Updated -
Utilities and libraries for working with data pipelines at WMF. E.g. distributing conda envs, building and syncing artifacts, etc.
Updated -
repos / data-engineering / Airflow DAGs
Apache License 2.0Collection of DAGs and common code to be executed by the WMF Airflow instances.
Updated -
repos / releng / Cli
GNU General Public License v3.0 onlyThe mw CLI tool (with development environment & gitlab commands)
Updated