Explore projects
-
This repository contains the build pipeline for the Data Science and Engineering deployments of Apache Airflow at the Wikimedia Foundation.
Updated -
repos / cloud / toolforge / Components API
GNU Affero General Public License v3.0Updated -
repos / cloud / toolforge / api-gateway
GNU Affero General Public License v3.0Updated -
repos / cloud / cloud-vps / tofu-infra
GNU Affero General Public License v3.0Updated -
repos / cloud / toolforge / Build service - builder
Apache License 2.0Toolforge Buildservice builder component code (currently tekton and boilerplate around using it)
Updated -
Updated
-
repos / cloud / toolforge / toolforge-cli
GNU General Public License v3.0 onlyCLI to run toolforge related commands
Updated -
repos / cloud / toolforge / Components cli
GNU General Public License v3.0 onlyUpdated -
repos / cloud / toolforge / Envvars service - API
GNU Affero General Public License v3.0Updated -
repos / cloud / toolforge / Registry Admission
MIT LicenseThis is a simple Kubernetes Admission Validation Webhook that ensures Toolforge users will only use container images from approved registries.
Updated -
Calculation of key metrics related to the Wikimedia movement
Updated -
repos / sre / ncmonitor
GNU General Public License v3.0 or laterUpdated -
manages the execution of function calls (Z7s) for Wikifunctions
Updated -
repos / cloud / toolforge / jobs emailer
GNU Affero General Public License v3.0Updated -
repos / data-engineering / Metrics Platform
GNU General Public License v2.0 or laterJavaScript, PHP, Java, and Swift libraries for analytics instrumentation and experimentation at WMF
Updated -
repos / cloud / toolforge / Build service - API
GNU Affero General Public License v3.0Updated -
repos / cloud / toolforge / Build service - Cli
GNU General Public License v3.0 onlyUpdated -
Creates an artifact, a packed conda environment, to be deployed across the data engineering cluster. Currently contains Pyspark3 and JupyterHub.
Updated -
repos / cloud / toolforge / Jobs API
GNU Affero General Public License v3.0Updated