Explore projects
-
repos / data-engineering / Airflow DAGs
Apache License 2.0Collection of DAGs and common code to be executed by the WMF Airflow instances.
Updated -
Mhurd / mediawiki-quickstart
MIT LicenseFetch, configure and spin up Dockerized MediaWiki with a single command.
Supports extension and skin manifests and running Selenium tests with live preview.
Updated -
Utilities and libraries for working with data pipelines at WMF. E.g. distributing conda envs, building and syncing artifacts, etc.
Updated -
Creates an artifact, a packed conda environment, to be deployed across the data engineering cluster. Currently contains Pyspark3 and JupyterHub.
Updated -
Updated
-
-
-
-
This is an environment for developing and testing scap deployment tools.
Updated -
Updated
-
-
repos / cloud / toolforge / lima-kilo
GNU General Public License v3.0 or laterToolforge Local Kubernetes setup for development
See also: https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/lima-kilo
Updated -
repos / search-platform / Discolytics
Apache License 2.0Updated -
repos / cloud / toolforge / Build service - builder
Apache License 2.0Toolforge Buildservice builder component code (currently tekton and boilerplate around using it)
Updated -
repos / cloud / toolforge / api-gateway
GNU Affero General Public License v3.0Updated -
repos / cloud / toolforge / Build service - API
GNU Affero General Public License v3.0Updated -
manages the execution of function calls (Z7s) for Wikifunctions
Updated