Explore projects
-
repos / data-engineering / Airflow DAGs
Apache License 2.0Collection of DAGs and common code to be executed by the WMF Airflow instances.
Updated -
Summon our tricksy CI functions to build/test/publish your WMF deployable artifacts.
Updated -
-
Repository for configuration of Trusted GitLab Runner.
Updated -
Repository for configuration of general purpose GitLab Cloud Runner.
Updated -
Utilities and libraries for working with data pipelines at WMF. E.g. distributing conda envs, building and syncing artifacts, etc.
Updated -
repos / releng / Blubber
Apache License 2.0Blubber is a BuildKit frontend for building application container images from a minimal set of declarative constructs in YAML. Its focus is on composability, determinism, cache efficiency, and secure default behaviors.
Updated -
toolforge-repos / mwdemo
GNU General Public License v2.0 or laterA template for deploying and maintaining MediaWiki as a Toolforge tool.
Updated -
This project takes care of creating the docker image required to run the RDF Streaming Updater. The RDF Streaming Updater is a flink job that replicates updates made to wikidata and commons into blazegraph.
Updated -
This repository contains the WMF build pipeline for the Ceph container storage interface.
Updated -
Creates an artifact, a packed conda environment, to be deployed across the data engineering cluster. Currently contains Pyspark3 and JupyterHub.
Updated -
repos / data-engineering / Eventutilities Python
Apache License 2.0Updated -
repos / cloud / toolforge / Build service - API
GNU Affero General Public License v3.0Updated -
Updated
-
toolforge-repos / fourohfour
GNU General Public License v3.0 or laterA 404 Not Found (and other error page) handler for Toolforge
Updated -
repos / cloud / cicd / gitlab-ci
GNU General Public License v3.0 or laterWMCS repository for Gitlab CI/CD related stuff.
Updated -
repos / commtech / wishlist-intake
GNU General Public License v3.0 or laterA gadget for intake and editing of wishlist proposals
Updated -
repos / abstract-wiki / wikifunctions / function evaluator
Apache License 2.0executes user-written 'native' code in a variety of programming languages
Updated -
repos / ci-tools / patchdemo
MIT LicenseWith Patch demo, you too can spin up a MediaWiki instance running a particular patch from Wikimedia Gerrit.
Updated