Explore projects

The mw CLI tool (with development environment & gitlab commands)

Collection of DAGs and common code to be executed by the WMF Airflow instances.

Summon our tricksy CI functions to build/test/publish your WMF deployable artifacts.

Docker images for local MediaWiki development and related tasks.

Wikimedia Release Tools

Stats about Wikimedia train deploys

Data³ is a toolkit and general framework for visualizing just about any data. More specifically, it currently provides dashboards to explore Phabricator workflows and MediaWiki production deployments.

a python library for working with the HTML dumps

GitLab settings and tooling for applying them via the API.

Example python project for using gitlab-ci and workflow-utils to test and build job artifacts for running as jobs in the Analytics Data Lake.

Repository for configuration of general purpose GitLab Cloud Runner.

machine learning pipelines for research

mwbot is a framework for writing bots in Rust

Repository for configuration of Trusted GitLab Runner.

Blubber is a highly opinionated abstraction for container build configurations and a command-line compiler which currently supports outputting multi-stage Dockerfiles. It aims to provide a handful of declarative constructs that accomplish build configuration in a more secure and determinate way than running ad-hoc commands.

Utilities and libraries for working with data pipelines at WMF. E.g. distributing conda envs, building and syncing artifacts, etc.