Tools for processing Wikimedia content for natural language processing

Collection of data engineering DAGs to be executed by the WMF Airflow instances.

A tool to compose and manage deployment charts from our library of templates

mwbot is a framework for writing bots in Rust

Web2Cit translation server

Provides classes and functions shared by all components in the Web2Cit translation ecosystem.

View analytic data about usage of Toolforge tools. Data is collected from the webserver access logs for the https://*.toolforge.org/ front proxy.

The mw CLI tool (with development environment & gitlab commands)

Prototype MediaWiki extension that provides Vue SSR support

Collection of data engineering DAGs to be executed by the WMF Airflow instances.

A repository for code relevant to putting differential privacy (DP) into production at WMF, involving:

automating DP pipelines publishing projects as pip packages for use in Airflow publishing outputs

a python library for working with the HTML dumps