Explore projects

Collection of DAGs and common code to be executed by the WMF Airflow instances.

executes user-written 'native' code in a variety of programming languages

Creates an artifact, a packed conda environment, to be deployed across the data engineering cluster. Currently contains Pyspark3 and JupyterHub.

See https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Jobs_framework

Toolforge Buildservice builder component code (currently tekton and boilerplate around using it)

This is a repository for various gitlab ci-related security templates. The design of this repository is an a la carte selection of different security tools which users can add to their various repositories as needed.

A command line interface to Wikifunctions (or any other WikiLambda installation).

shared set of JSON schemata for the Wikifunctions project, to achieve a "single version of the truth" on what counts as a structurally valid ZObject, and provide shared utility code