GitLab

Datapipelines operationalised by the Generated Data Platform team.

Code for research on curios and critical readers

The mw CLI tool (with development environment & gitlab commands)

A simple script to deploy and run spark3 on WMF stat machines

Collection of data engineering DAGs to be executed by the WMF Airflow instances.

Repository for configuration of Trusted GitLab Runner.

A test version of the function-schemata repo. This will be used to analyze various security-related CI includes in the hopes of this repo becoming one of the first case studies for such CI includes.

A repository of semgrep rules, many specific to Wikimedia projects and codebases. Note that all rules within this repository MUST be licensed with an OSI or free culture compliant license.

A fork of MediaWiki's BoilerPlate template to show example security CI template setup.

Fork of service-runner for Security Team testing.

A fork of pywikibot from github for testing purposes for the Security Team.

Web2Cit translation server

Blubber is a highly opinionated abstraction for container build configurations and a command-line compiler which currently supports outputting multi-stage Dockerfiles. It aims to provide a handful of declarative constructs that accomplish build configuration in a more secure and determinate way than running ad-hoc commands.

Provides classes and functions shared by all components in the Web2Cit translation ecosystem.