Explore projects

A cocktail of scriptz that does incredible things.

Product Analytics team's ETL jobs

PySpark jobs for the image suggestions data pipeline.

A cocktail of scriptz that does incredible things.

A repository for code relevant to putting differential privacy (DP) into production at WMF, involving:

automating DP pipelines publishing projects as pip packages for use in Airflow publishing outputs

Don't leave Wikipedia articles and sections without images, here's the image suggestions data pipeline.

Friends call me ALIS and SLIS.

Experiments with airflow dags and jobs running on WMF analytics infrastructure.

Datapipelines operationalised by the Generated Data Platform team.

Experiments with airflow dags and jobs running on WMF analytics infrastructure.

Experiments with airflow dags and jobs running on WMF analytics infrastructure.

Experiments with airflow dags and jobs running on WMF analytics infrastructure.