Explore projects
-
Utilities and libraries for working with data pipelines at WMF. E.g. distributing conda envs, building and syncing artifacts, etc.
Updated -
Effie Mouzeli / phab
GNU General Public License v3.0 or laterPhabricator command line client
Updated -
toolforge-repos / python-toolforge
GNU General Public License v3.0 onlyPython library that contains helper functions for different tasks in Toolforge.
https://phabricator.wikimedia.org/tag/tool-python-toolforge/
Updated -
A tool to keep image and volume resource usage within configurable limits.
Updated -
repos / releng / reggie
GNU General Public License v3.0 or laterA container registry implemented in Python which supports automatic online garbage collection of unreferenced blobs.
Updated -
repos / sre / mediabackups
GNU General Public License v3.0 or laterWMF MediaWiki media storage backups software
Updated -
Updated
-
repos / sre / acme-chief
GNU General Public License v3.0 or lateracme-chief is a Python 3 application that is to be used to centrally request configured TLS certificates from ACME servers, then make them available to authorised API users.
Updated -
Creates an artifact, a packed conda environment, to be deployed across the data engineering cluster. Currently contains Pyspark3 and JupyterHub.
Updated -
Updated
-
repos / data-engineering / Eventutilities Python
Apache License 2.0Updated -
toolforge-repos / multitrack-drafting
GNU Affero General Public License v3.0Updated -
Updated
-
toolforge-repos / schedule-deployment
GNU General Public License v3.0 onlyAdd a patch to an upcoming backport window on the https://wikitech.wikimedia.org/wiki/Deployments calendar.
Updated -
Updated
-
toolforge-repos / fourohfour
GNU General Public License v3.0 or laterA 404 Not Found (and other error page) handler for Toolforge
Updated -
repos / cloud / cicd / gitlab-ci
GNU General Public License v3.0 or laterWMCS repository for Gitlab CI/CD related stuff.
Updated -
Updated