Explore projects
-
repos / data-engineering / Airflow DAGs
Apache License 2.0Collection of DAGs and common code to be executed by the WMF Airflow instances.
Updated -
Summon our tricksy CI functions to build/test/publish your WMF deployable artifacts.
Updated -
-
Repository for configuration of Trusted GitLab Runner.
Updated -
Repository for configuration of general purpose GitLab Cloud Runner.
Updated -
Utilities and libraries for working with data pipelines at WMF. E.g. distributing conda envs, building and syncing artifacts, etc.
Updated -
repos / sre / Schema Changes
Apache License 2.0Updated -
repos / data-engineering / Eventutilities Python
Apache License 2.0Updated -
repos / cloud / cicd / gitlab-ci
GNU General Public License v3.0 or laterWMCS repository for Gitlab CI/CD related stuff.
Updated -
repos / releng / Scap
GNU General Public License v3.0 onlyUpdated -
repos / abstract-wiki / wikifunctions / function evaluator
Apache License 2.0executes user-written 'native' code in a variety of programming languages
Updated -
toolforge-repos / fourohfour
GNU General Public License v3.0 or laterA 404 Not Found (and other error page) handler for Toolforge
Updated -
Creates an artifact, a packed conda environment, to be deployed across the data engineering cluster. Currently contains Pyspark3 and JupyterHub.
Updated -
repos / cloud / toolforge / Toolforge deploy
GNU Affero General Public License v3.0Updated -
Updated
-
Updated
-
repos / cloud / toolforge / Webservice CLI
Apache License 2.0Updated -
repos / cloud / toolforge / Jobs API
GNU Affero General Public License v3.0Updated -
Don't leave Wikipedia articles and sections without images, here's the image suggestions data pipeline.
Friends call me ALIS and SLIS.
Updated