Explore projects
-
repos / data-engineering / Metrics Platform
GNU General Public License v2.0 or laterJavaScript, PHP, Java, and Swift libraries for analytics instrumentation and experimentation at WMF
Updated -
repos / ci-tools / patchdemo
MIT LicenseWith Patch demo, you too can spin up a MediaWiki instance running a particular patch from Wikimedia Gerrit.
Updated -
Utilities and libraries for working with data pipelines at WMF. E.g. distributing conda envs, building and syncing artifacts, etc.
Updated -
repos / cloud / toolforge / api-gateway
GNU Affero General Public License v3.0Updated -
repos / abstract-wiki / wikifunctions / function evaluator
Apache License 2.0executes user-written 'native' code in a variety of programming languages
Topics: wikifunctionsUpdated -
repos / cloud / toolforge / Jobs Cli
GNU General Public License v3.0 onlyUpdated -
repos / cloud / toolforge / Jobs API
GNU Affero General Public License v3.0Updated -
repos / cloud / toolforge / Build service - builder
Apache License 2.0Toolforge Buildservice builder component code (currently tekton and boilerplate around using it)
Updated -
repos / cloud / toolforge / Build service - Cli
GNU General Public License v3.0 onlyUpdated -
repos / cloud / toolforge / Envvars service - cli
GNU General Public License v3.0 onlyUpdated -
repos / cloud / toolforge / Webservice CLI
Apache License 2.0Updated -
repos / cloud / toolforge / Maintain Harbor
MIT LicenseUpdated -
-
-
repos / releng / Scap
GNU General Public License v3.0 onlyUpdated -
repos / data-engineering / Airflow DAGs
Apache License 2.0Collection of DAGs and common code to be executed by the WMF Airflow instances.
Updated -
-
Creates an artifact, a packed conda environment, to be deployed across the data engineering cluster. Currently contains Pyspark3 and JupyterHub.
Updated -
repos / cloud / toolforge / Toolforge deploy
GNU Affero General Public License v3.0Updated -
repos / cloud / toolforge / Maintain Kubeusers
MIT LicenseUpdated