Explore projects

This is a clone of https://github.com/apache/bigtop/ but with WMF specific modifications that have not yet been sent upstream.

PoC Flink connector to query Http endpoint with Flink SQL.

Spacemedia is a tool that continuously harvests media libraries of space-related organizations in order to upload free media to Wikimedia Commons.

A repository of semgrep rules, many specific to Wikimedia projects and codebases. Note that all rules within this repository MUST be licensed with an OSI or free culture compliant license.

A JVMTI agent that attaches to your JVM and kills it when things go sideways

Hebrew analyzer plugin for elasticsearch

This is an open-source effort for making Hebrew properly searchable by various IR software libraries, while maintaining decent recall, precision and relevancy in retrievals. Includes Hebrew Analyzer for Lucene, and already produces results for Hebrew texts which are much better than the default Lucene implementation. Available for Java and .NET / Mono.

A JVMTI agent that attaches to your JVM and kills it when things go sideways

Log presto queries to EventGate

Send Presto queries to EventGate (see upstream: https://gitlab.wikimedia.org/repos/data-engineering/presto-query-logger)