Skip to content

Revert "[POC] Use spark for hive queries"

Neil Shah-Quinn (WMF) requested to merge revert-3-master into master

Created by: bearloga

Reverts neilpquinn/wmfdata#3

I disagree with merging a PR labeled "proof of concept", especially since "[Morten] did run into a couple of issues during installation/use" (T240890#5759663). Testing of the Spark-based code and discovery of issues can be done by installing a branch or a fork with pip, which is what should be done before merging to production:

pip install git+https://github.com/ottomata/wmfdata.git

Merge request reports