Skip to content
  • Btullis's avatar
    Create a build script for packaging multiple spark shufflers · fd983cbc
    Btullis authored
    We need to deploy multiple version of the spark shuffler service for yarn.
    
    We have already built the required spark versions from source and published
    the build image on docker-registry.wikimedia.org, which contains the
    required jar file.
    
    This script uses docker to pull those images and extract the jar file.
    It then uses templated files to create the required debian control files
    and runs pdebuild to create the deb files on a Wikimedia build server.
    
    Bug: T344910
    fd983cbc