Skip to content
  • Aleksandar Mastilovic's avatar
    a92b3252
    Introduce Gobblin jobs to Airflow · a92b3252
    Aleksandar Mastilovic authored
    
    
    * Fix mypy issues
    
    * Fix mypy complaining
    
    Signed-off-by: default avatarBalthazar Rouberol <brouberol@wikimedia.org>
    
    * Brought back changes from analytics_test
    
    * Better logging
    * Resource management per job
    * New Gobblin JAR version
    
    * Linter fix
    
    * Remove obsolete Gobblin job, refactoring
    
    * Remove webrequest_frontend_rc0 as it's obsolete
    * Refactor the gobblin_jobs configuration dict
    
    * Addressing review comments
    
    * Making the linter happy...
    
    * Adding commentary from the original puppet configuration
    
    * Correct HDFS Gobblin work dir path
    
    * Correct Gobblin JAR reference
    
    * Cleaning up analytics_test and just_a_test.pull config
    
    * Deleting the temporary test_k8s config directory
    
    * Adding the missing fixtures
    
    * Make linter happy
    
    * Fixing the linters and tests
    
    * Getting there
    
    * Was it this env?
    
    * Weird...
    
    * Maybe env was needed after all?
    
    * Getting close!
    
    * Missing artifact
    
    * Fix the import
    
    * Moving to analytics_tes
    
    * Added missing properties
    
    * Putting all the config fil...
    a92b3252
    Introduce Gobblin jobs to Airflow
    Aleksandar Mastilovic authored
    
    
    * Fix mypy issues
    
    * Fix mypy complaining
    
    Signed-off-by: default avatarBalthazar Rouberol <brouberol@wikimedia.org>
    
    * Brought back changes from analytics_test
    
    * Better logging
    * Resource management per job
    * New Gobblin JAR version
    
    * Linter fix
    
    * Remove obsolete Gobblin job, refactoring
    
    * Remove webrequest_frontend_rc0 as it's obsolete
    * Refactor the gobblin_jobs configuration dict
    
    * Addressing review comments
    
    * Making the linter happy...
    
    * Adding commentary from the original puppet configuration
    
    * Correct HDFS Gobblin work dir path
    
    * Correct Gobblin JAR reference
    
    * Cleaning up analytics_test and just_a_test.pull config
    
    * Deleting the temporary test_k8s config directory
    
    * Adding the missing fixtures
    
    * Make linter happy
    
    * Fixing the linters and tests
    
    * Getting there
    
    * Was it this env?
    
    * Weird...
    
    * Maybe env was needed after all?
    
    * Getting close!
    
    * Missing artifact
    
    * Fix the import
    
    * Moving to analytics_tes
    
    * Added missing properties
    
    * Putting all the config fil...
Loading