Skip to content

Set sensor timeout to 14 days for mediawiki_wikitext_current

Xcollazo requested to merge bump-mw-wt-current into main

Recent reality from upstream dumps reflects later availability of the data in HDFS. Twice now the sensor has timed out, and this last time we missed the failure and thus had not triggered the job more than 2 weeks later than when data was actually available.

Thus, let's bump sensor wait time and avoid this.

$ pwd
/mnt/hdfs/wmf/data/wmf/mediawiki/wikitext/current
$ ls -lsha */_SUCCESS
0 -rw-r----- 1 analytics analytics-privatedata-users 0 Dec  6  2023 'snapshot=2023-11/_SUCCESS'
0 -rw-r----- 1 analytics analytics-privatedata-users 0 Jan  6 12:16 'snapshot=2023-12/_SUCCESS'
0 -rw-r----- 1 analytics analytics-privatedata-users 0 Feb  6 11:49 'snapshot=2024-01/_SUCCESS'
0 -rw-r----- 1 analytics analytics-privatedata-users 0 Mar  6 11:53 'snapshot=2024-02/_SUCCESS'
0 -rw-r----- 1 analytics analytics-privatedata-users 0 Apr  6 11:43 'snapshot=2024-03/_SUCCESS'
0 -rw-r----- 1 analytics analytics-privatedata-users 0 May 13 17:25 'snapshot=2024-04/_SUCCESS'

Merge request reports