Flatten statements into an Iceberg table

The one heavy pass of the census: every main snak of every item becomes one row in an Iceberg table partitioned by snapshot (hql/insert_statements.hql). Best rank is resolved with a window over subject and property, and the three subject flags from !1 (merged) are joined in, so every metric afterwards is a plain query on this table.

The insert is skipped when the snapshot partition already holds rows. Sampled runs write to a table suffixed with the modulus and use a regular YARN session; only the census uses the large one.

Bug: T437880

Merge request reports

Loading