Monthly Refresh Process
1. Run Core Pricing Service DAG
DAG parameters:
ps_month: version name, e.g. ifps_monthis2025_11, then table will be namedtq_dev.internal_dev_csong_consumer_pricing_service.pricing_service_rates_2025_11core_rates_month: select latest core rates month, e.g.2025_10ps_schema: target schema, e.g.tq_dev.internal_dev_csong_consumer_pricing_servicecld_schema: Clear Rates schema, e.g.tq_dev.internal_dev_csong_cld_v2_3_0ssps: list of SSP IDs to price
Outputs:
tq_production.consumer_prices.pricing_service_ratestq_production.consumer_prices.pricing_service_ssp
2. Run Consumer Specific Provider Table DAG
DAG parameters:
ps_version: version name, e.g.2025_11
Outputs:
-
tq_production.consumer_prices.pricing_service_ref_provider
API Team Update
Last Updated: 2025-12
API team posts in #rates-api-dev, with a link to a Notion page. The purpose of this page is to track the data tables that need to be updated with this month's API refresh.
There are two columns in the "Data Tables" section for us to update: Review and Table Ready?
Importantly, if there are schema changes (columns added/removed or data type changes), we need to leave a note in the "Exceptions" column.
There are three relevant Consumer tables:
- api_pricing_service_rates
- api_pricing_service_ssp
- api_pricing_service_ref_provider