Skip to main content

Monthly Refresh Process

1. Run Core Pricing Service DAG

DAG parameters:

  • ps_month: version name, e.g. if ps_month is 2025_11, then table will be named tq_dev.internal_dev_csong_consumer_pricing_service.pricing_service_rates_2025_11
  • core_rates_month: select latest core rates month, e.g. 2025_10
  • ps_schema: target schema, e.g. tq_dev.internal_dev_csong_consumer_pricing_service
  • cld_schema: Clear Rates schema, e.g. tq_dev.internal_dev_csong_cld_v2_3_0
  • ssps: list of SSP IDs to price

Outputs:

  • tq_production.consumer_prices.pricing_service_rates
  • tq_production.consumer_prices.pricing_service_ssp

2. Run Consumer Specific Provider Table DAG

DAG parameters:

  • ps_version: version name, e.g. 2025_11

Outputs:

    • tq_production.consumer_prices.pricing_service_ref_provider
API Team Update

Last Updated: 2025-12

API team posts in #rates-api-dev, with a link to a Notion page. The purpose of this page is to track the data tables that need to be updated with this month's API refresh.

There are two columns in the "Data Tables" section for us to update: Review and Table Ready?

Importantly, if there are schema changes (columns added/removed or data type changes), we need to leave a note in the "Exceptions" column.

There are three relevant Consumer tables:

  • api_pricing_service_rates
  • api_pricing_service_ssp
  • api_pricing_service_ref_provider