For the complete documentation index, see llms.txt. This page is also available as Markdown.

Custom Scheduling For Monitors

The scan frequency options available for Scheduled monitors and the additional settings each frequency exposes.

Custom scheduling applies to Scheduled monitors only. On-Demand monitors are triggered manually and do not use a frequency setting.

Scan frequency controls how often a Scheduled monitor runs. The frequency you choose also determines how much historical data the ML model collects during training — higher-frequency monitors collect a shorter lookback window; lower-frequency monitors collect a longer one. See the historical lookback table.


Available frequencies

Frequency
Additional settings

Every 1 hour

Timezone

Every 3 hours

Timezone

Every 6 hours

Timezone

Every 12 hours

Timezone

Daily

Timezone, time of day

Weekly

Timezone, day of week, time of day

Monthly

Timezone, day of month (or last day), time of day

Frequency selector for a Scheduled monitor

Daily scheduling

For daily monitors, you configure:

  • Timezone — the timezone used to interpret the scheduled time

  • Time of day — the hour at which the monitor runs (24-hour format)

Daily scheduling options

Schedule daily monitors to run after your ETL jobs complete, so the scan reflects the latest data.


Weekly scheduling

For weekly monitors, you configure:

  • Timezone

  • Day of week — which day the monitor runs

  • Time of day

Weekly scheduling options

Monthly scheduling

For monthly monitors, you configure:

  • Timezone

  • Day of month — a specific date (up to the 28th) or the last day of the month

  • Time of day

Use the last day of the month option when you need to monitor month-end data regardless of whether the month has 28, 30, or 31 days.

Monthly scheduling options

Choosing the right frequency

Match the scan frequency to how often your data actually changes:

  • If your pipeline loads data hourly, an hourly monitor catches issues within the same cycle.

  • If your pipeline runs once daily (for example, a nightly ETL), a daily monitor scheduled shortly after the load completes is sufficient.

  • For reference tables or slowly-changing dimensions, weekly or monthly is appropriate.

Available Monitor Modes

Last updated