Enable asset monitoring

Transform your data quality management with Decube's comprehensive monitoring system. This guide walks you through setting up, managing, and optimizing monitors for your critical data assets.

Quick Start Checklist ✅

Before setting up monitors, ensure you have:

• Data source connected and accessible

• Critical tables identified for monitoring

• Alert channels configured (email/Slack) in Config Settings

Time Investment: 15-30 minutes for initial setup, 5 minutes per additional monitor

Monitoring Management Hub

Our Config module provides a centralized control center for all your data quality monitoring needs.

All Monitors Tab

• Once you click on Config in Navigation bar, you will land on All Monitors tab:

  • Within the "All Monitors" tab, users have the capability to edit, enable/disable, or even delete any previously configured monitors. To access these options, simply click on the ellipsis menu (︙), located at the far right of the selected monitor.

• Once you click on ellipsis menu (︙), you will see 2 options View monitor and Monitor Info:

  • View Monitor: Once you click on view monitor, a form will pop-up which gives you option to modify, disable and delete monitor.

• Monitor Info: Once you click on Monitor Info, you’ll see 2 tabs History and Performance.

  • History: Displays the Timestamp and status for the running monitors. Status includes:

    • Passed - The test was executed and result was passed.

    • Failed - The test was executed and result was failed.

    • Skipped - The test was skipped as metrics were not able to be collected or the baseline threshold has not been established.

    • Errored - The test was unable to be executed. Please reach out to [email protected] for support on this error.

• Performance: Displays the progress for the running monitor

Create

Navigate to Config > Create to set up new monitors for your data assets. Choose from our comprehensive monitor types designed for different data quality requirements:

Available Monitor Types

🔄 Freshness Monitoring

• Purpose: Monitors data update intervals and detects stale data

• Best For: Real-time dashboards, daily reports, SLA compliance

• Setup Time: ~5 minutes

📊 Volume Monitoring

• Purpose: Tracks row count changes and detects data load anomalies

• Best For: ETL validation, data pipeline monitoring

• Setup Time: ~5 minutes

🔍 Field Health Testing

• Purpose: Column-level validation (nulls, uniqueness, ranges, patterns)

• Best For: Data integrity, compliance, ML data preparation

• Setup Time: ~10 minutes per field

🔧 Custom SQL Monitoring

• Purpose: Advanced business rule validation with custom logic

• Best For: Complex data relationships, business-specific requirements

• Setup Time: ~15 minutes

⚙️ Auto-Enabled Monitors

• Schema Drift: Automatically monitors table structure changes

• Job Failure: Auto-configured for ETL tools (dbt, Airflow, etc.)

Getting Started Recommendations

For Data Engineers 👨‍💻

1. Start Here: Freshness & Volume for critical tables

2. Add Next: Custom SQL for business logic validation

3. Advanced: Field Health for pipeline data validation

For Governance Teams 🛡️

1. Start Here: Review auto-enabled Schema Drift monitoring

2. Add Next: Field Health for compliance requirements

3. Advanced: Grouped-By monitoring for business segments

For Platform Admins 👤

1. Start Here: Configure Job Failure for all ETL processes

2. Add Next: Volume for data load validation

3. Advanced: Config Settings for default monitoring behavior

Monitor Status & Lifecycle

Once monitoring is activated for an asset, you can track all monitor states:

• 🟢 Active: Monitor running on schedule with alerts enabled

• 🟡 Inactive: Monitor configured but temporarily disabled

Access detailed monitor management through the All Monitors Tab for complete visibility and control.

Next Steps

1. ✅ Choose your monitor type from the options above

2. ⚙️ Configure alert channels in Config Settings

3. 🎯 Set up your first monitor using our step-by-step guides

4. 📊 Monitor performance and adjust thresholds as needed

Need Help? Contact [email protected] for assistance with monitor setup and optimization.