Deprecation Guide: Unified Tests
This guide explains the new Unified Tests, the upcoming migration for legacy tests, and what the "Planned Deprecation" warnings in the UI mean for you.
What is changing?
Historically, our platform treated "Row Count" checks and "Percentage" checks as completely separate test types. You had to choose between:
not_null: Strict check (e.g., "Fail if any rows are null").null%: Trend check (e.g., "Fail if more than 5% of rows are null").
We have consolidated these into single, flexible Unified Tests. You can now select a logic check (like null) and simply toggle how you want to measure failure—by row count, percentage, or automatic detection—all within a single screen.
The New Unified Tests
The following test types support flexible thresholds:
Null
not_null, null%
Checks for missing values.
Unique
is_unique, unique%
Checks for duplicate values.
is_email
Validates email format compliance.
UUID
is_uuid
Validates UUID format compliance.
Flexible Threshold Modes
When configuring these tests, you can now choose between three modes:
Absolute (Row Count): Best for strict data contracts.
Example: "Fail when null values > 0 rows."
Percentage: Best for monitoring trends in large datasets.
Example: "Fail when null values > 5%."
Automatic: The system automatically calculates thresholds based on your historical data (available for Scheduled monitors).
These thresholds modes now also apply to other existing tests, like Regex Match test.
Deprecation Notice
As part of this update, we are deprecating the older, rigid test types.
Which tests are affected?
If you see a "Planned Future Deprecation" warning in the UI, it applies to one of these legacy tests:
not_nullnull%is_uniqueunique%is_emailis_uuid
Do I need to take action?
For Existing Monitors: No. Your existing tests continue to run normally. You do not need to delete or change them.
For New Monitors: We recommend using the new Unified Test types (e.g., use
nullinstead ofis_null) to take advantage of the improved features and scorecard inclusion.
Automatic Migration Plan
To make this transition seamless, we will handle the migration of your legacy tests automatically in a future release (Phase 2).
How it will work
We will convert your legacy configuration into the equivalent Unified Test format. This ensures your monitoring logic remains exactly the same.
Example 1: A legacy
null%test with a threshold of5%will become a Unifiednulltest with a Percentage threshold of5%.Example 2: A legacy
is_nulltest (which fails on 1 bad row) will become a Unifiednulltest with an Absolute threshold of0 rows.
Note: We will provide a distinct notice through your account manager before this automatic migration occurs.
Impact on Data Quality Scorecard
This update significantly improves your Data Quality Scorecard accuracy.
Previously: Legacy percentage tests (like
null%orunique%) were excluded from scorecard calculations.Now: All Unified Tests—whether using Absolute or Percentage thresholds—are included in the Data Quality Scorecard.
FAQ
Q: Will the migration change my historical data?
No. Your incident history and scan results will be preserved. Once migrated, historical data for not_null will simply appear under the history for the new null test.
Q: I use the API. How does this affect me?
We have introduced a standardized threshold schema for these new tests. If you programmatically create monitors, please review the API Documentation to adopt the new schema.
Last updated