Getting Started

This application enables organizations to monitor, validate, and manage data quality by executing rules against datasets that are logically organized into products and domains.

Hierarchy
Organization → Domains → Products → Rules

Before working with data quality rules, the following prerequisites must be met:

  • You must create or join an organization, which represents your subscription.
  • At least one domain must exist (logical groupings such as Customer Data or Product Data).
  • Products must be created under a domain (datasets/tables monitored for quality).
  • Rules must be defined to validate data contained in those products.

First-Time Setup

  1. Sign up or log in to the application.
  2. Create your first domain.
  3. Add a product within that domain.
  4. Define at least one data quality rule.
  5. Schedule and activate the rule.

Users and Permissions

Access control follows a hierarchical and intentionally restrictive model to ensure data integrity and minimize unauthorized changes.

Permissions can be assigned at the following levels:

  • Organization level
  • Domain level
  • Product level

Permission Roles

Role Permissions
Admin Full access including user management, billing, and access to all domains and products.
Contributor Create and edit domains, products, and rules.
Reader View-only access.

Invite Users

User and invitation management is handled through the secure identity service provided by Clerk.com. Inviting users requires administrator privileges.

  1. Navigate to Settings.
  2. Select Users.
  3. Enter the email address and send the invitation.

The invited user receives an invitation email shortly after. Once accepted, the administrator receives a confirmation notification and can assign roles and permissions at the organization, domain, or product level.

Delete Users

  1. Navigate to Settings → Users.
  2. Click the Delete button next to the user.

Deleting a user also removes any corresponding invitations. All organization members appear as Member, except the user who created the subscription, who is designated as Admin. To remove or replace the Admin, contact customer support.

Revoke Invitations

  1. Navigate to Settings → Users.
  2. Click Revoke next to the invited email address.

Set Permissions

Permissions can be scoped precisely to control access and allowed actions.

Organization Level
  • Assigns a global Admin role
  • Applies to all domains and products
  • Grants create, read, edit, and delete permissions
  • Enables user management, invitations, permissions, and connection management
Domain Level
  • Contributor: create, read, edit, and delete items within the domain
  • Reader: read-only access within the domain
Product Level
  • Contributor: create, read, edit, and delete items within the product
  • Reader: read-only access within the product

Connections

Connections allow the application to securely access external data sources. Connections can be scoped for use at the organization, domain, or product level.

Create a Connection

  1. Navigate to Settings → Connections.
  2. Click New Connection.
  3. Select the connection type and complete the required fields.
  4. Follow permission and firewall requirements for the selected data source.
  • Credentials (usernames, passwords, tokens) are stored securely using a two-layer Azure Key Vault.
  • If created during rule creation, the connection is automatically assigned to the parent product of that rule.

Edit a Connection

  1. Select a connection from the list.
  2. Click Edit.
  3. Update fields and save.
All changes propagate automatically to every rule using that connection.

Delete a Connection

  1. Select the connection from the list.
  2. Click Edit.
  3. Scroll to the bottom and select Delete.
  4. Confirm deletion.
A connection can only be deleted once all associated rules have been removed.

Connection Permissions

To use a connection when creating rules, it must be assigned to the correct scope:

  • Organization-level connection: available to all products, present and future.
  • Domain-level connection: available to all products within the domain, present and future.
  • Product-level connection: available only to the assigned product.

Domains

Domains organize products by business context, such as Finance, Marketing, or Operations.

Create a Domain

  1. Navigate to the home screen.
  2. Click Create Domain.
  3. Enter a name and description.
  4. Save.

Edit a Domain

  • Update the domain name or description.
  • Changes automatically propagate to all associated products.

Delete a Domain

  • Deletion is only allowed if no active products exist.
  • Domain deletion is irreversible.

Add Goals to a Domain

Goals define what constitutes “good data” at the domain level.

Using the Goal Assistant Agent

  1. Open a domain.
  2. Navigate to Goals.
  3. Click Add Goal to define a business objective in natural language.
  4. Launch the Goal Assistant.
  • The Goal Assistant suggests three data quality–related business goals based on the domain name. Therefore it is important that the domain name is descriptive.
  • Suggestions can be edited to align with organizational objectives.
  • After confirmation, goals can be referenced during rule creation.

Products

Products represent specific datasets, systems, or data sources within a domain.

Create a Product

  1. Open a domain.
  2. Click Add Product.
  3. Enter the product name.
  4. Save.

Edit a Product

  • Update product metadata as needed.

Delete a Product

  • All associated rules must be deleted before the product can be removed.

Rules

Rules define how data is validated and monitored.

Create a Rule

  1. Navigate to a product.
  2. Click Create Rule.
  3. Select an existing connection or create a new one.
  4. The application lists all accessible tables using the connection credentials.
  5. Click Add Rule to open the rule definition window, or use the AI assistant.

Rule Assistant

  • Profiles a sample row set to identify column types, value distributions, and descriptive statistics.
  • Only metadata from profiling is evaluated; the AI engine never accesses actual data values.
  • Generates suggested data quality rules based on profiling.

Typical workflow:

  1. Select a suggested rule.
  2. Review the top five filtered records in the rule editor.
  3. Adjust the query using SQL or the no-code editor.
  4. Review generated title, description, and recommended actions.
  5. Set priority and monetary value per faulty record. The monetary value describes the incurring cost or the lost revenue per faulty record in the dataset.
  6. Configure a unique identifier (manual or auto-generated).
  7. Set scheduling and notification preferences.
  8. Confirm the rule.

Manual Rule Creation

  1. Review the top five records of the dataset.
  2. Define the query using SQL or the no-code editor.
  3. Set title, description, and actions.
  4. Set priority and monetary value per faulty record. The monetary value describes the incurring cost or the lost revenue per faulty record in the dataset.
  5. Configure a unique identifier (manual or auto-generated).
  6. Set scheduling and notifications.
  7. Confirm the rule.

Schedule Rules

Rules can be scheduled to run at most once per hour. Select execution frequency (hourly, daily, or weekly) and execution time. Once scheduled, the rule executes automatically and logs faulty records.

Enable Notifications

  • Notification emails can be configured for scheduled rules.
  • Emails are only sent when new data quality issues are detected.
  • Multiple email addresses can be added (comma-separated).
  • Recipients do not need to be application users, but a user license and read permission are required to view issues.

Edit Rules

On the product page, all rules are listed. Rules can be edited individually or updated in bulk for scheduling and notifications.

Batch Rule Edit

  1. Select rules using checkboxes (search can be used to filter).
  2. Click Batch Edit.
  3. Update scheduling or notification settings for all selected rules simultaneously.

Delete Rule

Rules can be deleted from the product page by selecting the rule and clicking Delete.

Exception Management

To review records identified by a rule, navigate to the product page and select See Exceptions.

Exception View Tabs

  • Open issues: unresolved data quality issues.
  • Closed issues: previously faulty records that are now resolved (includes auto-closed issues).
  • Snoozed issues: temporarily ignored until a specified date.
  • Whitelisted issues: accepted and acknowledged exceptions.

Setting Status

  1. Navigate to the appropriate tab.
  2. Select the record.
  3. Scroll to the right and choose a status from the dropdown.
Statuses are non-deterministic and can be overwritten. Snoozed records are excluded from open issue counts until the snooze period ends.

Batch Status Setting

  1. Select records using checkboxes (search can be used to filter).
  2. Choose the desired status from the dropdown.