Skip to main content

Data Quality

The Data Quality monitor helps you track the health of your data ingestion processes and catch problems early.

Screenshot of the Data Quality page showing stats cards (Success Rate, Rows Ingested, Failures, Jobs Run) and the ingestion history table

Quality Dashboard

Summary Cards

MetricWhat It Means
Success RatePercentage of successful ingestion jobs in the last 100 runs
Rows IngestedTotal rows successfully imported across all jobs
FailuresNumber of failed ingestion jobs
Jobs RunTotal number of ingestion jobs executed

Ingestion History

A detailed table of all ingestion jobs with:

ColumnDescription
Status✅ Success, ⚠️ Warning (partial), ❌ Failed
File/SourceSource file name or pipeline connection
Started AtWhen the job began
DurationHow long the job took
RowsNumber of rows processed
TransferredData volume transferred
InfoAdditional notes or error messages

The history updates in real-time — a pulsing indicator shows when new data is being loaded.

Interpreting Quality Issues

Common Problems and Solutions

ProblemPossible CauseSolution
Type mismatchColumn contains mixed types (e.g., numbers and text)Clean the source data or use a transformation
Null key columnPrimary key column has empty valuesRemove empty rows or choose a different key
Schema driftSource schema changed (new/removed columns)Re-configure the pipeline or update the dataset
Connection timeoutDatabase connection droppedCheck network/firewall settings and retry
File format errorCorrupted or incorrectly formatted fileVerify the file opens correctly in Excel
info

Tip: A healthy workspace maintains a success rate above 95%. If you see many failures, check your pipeline connections and source data quality.