Core Capabilities

Dataset Intelligence

Overview

Before you can trust a model, you must trust the dataset you use to evaluate it. Dataset Intelligence validates the health, quality, and compliance of your benchmark datasets.

CLI Validation

The Dataset Validation CLI evaluates schemas, quality, duplicates, and missing fields to compute the Dataset Health Score (DHS).

openvals -- validate-dataset
(openv)to-00016@chintu-00:~/Projects/openvals$openvals validate-dataset finance
🔍Validating dataset: finance
===================================
OpenVals Dataset Validation
===================================
Status : Healthy
Samples: 10
Schema Validation
✓ Passed
Quality Validation
Empty Prompts: 0Empty Outputs: 0Duplicate Prompts: 0Short Prompts: 0Short Outputs: 0
Dataset Health Score:100
Health Status       : Healthy
===================================

Examples

Validate custom datasets or pre-packaged domain benchmarks:

openvals validate-dataset finance
openvals validate-dataset ./customer_dataset.json
openvals validate-dataset ./customer_dataset.csv