Core Capabilities
Executive Reporting
Overview
OpenVals provides executive-grade, audit-ready reporting to bridge the gap between technical evaluation metrics and business/governance decisions.
Dashboard Report
The high-level dashboard (generated as report.html) compiles global insights:
- Trust Dashboard: Visual summary of overall system reliability.
- DRS Ranking: Normalized comparison of all benchmarked models.
- Operational Insights: Latency, cost, and throughput metrics.
- Governance Readiness: compliance alignment indices.
- Risk Analysis: Factual risk and hallucination breakdown.
- Visual Analytics: Charts and heatmaps.
Sample-Level Report
The deep-dive report (generated as sample_report.html) allows sample-by-sample analysis:
- Prompt & Expected Output vs. Actual Model Output.
- Per-sample Accuracy and Semantic scores.
- Factuality & Hallucination Risk breakdown.
- Safety and Latency diagnostics.