OpenValsDocumentation
Core Capabilities

Executive Reporting

Overview

OpenVals provides executive-grade, audit-ready reporting to bridge the gap between technical evaluation metrics and business/governance decisions.

Dashboard Report

The high-level dashboard (generated as report.html) compiles global insights:

  • Trust Dashboard: Visual summary of overall system reliability.
  • DRS Ranking: Normalized comparison of all benchmarked models.
  • Operational Insights: Latency, cost, and throughput metrics.
  • Governance Readiness: compliance alignment indices.
  • Risk Analysis: Factual risk and hallucination breakdown.
  • Visual Analytics: Charts and heatmaps.

Sample-Level Report

The deep-dive report (generated as sample_report.html) allows sample-by-sample analysis:

  • Prompt & Expected Output vs. Actual Model Output.
  • Per-sample Accuracy and Semantic scores.
  • Factuality & Hallucination Risk breakdown.
  • Safety and Latency diagnostics.
OpenVals Docs