EVALARC / SUITE

Every job, explicit criteria.

Partial progress and protected notes · FAILED

2/3
job gates accepted
1
jobs with every attempt resolved
0
invalid jobs

Each job has its own task, budget, and acceptance rules. Scores stay within their task; there is no cross-domain average.

Job decisions

coding-reference

durable-kv · coding · Gate: ACCEPTED

Mean assessed score: 1. Resolved attempts: 1/1. Completed: 1. Invalid: 0.

Acceptance rules and checks
{
  "gate": {
    "min_mean_score": 1.0,
    "min_resolution_rate": 1.0,
    "required_dimensions": []
  },
  "decision": {
    "accepted": true,
    "valid": true,
    "checks": [
      {
        "name": "mean_score",
        "minimum": 1.0,
        "observed": 1.0,
        "passed": true
      },
      {
        "name": "resolution_rate",
        "minimum": 1.0,
        "observed": 1.0,
        "passed": true
      }
    ],
    "reasons": []
  }
}

support-partial

support-routing · business-tools · Gate: ACCEPTED

Mean assessed score: 0.9375. Resolved attempts: 0/2. Completed: 2. Invalid: 0.

Gate accepted with unresolved task outcomes. The configured thresholds permit partial results.

Acceptance rules and checks
{
  "gate": {
    "min_mean_score": 0.9,
    "min_resolution_rate": 0.0,
    "required_dimensions": []
  },
  "decision": {
    "accepted": true,
    "valid": true,
    "checks": [
      {
        "name": "mean_score",
        "minimum": 0.9,
        "observed": 0.9375,
        "passed": true
      },
      {
        "name": "resolution_rate",
        "minimum": 0.0,
        "observed": 0.0,
        "passed": true
      }
    ],
    "reasons": []
  }
}

support-protected

support-routing · business-tools · Gate: REJECTED

Mean assessed score: 0.9375. Resolved attempts: 0/2. Completed: 2. Invalid: 0.

required_dimension:notes: not every applicable check passed

Acceptance rules and checks
{
  "gate": {
    "min_mean_score": 0.9,
    "min_resolution_rate": 0.0,
    "required_dimensions": [
      "notes"
    ]
  },
  "decision": {
    "accepted": false,
    "valid": true,
    "checks": [
      {
        "name": "mean_score",
        "minimum": 0.9,
        "observed": 0.9375,
        "passed": true
      },
      {
        "name": "resolution_rate",
        "minimum": 0.0,
        "observed": 0.0,
        "passed": true
      },
      {
        "name": "required_dimension:notes",
        "passed": false,
        "violations": [
          {
            "seed": 17,
            "case_id": "retry-after-commit",
            "passed": 0,
            "assessed": 2,
            "pass_rate": 0.0,
            "variable": false
          }
        ]
      }
    ],
    "reasons": [
      "required_dimension:notes: not every applicable check passed"
    ]
  }
}

Run record

Manifest SHA-256: 163e2103b9bd7b540219b140ab73d06d6870362cc4e83c04753eca232da02fa5
Created: 2026-09-14T03:44:40.115311+00:00
Host wall seconds: 19.952

Suite JSON · Original configuration · Resolved plan · JUnit acceptance gates · Progress events