Rubric changelog

Every change to how we score, with the date and the reason. Weights change only in a new version, and a new version is logged here before any score uses it.

Credentialing Scorecard is operated by Metolius Health, which is listed in our Software and Managed Services tracks. Rubric changes apply to every vendor at once, including our operator. Disclosure

What is logged on this page?

Changes to the rubric: dimensions, weights, scoring scales, the evidence rule and the composite threshold. A single vendor’s score moving because of new evidence is logged in listing and score changes instead.

Entries (newest first)

v1.1 — September 30, 2026

Status: Current

• Add a separately labeled documented capability score after 8/12 capabilities and all four core areas have cited evidence. This is documented scope, not performance.
• Show capability coverage beside scores, with weighted coverage and full/partial/unsupported counts on profiles. Unknown evidence is excluded; different coverage limits comparison. Listings remain A–Z.
• Below the threshold, show sourced capability areas rather than “Pending evidence.” An affirmative source is required for an unsupported finding; omission does not establish absence.
• Correct overall calculation to normalize each layer before applying 60% capability and 40% quality. Preserve every dimension’s relative weight. Earlier code pooled raw weights totaling 77/40, contradicting the stated split.
• Preserve the overall gate: 12 total dimensions, all four core capabilities, at least three quality dimensions. No existing overall ratings change; none were eligible. Publish quality rating anchors before future subjective assessments.
• Apply these rules to both tracks independently and to the operator without an override.

Why: readers need usable scope comparisons while independent quality evidence is incomplete. The calculation must match the published layer split. These rules implement the approved scoring update recorded in ADR-CS-005.

v1.0, published with the site’s launch

Status: Superseded by v1.1

Summary: First published rubric.

• Dimensions: 18 in total. 12 capability dimensions (60% of the composite) and 6 quality dimensions (40%). See all 18 with weights
• Tracks: Software Platforms and Managed Services are scored and listed separately, never head-to-head.
• Capability scale: none, partial or full, from cited evidence.
• Quality dimensions: scored from cited evidence.
• Evidence rule: no source, no score. A dimension without a cited, dated source shows “Not yet scored”.
• Composite threshold: a composite is published only when at least 12 of the track’s applicable dimensions are evidenced, including every capability dimension worth 8 points or more.
• NCQA status: recorded from NCQA’s certification directory only, re-pulled every quarter.
• Weights: fixed. No buyer-type re-weighting in this version.
• Operator: Metolius Health is scored by the same code, with no override.

Why: the rules had to be fixed and public before any vendor was scored, including the vendor that operates this site.

How versions are numbered

A new dimension, a weight change or a threshold change is a new minor version (v1.1). A change to the structure, such as adding buyer-type weights or a third track, is a new major version (v2.0). Wording fixes that change no score are not versioned.