hti-5 source attributes · clinical ai evidence checklist
HTI-5 Source Attributes: Clinical AI Evidence Checklist
November 8, 2026
30 min read
Versioned buyer checklist for predictive clinical AI after ONC's October 2026 HTI-5 final rule: 11-row evidence request matrix, FDA vs ONC decision table, scoring rubric, and evidence-gap register for 2026.

- 01HTI-5 takes effect December 28, 2026 and removes source attribute and predictive-DSI risk management requirements, shifting evidence collection to buyer contracts and governance files.
- 02FDA authorization and ONC certification address different scopes; neither proves benefit at a given hospital.
- 03Use a versioned request set covering intended use, development data, fairness, external and local validation, monitoring, updates, and incident handling.
- 04Record evidence level separately from result status: missing evidence is a gap, while failed evidence falls below thresholds set before reviewing supplier data.
- 05Set contract terms for continuing disclosure, model-change notice, monitoring responsibility, audit rights, and rollback, then recheck as rules and model versions change.
Executive Summary
Buyers of predictive clinical decision support now face a changed evidence baseline. The Office of the National Coordinator for Health Information Technology (ONC, within the Assistant Secretary for Technology Policy, ASTP) finalized its "HTI-5" deregulatory rule in the Federal Register on October 28, 2026, and the rule is effective December 28, 2026, apart from three amendatory instructions that start January 1, 2027 ([1]). For decision support interventions (DSIs), the final amendatory text removes paragraphs (b)(11)(iv) through (vi) of 45 CFR 170.315 ([2]). Those paragraphs carried the source attribute support, source attribute access and modification, and predictive-DSI intervention risk management requirements that HTI-1 introduced in 2024. ONC's stated reasons were that it identified no evidence of reliance on the requirements ([3]) and that most clinical users lack the time or technical background to use the information ([4]).
The practical consequence is a shift of evidence collection from a certification baseline to the buyer's contract and governance file. HTI-1 required a certified module to support up to 31 predictive-DSI source attributes ([5]), but only for models the developer supplied ([6]). After the effective date, ONC says the information is not "unknown or unavailable" and encourages users to ask developers for it ([7]). A large majority of commenters opposed the proposal ([8]), and, in its discussion of the legacy clinical decision support criterion, ONC said it will further consider whether the prior CDS source-attribute transparency requirements in § 170.315(a)(9)(v), or similar requirements, should be reinstated ([9]). That statement concerns the legacy evidence-based-intervention requirements, not the removed predictive-DSI requirements. A stable, versioned request set is therefore safer than one keyed to a single rule text; the scope bullet under "What remains uncertain" shows how far the final rule moved from the proposal.
This report supplies that request set: a decision table separating FDA device authorization from ONC certification, an eleven-row request matrix keyed to the former HTI-1 attribute categories, a missing-versus-failed scoring rubric, an evidence-gap register template, and a contract and recheck routine. The evidence base for urgency is quantitative. Hospitals reported 71% use of EHR-integrated predictive AI in 2024 ([10]), yet among 903 FDA-listed AI devices analyzed in a 2025 peer-reviewed study, 55.9% reported a clinical performance study, and among the 505 studies reported only 8.1% were prospective (a share of studies, not of devices) ([11]) ([12]). FDA says its own public summaries do not include most of the submitted information ([13]).
Three cautions apply. FDA authorization and ONC certification address different scopes, and neither proves benefit at a given hospital. ONC's own test method sets no specific validity or fairness thresholds ([14]). And the sources reviewed here are still mid-transition: as of November 8, 2026 the Code of Federal Regulations (eCFR) page for 170.315 was current only to November 5, 2026 ([15]), so readers should confirm codification status before relying on any paragraph number. This is analysis, not legal advice; compliance questions belong with counsel and regulatory affairs staff.
Predictive-DSI source attributes supported under the former HTI-1 criterion
Non-federal acute care hospitals using EHR-integrated predictive AI in 2024
Share of 903 devices with clinical performance studies reported in public summaries
Prospective share of the 505 reported studies, not of devices
Introduction and Background
Hospital innovation committees, medtech product teams, and life-sciences partners routinely ask the same question when a predictive tool reaches procurement: what evidence is enough? The question became harder in 2026. A proposed rule published on December 29, 2025 would have removed the DSI transparency requirements, with comments due by 5 p.m. Eastern Time on February 27, 2026 ([16]). ONC's proposal described the change as removing requirements "regarding source attribute support, access, and modification" ([17]). The final rule followed in October 2026. Earlier coverage, including the proposal itself, describes the removal only as a proposal, and ONC's decision support test method page still displays the full HTI-1 text under Certification Companion Guide version 1.10, whose revision note reads "Removed expired standards and deadlines." ([18]) This report treats the Federal Register final rule as controlling and the test method as the best available description of what the former attributes contained.
The checklist below is deliberately not an overview of the law. It asks what a supplier should be able to show, what artifact is acceptable, who inside the buyer's organization owns the review, and what to record when the evidence is absent. The row structure follows the categories ONC used for predictive DSI source attributes (purpose, development data, fairness, external validation, performance, maintenance, updating) because those categories were designed around the questions a clinician or governance committee needs answered. ONC's own stated aim for them was to let users judge whether a predictive DSI is "acceptably fair, appropriate, valid, effective, and safe." ([19])
First-party perspective. IntuitionLabs is a life-sciences and AI consultancy. This report does not evaluate IntuitionLabs offerings. The material below is an analyst framework built from regulator, standards-body, and peer-reviewed sources. Where a statement is an editorial policy view, it is labeled as such.
Which Regime Applies: A Decision Table
Three different authorities touch a predictive clinical tool, and they do not overlap neatly. FDA regulates devices. ONC regulates health IT developers that voluntarily certify modules under its Certification Program. A third source is the Department of Health and Human Services (HHS) nondiscrimination rule, which places a duty on covered entities that use patient care decision support tools. ONC itself noted in HTI-1 that FDA and ONC "have separate and distinct authorities and regulate for separate and distinct purposes." ([20]) ONC also declined to exclude FDA-regulated or non-device software from its predictive DSI definition ([21]), so a single tool can sit inside both regimes.
On the FDA side, the Clinical Decision Support (CDS) Software guidance, reissued January 29, 2026 ([22]), keeps the four-criterion test for non-device software. Criterion 4 requires that the clinician be able to independently review the basis for a recommendation ([23]), and FDA does not consider functions intended for a critical, time-sensitive task or decision to meet it ([24]). Its example of software that detects a life-threatening condition such as stroke or sepsis and alerts a clinician is a device function ([25]). Software aimed at patients or caregivers is addressed separately and treated as meeting the device definition ([26]).
On the ONC side, a predictive DSI is technology based on algorithms or models that derive relationships from training data ([27]). The Certification Companion Guide says a developer is not accountable for populating source attributes for predictive DSIs it does not supply ([28]), while "supplied" includes other-party models the developer has included, because it then has taken on stewardship and accountability ([29]). Table 1 below organizes these overlaps into a decision table. It is an analytical aid, not a classification of any product.
Table 1. Applicability decision table (analyst framework, status as of November 8, 2026)
| Scenario | FDA device authorization | ONC certified health IT obligation | What the buyer should do |
|---|---|---|---|
| A. Predictive alert inside an EHR module, supplied by the EHR developer, time-critical use | Likely a device function under the CDS guidance. Ask for the authorization number and indications for use. | HTI-1 source attributes applied to supplied predictive DSIs ([30]) until HTI-5 takes effect on December 28, 2026. After that, no federal attribute baseline. | Request both the FDA documents and the former attribute set by contract. |
| B. Risk score inside an EHR module, supplied, clinician-reviewable, not time-critical | May be non-device CDS if all four criteria hold. Ask the supplier for its written criteria analysis. | Same as A. | Request the attribute set. Do not treat "non-device" as a signal of lower evidence needs. |
| C. Third-party model connected to a certified EHR but not supplied by the developer | Depends on the model's own classification. | Developer is not accountable for populating attributes for models it does not supply. Developers must give users the capability to populate attributes (HTI-1 text). | Obtain the evidence from the model owner directly. Record who supplies the model. |
| D. In-house model built by the hospital | Classification depends on the facts of development and use. Confirm with regulatory counsel. | Outside the developer's duty. | The hospital is its own supplier: apply the same rows to internal teams. |
| E. Standalone clinical AI product, not part of a certified module | Often a device with a public authorization record ([31]). | No ONC certification duty unless the product is part of a certified module. | Use FDA documents plus Table 2 rows. Ask what the FDA summary omits. |
| F. Patient-facing or caregiver-facing recommendation tool | Treated as meeting the device definition under the CDS guidance. | Not specific to ONC unless integrated. | Request authorization status and usability evidence for lay users. |
Table 1 shows why a single "FDA cleared" or "ONC certified" label cannot settle diligence. Rows A and B can look identical to a clinician at the bedside yet carry different FDA status, and rows C and D fall outside the developer's certification duty entirely. In a Regulatory Review opinion piece published August 6, 2026, a clinical AI founder argued that non-device decision support, internally developed models, and generative AI assistants frequently fall outside FDA oversight ([32]). That is an editorial position, not a measurement, but the classification logic in the table is consistent with it. For federal nondiscrimination purposes, the HHS definition of "patient care decision support tool" covers any automated or non-automated tool, mechanism, method, technology, or combination thereof ([33]), so the duty reaches beyond AI.
Key Changes: HTI-1 Today, HTI-5 Tomorrow
What the HTI-1 criterion required
HTI-1, published January 9, 2024 and effective February 8, 2024, created the DSI criterion at 170.315(b)(11). ONC's fact sheet states that it supports 31 source attributes for predictive DSIs. Developers with the earlier clinical decision support certification had to update to the new criterion by December 31, 2024. Conformance is by attestation to the certification body ([34]), not by an ONC-run performance test.
The predictive attribute set grouped into categories that map directly to a buyer's questions:
- Details and output: developer name and contact information.
- Purpose: intended use ([35]) and intended decision-making role.
- Cautioned out-of-scope use: tasks, situations, or populations where users are cautioned against use ([36]), plus known risks and limitations.
- Development data: inclusion and exclusion criteria for training data ([37]), demographic representativeness ([38]), and relevance of training data to the deployed setting.
- Fairness in development: approaches to manage, reduce, or eliminate bias.
- External validation: the testing party and the validation process ([39]).
- Performance: validity on same-source test data, fairness on external data, and outcome-evaluation references.
- Ongoing maintenance and updating: validity in local data ([40]), fairness in local data, update process and frequency ([41]).
Separately, HTI-1 required risk management practices for supplied predictive DSIs, covering risk analysis across validity, reliability, robustness, fairness, intelligibility, safety, security, and privacy ([42]), mitigation, and governance of data acquisition and use. ONC did not prescribe a framework. For several attributes the module had to indicate when information was not available for review ([43]), and ONC acknowledged that models drawn from the literature may have training data that is not available nor re-creatable. This last point matters to buyers: "unknown" under HTI-1 was a permitted answer, and was never evidence of absence.
What HTI-5 removes
The final rule removes paragraphs (b)(11)(iv) through (vi), which ONC ties to "model cards" that it says "essentially function as nutrition labels" ([44]). It states, "We have finalized removal of the requirements related to" model cards ([45]). The final text also removes the transition-of-care intervention-enablement paragraph (b)(11)(ii)(B) and the conforming maintenance-of-certification duty to review and update source attributes and risk management practices ([46]). The legacy clinical decision support criterion (a)(9) is removed and reserved, with ONC noting this has no further substantive effect because the criterion had already lapsed. ONC's chart lists the DSI criterion as "Revise," not "Remove," with the effective date of the final rule ([47]).
What HTI-5 retains and what ONC says about voluntary information
The electronic feedback requirement for evidence-based DSIs stays, redesignated ([48]). ONC states that removal "does not mean that such information about intended use, provenance, training data, limitations, performance, and known risks is unknown or unavailable" ([49]), and it encourages users to request it from developers. It adds that risk management for supplied predictive DSIs "may still be considered best practices", and that industry-led transparency efforts "have promise". The rule does not require developers to keep publishing the information. Law-firm commentary characterizes the choice as voluntary: one firm advises developers and providers to determine whether to continue providing model card information and risk management voluntarily ([50]), while another observes that vendors continuing to publish model cards may find it sets them apart in procurement ([51]). Hospital and clinician commenters objected, according to a third firm, that the change shifts the burden of vetting AI onto providers ([52]).
What remains uncertain
- Codification lag. The eCFR page for 170.315 was current to November 5, 2026 ([15]), before the December 28 effective date.
- Stale agency pages. The test method page was last revised under version 1.10 and, per this review's reading of the page text, does not mention HTI-5.
- Future rulemaking. In its discussion of the legacy clinical decision support criterion, ONC said it will further consider whether the prior CDS source-attribute transparency requirements in § 170.315(a)(9)(v), or similar requirements, should be reinstated. This statement does not address the removed predictive-DSI requirements in (b)(11)(iv)-(vi).
- Commenter sentiment versus outcome. Many commenters said removal was premature because the requirements had been in effect for less than two years, yet the provision was finalized.
- Scope of criteria changes. The proposal would have removed 34 of 60 criteria ([53]), and the final rule removed 14 and revised seven ([54]), retaining 39. Scope moved materially between proposal and final text, which is itself a reason to build checklists that do not depend on one rule version.
- Supported source attributes for supplied predictive DSIs.
- Required risk management for supplied predictive DSIs.
- Conformance relied on attestation rather than an ONC-run performance test.
- Removes source attribute and predictive-DSI risk management requirements.
- ONC encourages users to request information from developers.
- Continuing publication is voluntary; buyers need contracts and governance files.
FDA authorization and ONC certification address different scopes, and neither proves benefit at a given hospital.
“The central finding is that evidence sufficiency, not regulatory labeling, should drive clinical AI purchasing.
The Buyer's Evidence Request Matrix
The matrix below is the core deliverable. Each row pairs a former ONC attribute category with a request, an acceptable artifact, a suggested internal owner, and red flags. Rows 1 to 8 correspond to attribute categories; rows 9 to 11 add governance and lifecycle items drawn from the former risk management practices and from FDA, Joint Commission, and health-sector guidance.
Two distinctions keep the matrix honest. First, a certified-module obligation (what a certified developer had to support for supplied models) differs from a voluntary request to a third-party model owner, so the "basis" column below labels each row accordingly. Second, FDA public summaries are a partial view: FDA states the list is not a comprehensive resource of AI-enabled devices ([55]), with inclusion based primarily on AI-related terms in the summary descriptions ([56]).
Table 2. Evidence request matrix keyed to former HTI-1 source attribute categories
| # | Evidence domain | ONC anchor (former HTI-1 attribute) | Request to supplier | Accepted artifact | Suggested owner | Red flags |
|---|---|---|---|---|---|---|
| 1 | Intended use and role | Intended use and decision-making role | State the clinical question, user, setting, and whether output informs, augments, or replaces judgment. | Intended-use statement matching FDA indications (if authorized) and the labeling. | Clinical lead | Marketing claims broader than the written intended use. |
| 2 | Intended population and out-of-scope use | Cautioned out-of-scope use and known limitations | Name excluded populations, settings, and tasks. | Labeling, model card, or instructions for use with explicit exclusions. | Clinical lead and patient safety | No exclusions listed for any tool. |
| 3 | Data provenance | Inclusion and exclusion criteria for training data | Describe sources, time window, sites, and label definitions. | Data sheet with collection dates, site counts, and exclusion logic. | Data science lead | "Proprietary" with no summary; labels derived from billing codes with no validation. |
| 4 | Representativeness and relevance | Demographic representativeness and relevance to deployed setting | Provide demographic breakdown of development data versus your population. | Table of age, sex, race and ethnicity, and payer mix against the local population. | Health equity lead | Only aggregate counts; demographic fields missing. |
| 5 | External validation | Testing party and validation process | Name who tested on which independent sites and when. | Peer-reviewed paper or independent report. FDA guidance suggests test data from sites different from development sites ([57]). | Chief medical informatics officer | Validation only on the development site; supplier-authored only. |
| 6 | Performance and fairness metrics | Same-source validity and external fairness | Provide discrimination, calibration, and subgroup metrics with confidence intervals. | Complete results tables, ideally following a reporting checklist such as TRIPOD+AI ([58]). | Biostatistician | Single headline metric; no subgroup results; "no notable bias" with no data. |
| 7 | Outcome and workflow evidence | Outcome-evaluation references | Provide evidence of effect on decisions and patient outcomes in live use. | Prospective or live-use study; early-stage reporting aligned with DECIDE-AI ([59]). | Clinical lead | Retrospective-only evidence presented as outcome proof. |
| 8 | Local validation plan | Validity and fairness in local data | Will the supplier support silent-mode local validation before go-live? | Written protocol, data-access plan, pre-set acceptance thresholds. | Data science lead | Supplier declines silent validation; no sandbox. |
| 9 | Monitoring and drift | Maintenance and monitoring (former maintenance category) | Specify metrics tracked, frequency, thresholds, and who is notified. | Monitoring plan; sample dashboard; alerting service levels. | Quality and safety | Monitoring "by customer" with no tools provided. |
| 10 | Updates and change control | Update process and frequency and corrective frequency | Describe retraining triggers, notice periods, version labeling, rollback. | Change-control policy; for FDA devices, the authorized change plan ([60]). | IT and procurement | Silent model changes; no version identifier visible to users. |
| 11 | Risk management and incident handling | Risk analysis, mitigation, governance | Provide risk register, escalation path, and event-reporting terms. | Documented risk process; event-notification clause; contact roster. | Patient safety and legal | No named contact; no defined timeline for notice. |
Table 2 should be read left to right as a negotiation script. Rows 1 to 4 define whether the tool was built for the buyer's patients, rows 5 to 8 test whether the claim survived contact with different data, and rows 9 to 11 govern what happens after go-live. Where HTI-1 imposed a certification-level duty, the "ONC anchor" now serves as vocabulary only; where the supplier is a third-party model owner, the request was always voluntary. The matrix aligns with sector guidance on vendor questions: the Joint Commission and Coalition for Health AI (CHAI) guidance advises asking whether vendors are willing to tune and validate a sample representative of the deployment setting ([61]), and a vendor-disclosure framework from the Health AI Partnership exists because hospitals have had limited guidance on what information to request from vendors during procurement ([62]).
Evaluation Worksheet: Local Validation, Bias, Updating, Drift, Monitoring
Scoring rubric: missing versus failed
A common error in diligence files is treating absent evidence and adverse evidence as the same entry. They carry different actions. The rubric below uses two independent fields per row: an evidence level and a result status. No numerical vendor scores are supplied here, because scoring requires the buyer's own thresholds.
- Evidence level 0, Missing: nothing was provided, or the supplier answered "unknown." Action: request again, then record as a gap with a compensating control.
- Evidence level 1, Asserted: a statement without an artifact. Action: request the artifact.
- Evidence level 2, Documented: an artifact with method, population, metrics, and date, supplier-authored.
- Evidence level 3, Verified: independently authored (peer-reviewed or third-party) or reproduced on the buyer's local data.
- Result status "Met": evidence meets thresholds the committee set before opening the supplier's data.
- Result status "Failed": evidence was provided and falls below those pre-set thresholds, or shows a subgroup disparity beyond tolerance. Action: do not deploy for the affected scope without a documented exception.
- Result status "Not assessable": no evidence was provided (Level 0), or evidence exists but cannot be compared to the local population.
Under this scheme, a row can be "Level 0, not assessable" (a gap) or "Level 3, Failed" (a rejection). Both are important, but only the second is a finding about the tool. HTI-1 itself allowed "unknown" for several attributes, which is why a blank is not a failure.
Local validation
Evidence shows why local checks matter. A review of 516 diagnostic imaging studies found only 6% performed external validation ([63]). A systematic review of deep-learning radiology algorithms found 81% (70 of 86) reported at least some decrease in performance externally compared with internal results ([64]). A New England Journal of Medicine perspective defines dataset shift as underperformance arising from a mismatch between the development data and the deployment data ([65]) and recommends running models silently first ([66]).
- Set accuracy, calibration, and subgroup tolerances before seeing results.
- Run the tool silently on a recent local cohort; compare against the supplier's reported metrics.
- Record the sample window, size, and exclusions in the register.
- Treat a vendor's refusal to enable silent mode as a Level 0 finding on row 8.
Bias and fairness
The federal duty on covered entities is separate from the supplier's attributes. The nondiscrimination rule at 45 CFR 92.210 imposes an ongoing duty to make reasonable efforts to identify uses of patient care decision support tools that use protected characteristics as input variables ([67]) and to mitigate the risk of discrimination resulting from those tools ([68]). An HHS Office for Civil Rights letter dates those obligations to May 1, 2025 ([69]). Practical steps: ask which input variables encode race, sex, age, or disability; ask whether subgroup performance was reported; and compare to the local population. Public FDA-authorization summaries are weak on this point: one study of 692 summaries found only 3.6% reported race and ethnicity and 99.1% provided no socioeconomic data ([70]), and 81.6% did not report the age of study subjects ([71]). FDA's draft lifecycle guidance warns that acceptable performance in certain subgroups may mask lower performance in others ([72]).
Updating and change control
FDA's final guidance on predetermined change control plans, originally issued December 4, 2024 ([73]), expects a modification protocol with data management, re-training, performance evaluation, and update procedures, with test data separate and independent from development ([74]). It also asks whether modifications differ across clinical sites ([75]) and recommends labeling disclose an authorized plan ([76]). A buyer can use these headings even for non-device tools. The AMA's AI evaluation guide flags, as an area to watch, any absence of description of how model updates are managed ([77]).
Drift and monitoring
FDA's draft lifecycle guidance, issued January 7, 2025 ([78]), says performance may change or degrade over time ([79]) and lists monitoring inputs such as changes in patient demographics or disease prevalence ([80]). Clinical-model research shows the pattern: in a Veterans Affairs kidney-injury study, calibration declined as models increasingly overpredicted risk ([81]), and the authors argued updating should respond to rapid drift instead of fixed annual or biannual schedules ([82]). The National Institute of Standards and Technology (NIST) AI Risk Management Framework notes AI systems may require more frequent maintenance and triggers for conducting it ([83]). The Joint Commission and CHAI guidance asks for feedback channels between third-party vendors and local monitors ([84]) and recommends that tools which inform or drive clinical decisions should be checked more often than administrative ones ([85]).
- Define metrics, thresholds, review cadence, and the named reviewer.
- Require version identifiers in every logged prediction.
- Pre-agree what triggers a pause, rollback, or revalidation.
- Review monitoring output at the governance committee, not only inside the supplier dashboard.
The evidence-gap register
Table 3 is a template. It contains no real suppliers and no scores. The rows are (Hypothetical Example) placeholders showing how entries are written.
Table 3. Evidence-gap register template (Hypothetical Example rows; version 1.0)
| Gap ID | Tool and version | Matrix row | Evidence level (0 to 3) | Result status | Risk if unresolved | Compensating control | Owner | Recheck trigger |
|---|---|---|---|---|---|---|---|---|
| G-001 (Hypothetical Example) | [Tool A, v1.0] | 4 Representativeness | 0 | Not assessable | Performance in the local population unknown | Silent-mode local validation before go-live | Health equity lead | Supplier delivers demographic table, or 60 days elapse |
| G-002 (Hypothetical Example) | [Tool B, v2.3] | 10 Updates | 1 | Not assessable | Unannounced model changes alter alert volume | Contract notice clause; version logging | IT and procurement | Any new version string |
| G-003 (Hypothetical Example) | [Tool C, v1.1] | 6 Metrics | 3 | Failed | Subgroup calibration below pre-set tolerance | Restrict scope or decline | Clinical lead | New validation data or recalibration |
| G-004 (Hypothetical Example) | [Tool D, v1.0] | 11 Incident handling | 2 | Met | None identified | Annual review | Patient safety | Contract renewal |
Table 3 is meant to be retained as a living risk register entry per tool, not a one-time form. The recheck trigger column links register rows to the regulatory recheck routine in the next section, and the version field lets auditors see which edition of the request set was used for a given decision.
Define accuracy, calibration, and subgroup tolerances before reviewing results.
Use a recent local cohort and compare results with the supplier's reported metrics.
Enter the sample window, size, and exclusions in the evidence-gap register.
Met: evidence meets thresholds the committee set before opening supplier data.
Failed: evidence falls below pre-set thresholds or shows a subgroup disparity beyond tolerance; do not deploy for the affected scope without a documented exception.
Implementation Considerations and Process Changes
Contract and change-control questions
Joint Commission and CHAI guidance says monitoring responsibility between the hospital and vendor should be settled as part of third-party procurement and contracting ([86]), and that data use agreements should reserve audit rights ([87]). A health-sector coordinating council guide includes 69 vendor risk questions in an appendix ([88]) and sample language requiring vendors to implement continuous or periodic monitoring for model drift ([89]). Combining these sources, a procurement committee can ask:
- Disclosure continuity: will the supplier keep providing the former source attribute information after December 28, 2026, and for how long? ONC encourages users to ask.
- Model card cadence: will updated cards be reissued on material changes? CHAI's Applied Model Card documentation recommends that implementers ask for updated cards annually ([90]).
- Notice of change: how many days of advance notice precede a model update, and what version identifier appears in logs?
- Local access: will the supplier grant data access and a test environment for silent validation?
- Event reporting: how does the supplier receive and respond to reports of unsafe outputs? The Joint Commission and CHAI guidance recommends treating AI near-misses and unsafe recommendations like patient safety events ([91]).
- Audit and exit: what audit rights, data return, and rollback commitments exist?
- Regulatory status warranties: will the supplier notify the buyer of changes in FDA status or ONC certification status?
Governance structures
ASTP data show that hospital governance is distributed: 74% of hospitals using predictive AI said multiple entities were accountable for evaluating it, and the most cited evaluator was a dedicated committee or task force for predictive AI at 66% ([92]). The Joint Commission and CHAI guidance lists seven elements, including voluntary, blinded reporting of AI safety-related events ([93]), and states that it does not validate the effectiveness of AI tools themselves ([94]). The Joint Commission's 2026 certification program likewise does not validate or certify individual AI products ([95]). In other words, organizational certification is not product evidence.
Periodic regulatory-status recheck
Because the rule status moved from proposal to final within ten months, the register needs a recheck routine. A suggested cadence:
- Now through December 28, 2026: confirm the effective date and whether the HTI-1 text remains in force for current certified modules.
- At each quarter: check the Federal Register, eCFR currency date, ONC's HTI-5 final rule page, and the test method page for updates.
- At each contract renewal: reconfirm FDA status, including the date of the current CDS guidance.
- On any new ONC proposal: reassess the matrix, because the request set should not be keyed to a single rule text and the scope of ONC's criteria changed between the proposed and final rules (see "Scope of criteria changes").
“These studies measure what public documents say, not what manufacturers know;
Data Analysis and Evidence
The numbers below are the quantitative basis for treating public regulatory status as insufficient. They come from regulators and peer-reviewed analyses, and each carries the denominator and date the source states.
Adoption and evaluation in US hospitals (ASTP, 2024 AHA IT Supplement). In 2024, 71% of non-federal acute care hospitals used predictive AI integrated with the EHR. Of hospitals using it, 82% evaluated for accuracy, 74% for bias, and 79% conducted post-implementation evaluation or monitoring ([96]), but 15% answered "don't know" on accuracy evaluation, 21% on bias, and 18% on monitoring, and those answers were excluded from the denominators, so the shares may overstate practice ([97]). Use was 86% at system-affiliated hospitals versus 37% at independent hospitals, and 80% used predictive AI from their EHR developer while 52% used third-party AI ([98]). The survey had a 51% response rate (N = 2,253). ASTP itself flags demonstrating real-world performance as a persistent implementation challenge. An earlier analysis of 2023 data found that hospitals with their own models, high operating margins, or system membership were more likely to evaluate locally, which the authors describe as a risk of a new digital divide ([99]).
FDA-authorized AI devices. FDA states it has authorized over 1,600 AI-enabled devices as of September 2026. A tally of the downloadable FDA list by this review, covering 1,614 rows with a newest decision date of June 29, 2026, gives 226 final decisions in 2023, 235 in 2024, 335 in 2025, and 181 in 2026 through June 29. This is an approximate analyst count, not independently reproduced, of a list FDA says it updates periodically, so figures will differ from other published counts depending on list vintage. Source file: [100].
Public evidence in device summaries. Because buyers often rely on these summaries, the reporting gaps are decision-relevant:
- Clinical performance studies reported: 505 of 903 devices (55.9%) ([11]); 218 (24.1%) explicitly stated no performance study ([101]).
- Study type among the 505 reported studies (share of studies, not of devices): 8.1% prospective and 2.4% randomized ([12]).
- Randomized or prospective data in a separate review of 691 clearances: 1.6% randomized and 7.7% prospective ([102]).
- Registered trials: 34 of 1,357 devices (2.5%) had registered clinical trials, and 3 (0.2%) reported patient outcomes ([103]) ([104]).
- Post-market: only 9.0% contained a prospective study for post-market surveillance ([105]).
These studies measure what public documents say, not what manufacturers know; the authors of the first study note that detailed descriptions of development were absent from most publicly provided summaries ([106]). FDA's own public comment request acknowledges that many AI devices are evaluated primarily through retrospective testing or static benchmarks ([107]), which are not designed to predict behavior in dynamic, real-world environments ([108]).
Regulatory cost estimates. ONC counted 251 certified products from 206 developers for the DSI criterion and estimated annual savings from the DSI change of $7,361,579 to $53,275,503 ([109]) ([110]). These are ONC's developer-side burden estimates. These figures describe developer-side savings only; this review found no published estimate of the diligence cost that shifts to buyers.
Interpretation. Availability of a clearance record does not equal availability of evidence. A 510(k) is a premarket submission made to demonstrate that a device is as safe and effective as a legally marketed device ([111]); FDA describes its listed devices as having met premarket review of overall safety and effectiveness, including evaluation of study appropriateness ([112]). Neither statement says the device performs as expected at a specific hospital. For a published reporting standard, TRIPOD+AI offers a 27-item checklist ([58]), and a risk-of-bias tool, PROBAST+AI, uses 18 targeted signalling questions for evaluating models ([113]).
Implications and Future Directions
For hospital committees. The removal of a federal attribute baseline changes where the evidence lives. An editorial view published before the final rule argued that removing the floor does not relieve a burden but shifts it onto the buyer ([114]). The final rule's text is consistent with that direction of travel: ONC pointed users to their developers for the information. Committees with lean staff, particularly independent and small hospitals where predictive AI use is lower, may find that a standard request set reduces the cost of each evaluation.
For medtech and product teams. Suppliers that already maintain structured transparency documents have a reusable asset. CHAI's Applied Model Card is described as a standardized template usable in procurement processes ([115]). FDA-authorized products can reuse change-plan and monitoring documentation. Suppliers without such documents face repeated bespoke questionnaires.
Open questions.
- Whether ONC acts on its stated plan to consider reinstating the legacy CDS source-attribute transparency requirements in § 170.315(a)(9)(v), and whether it later revisits predictive-DSI transparency.
- Whether state or accreditation programs fill the gap. The NIST framework is voluntary ([116]) and Joint Commission certification is organizational ([95]).
- Whether suppliers continue voluntary disclosure; this report found no measured data yet on that behavior.
- Whether evidence-gap registers improve outcomes. No measured outcome data exist; the register is a risk-management practice, not a proven intervention.
Frequently Asked Questions (FAQs)
What is HTI-5 and how does it relate to ONC certification? HTI-5 is the ONC rule "Health Data, Technology, and Interoperability: ONC Deregulatory Actions to Unleash Prosperity," published October 28, 2026. It resets the scope of the Certification Program and reduces developer compliance costs. The criteria apply to certified health IT modules supplied by developers, not directly to hospitals.
What did the HTI-5 proposed rule say about decision support interventions? It proposed removing source attribute support, access, and modification requirements and said ONC had no publicly available evidence that a single doctor, nurse, or administrator had accessed, recorded, or modified a source attribute ([117]).
What are predictive DSI source attributes? They are the descriptive fields (purpose, training data, fairness approaches, validation, performance, maintenance, updating) that a certified module had to support for supplied predictive DSIs under HTI-1. See the matrix in Table 2.
Do HTI-1 source attribute rules still apply? As of November 8, 2026, the HTI-5 changes take effect December 28, 2026, and the eCFR page reviewed for this report was current only to November 5 ([15]). Confirm current status with counsel.
How do AI model card requirements fit health IT certification? ONC described the source attribute requirements as supporting model cards, and removed them. Voluntary model cards continue as an industry practice ([115]).
How should a health system evaluate clinical AI vendors? Use the matrix in Table 2, the rubric in the worksheet, and the register in Table 3, then confirm contract terms for monitoring, notice, and audit ([86]).
What questions belong in clinical decision support AI procurement? See the contract and change-control list; the AMA guide adds recent-data validation ([118]) and cautions about tools reporting only retrospective performance ([119]).
Does FDA clearance prove local clinical benefit? No. Clearance is a premarket determination for an intended use. Local validation remains necessary.
Conclusion
The central finding is that evidence sufficiency, not regulatory labeling, should drive clinical AI purchasing. ONC's HTI-5 final rule, published October 28, 2026 and effective December 28, 2026, removes the certified-module requirement to support source attributes and predictive-DSI risk management. FDA authorization addresses a different scope and publicly documents only part of what was submitted. Neither regime sets validity or fairness thresholds for a given hospital's patients.
A versioned request set based on the former ONC attribute categories lets a buyer ask for the same evidence whether HTI-1 text, HTI-5 text, or some future ONC action governs. The elements are a decision table that separates scopes, an eleven-row matrix, a rubric that distinguishes missing from failed evidence, a register with recheck triggers, and a contract list covering notice, monitoring, and audit. Each should be treated as a working document, revised when the regulatory status, the supplier's model version, or the local population changes.
Readers should confirm the live status of the rule, the codified paragraph text, and any product-specific FDA classification with qualified counsel and regulatory staff before acting on this framework.
About IntuitionLabs
Build practical AI for pharma and biotech with IntuitionLabs. We help life-science teams turn complex information and workflows into useful software, governed knowledge systems and AI tools.
IntuitionLabs is an AI consulting, custom software development and data engineering firm serving pharmaceutical, biotechnology, medical-device and other life-science organizations. We work with clinical, regulatory, medical-affairs, commercial, quality and IT teams to connect technology decisions with the work people need to accomplish.
AI consulting and adoption
Our AI enablement services cover readiness assessments, use-case selection, governance and policies, team workshops, adoption measurement and ongoing advisory support. We help organizations structure the information layer behind AI: source material, context, permissions and maintained knowledge that make generated answers useful and reviewable. Private LLM inference and hosted AI options support teams evaluating how to operate AI with appropriate control over their data and infrastructure.
Software, data and life-science workflows
IntuitionLabs develops custom software for pharma and biotech, integrates enterprise systems, and builds data engineering and business intelligence solutions. Areas of focus include AI agents, regulatory research, medical writing, medical affairs, CMC information, competitive intelligence and clinical-document workflows. Our eTMF intelligence work includes cross-system reconciliation and inspection-readiness support.
Enterprise platforms and regulated delivery
We provide Veeva services, application support, managed services, integrations and custom applications, alongside enterprise content work involving platforms such as Egnyte. For regulated workflows, our services include GxP enablement, computer-system validation and software development addressing 21 CFR Part 11 requirements. The applicable controls, validation responsibilities and acceptance criteria are defined for each engagement.
Work with IntuitionLabs
Explore AI enablement, pharma and biotech software development, data engineering and BI, and Veeva services. Contact IntuitionLabs to discuss your workflow, information sources and implementation needs.
IntuitionLabs publishes educational research to help life-science teams make informed technology decisions. Coverage of a product or organization does not imply a client relationship, endorsement or partnership.
Sources / 119

Need Expert Guidance on This Topic?
Let's discuss how IntuitionLabs can help you navigate the challenges covered in this article.
I'm Adrien Laurent, Founder & CEO of IntuitionLabs. With 25+ years of experience in enterprise software development, I specialize in creating custom AI solutions for the pharmaceutical and life science industries.
The information contained in this document is provided for educational and informational purposes only. We make no representations or warranties of any kind, express or implied, about the completeness, accuracy, reliability, suitability, or availability of the information contained herein. Any reliance you place on such information is strictly at your own risk. In no event will IntuitionLabs.ai or its representatives be liable for any loss or damage including without limitation, indirect or consequential loss or damage, or any loss or damage whatsoever arising from the use of information presented in this document. This document may contain content generated with the assistance of artificial intelligence technologies. AI-generated content may contain errors, omissions, or inaccuracies. Readers are advised to independently verify any critical information before acting upon it. All product names, logos, brands, trademarks, and registered trademarks mentioned in this document are the property of their respective owners. All company, product, and service names used in this document are for identification purposes only. Use of these names, logos, trademarks, and brands does not imply endorsement by the respective trademark holders. IntuitionLabs.ai is an AI software development company specializing in helping life-science companies implement and leverage artificial intelligence solutions. Founded in 2023 by Adrien Laurent and based in San Jose, California. This document does not constitute professional or legal advice. For specific guidance related to your business needs, please consult with appropriate qualified professionals.