AI Assurance / Governance Related Work: Capability-by-System Matrix

Capability / Function	FrameworkNIST AI RMF / Playbook	FrameworkNIST GenAI Profile	StandardISO/IEC 42001	StandardISO/IEC 23894	PolicyOECD AI Principles	PolicyUNESCO AI Ethics Recommendation	StandardIEEE 7000 series	RegulationEU AI Act / compliance tools	Gov toolCanada Algorithmic Impact Assessment	Gov toolAustralian Gov AI Impact Assessment Tool	Gov toolNSW AI Assessment Framework / GenAI template	TemplateMicrosoft RAI Impact Assessment	ToolGoogle SAIF Risk Assessment	TestingSingapore AI Verify	DocumentationModel Cards	DocumentationDatasheets for Datasets	TestingFairlearn / IBM AIF360	ProductIBM watsonx.governance	ProductCredo AI	ProductHolistic AI	ProductOneTrust AI Governance	ProductFiddler AI	ObservabilityArize / Phoenix	Your systemProposed Compass system
Meta / positioningResource type / how it is normally used	Framework	Framework	Auditable standard	Risk standard	Policy principles	Policy principles	Technical standard	Regulation + tools	Questionnaire tool	Questionnaire tool	Template/framework	Impact template	Security questionnaire	Testing framework/toolkit	Documentation template	Dataset documentation	Fairness testing library	Commercial platform	Commercial platform	Commercial platform	Commercial platform	Monitoring/governance product	Observability/evaluation tool	Scenario-to-checklist product
Scenario understandingInput a free-text AI use scenario	△Partial	△Partial	×No	×No	×No	×No	×No	△Partial	△Partial	△Partial	△Partial	△Partial	△Partial	×No	×No	×No	×No	△Partial	△Partial	△Partial	△Partial	×No	×No	✓Yes
Scenario understandingAutomatically identify industry / domain	△Partial	△Partial	×No	×No	×No	△Partial	×No	△Partial	△Partial	△Partial	△Partial	△Partial	×No	×No	△Partial	△Partial	×No	△Partial	△Partial	△Partial	△Partial	×No	×No	✓Yes
Scenario understandingAutomatically identify AI use case	△Partial	△Partial	×No	×No	×No	×No	△Partial	△Partial	△Partial	△Partial	△Partial	△Partial	△Partial	△Partial	△Partial	×No	×No	△Partial	△Partial	△Partial	△Partial	×No	×No	✓Yes
Scenario understandingAutomatically identify development / deployment stage	△Partial	△Partial	△Partial	△Partial	×No	×No	△Partial	△Partial	△Partial	△Partial	△Partial	△Partial	△Partial	△Partial	△Partial	△Partial	×No	△Partial	△Partial	△Partial	△Partial	△Partial	△Partial	✓Yes
Scenario understandingMap use context and affected stakeholders	✓Yes	✓Yes	△Partial	△Partial	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	△Partial	△Partial	△Partial	△Partial	×No	△Partial	△Partial	✓Yes	△Partial	×No	×No	✓Yes
Risk and regulatory mappingClassify high-risk AI use	△Partial	△Partial	△Partial	△Partial	△Partial	△Partial	△Partial	✓Yes	✓Yes	✓Yes	✓Yes	△Partial	×No	△Partial	×No	×No	×No	✓Yes	✓Yes	✓Yes	✓Yes	△Partial	×No	✓Yes
Governance and accountabilityMap to governance principles	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	△Partial	✓Yes	△Partial	△Partial	△Partial	✓Yes	✓Yes	✓Yes	✓Yes	△Partial	△Partial	✓Yes
Risk and regulatory mappingMap applicable laws / standards	△Partial	△Partial	△Partial	△Partial	×No	×No	△Partial	✓Yes	✓Yes	✓Yes	✓Yes	△Partial	×No	△Partial	×No	×No	×No	✓Yes	✓Yes	✓Yes	✓Yes	△Partial	×No	✓Yes
Checklist generationGenerate tailored assurance checklist	△Partial	△Partial	△Partial	△Partial	×No	×No	△Partial	△Partial	✓Yes	✓Yes	✓Yes	△Partial	✓Yes	△Partial	△Partial	△Partial	×No	✓Yes	✓Yes	✓Yes	✓Yes	△Partial	×No	✓Yes
Checklist generationGenerate industry-specific questions	△Partial	△Partial	×No	△Partial	×No	△Partial	△Partial	△Partial	△Partial	△Partial	△Partial	△Partial	×No	×No	△Partial	△Partial	×No	△Partial	△Partial	✓Yes	△Partial	×No	×No	✓Yes
Checklist generationGenerate qualitative governance questions	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	△Partial	✓Yes	△Partial	△Partial	×No	✓Yes	✓Yes	✓Yes	✓Yes	△Partial	×No	✓Yes
Evidence and scoringGenerate quantitative evidence requirements	△Partial	△Partial	△Partial	△Partial	×No	△Partial	△Partial	△Partial	△Partial	△Partial	△Partial	△Partial	△Partial	✓Yes	✓Yes	△Partial	✓Yes	✓Yes	✓Yes	✓Yes	△Partial	✓Yes	✓Yes	✓Yes
Evidence and scoringExtract answers from project reports	×No	×No	×No	×No	×No	×No	×No	△Partial	×No	×No	×No	×No	×No	×No	×No	×No	×No	△Partial	△Partial	△Partial	△Partial	×No	×No	✓Yes
Evidence and scoringAssess whether evidence is sufficient	×No	×No	△Partial	△Partial	×No	×No	△Partial	△Partial	△Partial	△Partial	△Partial	△Partial	△Partial	△Partial	△Partial	△Partial	△Partial	△Partial	△Partial	✓Yes	△Partial	△Partial	△Partial	✓Yes
Evidence and scoringScore evidence quality quantitatively	×No	×No	△Partial	△Partial	×No	×No	△Partial	△Partial	✓Yes	✓Yes	△Partial	△Partial	△Partial	✓Yes	△Partial	△Partial	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes
Risk and regulatory mappingProduce risk level / risk rating	△Partial	△Partial	△Partial	✓Yes	×No	△Partial	△Partial	✓Yes	✓Yes	✓Yes	✓Yes	△Partial	△Partial	△Partial	×No	×No	×No	✓Yes	✓Yes	✓Yes	✓Yes	△Partial	△Partial	✓Yes
Mitigation and lifecycle managementSuggest mitigation / control actions	✓Yes	✓Yes	△Partial	✓Yes	△Partial	△Partial	△Partial	△Partial	✓Yes	✓Yes	✓Yes	△Partial	✓Yes	△Partial	△Partial	△Partial	△Partial	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	△Partial	✓Yes
Governance and accountabilityHuman oversight assessment	✓Yes	✓Yes	✓Yes	△Partial	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	×No	△Partial	△Partial	×No	×No	△Partial	✓Yes	✓Yes	✓Yes	△Partial	×No	✓Yes
Technical evaluationBias / fairness testing	△Partial	△Partial	△Partial	△Partial	✓Yes	✓Yes	△Partial	✓Yes	△Partial	✓Yes	✓Yes	✓Yes	×No	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	△Partial	✓Yes	△Partial	✓Yes
Technical evaluationAccuracy / performance testing	△Partial	△Partial	△Partial	△Partial	×No	△Partial	△Partial	✓Yes	△Partial	△Partial	△Partial	△Partial	×No	✓Yes	✓Yes	△Partial	✓Yes	✓Yes	△Partial	✓Yes	△Partial	✓Yes	✓Yes	✓Yes
Technical evaluationExplainability / transparency assessment	✓Yes	✓Yes	✓Yes	△Partial	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	×No	✓Yes	✓Yes	△Partial	△Partial	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes
Governance and accountabilityPrivacy / data governance assessment	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	△Partial	△Partial	✓Yes	×No	✓Yes	✓Yes	✓Yes	✓Yes	△Partial	△Partial	✓Yes
Technical evaluationSecurity / adversarial risk assessment	△Partial	✓Yes	△Partial	△Partial	△Partial	△Partial	△Partial	△Partial	△Partial	△Partial	△Partial	△Partial	✓Yes	△Partial	△Partial	△Partial	×No	✓Yes	✓Yes	△Partial	△Partial	✓Yes	△Partial	✓Yes
Technical evaluationRobustness / resilience testing	△Partial	✓Yes	△Partial	✓Yes	△Partial	△Partial	△Partial	✓Yes	△Partial	△Partial	△Partial	△Partial	△Partial	✓Yes	✓Yes	△Partial	△Partial	✓Yes	△Partial	✓Yes	△Partial	✓Yes	✓Yes	✓Yes
Mitigation and lifecycle managementModel drift / post-deployment monitoring	△Partial	△Partial	✓Yes	✓Yes	△Partial	△Partial	△Partial	✓Yes	△Partial	△Partial	△Partial	△Partial	△Partial	△Partial	△Partial	×No	△Partial	✓Yes	✓Yes	△Partial	△Partial	✓Yes	✓Yes	✓Yes
Governance and accountabilityAudit trail / accountability record	△Partial	△Partial	✓Yes	△Partial	△Partial	△Partial	△Partial	✓Yes	✓Yes	✓Yes	✓Yes	△Partial	△Partial	△Partial	✓Yes	✓Yes	×No	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes
Checklist generationQuestionnaire-bank to question extraction	×No	×No	×No	×No	×No	×No	×No	×No	×No	×No	×No	×No	×No	×No	×No	×No	×No	△Partial	△Partial	△Partial	△Partial	×No	×No	✓Yes
Evidence and scoringReport-to-checklist answering workflow	×No	×No	×No	×No	×No	×No	×No	△Partial	×No	×No	×No	×No	×No	×No	×No	×No	×No	△Partial	△Partial	△Partial	△Partial	×No	×No	✓Yes
Checklist generationLLM-assisted checklist drafting	×No	×No	×No	×No	×No	×No	×No	△Partial	×No	△Partial	△Partial	△Partial	×No	×No	△Partial	△Partial	×No	△Partial	△Partial	△Partial	△Partial	△Partial	△Partial	✓Yes
Productisation and usabilityEnd-user interactive demo experience	×No	×No	×No	×No	×No	×No	×No	△Partial	✓Yes	✓Yes	△Partial	×No	✓Yes	✓Yes	×No	×No	×No	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes
Meta / positioningSuitable as theoretical backbone	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	△Partial	△Partial	△Partial	△Partial	△Partial	✓Yes	△Partial	△Partial	△Partial	△Partial	△Partial	△Partial	△Partial	△Partial	△Partial	✓Yes
Productisation and usabilityIs itself an automated product	×No	×No	×No	×No	×No	×No	×No	△Partial	✓Yes	✓Yes	△Partial	×No	✓Yes	✓Yes	×No	×No	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes	✓Yes