T51. Transparency, explainability and contestability monitoring design

Monitoring AI system TCE performance is crucial to ensuring that the organization sustains the desired level of AI system performance. The monitoring must be systematic and metrics-based to achieve consistency over time.

The AI System Owner should ensure that the organization defines, documents, and entrenches
1) workflows and technical interfaces to facilitate the monitoring of AI system TEC performance, including for example
2) automated or manual production and reporting of performance metrics data,
3) alarm thresholds, and
4) workflows that allocate monitoring responsibilities.
5) workflows to address issues detected during regular monitoring and health checks.

The AI System Owner should ensure that the AI system TEC performance monitoring process aligns with the organization’s values and risk tolerance.