Monitoring AI system performance is crucial to ensuring that the system sustains the desired level of performance. The monitoring must be systematic and metrics-based to achieve consistency over time.
The AI System Owner should ensure that the organization defines, documents, and entrenches
1) workflows and technical interfaces to facilitate the monitoring of AI system performance, including, for example
a) the automated or manual production and reporting of performance metrics data,
b) alarm thresholds, and
c) workflows that allocate monitoring responsibilities.
2) workflows and technical interfaces to facilitate the detection of system malfunctions and other anomalous events, and
3) workflows to address issues detected during health checks.
The AI System Owner should ensure that the AI system performance monitoring process aligns with the organization’s values and risk tolerance.