Explainable NLP with attention

The very reason we use AI is to deal with very complex problems – problems one cannot adequately solve with traditional computer programs. Should you trust an AI algorithm, when you cannot even explain how it works?