#interpretability

We must design AI systems that are interpretable and transparent to their users.

From The Alignment Problem by Brian Christian

Deep learning models are often seen as black boxes because it can be difficult to interpret how they make decisions.

From Deep Learning by Ian Goodfellow, Yoshua Bengio, and Aaron Courville