Interpretability

Research into understanding why a model produces a given output, so its behavior is not a black box.

Interpretability — glossary | The Super Intelligence News