Model Insights

There are some valuable insights from sophisticated machine learning:

  • What features in the data did the model think are most important ?
  • For any single prediction from a model, how did each feature in the data affect that particular prediction ?
  • How does each feature affect the model’s prediction in a big-picture sense (What is its typical effect when considered over a large number of possible predictions) ?

Effect of Insights

These insights have many uses, including:

  • Debugging
  • Informing feature engineering
  • Directing future data collection
  • Informing human decision-making
  • Building trust

Reference