Assessing Model Behaviour on Extreme Counterfactuals.

Abstract:

This paper outlines reported issues that stem from applying statistical models to extreme counterfactuals – data points which are far outside the scope of what the model was trained on.

It then proposes a technique to estimate model behaviour on these out-of-convex-hull datapoints, and rank models based on their performance.

View paper on Researchgate.