Statistical Mechanics And Information Theory In Approximate Robust Inference